Jonathan de Jong
3cbe24caab
fixes #384
...
also adds MultiError to libp2p/exceptions.py
and an additional fixme I have noticed
2019-12-17 12:00:11 +01:00
NIC619
474ed41652
Remove dead peer if floodsub write stream fail
2019-12-17 18:48:25 +08:00
NIC619
009df257bc
Check peer id exist in dict before access
2019-12-17 18:47:58 +08:00
mhchia
47d10e186f
Add SubscriptionAPI
...
And `TrioSubscriptionAPI`, to make subscription io-agnostic.
2019-12-17 18:17:28 +08:00
Jonathan de Jong
794d2101e9
fixes #197
2019-12-17 11:00:45 +01:00
NIC619
f10e3099cb
Change type of peers in pubsub from list to set
2019-12-17 17:55:13 +08:00
NIC619
b4bd997932
Fix mypy
2019-12-17 17:49:49 +08:00
NIC619
65766ec9ac
Change type of local peers var from list to set
2019-12-17 17:36:15 +08:00
NIC619
f1d58ef8ff
Change type of peers from list to set:
...
`peers_gossipsub`, `peers_floodsub` and mesh/fanout peers
2019-12-17 17:30:24 +08:00
NIC619
7d6daa8e10
Minor cleanup:
...
- remove outdated comment
- add new peer at the end
- turn peers to send from list to set
2019-12-17 17:17:03 +08:00
mhchia
fb0519129d
Refine Mplex.close and SwarmConn.close
...
Ensure `close` cleans up things and cancel the service finally.
2019-12-17 15:50:55 +08:00
Alex Stokes
733b1d08b6
Merge pull request #372 from ralexstokes/add-py36-compatibility
...
Add py36 compatibility
2019-12-10 17:28:49 -08:00
Alex Stokes
3b9d7c7acd
Apply PR feedback
2019-12-10 17:20:41 -08:00
NIC Lin
ad379221b9
Merge pull request #373 from NIC619/refactor_and_cleanup_gossipsub
...
Refactor and cleanup gossipsub
2019-12-07 16:28:55 +08:00
NIC Lin
a675da52ee
Update libp2p/pubsub/gossipsub.py
...
Co-Authored-By: Kevin Mai-Husan Chia <mhchia@users.noreply.github.com>
2019-12-07 15:46:42 +08:00
mhchia
837a249552
Fix security module
2019-12-07 00:14:01 +08:00
NIC619
2d3bfc8184
Apply PR feedback:
...
use defaultdict and init control message
2019-12-06 23:42:31 +08:00
mhchia
1929f307fb
Fix all modules except for security
2019-12-06 17:06:37 +08:00
Chih Cheng Liang
82dcce214a
Remove kademlia module ( #377 )
...
* Remove kademlia and routing/kademlia
* cleanup
* Fix routed_host test
* lint mypy
* fix doc
* remove set_up_nodes_by_transport_and_disc_opt and fix typing
2019-12-06 14:14:33 +08:00
NIC619
db0017ddbb
Fix lint after applying suggestion
2019-12-05 17:33:07 +08:00
NIC Lin
b4900d53da
Apply suggestions from code review
...
Co-Authored-By: Chih Cheng Liang <chihchengliang@gmail.com>
2019-12-05 15:21:09 +08:00
NIC619
67f02c512a
Remove unnecessary check and fix test
2019-12-05 15:10:04 +08:00
NIC619
e6813da5f5
Refactor _get_peers_to_send
2019-12-05 14:35:34 +08:00
NIC619
c08b2375e1
Fix: should not remove topic if no peers
2019-12-03 23:10:47 +08:00
NIC619
a9abf1e3dd
Fix list deletion and add list remove check
2019-12-03 22:37:49 +08:00
NIC619
bb15c817b1
Fix var access before assignment
2019-12-03 22:14:45 +08:00
NIC619
ea6cd30a16
Add back some comment and TODO. Add comment to tests
2019-12-03 18:45:33 +08:00
mhchia
e9ab0646e3
Fix Pubsub
2019-12-03 17:27:49 +08:00
NIC619
5efdf4c703
Group messages for peer in heartbeat
2019-12-03 15:48:23 +08:00
NIC619
ab1500c708
Remove unneccessary check in gossip heartbeat
2019-12-03 15:03:06 +08:00
Alex Stokes
63fd531ed0
Fixes to add python 3.6 compatibility
2019-12-02 16:33:32 -08:00
NIC619
920cf646ef
Fix lint and add check in fanout heartbeat
2019-12-02 22:49:27 +08:00
NIC619
a7e0c5d737
Add missing cleanup in gossipsub remove_peer
2019-12-02 22:41:49 +08:00
NIC619
357341e0d8
Remove unneccessary filter and check in gossipsub
2019-12-02 22:40:35 +08:00
NIC619
c2d88962c7
Add gossipsub heartbeat_initial_delay
2019-12-02 16:55:16 +08:00
NIC619
0672f5ae6d
Fix: move heartbeat delay to heartbeat
2019-12-02 16:38:48 +08:00
mhchia
bdbb7b2394
Add RoutedHostFactory
...
And skip the tests for `RoutedHost` for now, since there are too many to
be fixed in `Kademlia`, and it's not that necessary now.
2019-12-01 19:17:44 +08:00
mhchia
eb494e8682
Fix ping protocol
2019-12-01 19:17:32 +08:00
mhchia
31bf774a16
Fix tests in protocol_muxer and libp2p
2019-12-01 17:43:14 +08:00
mhchia
79fcdf3a02
Update tests in test_tcp.py
...
Besides, run `make format`
2019-12-01 16:26:16 +08:00
NIC619
50fd0acf41
Cleanup outdated TODOs in gossipsub
2019-11-30 20:19:17 +08:00
NIC619
0a52a05375
Del entry if no more peers subscribe to the topic
2019-11-30 20:02:11 +08:00
NIC619
e59ac6a250
Cleanup TODOs in pubsub
2019-11-30 17:12:37 +08:00
NIC Lin
dfdcf524b7
Merge pull request #362 from NIC619/add_signing_and_verification_to_pubsub
...
Add signing and verification to pubsub
2019-11-30 13:44:12 +08:00
NIC619
658a0ae156
Apply PR feedback:
...
move signature validation logic into signature validator
2019-11-29 19:37:48 +08:00
mhchia
1e600ea7e0
Fix Mplex and Swarm
2019-11-29 19:09:56 +08:00
NIC619
1c54c38ca7
Fix lint and add signing_strict to interop tests
2019-11-29 17:24:40 +08:00
NIC619
a262b94836
Apply PR feedback:
...
check if signing key and ID match
2019-11-29 14:12:42 +08:00
NIC619
064c109b64
Fix signature validator:
...
Add prefix and return verify result
2019-11-28 18:45:00 +08:00
Jason Carver
27ecd4b0ed
Mock dependencies that are excluded in readthedocs
...
It seems preferable to import just fastecdsa. But if you do that,
then some kind of side-effect doesn't happen, which means that `sec1` is
not available as an attribute on `fastecdsa.encoding`.
So we specifically mock the sub-modules as well.
2019-11-27 14:07:14 -08:00
Jason Carver
2a9dc96269
Merge pull request #369 from carver/docs-travis-target
...
Add docs test to Travis CI
2019-11-27 10:36:15 -08:00
NIC619
d5d6962dce
Update Pubsub fixture and test
2019-11-27 17:15:24 +08:00
NIC619
0fd400fdf8
Sign and verify in Pubsub
2019-11-27 17:15:24 +08:00
NIC619
f3c9972159
Implement Pubsub signature validator
2019-11-27 17:15:24 +08:00
NIC619
683710573e
Add strict_signing: bool and sign_key to Pubsub
2019-11-27 17:15:23 +08:00
NIC Lin
da10fc8531
Merge pull request #360 from NIC619/store_our_keypair_in_peerstore
...
Store our keypair in peerstore
2019-11-27 17:14:36 +08:00
Jason Carver
d503950179
Fix all doc build warnings
2019-11-26 17:44:33 -08:00
NIC Lin
cac7e3909a
Merge pull request #357 from NIC619/minor_fix_replace_del
...
Replace (check and) del pattern with pop method
2019-11-26 19:39:41 +08:00
mhchia
ec43c25b45
Rewrite factories, made some of the test running
2019-11-26 19:24:30 +08:00
NIC619
9f3f2c53da
Apply PR feedback:
...
use defaultdict for peer data map
2019-11-26 16:18:15 +08:00
Chih Cheng Liang
417b5e7d61
remove unused asyncio
2019-11-26 15:27:06 +08:00
Chih Cheng Liang
6ab0e108d3
minor
2019-11-26 15:27:06 +08:00
Chih Cheng Liang
a397ccdc04
makes test_mplex_stream.py::test_mplex_stream_read_write work
2019-11-26 15:27:06 +08:00
Chih Cheng Liang
c55ea0e5bb
implement trio queue interface
2019-11-26 15:27:05 +08:00
Chih Cheng Liang
41ff884eef
rewrite tcp reader/writer interface
2019-11-26 15:27:05 +08:00
Chih Cheng Liang
d4d345c3c7
progressing
2019-11-26 15:27:05 +08:00
Chih Cheng Liang
ed17bfd663
hack chat example
2019-11-26 15:27:04 +08:00
NIC619
94c7a0bca4
Apply PR feedback and fix
2019-11-26 14:04:28 +08:00
NIC619
fab27b0357
Fix lint
2019-11-26 12:35:50 +08:00
NIC619
ffa73f5649
Check if pubkey matches peer ID before add
2019-11-26 12:33:55 +08:00
NIC619
0bfbdf7fab
Move keypair into PeerData
2019-11-26 12:27:59 +08:00
NIC619
828ae69c66
Apply PR feedback: add_key_pair
2019-11-26 11:52:31 +08:00
NIC619
566e4c080d
Fix lint
2019-11-25 17:32:53 +08:00
NIC619
e28a974425
Update peer store initialization in host factory
2019-11-25 17:17:09 +08:00
NIC619
8b4022328d
Update peer store interface
2019-11-25 17:16:47 +08:00
NIC619
e49de15227
Add get_private_key to Host
2019-11-25 16:57:00 +08:00
NIC619
a63f00d8f8
Store our pubkey/privkey info during
...
`initialize_default_swarm`
2019-11-25 16:55:55 +08:00
NIC619
144d93a023
Add pubkey/privkey info to PeerStore
2019-11-24 18:04:00 +08:00
NIC619
9837f30698
Rename peer_map to peer_data_map
2019-11-24 16:52:46 +08:00
NIC619
e355cb2600
Apply PR feedback:
...
Only use pop method if error handling is in place
2019-11-23 16:04:22 +08:00
NIC619
501eef59de
Apply PR feedback:
...
Only use pop method if graceful failure handling is desired
2019-11-21 14:48:03 +08:00
Chih Cheng Liang
bcd7890124
Move test utilities to tools ( #356 )
...
* move test factories to libp2p/tools
* remove unused inits
* move pubsub test utils to tools
* cleanup test_interop
* fix typing libp2p/tools/utils
* add typing to pubsub utils
* fix factories typing
* fix typing for floodsub_integration_test_settings
* fix rest of the typing
* fix isort
2019-11-21 11:47:54 +08:00
NIC619
19907e18ec
Replace (check and) del pattern with pop method
2019-11-20 23:06:37 +08:00
NIC619
c0522c1bd9
Check if entry exists in dictionary before delete
2019-11-17 21:52:05 +08:00
NIC619
ace5ef69a8
Apply PR feedback:
...
handle pubsub dead peer when stream closed in gossipsub
2019-11-16 17:03:04 +08:00
NIC619
ccc7879422
Add stream.write error handling in gossipsub
2019-11-16 16:57:11 +08:00
NIC619
7d1f3d6000
Remove outdated comment
2019-11-16 16:56:59 +08:00
NIC619
cbe57cd5d7
Fix lint
2019-11-16 16:56:59 +08:00
NIC619
86e0fa4563
Handle StreamClosed in ping protocol handler
2019-11-16 16:56:59 +08:00
NIC619
9be9b4bbfc
Handle StreamClosed in pub/gossip/flood-sub
2019-11-16 16:56:59 +08:00
NIC619
c4f9ce6bb3
Handle StreamClosed in identify protocol handler
2019-11-16 16:56:58 +08:00
NIC619
b8c7f0cfff
Fix lint
2019-11-09 23:55:35 +08:00
NIC619
5dfa29a0df
Track tasks created in pubsub and add close()
2019-11-09 23:24:09 +08:00
NIC619
93ef36bd86
Clean up peer record if pubsub stream fail
2019-11-09 23:24:09 +08:00
NIC619
eeb87848af
Apply PR feedback:
...
- fix await stream close/reset
- make `_handle_dead_peer` a sync function
2019-11-09 23:24:09 +08:00
NIC619
d36e323703
Update error handling of pubsub stream handler
2019-11-09 23:24:08 +08:00
NIC619
97b3aca535
Fix:
...
Force context switch before canceling swarm connection tasks
2019-11-09 23:24:08 +08:00
NIC619
a8d9536b08
Spin up handle_dead_peer_queue task
2019-11-09 23:24:08 +08:00
NIC619
84f5210220
Implement handle_dead_peer_queue
2019-11-09 23:24:08 +08:00
NIC619
4b15cb1af5
Implement PubsubNotifee.disconnected
2019-11-09 23:24:08 +08:00
NIC619
c6c9393f2b
Add dead_peer_queue to pubsub
2019-11-09 23:24:08 +08:00
NIC619
3a0c7d06d1
Update comment for connection.close()
2019-11-09 23:24:07 +08:00
Alex Stokes
2a7b43d853
bugfix: return empty bytes immediately if read length is 0
2019-11-07 20:57:55 -08:00
Alex Stokes
4b01c33d54
add some additional logging
2019-11-07 20:57:43 -08:00
Alex Stokes
58f360167d
refactor creation of identify response to make testing easier
2019-11-07 08:05:39 -08:00
Alex Stokes
9a23609b48
type protocol IDs to satisfy mypy
2019-11-07 07:51:44 -08:00
Alex Stokes
ed81562a89
Add identify and ping as default protocols
2019-11-07 07:51:43 -08:00
mhchia
10dd997805
Reorganize factories
2019-11-06 12:11:09 -08:00
Alex Stokes
9500bdbf55
Add class attribute for additional property
2019-11-06 12:11:09 -08:00
Alex Stokes
0ca3e83540
lintroll
2019-11-06 11:41:28 -08:00
Alex Stokes
693a8cf99a
Default protocols are constructed using a reference to the host
2019-11-06 11:41:28 -08:00
Alex Stokes
e0a94b6092
identify handler reads data on request from the host
2019-11-06 11:41:27 -08:00
Alex Stokes
32c55bcaf2
hosts track their public key
2019-11-06 11:41:27 -08:00
Alex Stokes
11db313b17
A mux can provide the protocols it responds to
2019-11-06 11:41:27 -08:00
Alex Stokes
d09046f5ca
Merge pull request #343 from ralexstokes/add-pytest-xdist
...
Add pytest xdist and fix some issues w/ parallelizing tests
2019-11-07 04:34:14 +09:00
Alex Stokes
c30d9ce397
Fix linter error from merge in #315 .
2019-11-05 17:50:43 -08:00
Alex Stokes
5cb4479534
Modify the `KademliaServer` so that lack of port lets the OS choose a free one
2019-11-05 17:50:10 -08:00
Alex Stokes
8ab69b9676
fix medley of typos
2019-11-05 17:37:43 -08:00
Alex Stokes
01dc49164f
fix bug found via typechecker
2019-11-05 17:37:43 -08:00
Alex Stokes
08b57fa2ee
Add core handler for identify protocol
2019-11-05 17:37:42 -08:00
Alex Stokes
700209c50a
Merge pull request #315 from ralexstokes/add-ping-protocol
...
Add `ping` protocol.
2019-11-06 10:14:39 +09:00
Dominik Muhs
817325f341
Fix docstring list in KademliaProtocol
2019-10-29 18:22:13 +01:00
Piper Merriam
ded3792924
Merge pull request #331 from dmuhs/fix/docs-format
...
Add automatic docstring formatting
2019-10-28 09:39:52 -06:00
Alex Stokes
f2bfc68f6d
Re-generate protobufs
2019-10-25 18:51:57 +09:00
Dominik Muhs
bafdd8512d
Enforce pre-summary newline in docstrings
2019-10-24 20:10:45 +02:00
Dominik Muhs
09ab6c51ec
Fix formatting in secio transport
2019-10-24 19:52:03 +02:00
Dominik Muhs
b5eeceecbf
Rename raw connection initiator flags
2019-10-24 19:28:42 +02:00
Dominik Muhs
5810174374
Rename stream muxer initiator flags
2019-10-24 19:28:19 +02:00
Dominik Muhs
031b98ddf0
Rename stream muxer initiator flags
2019-10-24 19:25:34 +02:00
Dominik Muhs
4bda366bb8
Rename protocol muxer initiator flags
2019-10-24 19:25:09 +02:00
Dominik Muhs
021c92ea25
Rename secio initiator flags
2019-10-24 19:22:24 +02:00
Dominik Muhs
7ad96d167c
Rename InsecureSession initiator flag
2019-10-24 19:18:29 +02:00
Dominik Muhs
18783b82a2
Rename SecurityMultistream initiator flag
2019-10-24 19:17:00 +02:00
Dominik Muhs
ee0b4daf1c
Rename BaseSession initiator flag
2019-10-24 19:16:08 +02:00
Dominik Muhs
afb79da9f8
Fix typo
2019-10-24 19:12:15 +02:00
Dominik Muhs
2e38d5e5fb
Rename TransportUpgrader initiator flag
2019-10-24 19:06:49 +02:00
Alex Stokes
1cf239cce6
Respect a remote close during the ping protocol
2019-10-24 19:44:52 +09:00
Alex Stokes
e157c3f654
typing fixes
2019-10-24 18:10:56 +09:00
Alex Stokes
f24b488f79
handle other side closing their end of the connection during ping
2019-10-24 18:10:56 +09:00
Alex Stokes
4a800e5c56
Add first-pass at ping protocol
2019-10-24 18:10:55 +09:00
Alex Stokes
15cabb1c33
Copy default data to avoid undesirable mutations
2019-10-24 17:29:33 +09:00
Alex Stokes
d0c8b7d8af
Avoid sharing default dictionary argument across all instances of class
2019-10-24 17:29:16 +09:00
Alex Stokes
c92bade815
Add "default protocols" that all hosts have by default
2019-10-24 17:29:16 +09:00
Dominik Muhs
3db297fbee
Fix mypy errors
2019-10-24 08:53:19 +02:00
Dominik Muhs
eef505f2d9
Add automatic docstring formatter and apply
2019-10-24 08:41:10 +02:00
NIC619
d52b093286
Fix mypy error
2019-10-18 15:59:35 +08:00
NIC619
9889cb8ab1
Fix wrong import
2019-10-18 15:44:07 +08:00
NIC619
211e2f6dd0
Catch PeerDataError in PeerStore.get
2019-10-17 15:52:57 +08:00
NIC619
5063f0e2a6
Fix lint
2019-10-17 15:34:11 +08:00
NIC619
49bd460e37
Catch SedesException in deserialize_public_key
2019-10-17 15:19:39 +08:00
