Commit Graph

731 Commits

Author SHA1 Message Date
Jason Carver
2a9dc96269
Merge pull request #369 from carver/docs-travis-target
Add docs test to Travis CI
2019-11-27 10:36:15 -08:00
NIC619
d5d6962dce
Update Pubsub fixture and test 2019-11-27 17:15:24 +08:00
NIC619
0fd400fdf8
Sign and verify in Pubsub 2019-11-27 17:15:24 +08:00
NIC619
f3c9972159
Implement Pubsub signature validator 2019-11-27 17:15:24 +08:00
NIC619
683710573e
Add strict_signing: bool and sign_key to Pubsub 2019-11-27 17:15:23 +08:00
NIC Lin
da10fc8531
Merge pull request #360 from NIC619/store_our_keypair_in_peerstore
Store our keypair in peerstore
2019-11-27 17:14:36 +08:00
Jason Carver
d503950179 Fix all doc build warnings 2019-11-26 17:44:33 -08:00
NIC Lin
cac7e3909a
Merge pull request #357 from NIC619/minor_fix_replace_del
Replace (check and) del pattern with pop method
2019-11-26 19:39:41 +08:00
mhchia
ec43c25b45
Rewrite factories, made some of the test running 2019-11-26 19:24:30 +08:00
NIC619
9f3f2c53da
Apply PR feedback:
use defaultdict for peer data map
2019-11-26 16:18:15 +08:00
Chih Cheng Liang
417b5e7d61
remove unused asyncio 2019-11-26 15:27:06 +08:00
Chih Cheng Liang
6ab0e108d3
minor 2019-11-26 15:27:06 +08:00
Chih Cheng Liang
a397ccdc04
makes test_mplex_stream.py::test_mplex_stream_read_write work 2019-11-26 15:27:06 +08:00
Chih Cheng Liang
c55ea0e5bb
implement trio queue interface 2019-11-26 15:27:05 +08:00
Chih Cheng Liang
41ff884eef
rewrite tcp reader/writer interface 2019-11-26 15:27:05 +08:00
Chih Cheng Liang
d4d345c3c7
progressing 2019-11-26 15:27:05 +08:00
Chih Cheng Liang
ed17bfd663
hack chat example 2019-11-26 15:27:04 +08:00
NIC619
94c7a0bca4
Apply PR feedback and fix 2019-11-26 14:04:28 +08:00
NIC619
fab27b0357
Fix lint 2019-11-26 12:35:50 +08:00
NIC619
ffa73f5649
Check if pubkey matches peer ID before add 2019-11-26 12:33:55 +08:00
NIC619
0bfbdf7fab
Move keypair into PeerData 2019-11-26 12:27:59 +08:00
NIC619
828ae69c66
Apply PR feedback: add_key_pair 2019-11-26 11:52:31 +08:00
NIC619
566e4c080d
Fix lint 2019-11-25 17:32:53 +08:00
NIC619
e28a974425
Update peer store initialization in host factory 2019-11-25 17:17:09 +08:00
NIC619
8b4022328d
Update peer store interface 2019-11-25 17:16:47 +08:00
NIC619
e49de15227
Add get_private_key to Host 2019-11-25 16:57:00 +08:00
NIC619
a63f00d8f8
Store our pubkey/privkey info during
`initialize_default_swarm`
2019-11-25 16:55:55 +08:00
NIC619
144d93a023
Add pubkey/privkey info to PeerStore 2019-11-24 18:04:00 +08:00
NIC619
9837f30698
Rename peer_map to peer_data_map 2019-11-24 16:52:46 +08:00
NIC619
e355cb2600
Apply PR feedback:
Only use pop method if error handling is in place
2019-11-23 16:04:22 +08:00
NIC619
501eef59de
Apply PR feedback:
Only use pop method if graceful failure handling is desired
2019-11-21 14:48:03 +08:00
Chih Cheng Liang
bcd7890124
Move test utilities to tools (#356)
* move test factories to libp2p/tools

* remove unused inits

* move pubsub test utils to tools

* cleanup test_interop

* fix typing libp2p/tools/utils

* add typing to pubsub utils

* fix factories typing

* fix typing for floodsub_integration_test_settings

* fix rest of the typing

* fix isort
2019-11-21 11:47:54 +08:00
NIC619
19907e18ec
Replace (check and) del pattern with pop method 2019-11-20 23:06:37 +08:00
NIC619
c0522c1bd9
Check if entry exists in dictionary before delete 2019-11-17 21:52:05 +08:00
NIC619
ace5ef69a8
Apply PR feedback:
handle pubsub dead peer when stream closed in gossipsub
2019-11-16 17:03:04 +08:00
NIC619
ccc7879422
Add stream.write error handling in gossipsub 2019-11-16 16:57:11 +08:00
NIC619
7d1f3d6000
Remove outdated comment 2019-11-16 16:56:59 +08:00
NIC619
cbe57cd5d7
Fix lint 2019-11-16 16:56:59 +08:00
NIC619
86e0fa4563
Handle StreamClosed in ping protocol handler 2019-11-16 16:56:59 +08:00
NIC619
9be9b4bbfc
Handle StreamClosed in pub/gossip/flood-sub 2019-11-16 16:56:59 +08:00
NIC619
c4f9ce6bb3
Handle StreamClosed in identify protocol handler 2019-11-16 16:56:58 +08:00
NIC619
b8c7f0cfff
Fix lint 2019-11-09 23:55:35 +08:00
NIC619
5dfa29a0df
Track tasks created in pubsub and add close() 2019-11-09 23:24:09 +08:00
NIC619
93ef36bd86
Clean up peer record if pubsub stream fail 2019-11-09 23:24:09 +08:00
NIC619
eeb87848af
Apply PR feedback:
- fix await stream close/reset
- make `_handle_dead_peer` a sync function
2019-11-09 23:24:09 +08:00
NIC619
d36e323703
Update error handling of pubsub stream handler 2019-11-09 23:24:08 +08:00
NIC619
97b3aca535
Fix:
Force context switch before canceling swarm connection tasks
2019-11-09 23:24:08 +08:00
NIC619
a8d9536b08
Spin up handle_dead_peer_queue task 2019-11-09 23:24:08 +08:00
NIC619
84f5210220
Implement handle_dead_peer_queue 2019-11-09 23:24:08 +08:00
NIC619
4b15cb1af5
Implement PubsubNotifee.disconnected 2019-11-09 23:24:08 +08:00
NIC619
c6c9393f2b
Add dead_peer_queue to pubsub 2019-11-09 23:24:08 +08:00
NIC619
3a0c7d06d1
Update comment for connection.close() 2019-11-09 23:24:07 +08:00
Alex Stokes
2a7b43d853
bugfix: return empty bytes immediately if read length is 0 2019-11-07 20:57:55 -08:00
Alex Stokes
4b01c33d54
add some additional logging 2019-11-07 20:57:43 -08:00
Alex Stokes
58f360167d
refactor creation of identify response to make testing easier 2019-11-07 08:05:39 -08:00
Alex Stokes
9a23609b48
type protocol IDs to satisfy mypy 2019-11-07 07:51:44 -08:00
Alex Stokes
ed81562a89
Add identify and ping as default protocols 2019-11-07 07:51:43 -08:00
mhchia
10dd997805
Reorganize factories 2019-11-06 12:11:09 -08:00
Alex Stokes
9500bdbf55
Add class attribute for additional property 2019-11-06 12:11:09 -08:00
Alex Stokes
0ca3e83540
lintroll 2019-11-06 11:41:28 -08:00
Alex Stokes
693a8cf99a
Default protocols are constructed using a reference to the host 2019-11-06 11:41:28 -08:00
Alex Stokes
e0a94b6092
identify handler reads data on request from the host 2019-11-06 11:41:27 -08:00
Alex Stokes
32c55bcaf2
hosts track their public key 2019-11-06 11:41:27 -08:00
Alex Stokes
11db313b17
A mux can provide the protocols it responds to 2019-11-06 11:41:27 -08:00
Alex Stokes
d09046f5ca
Merge pull request #343 from ralexstokes/add-pytest-xdist
Add pytest xdist and fix some issues w/ parallelizing tests
2019-11-07 04:34:14 +09:00
Alex Stokes
c30d9ce397
Fix linter error from merge in #315. 2019-11-05 17:50:43 -08:00
Alex Stokes
5cb4479534
Modify the `KademliaServer` so that lack of port lets the OS choose a free one 2019-11-05 17:50:10 -08:00
Alex Stokes
8ab69b9676
fix medley of typos 2019-11-05 17:37:43 -08:00
Alex Stokes
01dc49164f
fix bug found via typechecker 2019-11-05 17:37:43 -08:00
Alex Stokes
08b57fa2ee
Add core handler for identify protocol 2019-11-05 17:37:42 -08:00
Alex Stokes
700209c50a
Merge pull request #315 from ralexstokes/add-ping-protocol
Add `ping` protocol.
2019-11-06 10:14:39 +09:00
Dominik Muhs
817325f341 Fix docstring list in KademliaProtocol 2019-10-29 18:22:13 +01:00
Piper Merriam
ded3792924
Merge pull request #331 from dmuhs/fix/docs-format
Add automatic docstring formatting
2019-10-28 09:39:52 -06:00
Alex Stokes
f2bfc68f6d
Re-generate protobufs 2019-10-25 18:51:57 +09:00
Dominik Muhs
bafdd8512d Enforce pre-summary newline in docstrings 2019-10-24 20:10:45 +02:00
Dominik Muhs
09ab6c51ec Fix formatting in secio transport 2019-10-24 19:52:03 +02:00
Dominik Muhs
b5eeceecbf Rename raw connection initiator flags 2019-10-24 19:28:42 +02:00
Dominik Muhs
5810174374 Rename stream muxer initiator flags 2019-10-24 19:28:19 +02:00
Dominik Muhs
031b98ddf0 Rename stream muxer initiator flags 2019-10-24 19:25:34 +02:00
Dominik Muhs
4bda366bb8 Rename protocol muxer initiator flags 2019-10-24 19:25:09 +02:00
Dominik Muhs
021c92ea25 Rename secio initiator flags 2019-10-24 19:22:24 +02:00
Dominik Muhs
7ad96d167c Rename InsecureSession initiator flag 2019-10-24 19:18:29 +02:00
Dominik Muhs
18783b82a2 Rename SecurityMultistream initiator flag 2019-10-24 19:17:00 +02:00
Dominik Muhs
ee0b4daf1c Rename BaseSession initiator flag 2019-10-24 19:16:08 +02:00
Dominik Muhs
afb79da9f8 Fix typo 2019-10-24 19:12:15 +02:00
Dominik Muhs
2e38d5e5fb Rename TransportUpgrader initiator flag 2019-10-24 19:06:49 +02:00
Alex Stokes
1cf239cce6
Respect a remote close during the ping protocol 2019-10-24 19:44:52 +09:00
Alex Stokes
e157c3f654
typing fixes 2019-10-24 18:10:56 +09:00
Alex Stokes
f24b488f79
handle other side closing their end of the connection during ping 2019-10-24 18:10:56 +09:00
Alex Stokes
4a800e5c56
Add first-pass at ping protocol 2019-10-24 18:10:55 +09:00
Alex Stokes
15cabb1c33
Copy default data to avoid undesirable mutations 2019-10-24 17:29:33 +09:00
Alex Stokes
d0c8b7d8af
Avoid sharing default dictionary argument across all instances of class 2019-10-24 17:29:16 +09:00
Alex Stokes
c92bade815
Add "default protocols" that all hosts have by default 2019-10-24 17:29:16 +09:00
Dominik Muhs
3db297fbee Fix mypy errors 2019-10-24 08:53:19 +02:00
Dominik Muhs
eef505f2d9 Add automatic docstring formatter and apply 2019-10-24 08:41:10 +02:00
NIC619
d52b093286
Fix mypy error 2019-10-18 15:59:35 +08:00
NIC619
9889cb8ab1
Fix wrong import 2019-10-18 15:44:07 +08:00
NIC619
211e2f6dd0
Catch PeerDataError in PeerStore.get 2019-10-17 15:52:57 +08:00
NIC619
5063f0e2a6
Fix lint 2019-10-17 15:34:11 +08:00
NIC619
49bd460e37
Catch SedesException in deserialize_public_key 2019-10-17 15:19:39 +08:00
NIC619
da08d37c38
Add SedesException SecioException 2019-10-17 15:03:18 +08:00
NIC619
29bf623d2c
Raise DecryptionFailedException
when failed to decrypt read msg
2019-10-17 14:30:30 +08:00
NIC619
5e5c96f1ea
Add DecryptionFailedException MsgioException 2019-10-17 14:29:58 +08:00
Aratz M. Lasa
ac9feef26c Pull request feedback 2019-10-15 20:32:25 +02:00
Aratz M. Lasa
70ea471491 Blacked 2019-10-15 19:11:11 +02:00
Aratz M. Lasa
d1d91e4091 Refactored for 'lint' testenv 2019-10-15 19:02:03 +02:00
aratz-lasa
65b5e7aeea
Update libp2p/peer/peerinfo.py
Co-Authored-By: Kevin Mai-Husan Chia <mhchia@users.noreply.github.com>
2019-10-15 16:31:20 +02:00
Aratz M. Lasa
8143563831 Added tests for 'RoutedHost' and modified 'FindPeer' 2019-10-15 01:01:16 +02:00
Aratz M. Lasa
3f24b015ab Implemented Host that includes a routing system. Explicitly separating different Host types as in Go implementation 2019-10-14 00:29:28 +02:00
mhchia
82dc5d9e31
Ignore typing for asyncio.wait 2019-10-02 15:45:54 +08:00
Moshe Malawach
986a852e7e Remove forced debug level 2019-10-01 11:17:05 +02:00
Alex Stokes
ada4d48b6e
remove overly verbose comments 2019-09-24 15:36:50 -07:00
Alex Stokes
75ec2facce
linter fix 2019-09-24 10:07:33 -07:00
Alex Stokes
487c923791
add ed25519 private key deserializer 2019-09-24 10:06:35 -07:00
Alex Stokes
bbd8279811
Add explicit exception if we are missing a deserializer 2019-09-24 09:51:32 -07:00
Alex Stokes
6e53849604
Delete utils in favor of serialization module 2019-09-24 09:51:31 -07:00
Alex Stokes
5fdca2ffb2
Add public key implementation 2019-09-24 09:51:31 -07:00
Alex Stokes
fa7d1d66a8
Fix import path 2019-09-24 09:51:31 -07:00
Alex Stokes
b142964d31
Adds support for verifying ed25519 signatures, for secio 2019-09-24 09:51:31 -07:00
Kevin Mai-Husan Chia
dbc35e8b9d
Merge pull request #310 from mhchia/fix/missing_await_for_stream_reset_in_pubsub
Add the missing `await` for `stream.reset` in pubsub
2019-09-24 14:04:25 +08:00
mhchia
da34b086d5
Merge branch 'master' into fix/change-notifee-and-add-tests-for-swarm-conn-and-mplex 2019-09-24 13:50:54 +08:00
mhchia
b0c919aab7
Add the missing await 2019-09-24 13:34:26 +08:00
mhchia
7405f078e6
Raise read_delim exception with different msgs
Separate `len(msg_bytes) == 0` and `msg_bytes[-1:] != b"\n"`, to raise
`ParseError` with different messages.
2019-09-24 13:22:25 +08:00
mhchia
37bee9fb16
PR feedback
- Use `TMuxerOptions` and `TSecurityOptions` in libp2p/__init__.py
- Remove the default value for `muxer_transports_by_protocol` in
`MuxerMultistream` and `secure_transports_by_protocol`
`SecureMultistream`
2019-09-24 12:51:59 +08:00
Kevin Mai-Husan Chia
1bd18c84f2
Apply suggestions from code review
Co-Authored-By: Alex Stokes <r.alex.stokes@gmail.com>
2019-09-24 12:33:14 +08:00
mhchia
d1c25b8b1e
Fix interop pubsub tests and PR feedback
- Use `from_id`, the changed field name in `PSMessage`.
- PR feedbacks
        - Add label `test` in `testenv` in tox.ini, to avoid wrong
dispatching an environment's command in the future.
        - Use `pytest` over `py.test`.
2019-09-24 11:30:52 +08:00
mhchia
95ae718e3d
Raise ParseError in read_delim 2019-09-23 16:01:22 +08:00
mhchia
92deae41dc
Change SwarmConn.conn to muxed_conn 2019-09-23 15:46:50 +08:00
mhchia
8d2415a404
Move calls to Notifee inside Swarm 2019-09-23 15:01:58 +08:00
mhchia
6f8394e4bd
Merge branch 'master' into fix/change-notifee-and-add-tests-for-swarm-conn-and-mplex 2019-09-21 18:34:12 +08:00
mhchia
539047be2d
Make mplex.read_message handle RawConnError 2019-09-21 18:17:00 +08:00
mhchia
e44c2145cc
Merge branch 'master' into fix/detection-of-close 2019-09-21 18:05:54 +08:00
mhchia
0df578d219
Add the missing exceptions.py 2019-09-21 17:18:55 +08:00
mhchia
a27a817d50
Fix tests 2019-09-20 16:17:13 +08:00
mhchia
89c127eff4
Merge branch 'master' into fix/refactor-mplex-swarm-host 2019-09-20 15:45:28 +08:00
NIC619
7fc958e7be
Add exception raised to docstring 2019-09-19 22:19:36 +08:00
NIC619
c6294ad19b
Raise MultiselectCommunicatorError:
when failed to write to communicator
2019-09-19 21:51:23 +08:00
NIC619
b9d1875027
Catch OpenConnectionError in swarm.dial_peer 2019-09-19 21:24:01 +08:00
NIC619
1f76f6ee1b
Raise OpenConnectionError
when failed to open connection
2019-09-19 21:23:35 +08:00
NIC619
c44be5e247
Add OpenConnectionError for base transport 2019-09-19 21:23:01 +08:00
mhchia
62b0bc4580
Remove useless protocol_ids in logging 2019-09-19 16:31:42 +08:00
mhchia
02c55e5d14
Add tests for MplexConn 2019-09-19 16:31:42 +08:00
mhchia
a9ad37bc6f
Add mplex tests and fix error in SwarmConn.close 2019-09-19 16:31:41 +08:00
mhchia
d61327f5f9
Add tests for SwarmConn 2019-09-19 16:31:41 +08:00
mhchia
b8b5ac5e06
Add test for notifee disconnected 2019-09-19 16:31:41 +08:00
mhchia
5307c0506b
Change IMuxedConn to INetConn in Notifee 2019-09-19 16:31:41 +08:00
mhchia
0356380996
Add tests for swarm, and debug
Fix `swarm_pair_factory`
2019-09-19 16:31:40 +08:00
mhchia
e7304538da
Add test for Swarm.close_peer 2019-09-19 16:31:12 +08:00
mhchia
6923f257f6
Remove print 2019-09-19 16:07:53 +08:00
mhchia
5f064dd329
Refactor: get rid of single huge _handle_incoming 2019-09-19 15:55:27 +08:00
mhchia
4a689c7d57
Fix error when reset
If `Mplex` is cleanup first, `MplexStream.reset` possibly fails because
`Mplex.streams` is set to `None` in `cleanup`.
2019-09-19 15:55:27 +08:00
mhchia
b51c2939a8
Handle exceptions inside read_message
And remove the need of checking `None` for every read messages.
2019-09-19 15:55:26 +08:00
mhchia
f62f07bb9f
Handle IncompleteRead in handle_incoming 2019-09-19 15:55:26 +08:00
mhchia
2d8e02b7eb
Add detection for disconnections in mplex 2019-09-19 15:55:26 +08:00
mhchia
393b51a744
isort 2019-09-19 15:53:40 +08:00
mhchia
5653b3f604
Add "closed" and "shutting_down" events 2019-09-19 15:53:39 +08:00
mhchia
7cf0495f37
Remove print 2019-09-19 15:38:38 +08:00
mhchia
a7bc9fc358
Asynchronously handling the accepted stream. 2019-09-19 13:59:51 +08:00
mhchia
6cb033fd1f
Refactor multiselect out of Swarm to BasicHost 2019-09-19 13:59:50 +08:00
mhchia
0bd213bbb7
Refactor mplex and start to add close detection 2019-09-19 13:56:05 +08:00
NIC619
f253152858
Handle protocol negotiation failure in swarm new_stream 2019-09-17 16:17:41 +08:00
NIC619
559f419b4e
Fix stream registration in accept_stream 2019-09-17 15:42:18 +08:00
NIC619
0080466d86
Handle RawConnError in InsecureSession.run_handshake 2019-09-16 19:16:41 +08:00
NIC619
09bfa0ab09
Handle IOException in create_secure_session 2019-09-16 19:15:40 +08:00
NIC619
c7593bff97
Add InconsistentNonce in secio 2019-09-16 19:11:46 +08:00
NIC619
359bcf45ff
SecioException inherit from HandshakeFailure 2019-09-16 19:11:06 +08:00
NIC619
d6dda91482
Move HandshakeFailure to libp2p.security 2019-09-16 19:09:09 +08:00
NIC619
4cd5b77f10
Raise RawConnError in RawConnection 2019-09-16 18:37:00 +08:00
NIC619
cb632fa509
Add RawConnError 2019-09-16 18:35:48 +08:00
NIC619
76af835af8
Handle MultiselectError in stream_muxer.accept_stream 2019-09-15 17:35:01 +08:00
NIC619
eaa74c4e26
Handle MultiselectCommunicatorError 2019-09-15 16:58:22 +08:00
NIC619
879f193aa1
Handle errors from
- `read_delim`
    - `read_varint_prefixed_bytes`
    - `decode_uvarint_from_stream`
2019-09-15 16:58:08 +08:00
NIC619
905a473ac3
Add MultiselectCommunicatorError 2019-09-15 16:37:37 +08:00
NIC619
68573e94d3
Have StreamError inherit from IOException 2019-09-15 16:34:16 +08:00
NIC619
f368f5e93b
Apply PR feedback 2019-09-15 15:09:58 +08:00
NIC619
501513b747
Update IMultiselectClient 2019-09-14 22:24:53 +08:00
NIC619
9bad7a61f0
Add some loggings to pubsub 2019-09-14 21:54:26 +08:00
NIC619
786a03544c
Add some loggings to swarm and cosmetic updates 2019-09-14 21:47:49 +08:00
NIC619
65a48d5c51
Remove unused select_protocol_or_fail 2019-09-14 17:42:18 +08:00
mhchia
8c8c206c33
flake8 2019-09-11 18:33:52 +08:00
mhchia
451f993058
Fix isort 2019-09-11 18:05:41 +08:00
mhchia
c1ffc0ab07
Fix transport.dial in swarm 2019-09-11 17:13:21 +08:00
Alex Stokes
cb1a25f94c
Execute the todo to remove an unused argument 2019-09-10 21:01:03 -04:00
Alex Stokes
4bd32cc4bc
Add logs during connection handshake 2019-09-10 19:02:29 -04:00
Alex Stokes
f128c746f0
Write data payload as hex to log 2019-09-10 16:17:40 -04:00
Alex Stokes
68e75707e4
Enhance logs 2019-09-10 16:04:18 -04:00
mhchia
31fb4e0b69
Rewrite _wait_for_data, to handle task precisely
Make the futures first, and then we can compare them with the return
value from `asyncio.wait`.
2019-09-10 23:38:45 +08:00
mhchia
df87f5adb9
Add tests against the daemon for close/reset 2019-09-10 18:01:16 +08:00
mhchia
e5eb01d22b
Fix stream read 2019-09-10 18:01:16 +08:00
mhchia
df312f3e57
Fix linting 2019-09-10 18:01:15 +08:00
mhchia
be2c0f122a
Fix close behavior 2019-09-10 18:01:14 +08:00
Brian Cloutier
b2146c5268
Don't crash on large messages 2019-09-09 17:13:26 -04:00
Alex Stokes
155bec0562
Fix initiator flag during secio upgrade 2019-09-09 16:40:14 -04:00
Alex Stokes
2025a5c7f1
Restore initiator flag to BaseSession type 2019-09-08 15:40:02 -04:00
Alex Stokes
50ae439d20
remove friendly IDs 2019-09-07 11:04:20 -04:00
mhchia
6c1f77dc1a
Fix: Change the event.close to event.set
And add missing parts.
2019-09-06 21:35:15 +08:00
mhchia
1cd969a2d5
Fix: Add typing in functions 2019-09-06 20:02:35 +08:00
mhchia
649a230776
Fix MplexStream.read 2019-09-06 17:26:40 +08:00
mhchia
95926b7376
Temp for mplex_stream 2019-09-06 01:08:42 +08:00
mhchia
207fa75d8f
Add reset and close 2019-09-05 23:44:22 +08:00