NIC619
0fd400fdf8
Sign and verify in Pubsub
2019-11-27 17:15:24 +08:00
NIC619
f3c9972159
Implement Pubsub signature validator
2019-11-27 17:15:24 +08:00
NIC619
683710573e
Add strict_signing: bool and sign_key to Pubsub
2019-11-27 17:15:23 +08:00
NIC Lin
da10fc8531
Merge pull request #360 from NIC619/store_our_keypair_in_peerstore
...
Store our keypair in peerstore
2019-11-27 17:14:36 +08:00
Jason Carver
d503950179
Fix all doc build warnings
2019-11-26 17:44:33 -08:00
NIC Lin
cac7e3909a
Merge pull request #357 from NIC619/minor_fix_replace_del
...
Replace (check and) del pattern with pop method
2019-11-26 19:39:41 +08:00
mhchia
ec43c25b45
Rewrite factories, made some of the test running
2019-11-26 19:24:30 +08:00
NIC619
9f3f2c53da
Apply PR feedback:
...
use defaultdict for peer data map
2019-11-26 16:18:15 +08:00
Chih Cheng Liang
417b5e7d61
remove unused asyncio
2019-11-26 15:27:06 +08:00
Chih Cheng Liang
6ab0e108d3
minor
2019-11-26 15:27:06 +08:00
Chih Cheng Liang
a397ccdc04
makes test_mplex_stream.py::test_mplex_stream_read_write work
2019-11-26 15:27:06 +08:00
Chih Cheng Liang
c55ea0e5bb
implement trio queue interface
2019-11-26 15:27:05 +08:00
Chih Cheng Liang
41ff884eef
rewrite tcp reader/writer interface
2019-11-26 15:27:05 +08:00
Chih Cheng Liang
d4d345c3c7
progressing
2019-11-26 15:27:05 +08:00
Chih Cheng Liang
ed17bfd663
hack chat example
2019-11-26 15:27:04 +08:00
NIC619
94c7a0bca4
Apply PR feedback and fix
2019-11-26 14:04:28 +08:00
NIC619
fab27b0357
Fix lint
2019-11-26 12:35:50 +08:00
NIC619
ffa73f5649
Check if pubkey matches peer ID before add
2019-11-26 12:33:55 +08:00
NIC619
0bfbdf7fab
Move keypair into PeerData
2019-11-26 12:27:59 +08:00
NIC619
828ae69c66
Apply PR feedback: add_key_pair
2019-11-26 11:52:31 +08:00
NIC619
566e4c080d
Fix lint
2019-11-25 17:32:53 +08:00
NIC619
e28a974425
Update peer store initialization in host factory
2019-11-25 17:17:09 +08:00
NIC619
8b4022328d
Update peer store interface
2019-11-25 17:16:47 +08:00
NIC619
e49de15227
Add get_private_key to Host
2019-11-25 16:57:00 +08:00
NIC619
a63f00d8f8
Store our pubkey/privkey info during
...
`initialize_default_swarm`
2019-11-25 16:55:55 +08:00
NIC619
144d93a023
Add pubkey/privkey info to PeerStore
2019-11-24 18:04:00 +08:00
NIC619
9837f30698
Rename peer_map to peer_data_map
2019-11-24 16:52:46 +08:00
NIC619
e355cb2600
Apply PR feedback:
...
Only use pop method if error handling is in place
2019-11-23 16:04:22 +08:00
NIC619
501eef59de
Apply PR feedback:
...
Only use pop method if graceful failure handling is desired
2019-11-21 14:48:03 +08:00
Chih Cheng Liang
bcd7890124
Move test utilities to tools ( #356 )
...
* move test factories to libp2p/tools
* remove unused inits
* move pubsub test utils to tools
* cleanup test_interop
* fix typing libp2p/tools/utils
* add typing to pubsub utils
* fix factories typing
* fix typing for floodsub_integration_test_settings
* fix rest of the typing
* fix isort
2019-11-21 11:47:54 +08:00
NIC619
19907e18ec
Replace (check and) del pattern with pop method
2019-11-20 23:06:37 +08:00
NIC619
c0522c1bd9
Check if entry exists in dictionary before delete
2019-11-17 21:52:05 +08:00
NIC619
ace5ef69a8
Apply PR feedback:
...
handle pubsub dead peer when stream closed in gossipsub
2019-11-16 17:03:04 +08:00
NIC619
ccc7879422
Add stream.write error handling in gossipsub
2019-11-16 16:57:11 +08:00
NIC619
7d1f3d6000
Remove outdated comment
2019-11-16 16:56:59 +08:00
NIC619
cbe57cd5d7
Fix lint
2019-11-16 16:56:59 +08:00
NIC619
86e0fa4563
Handle StreamClosed in ping protocol handler
2019-11-16 16:56:59 +08:00
NIC619
9be9b4bbfc
Handle StreamClosed in pub/gossip/flood-sub
2019-11-16 16:56:59 +08:00
NIC619
c4f9ce6bb3
Handle StreamClosed in identify protocol handler
2019-11-16 16:56:58 +08:00
NIC619
b8c7f0cfff
Fix lint
2019-11-09 23:55:35 +08:00
NIC619
5dfa29a0df
Track tasks created in pubsub and add close()
2019-11-09 23:24:09 +08:00
NIC619
93ef36bd86
Clean up peer record if pubsub stream fail
2019-11-09 23:24:09 +08:00
NIC619
eeb87848af
Apply PR feedback:
...
- fix await stream close/reset
- make `_handle_dead_peer` a sync function
2019-11-09 23:24:09 +08:00
NIC619
d36e323703
Update error handling of pubsub stream handler
2019-11-09 23:24:08 +08:00
NIC619
97b3aca535
Fix:
...
Force context switch before canceling swarm connection tasks
2019-11-09 23:24:08 +08:00
NIC619
a8d9536b08
Spin up handle_dead_peer_queue task
2019-11-09 23:24:08 +08:00
NIC619
84f5210220
Implement handle_dead_peer_queue
2019-11-09 23:24:08 +08:00
NIC619
4b15cb1af5
Implement PubsubNotifee.disconnected
2019-11-09 23:24:08 +08:00
NIC619
c6c9393f2b
Add dead_peer_queue to pubsub
2019-11-09 23:24:08 +08:00
NIC619
3a0c7d06d1
Update comment for connection.close()
2019-11-09 23:24:07 +08:00
Alex Stokes
2a7b43d853
bugfix: return empty bytes immediately if read length is 0
2019-11-07 20:57:55 -08:00
Alex Stokes
4b01c33d54
add some additional logging
2019-11-07 20:57:43 -08:00
Alex Stokes
58f360167d
refactor creation of identify response to make testing easier
2019-11-07 08:05:39 -08:00
Alex Stokes
9a23609b48
type protocol IDs to satisfy mypy
2019-11-07 07:51:44 -08:00
Alex Stokes
ed81562a89
Add identify and ping as default protocols
2019-11-07 07:51:43 -08:00
mhchia
10dd997805
Reorganize factories
2019-11-06 12:11:09 -08:00
Alex Stokes
9500bdbf55
Add class attribute for additional property
2019-11-06 12:11:09 -08:00
Alex Stokes
0ca3e83540
lintroll
2019-11-06 11:41:28 -08:00
Alex Stokes
693a8cf99a
Default protocols are constructed using a reference to the host
2019-11-06 11:41:28 -08:00
Alex Stokes
e0a94b6092
identify handler reads data on request from the host
2019-11-06 11:41:27 -08:00
Alex Stokes
32c55bcaf2
hosts track their public key
2019-11-06 11:41:27 -08:00
Alex Stokes
11db313b17
A mux can provide the protocols it responds to
2019-11-06 11:41:27 -08:00
Alex Stokes
d09046f5ca
Merge pull request #343 from ralexstokes/add-pytest-xdist
...
Add pytest xdist and fix some issues w/ parallelizing tests
2019-11-07 04:34:14 +09:00
Alex Stokes
c30d9ce397
Fix linter error from merge in #315 .
2019-11-05 17:50:43 -08:00
Alex Stokes
5cb4479534
Modify the `KademliaServer` so that lack of port lets the OS choose a free one
2019-11-05 17:50:10 -08:00
Alex Stokes
8ab69b9676
fix medley of typos
2019-11-05 17:37:43 -08:00
Alex Stokes
01dc49164f
fix bug found via typechecker
2019-11-05 17:37:43 -08:00
Alex Stokes
08b57fa2ee
Add core handler for identify protocol
2019-11-05 17:37:42 -08:00
Alex Stokes
700209c50a
Merge pull request #315 from ralexstokes/add-ping-protocol
...
Add `ping` protocol.
2019-11-06 10:14:39 +09:00
Dominik Muhs
817325f341
Fix docstring list in KademliaProtocol
2019-10-29 18:22:13 +01:00
Piper Merriam
ded3792924
Merge pull request #331 from dmuhs/fix/docs-format
...
Add automatic docstring formatting
2019-10-28 09:39:52 -06:00
Alex Stokes
f2bfc68f6d
Re-generate protobufs
2019-10-25 18:51:57 +09:00
Dominik Muhs
bafdd8512d
Enforce pre-summary newline in docstrings
2019-10-24 20:10:45 +02:00
Dominik Muhs
09ab6c51ec
Fix formatting in secio transport
2019-10-24 19:52:03 +02:00
Dominik Muhs
b5eeceecbf
Rename raw connection initiator flags
2019-10-24 19:28:42 +02:00
Dominik Muhs
5810174374
Rename stream muxer initiator flags
2019-10-24 19:28:19 +02:00
Dominik Muhs
031b98ddf0
Rename stream muxer initiator flags
2019-10-24 19:25:34 +02:00
Dominik Muhs
4bda366bb8
Rename protocol muxer initiator flags
2019-10-24 19:25:09 +02:00
Dominik Muhs
021c92ea25
Rename secio initiator flags
2019-10-24 19:22:24 +02:00
Dominik Muhs
7ad96d167c
Rename InsecureSession initiator flag
2019-10-24 19:18:29 +02:00
Dominik Muhs
18783b82a2
Rename SecurityMultistream initiator flag
2019-10-24 19:17:00 +02:00
Dominik Muhs
ee0b4daf1c
Rename BaseSession initiator flag
2019-10-24 19:16:08 +02:00
Dominik Muhs
afb79da9f8
Fix typo
2019-10-24 19:12:15 +02:00
Dominik Muhs
2e38d5e5fb
Rename TransportUpgrader initiator flag
2019-10-24 19:06:49 +02:00
Alex Stokes
1cf239cce6
Respect a remote close during the ping protocol
2019-10-24 19:44:52 +09:00
Alex Stokes
e157c3f654
typing fixes
2019-10-24 18:10:56 +09:00
Alex Stokes
f24b488f79
handle other side closing their end of the connection during ping
2019-10-24 18:10:56 +09:00
Alex Stokes
4a800e5c56
Add first-pass at ping protocol
2019-10-24 18:10:55 +09:00
Alex Stokes
15cabb1c33
Copy default data to avoid undesirable mutations
2019-10-24 17:29:33 +09:00
Alex Stokes
d0c8b7d8af
Avoid sharing default dictionary argument across all instances of class
2019-10-24 17:29:16 +09:00
Alex Stokes
c92bade815
Add "default protocols" that all hosts have by default
2019-10-24 17:29:16 +09:00
Dominik Muhs
3db297fbee
Fix mypy errors
2019-10-24 08:53:19 +02:00
Dominik Muhs
eef505f2d9
Add automatic docstring formatter and apply
2019-10-24 08:41:10 +02:00
NIC619
d52b093286
Fix mypy error
2019-10-18 15:59:35 +08:00
NIC619
9889cb8ab1
Fix wrong import
2019-10-18 15:44:07 +08:00
NIC619
211e2f6dd0
Catch PeerDataError in PeerStore.get
2019-10-17 15:52:57 +08:00
NIC619
5063f0e2a6
Fix lint
2019-10-17 15:34:11 +08:00
NIC619
49bd460e37
Catch SedesException in deserialize_public_key
2019-10-17 15:19:39 +08:00
NIC619
da08d37c38
Add SedesException SecioException
2019-10-17 15:03:18 +08:00
NIC619
29bf623d2c
Raise DecryptionFailedException
...
when failed to decrypt read msg
2019-10-17 14:30:30 +08:00
NIC619
5e5c96f1ea
Add DecryptionFailedException MsgioException
2019-10-17 14:29:58 +08:00
Aratz M. Lasa
ac9feef26c
Pull request feedback
2019-10-15 20:32:25 +02:00
Aratz M. Lasa
70ea471491
Blacked
2019-10-15 19:11:11 +02:00
Aratz M. Lasa
d1d91e4091
Refactored for 'lint' testenv
2019-10-15 19:02:03 +02:00
aratz-lasa
65b5e7aeea
Update libp2p/peer/peerinfo.py
...
Co-Authored-By: Kevin Mai-Husan Chia <mhchia@users.noreply.github.com>
2019-10-15 16:31:20 +02:00
Aratz M. Lasa
8143563831
Added tests for 'RoutedHost' and modified 'FindPeer'
2019-10-15 01:01:16 +02:00
Aratz M. Lasa
3f24b015ab
Implemented Host that includes a routing system. Explicitly separating different Host types as in Go implementation
2019-10-14 00:29:28 +02:00
mhchia
82dc5d9e31
Ignore typing for asyncio.wait
2019-10-02 15:45:54 +08:00
Moshe Malawach
986a852e7e
Remove forced debug level
2019-10-01 11:17:05 +02:00
Alex Stokes
ada4d48b6e
remove overly verbose comments
2019-09-24 15:36:50 -07:00
Alex Stokes
75ec2facce
linter fix
2019-09-24 10:07:33 -07:00
Alex Stokes
487c923791
add ed25519 private key deserializer
2019-09-24 10:06:35 -07:00
Alex Stokes
bbd8279811
Add explicit exception if we are missing a deserializer
2019-09-24 09:51:32 -07:00
Alex Stokes
6e53849604
Delete utils in favor of serialization module
2019-09-24 09:51:31 -07:00
Alex Stokes
5fdca2ffb2
Add public key implementation
2019-09-24 09:51:31 -07:00
Alex Stokes
fa7d1d66a8
Fix import path
2019-09-24 09:51:31 -07:00
Alex Stokes
b142964d31
Adds support for verifying ed25519 signatures, for secio
2019-09-24 09:51:31 -07:00
Kevin Mai-Husan Chia
dbc35e8b9d
Merge pull request #310 from mhchia/fix/missing_await_for_stream_reset_in_pubsub
...
Add the missing `await` for `stream.reset` in pubsub
2019-09-24 14:04:25 +08:00
mhchia
da34b086d5
Merge branch 'master' into fix/change-notifee-and-add-tests-for-swarm-conn-and-mplex
2019-09-24 13:50:54 +08:00
mhchia
b0c919aab7
Add the missing await
2019-09-24 13:34:26 +08:00
mhchia
7405f078e6
Raise read_delim exception with different msgs
...
Separate `len(msg_bytes) == 0` and `msg_bytes[-1:] != b"\n"`, to raise
`ParseError` with different messages.
2019-09-24 13:22:25 +08:00
mhchia
37bee9fb16
PR feedback
...
- Use `TMuxerOptions` and `TSecurityOptions` in libp2p/__init__.py
- Remove the default value for `muxer_transports_by_protocol` in
`MuxerMultistream` and `secure_transports_by_protocol`
`SecureMultistream`
2019-09-24 12:51:59 +08:00
Kevin Mai-Husan Chia
1bd18c84f2
Apply suggestions from code review
...
Co-Authored-By: Alex Stokes <r.alex.stokes@gmail.com>
2019-09-24 12:33:14 +08:00
mhchia
d1c25b8b1e
Fix interop pubsub tests and PR feedback
...
- Use `from_id`, the changed field name in `PSMessage`.
- PR feedbacks
- Add label `test` in `testenv` in tox.ini, to avoid wrong
dispatching an environment's command in the future.
- Use `pytest` over `py.test`.
2019-09-24 11:30:52 +08:00
mhchia
95ae718e3d
Raise ParseError in read_delim
2019-09-23 16:01:22 +08:00
mhchia
92deae41dc
Change SwarmConn.conn to muxed_conn
2019-09-23 15:46:50 +08:00
mhchia
8d2415a404
Move calls to Notifee inside Swarm
2019-09-23 15:01:58 +08:00
mhchia
6f8394e4bd
Merge branch 'master' into fix/change-notifee-and-add-tests-for-swarm-conn-and-mplex
2019-09-21 18:34:12 +08:00
mhchia
539047be2d
Make mplex.read_message handle RawConnError
2019-09-21 18:17:00 +08:00
mhchia
e44c2145cc
Merge branch 'master' into fix/detection-of-close
2019-09-21 18:05:54 +08:00
mhchia
0df578d219
Add the missing exceptions.py
2019-09-21 17:18:55 +08:00
mhchia
a27a817d50
Fix tests
2019-09-20 16:17:13 +08:00
mhchia
89c127eff4
Merge branch 'master' into fix/refactor-mplex-swarm-host
2019-09-20 15:45:28 +08:00
NIC619
7fc958e7be
Add exception raised to docstring
2019-09-19 22:19:36 +08:00
NIC619
c6294ad19b
Raise MultiselectCommunicatorError:
...
when failed to write to communicator
2019-09-19 21:51:23 +08:00
NIC619
b9d1875027
Catch OpenConnectionError in swarm.dial_peer
2019-09-19 21:24:01 +08:00
NIC619
1f76f6ee1b
Raise OpenConnectionError
...
when failed to open connection
2019-09-19 21:23:35 +08:00
NIC619
c44be5e247
Add OpenConnectionError for base transport
2019-09-19 21:23:01 +08:00
mhchia
62b0bc4580
Remove useless protocol_ids in logging
2019-09-19 16:31:42 +08:00
mhchia
02c55e5d14
Add tests for MplexConn
2019-09-19 16:31:42 +08:00
mhchia
a9ad37bc6f
Add mplex tests and fix error in SwarmConn.close
2019-09-19 16:31:41 +08:00
mhchia
d61327f5f9
Add tests for SwarmConn
2019-09-19 16:31:41 +08:00
mhchia
b8b5ac5e06
Add test for notifee disconnected
2019-09-19 16:31:41 +08:00
mhchia
5307c0506b
Change IMuxedConn to INetConn in Notifee
2019-09-19 16:31:41 +08:00
mhchia
0356380996
Add tests for swarm, and debug
...
Fix `swarm_pair_factory`
2019-09-19 16:31:40 +08:00
mhchia
e7304538da
Add test for Swarm.close_peer
2019-09-19 16:31:12 +08:00
mhchia
6923f257f6
Remove print
2019-09-19 16:07:53 +08:00
mhchia
5f064dd329
Refactor: get rid of single huge _handle_incoming
2019-09-19 15:55:27 +08:00
mhchia
4a689c7d57
Fix error when reset
...
If `Mplex` is cleanup first, `MplexStream.reset` possibly fails because
`Mplex.streams` is set to `None` in `cleanup`.
2019-09-19 15:55:27 +08:00
mhchia
b51c2939a8
Handle exceptions inside read_message
...
And remove the need of checking `None` for every read messages.
2019-09-19 15:55:26 +08:00
mhchia
f62f07bb9f
Handle IncompleteRead in handle_incoming
2019-09-19 15:55:26 +08:00
mhchia
2d8e02b7eb
Add detection for disconnections in mplex
2019-09-19 15:55:26 +08:00
mhchia
393b51a744
isort
2019-09-19 15:53:40 +08:00
mhchia
5653b3f604
Add "closed" and "shutting_down" events
2019-09-19 15:53:39 +08:00
mhchia
7cf0495f37
Remove print
2019-09-19 15:38:38 +08:00
mhchia
a7bc9fc358
Asynchronously handling the accepted stream.
2019-09-19 13:59:51 +08:00
mhchia
6cb033fd1f
Refactor multiselect out of Swarm to BasicHost
2019-09-19 13:59:50 +08:00
mhchia
0bd213bbb7
Refactor mplex and start to add close detection
2019-09-19 13:56:05 +08:00
NIC619
f253152858
Handle protocol negotiation failure in swarm new_stream
2019-09-17 16:17:41 +08:00
NIC619
559f419b4e
Fix stream registration in accept_stream
2019-09-17 15:42:18 +08:00
NIC619
0080466d86
Handle RawConnError in InsecureSession.run_handshake
2019-09-16 19:16:41 +08:00
NIC619
09bfa0ab09
Handle IOException in create_secure_session
2019-09-16 19:15:40 +08:00
NIC619
c7593bff97
Add InconsistentNonce in secio
2019-09-16 19:11:46 +08:00
NIC619
359bcf45ff
SecioException inherit from HandshakeFailure
2019-09-16 19:11:06 +08:00
NIC619
d6dda91482
Move HandshakeFailure to libp2p.security
2019-09-16 19:09:09 +08:00
NIC619
4cd5b77f10
Raise RawConnError in RawConnection
2019-09-16 18:37:00 +08:00
NIC619
cb632fa509
Add RawConnError
2019-09-16 18:35:48 +08:00
NIC619
76af835af8
Handle MultiselectError in stream_muxer.accept_stream
2019-09-15 17:35:01 +08:00
NIC619
eaa74c4e26
Handle MultiselectCommunicatorError
2019-09-15 16:58:22 +08:00
NIC619
879f193aa1
Handle errors from
...
- `read_delim`
- `read_varint_prefixed_bytes`
- `decode_uvarint_from_stream`
2019-09-15 16:58:08 +08:00
NIC619
905a473ac3
Add MultiselectCommunicatorError
2019-09-15 16:37:37 +08:00
NIC619
68573e94d3
Have StreamError inherit from IOException
2019-09-15 16:34:16 +08:00
NIC619
f368f5e93b
Apply PR feedback
2019-09-15 15:09:58 +08:00
NIC619
501513b747
Update IMultiselectClient
2019-09-14 22:24:53 +08:00
NIC619
9bad7a61f0
Add some loggings to pubsub
2019-09-14 21:54:26 +08:00
NIC619
786a03544c
Add some loggings to swarm and cosmetic updates
2019-09-14 21:47:49 +08:00
NIC619
65a48d5c51
Remove unused select_protocol_or_fail
2019-09-14 17:42:18 +08:00
mhchia
8c8c206c33
flake8
2019-09-11 18:33:52 +08:00
mhchia
451f993058
Fix isort
2019-09-11 18:05:41 +08:00
mhchia
c1ffc0ab07
Fix transport.dial in swarm
2019-09-11 17:13:21 +08:00
Alex Stokes
cb1a25f94c
Execute the todo to remove an unused argument
2019-09-10 21:01:03 -04:00
Alex Stokes
4bd32cc4bc
Add logs during connection handshake
2019-09-10 19:02:29 -04:00
Alex Stokes
f128c746f0
Write data payload as hex to log
2019-09-10 16:17:40 -04:00
Alex Stokes
68e75707e4
Enhance logs
2019-09-10 16:04:18 -04:00
mhchia
31fb4e0b69
Rewrite _wait_for_data, to handle task precisely
...
Make the futures first, and then we can compare them with the return
value from `asyncio.wait`.
2019-09-10 23:38:45 +08:00
mhchia
df87f5adb9
Add tests against the daemon for close/reset
2019-09-10 18:01:16 +08:00
mhchia
e5eb01d22b
Fix stream read
2019-09-10 18:01:16 +08:00
mhchia
df312f3e57
Fix linting
2019-09-10 18:01:15 +08:00
mhchia
be2c0f122a
Fix close behavior
2019-09-10 18:01:14 +08:00
Brian Cloutier
b2146c5268
Don't crash on large messages
2019-09-09 17:13:26 -04:00
Alex Stokes
155bec0562
Fix initiator flag during secio upgrade
2019-09-09 16:40:14 -04:00
Alex Stokes
2025a5c7f1
Restore initiator flag to BaseSession type
2019-09-08 15:40:02 -04:00
Alex Stokes
50ae439d20
remove friendly IDs
2019-09-07 11:04:20 -04:00
mhchia
6c1f77dc1a
Fix: Change the event.close to event.set
...
And add missing parts.
2019-09-06 21:35:15 +08:00
mhchia
1cd969a2d5
Fix: Add typing in functions
2019-09-06 20:02:35 +08:00
mhchia
649a230776
Fix MplexStream.read
2019-09-06 17:26:40 +08:00
mhchia
95926b7376
Temp for mplex_stream
2019-09-06 01:08:42 +08:00
mhchia
207fa75d8f
Add reset and close
2019-09-05 23:44:22 +08:00
mhchia
10415cb956
Use ReadWriteCloser for conns and streams
2019-09-05 23:24:17 +08:00
mhchia
eac159c527
Restructure mplex and mplex_stream
2019-09-05 22:29:33 +08:00
