Alex Stokes
3debd2c808
Run black and isort w/ the new config
2019-08-13 14:36:42 -07:00
Chih Cheng Liang
28f6de37ee
Fix the rest of the typing hints ( #232 )
...
* ignore kad
* fix swarm, and minor
* fix init and swarm
* ignore pb
* enable mypy
* fix basic host
* fix tcp
* fix mplex
* add typing for pb
* skip format pyi
* [mypy] no need to ignore pb now
* add typing to chat
2019-08-11 16:47:54 +08:00
Chih Cheng Liang
c536aa3e07
flake8
2019-08-08 16:09:02 +08:00
NIC Lin
b26426214e
Update libp2p/pubsub/pubsub.py
...
Co-Authored-By: Kevin Mai-Husan Chia <mhchia@users.noreply.github.com>
2019-08-07 11:43:32 +08:00
NIC619
d4febea469
Message was not enforced to carry signature yet
2019-08-06 13:05:31 +08:00
NIC619
1cea1264a4
Raise exception when topic validation failed
2019-08-06 12:38:31 +08:00
NIC619
47643a67c6
Apply PR feedback
2019-08-06 12:32:18 +08:00
NIC619
b96ef0e6c7
Fix:
...
`_is_subscribed_to_msg` need only subscribe to one of the topics
2019-08-05 18:20:04 +08:00
NIC619
a2efd03dfa
Schedule push_msg into a task
2019-08-05 18:19:32 +08:00
NIC619
2bb7f42c20
Add validators to push_msg
2019-08-05 18:19:32 +08:00
NIC619
19ce5bb420
Add signature_validator stub and docstring
2019-08-05 18:19:32 +08:00
NIC619
e1b86904e3
Add validate_msg and test
2019-08-05 18:19:32 +08:00
NIC619
ec2c566e5a
Fix validator return type and add docstring
2019-08-05 18:19:32 +08:00
NIC619
f8ca4fa1ef
Add get_msg_validators and test
2019-08-05 18:19:32 +08:00
NIC619
cf69f7e800
Rename to set_topic_validator and add test
2019-08-05 18:19:31 +08:00
NIC619
b1f4813195
Add add/remove topic validator functions
2019-08-05 18:19:31 +08:00
NIC619
3973f1d13c
Add pubsub.topic_validators
2019-08-05 18:19:31 +08:00
Chih Cheng Liang
9e0a806218
move stream and connection interfaces to abc
2019-08-05 11:17:38 +08:00
Alex Stokes
7477b29508
run black w/ extended line length
2019-08-04 12:37:41 +08:00
Alex Stokes
cb301fcc51
Opt-out of linting on the special cases we have, given new ignore rules
2019-08-04 12:37:27 +08:00
Alex Stokes
69ec86c871
Remove grpc dependency
2019-08-03 11:17:28 -07:00
Alex Stokes
c8005c8113
Run isort in repo
2019-08-03 17:50:14 +08:00
Alex Stokes
e55d9f2e60
restore generated protobuf files
2019-08-02 12:09:27 -07:00
Alex Stokes
7b7c8ad30d
run black over dangling files
2019-08-02 11:47:08 -07:00
mhchia
2e94fcf56c
Remove pylint:disable
2019-08-02 23:26:06 +08:00
NIC619
924e965537
Change argument name of Network.listen and blakc format
2019-08-02 14:45:59 +08:00
NIC619
cd684aad9e
Update peer_id to type peer.ID in pubsub folder
2019-08-02 14:45:23 +08:00
NIC619
b928bdb356
Convert from base58/pubkey/privkey to class method
2019-08-02 14:42:10 +08:00
Alex Stokes
0ae9840928
Run black over repo
2019-07-31 15:00:12 -07:00
mhchia
9683d5e8ac
Add tests for Pubsub
...
- `test_handle_subscription`
- `test_handle_talk`
- `test_message_all_peers`
2019-07-31 14:15:11 +08:00
mhchia
3a42d72cd9
Fix a minor bug for pb optional field
...
In `Pubsub.continuously_read_stream`, it checks whether this is a
control message enclosed in RPC message with `if rpc_incoming.control:`.
However, in pb2, the condition is always true because a default value is
returned when a field is not set. Solved it by changing it to
`if rpc_incoming.HasField("control"):`.
2019-07-31 14:15:11 +08:00
mhchia
550289a439
Combine test_subscription.py to test_pubsub.py
...
And add a bunch of tests for pubsub
2019-07-31 14:15:10 +08:00
mhchia
96563c0d84
Add fixtures for pubsub and router
...
And a starting `test_pubsub.py`
2019-07-31 14:14:13 +08:00
NIC619
5e215901c0
Apply PR feedback
2019-07-30 23:41:28 +08:00
NIC619
437b7665c4
Fix:
...
type object not subscriptable
2019-07-30 18:00:30 +08:00
NIC619
c4105688d1
Fix after rebase
2019-07-30 17:31:08 +08:00
NIC619
e53727d301
Apply PR feedback: fix type hints
2019-07-30 16:28:25 +08:00
NIC619
2d4e23cfe2
Fix cyclic import and lint
2019-07-30 16:28:05 +08:00
NIC619
a4a0d79f6d
Improve import layout
2019-07-30 16:27:29 +08:00
NIC619
e7ac09cb94
Fix:
...
Add Gossipsub attribute `peers_protocol` and do cleanup when peer removed
2019-07-30 16:26:21 +08:00
NIC619
d716e90e17
Fix on type hints
2019-07-30 16:25:33 +08:00
NIC619
b2f496d081
Fix type hints except pb msg in pubsub folder
2019-07-30 16:24:34 +08:00
NIC619
a0aa105867
Add type hint to pubsub notifee/interface
2019-07-30 16:23:15 +08:00
NIC619
3549f2ff8b
Add type hints to mcache.py
2019-07-30 16:20:48 +08:00
NIC619
63014eeaae
Add type hints to floodsub.py
2019-07-30 16:20:47 +08:00
NIC619
b920955db6
Add type hints to gossipsub.py
2019-07-30 15:39:50 +08:00
NIC619
8eb6a230ff
Fix and add type hints to pubsub.py
2019-07-30 15:32:58 +08:00
mhchia
f02d38c0ee
Reflect PR feedback
...
* Rename `src` to `msg_forwarder` in pubsub/floodsub/gossipsub
* Rename Variables
* Sort imports
* Clean up
2019-07-29 12:09:35 +08:00
mhchia
74d831d4e2
Reflect PR feedback
2019-07-28 18:06:38 +08:00
Kevin Mai-Husan Chia
70c5c84f32
Update libp2p/pubsub/floodsub.py
...
Co-Authored-By: NIC Lin <twedusuck@gmail.com>
2019-07-28 16:09:01 +08:00
Kevin Mai-Husan Chia
a1e20caebe
Update libp2p/pubsub/floodsub.py
...
Co-Authored-By: NIC Lin <twedusuck@gmail.com>
2019-07-28 16:07:11 +08:00
Kevin Mai-Husan Chia
ffb3920468
Update libp2p/pubsub/floodsub.py
...
Co-Authored-By: NIC Lin <twedusuck@gmail.com>
2019-07-28 16:06:03 +08:00
Kevin Mai-Husan Chia
c252c62009
Update libp2p/pubsub/pubsub.py
...
Co-Authored-By: NIC Lin <twedusuck@gmail.com>
2019-07-28 16:05:29 +08:00
mhchia
766d8ba1e1
A little bit clean up
2019-07-27 12:06:36 +08:00
mhchia
c028aef2de
Fix all tests
...
- Dedup `perform_test_from_obj` and the test cases used in both
`test_floodsub` and `test_gossipsub_backward_compatibility.py`.
Therefore, they are put in the standalone file
`tests/pubsub/floodsub_integration_test_settings.py`. The functions
and testcases are imported from there then.
- IMO still need a refactor on the tests. There are still some duplicate
code.
2019-07-27 11:49:03 +08:00
mhchia
65aedcb25a
Fix several tests
2019-07-26 18:35:25 +08:00
mhchia
035d08b8bd
Fix test_floodsub.py
2019-07-25 23:11:27 +08:00
mhchia
dadcf8138e
Fix the tests according to pubsub.Publish
...
And refactored a bit.
2019-07-25 16:58:00 +08:00
mhchia
cae4f34034
Refactor floodsub.publish
...
Passed the first test of floodsub
2019-07-25 14:08:16 +08:00
mhchia
93cf5a2c32
A roughly skeleton of floodsub.publish
...
Still need to ensure when to deliver to ourselves
2019-07-24 22:33:32 +08:00
mhchia
3f52b0dc0a
Remove leftover imports
2019-07-24 21:57:46 +08:00
mhchia
b528c211b9
Temp modified publish
2019-07-24 21:55:57 +08:00
mhchia
218bdb42c4
Add basic functionalities of publish
2019-07-24 21:55:04 +08:00
mhchia
8f9e5a28ff
Temp
2019-07-24 21:54:36 +08:00
Kevin Mai-Husan Chia
f329c5a627
Merge pull request #188 from mhchia/feature/add-typing-for-pubusb
...
Add tox and mypy
2019-07-24 21:45:19 +08:00
mhchia
d3a948be47
Fix error: Change params floodsub.publish back
2019-07-24 16:24:14 +08:00
mhchia
d6c19e71a6
Add typing and notes in pubsub
2019-07-24 14:54:30 +08:00
NIC619
99252e49f8
Prevent re-adding peers to mesh
2019-07-23 23:00:43 +08:00
NIC619
e52bfe3a51
Fix:
...
Respond GRAFT with PRUNE if not subscribed to the topic
2019-07-23 22:52:24 +08:00
NIC619
afc853a776
Apply PR feedback
2019-07-22 23:22:07 +08:00
NIC619
67f9edb77d
Remove fanout topic after joining the topic
2019-07-22 19:28:07 +08:00
NIC619
4ab99485a6
Fix lint error
2019-07-21 23:32:54 +08:00
NIC619
41141c028b
FIx:
...
check topic exist in `pubsub.peer_topics`
2019-07-21 23:16:41 +08:00
NIC619
fd1f318b0c
Fix:
...
in mesh heartbeat, select from gossipsub peers subscribed to the topic
2019-07-21 23:14:08 +08:00
NIC619
404dc67e83
Fix:
...
prevent selecting peers from topic not in peer topics
2019-07-21 23:14:08 +08:00
NIC619
b5c3420c16
Refactor gossipsub.join
2019-07-21 23:14:08 +08:00
NIC Lin
1e78c21eca
Merge pull request #181 from NIC619/fix_handle_unsubscribe
...
Fix: handle unsubscribe message
2019-07-21 20:09:51 +08:00
NIC619
36575e8c9b
Add check to prevent gossipsub re-join and re-leave
2019-07-19 19:59:48 +08:00
NIC619
89347be526
Prevent self re-unsubscription
2019-07-18 13:26:31 +08:00
NIC619
f25d97fbd3
Prevent self re-subscription
2019-07-15 16:32:05 +08:00
NIC619
6d9ec7a9c5
Handle the unsubscribe case
2019-07-15 16:28:29 +08:00
mhchia
31cd520076
Add the missing __init__.py in pb
2019-07-11 17:50:36 +08:00
Robert Zajac
9052e8f8bd
The Gossipsub PR ( #162 )
...
* Add handle_rpc call to pubsub
* Scaffold gossipsub functions
* Add timer
* Implement most of mesh construction
* Implement emit and handle
* Implement fanout heartbeat
* Refactor emit
* some gossipsub cleanup and test
* minor lint stuff, more to come
* Implement publish
* Fix comment
* Modify pubsub/gossipsub so that floodsub tests pass using gossipsub router
* Add floodsub tests to gossipsub
* Handle case where select_from_minus, num_to_select > size(pool-minus)
* Add topic membership
* Implement handle ihave
* Implement most of iwant
* Add mcache.add and comments
* Refactor handle_ihave
* Implement stream write in handle_iwant
* Implement gossip heartbeat
* unresolved vars
* initial mcache code
* documenting mcache
* writing test/debugging mcache
* finished mcache test and debugged
* Make gossipsub backward compatibility its own file
* remove mcache prints
* DEBUGGING
* Add sender_peer_id to handle_rpc to get gossip test passing
* Modify gossipsub to make fanout work
* fanout maintenance test
* debugging gsub GOSSIP
* DEBUGGING
* debugged sender seen cachce
* adding lru, removing prints
* pylint cleanup
* Fix github comments in PR
* minor floodsub possible bugfix
2019-05-06 23:44:13 -04:00
zixuanzh
d04798ce7c
lru cache seen_messages
2019-04-05 21:46:03 -04:00
Stuckinaboot
686c55b09c
Remove unnecessary print #146
2019-04-05 17:38:29 -04:00
Stuckinaboot
feaa393c5f
Fix seen messages bug
2019-04-03 23:32:03 -04:00
Stuckinaboot
9d16aa834d
Modify pubsub to have seen message check incorporate seqno and node id
2019-04-03 23:32:03 -04:00
Stuckinaboot
f6299c7dee
Add priority queues to handle seqno
2019-04-03 23:32:03 -04:00
zixuanzh
225bd390df
add source to rpc.proto
2019-04-03 14:08:05 -04:00
zixuanzh
0238dff217
remove unused code
2019-04-02 21:17:48 -04:00
zixuanzh
41d1aae55b
clean up
2019-04-01 16:55:44 -04:00
zixuanzh
6eb070b78e
fix all tests
2019-04-01 16:23:20 -04:00
zixuanzh
89a19a9213
reworked floodsub logic
2019-03-31 22:16:28 -04:00
zixuanzh
971dbe1a96
fix encoding issue
2019-03-30 19:30:58 -04:00
zixuanzh
f5af4b9016
remove message.py
2019-03-30 18:49:50 -04:00
zixuanzh
aec783b843
reworked subscribe unsubsrcibe
2019-03-30 17:59:08 -04:00
Alex Haynes
bf17f424b3
RPC conversion progress
2019-03-29 16:23:30 -04:00
zixuanzh
3cfeccaf17
rewrote get_hello_packet
2019-03-28 15:25:33 -04:00
zixuanzh
81d121a029
update from to from_id in proto
2019-03-28 15:23:56 -04:00
zixuanzh
1e8d93fcf6
add generated rpc code
2019-03-28 09:55:14 -04:00
