Commit Graph

159 Commits

Author SHA1 Message Date
Kevin Mai-Husan Chia
c0e253a524
Update tests/pubsub/conftest.py
Co-Authored-By: NIC Lin <twedusuck@gmail.com>
2019-07-31 16:07:48 +08:00
Kevin Mai-Husan Chia
3bb63612a9
Update tests/pubsub/conftest.py
Co-Authored-By: NIC Lin <twedusuck@gmail.com>
2019-07-31 16:07:04 +08:00
mhchia
9683d5e8ac
Add tests for Pubsub
- `test_handle_subscription`
- `test_handle_talk`
- `test_message_all_peers`
2019-07-31 14:15:11 +08:00
mhchia
037b95252d
Add tests for Pubsub
- `test_get_hello_packet`
- `test_continuously_read_stream`
- `test_publish`
- `test_push_msg`
2019-07-31 14:15:10 +08:00
mhchia
550289a439
Combine test_subscription.py to test_pubsub.py
And add a bunch of tests for pubsub
2019-07-31 14:15:10 +08:00
mhchia
96563c0d84
Add fixtures for pubsub and router
And a starting `test_pubsub.py`
2019-07-31 14:14:13 +08:00
NIC619
f2de986c74
Add type hints to peer folder 2019-07-30 16:24:51 +08:00
mhchia
f02d38c0ee
Reflect PR feedback
* Rename `src` to `msg_forwarder` in pubsub/floodsub/gossipsub
* Rename Variables
* Sort imports
* Clean up
2019-07-29 12:09:35 +08:00
mhchia
c028aef2de
Fix all tests
- Dedup `perform_test_from_obj` and the test cases used in both
`test_floodsub` and `test_gossipsub_backward_compatibility.py`.
Therefore, they are put in the standalone file
`tests/pubsub/floodsub_integration_test_settings.py`. The functions
and testcases are imported from there then.
- IMO still need a refactor on the tests. There are still some duplicate
code.
2019-07-27 11:49:03 +08:00
mhchia
65aedcb25a
Fix several tests 2019-07-26 18:35:25 +08:00
mhchia
035d08b8bd
Fix test_floodsub.py 2019-07-25 23:11:27 +08:00
mhchia
dadcf8138e
Fix the tests according to pubsub.Publish
And refactored a bit.
2019-07-25 16:58:00 +08:00
mhchia
cae4f34034
Refactor floodsub.publish
Passed the first test of floodsub
2019-07-25 14:08:16 +08:00
NIC619
b0b4ddd0ca
Fix test_handle_prune 2019-07-24 11:35:14 +08:00
NIC619
99eabe49eb
Add handle_prune test 2019-07-23 23:00:43 +08:00
NIC619
42093e40ec
Add handle_graft test 2019-07-23 22:53:01 +08:00
NIC619
0cc8a205fb
Fix test and reduce number of nodes in test_join 2019-07-23 17:28:46 +08:00
NIC619
c0a3af69e0
Apply PR feedback:
Check that node is in mesh peer's mesh after subscribe
2019-07-23 16:45:54 +08:00
NIC Lin
042e0ac916
Update tests/pubsub/test_gossipsub.py
Co-Authored-By: Kevin Mai-Husan Chia <mhchia@users.noreply.github.com>
2019-07-23 16:37:41 +08:00
NIC Lin
3c3a9ac90b
Update tests/pubsub/test_gossipsub.py
Co-Authored-By: Kevin Mai-Husan Chia <mhchia@users.noreply.github.com>
2019-07-23 16:37:01 +08:00
NIC619
cdbeb63879
Add test 2019-07-22 19:28:12 +08:00
NIC619
14ee44c549
Lint test and add cleanup to the end 2019-07-21 23:16:42 +08:00
NIC619
2c1c8dc8cf
Add gossipsub.join test 2019-07-21 23:16:41 +08:00
NIC619
a26c7783d6
Add one_to_all_connect 2019-07-21 23:14:08 +08:00
NIC Lin
1e78c21eca
Merge pull request #181 from NIC619/fix_handle_unsubscribe
Fix: handle unsubscribe message
2019-07-21 20:09:51 +08:00
mhchia
a2d1aadf25
Add test for checking p2p code 2019-07-20 22:43:32 +08:00
mhchia
d3eb68fa50
Increase coverage 2019-07-20 22:43:32 +08:00
mhchia
73125b99b0
Fix the error due to the breaking change
In multiaddr, `split` is moved to `Multiaddr`'s method.
2019-07-20 22:43:31 +08:00
NIC619
29aae7dca4
Add gossipsub join/leave test 2019-07-19 20:16:53 +08:00
NIC619
183eee0e85
Add self subscription tests 2019-07-18 13:39:22 +08:00
Stuckinaboot
a4529d827d Modify peer_id str 2019-05-22 11:37:07 -04:00
Stuckinaboot
4b40339b63 Update peerid tests for longer peerids 2019-05-22 11:37:07 -04:00
ZX
49384ad3d7
Merge pull request #159 from libp2p/security-dev
Implement security
2019-05-07 09:56:19 -04:00
Robert Zajac
9052e8f8bd
The Gossipsub PR (#162)
* Add handle_rpc call to pubsub

* Scaffold gossipsub functions

* Add timer

* Implement most of mesh construction

* Implement emit and handle

* Implement fanout heartbeat

* Refactor emit

* some gossipsub cleanup and test

* minor lint stuff, more to come

* Implement publish

* Fix comment

* Modify pubsub/gossipsub so that floodsub tests pass using gossipsub router

* Add floodsub tests to gossipsub

* Handle case where select_from_minus, num_to_select > size(pool-minus)

* Add topic membership

* Implement handle ihave

* Implement most of iwant

* Add mcache.add and comments

* Refactor handle_ihave

* Implement stream write in handle_iwant

* Implement gossip heartbeat

* unresolved vars

* initial mcache code

* documenting mcache

* writing test/debugging mcache

* finished mcache test and debugged

* Make gossipsub backward compatibility its own file

* remove mcache prints

* DEBUGGING

* Add sender_peer_id to handle_rpc to get gossip test passing

* Modify gossipsub to make fanout work

* fanout maintenance test

* debugging gsub GOSSIP

* DEBUGGING

* debugged sender seen cachce

* adding lru, removing prints

* pylint cleanup

* Fix github comments in PR

* minor floodsub possible bugfix
2019-05-06 23:44:13 -04:00
Alex Haynes
eea6a9fda7
Merge pull request #157 from libp2p/router-refactor
Refactored RoutedHost into Injected Router
2019-05-05 14:45:22 -04:00
stuckinaboot
ff500e6d8e
Merge branch 'master' into security-dev 2019-05-01 17:26:23 -04:00
Stuckinaboot
144dc8d854 Move simple security to libp2p/security 2019-05-01 17:21:11 -04:00
Stuckinaboot
515a461172 Add more security tests 2019-05-01 17:13:01 -04:00
Stuckinaboot
4333c2d061 Fix linting issues' 2019-05-01 13:54:19 -04:00
Stuckinaboot
e555f17a7b Fix bug in security multistream 2019-04-30 16:07:26 -04:00
Stuckinaboot
a0bd6e5eb0 Add simple security with communication test 2019-04-30 03:27:06 -04:00
Stuckinaboot
f59f27d4d0 Integrate security selectin into libp2p system 2019-04-30 03:09:05 -04:00
Stuckinaboot
999e64854c Add security tests 2019-04-29 18:05:49 -04:00
zixuanzh
db7be2d561 add simple test 2019-04-28 17:57:57 -04:00
Alex Haynes
2efc0d3b5c updated peerinfo encoding stored in DHT 2019-04-28 17:38:40 -04:00
zixuanzh
3b1a3fb198 fix tests 2019-04-28 13:58:57 -04:00
Alex Haynes
fdaa4f56b9 working on adding tests 2019-04-27 21:59:25 -04:00
Alex Haynes
e7424d3673 added RoutedHost and updated new_node to support it 2019-04-20 17:35:05 -04:00
Alex Haynes
1228b11bc9
Update test_basic.py 2019-04-17 21:44:45 -04:00
zixuanzh
9906e23b55 fixed linting 2019-04-17 21:39:30 -04:00
ZX
14da7d49fe
Merge branch 'master' into peer_routing 2019-04-17 21:22:37 -04:00
zixuanzh
3c6ad886bb add dependencies 2019-04-17 21:21:17 -04:00
Alex Haynes
d5c7cc7cb7 added changes from future commits to last passing bmuller commit 2019-04-17 20:21:59 -04:00
zixuanzh
7a298adc33 add simple lru test 2019-04-05 21:46:18 -04:00
Stuckinaboot
b4aa64bc39 Change >I to >Q for 64-bit big endian int 2019-04-05 17:30:35 -04:00
Stuckinaboot
3c0fca8979 Remove prints 2019-04-04 17:10:41 -04:00
Stuckinaboot
22e503a260 Add test for ring topology multiple messages from two origins 2019-04-03 23:32:03 -04:00
Stuckinaboot
fc78928037 Add test for multiple messages from two origins 2019-04-03 23:32:03 -04:00
Stuckinaboot
211d6f6860 Add dummy node test 2019-04-03 23:32:03 -04:00
Stuckinaboot
9d16aa834d Modify pubsub to have seen message check incorporate seqno and node id 2019-04-03 23:32:03 -04:00
Stuckinaboot
c2b5389362 Adjust floodsub tests for new seqno util 2019-04-03 23:32:03 -04:00
zixuanzh
0238dff217 remove unused code 2019-04-02 21:17:48 -04:00
zixuanzh
41d1aae55b clean up 2019-04-01 16:55:44 -04:00
zixuanzh
6eb070b78e fix all tests 2019-04-01 16:23:20 -04:00
zixuanzh
2e5e7e3c10 remove message from test dummy 2019-04-01 15:04:20 -04:00
zixuanzh
de6bc011f0 update dummy account node 2019-03-31 22:16:49 -04:00
zixuanzh
971dbe1a96 fix encoding issue 2019-03-30 19:30:58 -04:00
zixuanzh
ec7bc45a58 remove Message from dummy account 2019-03-30 19:12:31 -04:00
Christophe de Carvalho
c5289952ee
add routing interfaces 2019-03-26 20:44:01 +01:00
Christophe de Carvalho
2d1b9a03d1
clean up 2019-03-26 20:20:14 +01:00
Christophe de Carvalho
cd8cb5c443
refactoring of the code to implement IAdvertiser and IDiscoverer 2019-03-26 20:16:16 +01:00
stuckinaboot
57077cd3b4 [WIP] PubSub and FloodSub development (#133)
* Add notifee interface

* Add notify function to network interface

* Implement notify feature

* Add tests for notify

* Make notifee functions all async

* Fix linting issue

* Fix linting issue

* Scaffold pubsub router interface

* Scaffold pubsub directory

* Store peer_id in muxed connection

* Implement pubsub notifee

* Remove outdated files

* Implement pubsub first attempt

* Prepare pubsub for floodsub

* Add mplex conn to net stream and add conn in notify tests

* Implement floodsub

* Use NetStream in generic protocol handler

* Debugging async issues

* Modify test to perform proper assert. Test passes

* Remove callbacks. Reduce sleep time

* Add simple three node test

* Clean up code. Add message classes

* Add test for two topics

* Add conn to net stream and conn tests

* Refactor test setup to remove duplicate code

* Fix linting issues

* Fix linting issue

* Fix linting issue

* Fix outstanding unrelated lint issue in multiselect_client

* Add connect function

* Remove debug prints

* Remove debug prints from floodsub

* Use MessageTalk in place of direct message breakdown

* Remove extra prints

* Remove outdated function

* Add message to queues for all topics in message

* Debugging

* Add message self delivery

* Increase read timeout to 5 to get pubsub tests passing

* Refactor testing helper func. Add tests

* Add tests and increase timeout to get tests passing

* Add dummy account demo scaffolding

* Attempt to use threads. Test fails

* Implement basic dummy node tests using threads

* Add generic testing function

* Add simple seven node tree test

* Add more complex seven node tree tests

* Add five node ring tests

* Remove unnecessary get_message_type func

* Add documentation to classes

* Add message id to messages

* Add documentation to test helper func

* Add docs to dummy account node helper func

* Add more docs to dummy account node test helper func

* fixed linting errors in floodsub

* small notify bugfix

* move pubsub into libp2p

* fixed pubsub linting

* fixing pubsub test failures

* linting
2019-03-23 13:52:02 -04:00
zixuanzh
d67aeb1974 fix linting issues 2019-03-17 21:30:56 -04:00
zixuanzh
0d15126ffc add test for listen event 2019-03-17 21:15:14 -04:00
zixuanzh
1886258fbf fix existing tests 2019-03-17 19:33:40 -04:00
zixuanzh
72a8d55faa refactor host setup helper 2019-03-17 19:33:10 -04:00
Stuckinaboot
d42a0d7e9f Add additional initiator and non-initiator notifee tests 2019-03-15 11:22:20 -04:00
Stuckinaboot
01099e9f2c Add opened_stream call for non-initiator 2019-03-15 11:22:20 -04:00
Stuckinaboot
a46779918f Fix linting issue 2019-03-15 11:22:20 -04:00
Stuckinaboot
0c60e28150 Fix linting issues 2019-03-15 11:22:20 -04:00
Stuckinaboot
2eb8382280 Refactor test setup to remove duplicate code 2019-03-15 11:22:20 -04:00
Stuckinaboot
22d6c97ef3 Add conn to net stream and conn tests 2019-03-15 11:22:20 -04:00
Stuckinaboot
26dd385c95 Fix linting issue 2019-03-15 11:22:20 -04:00
Stuckinaboot
3e64520506 Make notifee functions all async 2019-03-15 11:22:20 -04:00
Stuckinaboot
7a8878411f Add tests for notify 2019-03-15 11:22:20 -04:00
Robert Zajac
82840b5e6c
Stream rearchitecture (#126)
* Add generic protocol handler

* Add generic protocol handler to stream muxing pipeline

* Modify conn_handler to only deal with connections

* mplex accept stream architecture changes

* Add create generic protocol handler

* Fix minor bugs

* who would win 4 devs or one not

* Debugging

* rearch with handle_incoming infinite loop, seems to work, needs cleanup"

* passing linting, still needs cleanup

* fixing linting again; code still needs cleanup

* fixing tests; code still needs cleanup

* adding test cleanup and task cleanup, removing prints

* linting, and cleanup complete

* storing connections based on peer id

* remove dead code

* remove unnecessary peer_id
2019-02-24 20:58:23 -05:00
Tran Ly Vu
ebd5ddc21f Update unit tests from peer package (#103)
* Update more test for peerid.py

Signed-off-by: Tran Ly Vu <tranly.vu@accellion.com>

* Update more tests for peerid.py

Signed-off-by: Tran Ly Vu <tranly.vu@accellion.com>

* Update more tests for peerid.py

Signed-off-by: Tran Ly Vu <tranly.vu@accellion.com>

* Update more unit tests

Signed-off-by: Tran Ly Vu <tranly.vu@accellion.com>

* Update more unit tests

Signed-off-by: Tran Ly Vu <tranly.vu@accellion.com>

* FIx travis failaure

Signed-off-by: Tran Ly Vu <tranly.vu@accellion.com>

* Fix travis failaure

Signed-off-by: Tran Ly Vu <tranly.vu@accellion.com>

* Update indent-string to tab

Signed-off-by: Tran Ly Vu <tranly.vu@accellion.com>

* Fix lines that too long

Signed-off-by: Tran Ly Vu <tranly.vu@accellion.com>

* Convert indent back to space

Signed-off-by: Tran Ly Vu <tranly.vu@accellion.com>

* Fix lines that too long

Signed-off-by: Tran Ly Vu <tranly.vu@accellion.com>

* Fix lines that too long

Signed-off-by: Tran Ly Vu <tranly.vu@accellion.com>

* Fix lines that too long

Signed-off-by: Tran Ly Vu <tranly.vu@accellion.com>

* Fix lines that too long

Signed-off-by: Tran Ly Vu <tranly.vu@accellion.com>

* Disable W0212 and E1120

Signed-off-by: Tran Ly Vu <tranly.vu@accellion.com>

* Fix lines that too long

Signed-off-by: Tran Ly Vu <tranly.vu@accellion.com>

* Fix failure from travis

Signed-off-by: Tran Ly Vu <tranly.vu@accellion.com>

* Fix failure from travis

Signed-off-by: Tran Ly Vu <tranly.vu@accellion.com>

* Remove W0212 and E1120

Signed-off-by: Tran Ly Vu <vutransingapore@gmail.com>

* Fix packages import

Signed-off-by: Tran Ly Vu <vutransingapore@gmail.com>

* Add pylint dsiable

Signed-off-by: Tran Ly Vu <vutransingapore@gmail.com>
2019-01-12 11:31:08 -05:00
Alexander Koshkin
ce6ddb27a9 Migrate to new project structure. 2019-01-09 21:38:56 +03:00
Robert Zajac
4c0cd8730f updating to proper multiaddr and changing to p2p 2018-12-28 01:56:00 -05:00
Christophe de Carvalho Pereira Martins
97e554e265
make the chat example a runnable test
fixes #71
2018-12-21 09:03:20 +01:00
Christophe de Carvalho Pereira Martins
2a324c0076
don't manually assign port during test
fixes #89
instead of saving the multiaddr received in the listen method of the
tcp transport class, read what the service is actually listening on
this allow to use 0 as port and let the OS choose a free port for us
2018-12-07 22:28:07 +02:00
Robert Zajac
803999310a refactoring stream IDs 2018-11-29 13:42:05 -05:00
Christophe de Carvalho
611de28aca Add basic support for multiaddr addresses and improvement around peer id (#75)
* Improved peer ID construction and usage

* peer id object is directly passed to the network

no need to cast from a string to an ID

* don't base64 encode the peer id when loading from public key

* use proper multiaddr address

- keep multiaddr object into peerstore instead of string
- update network code to use new multiaddr lib
- update tests and example

* don't instanciate peerstore object in constructor

This has side effect where the same peerstore
is used for different instance of Libp2p

* add connect method to basic_host

* use zaibon's fork of sbuss/py-multiaddr

* lint
2018-11-29 10:06:40 -05:00
stuckinaboot
7fa674dee2
Protocol muxing (#82)
* Implement protocol muxing

* Integrate protocol muxing into new stream and listen's conn handler

* Fix bugs in protocol muxing

* Remove blank line

* Add comments and fix linting issues

* Fix order of parameters to select_one_of to match interface

* Use array of protocol ids in new stream instead of protocol id

* Add basic protocol muxer tests

* Add todo

* Modify new stream to take in protocol ids

* Add check to all tests to ensure protocol id is saved to net stream properly

* Lint tests

* Fix lint issues

* Add todo

* Modify port numbers in tests

* Fix linting issues

* Add more documentation to functions

* Add docs describing classes and fix indent error
2018-11-28 13:51:50 -05:00
Alex Haynes
f8963d628c
Switch message buffers to blocking queues and update reading logic (#83)
* working on blocking queues

* my mplex and delete muxer

* progress

* dont understand error

* tests passing

* cleaning up

* working on reading messages

* implmented varint reading from stream, rewrote message reading logic

* linting error in utils fix

* Update tcp.py

* removed unused vars

* removed prints

* added doc strings
2018-11-28 12:58:16 -05:00
Alex Haynes
6ff97ebb3e
added double response test (#80)
* added double response test

* moved to existing file
2018-11-26 23:09:16 -05:00
ZX
8bcffb67cb WIP CI Build Errors (#76)
* ignore TODO and kademlia

* remove unnecessary pass

* fixed swarm warnings

* fixed peerdata_interface warnings

* fixed peer warnings

* fixed rest of linting errors

* trying to fix last error

* fixed dup errors
2018-11-26 18:24:29 -05:00
zixuanzh
ff6fdccea4 refactor libp2p 2018-11-25 01:45:13 -05:00
Robert Zajac
276aa97f21
adding todo to connection test 2018-11-21 00:13:02 -05:00
zixuanzh
2569eac3a0 lint 2018-11-20 23:49:37 -05:00