Commit Graph

54 Commits

Author SHA1 Message Date
gammazero
eedcf910eb change scoring based on review 2022-02-10 10:53:07 -08:00
gammazero
b72cd90c19 Add indexer message scoring 2022-02-10 09:21:21 -08:00
Aarsh Shah
4691b2b809 changes to the indexer message relay PR 2022-02-04 12:15:01 +04:00
gammazero
c084130d3e Lotus chain nodes relay indexer pubsub messages
Content providers announce the availability of indexer data using gossip pubsub.  The content providers are not connected directly to indexers, so the pubsub messages are relayed to indexers via chain nodes. This PR makes chain nodes relay gossip pubsub messages, on the /indexer/ingest/<netname> topic.
2022-02-03 14:56:21 -08:00
vyzo
ed61642b3a
implement NodeStatus API
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2021-05-07 15:30:04 +02:00
vyzo
64646de761 add configuration option for pubsub IPColocationWhitelist subnets 2021-03-06 20:05:32 +02:00
vyzo
7933cf094f allow all drand topics 2020-10-08 21:48:55 +03:00
vyzo
4cd73f1560 use subscription filter in pubsub 2020-10-08 21:40:36 +03:00
vyzo
de390749fc set pubsub IPColocationFactor to 5 2020-10-06 09:11:44 +03:00
Jakub Sztandera
c71e1adc93 Integrate multiple drand networks with pubsub
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-09-10 17:41:55 -04:00
Jakub Sztandera
64fa6fd9e5 Draw the rest of the owl
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-09-10 17:41:55 -04:00
vyzo
0d0dd250ee use faster decay for bootstrappers 2020-09-07 19:54:38 +03:00
vyzo
c616958557 specify topic delivery weights, with priority for blocks 2020-09-07 13:40:48 +03:00
vyzo
453ab95e54 enable pubsub RED 2020-09-07 13:40:48 +03:00
vyzo
1c27a0c1cf adjust gossipsub gossip factor 2020-09-04 22:04:48 +03:00
Łukasz Magiera
84a632787c
Merge pull request #3313 from filecoin-project/feat/mpool-balance-tracking
Message Pool Rudimentary Spam Protection Measures
2020-08-28 22:35:30 +02:00
vyzo
20fbd66c90 tweak some pubsub parameters
- increase Bootstapp prune backoff to 5min from the default 1min
- reduce opportunistic graft threshold to 3.5 to account for low peer scores
2020-08-27 21:12:38 +03:00
vyzo
bedbdcaf13 give some score weight to the messages topic 2020-08-26 15:14:15 +03:00
vyzo
d1718369a1
Merge pull request #3205 from filecoin-project/fix/update-pubsub
update pubsub and bump behaviour penalty threshold to 6
2020-08-20 23:37:17 +03:00
vyzo
896edfe072 pubsub metrics for RPCs 2020-08-20 23:14:32 +03:00
vyzo
de05120e69 increase behaviour penalty threshold to 6 2020-08-20 22:32:41 +03:00
vyzo
6193f4e062 pubsub: increase gossip history length to 10 heartbeats 2020-08-20 18:09:17 +03:00
vyzo
98d6d25c74 pubsub: set behaviour penalty threshold, increase IWANT follow up time to 5s 2020-08-20 18:08:02 +03:00
vyzo
6c5a91735a fix drand topic first message delivery cap 2020-08-19 18:45:31 +03:00
vyzo
8cf9595d35 collect pubsub metrics through the tracer 2020-08-17 10:46:20 +03:00
vyzo
1649c32325 pubsub: only trace message for the blocks topic 2020-07-31 10:15:21 +03:00
Yusef Napora
b448de422e improve DrandConfig dependency injection 2020-06-23 16:01:10 -04:00
Jakub Sztandera
7762cd0a68
Assign positive scores to drand bootstrappers
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-06-08 11:34:46 +02:00
Jakub Sztandera
e91cc9cd08
Add drand topic scores
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-06-08 11:34:46 +02:00
Jakub Sztandera
7bee5b3abc
Merge remote-tracking branch 'origin/master' into next
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-06-05 00:33:43 +02:00
vyzo
f210a6e91a pubsub: set Dout parameter to 3 (from the default of 2)
we are using a higher D value than the default, so this can be safely increased.
2020-06-04 00:03:31 +03:00
Jakub Sztandera
186fd4da74
Add lotus net scores for pubsub score visibility
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-06-03 03:13:49 +02:00
Jakub Sztandera
002d021eb7
Enable HashMsgId
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-05-29 17:55:24 +02:00
vyzo
5531f27798 sink the FirstMessageDeliveries boost for the messages topic 2020-05-22 17:25:56 +03:00
vyzo
d597c3fb0d increase OpportunisticGraftThreshold to 5 2020-05-21 14:38:11 +03:00
vyzo
0cc8446a79 configure Dout=0 for bootstrappers, turn off Mesh Failure Penalty for messages as well 2020-05-21 12:11:22 +03:00
Whyrusleeping
70657e35ba
Merge pull request #1708 from filecoin-project/feat/block-validator
Improved pubsub block validator
2020-05-15 11:26:26 -07:00
vyzo
dbe2a1e2cd turn off Mesh Delivery Failure penalty 2020-05-15 12:50:20 +03:00
vyzo
b032d3524b configure behaviour penalty for gsv1.1 2020-05-14 20:48:19 +03:00
Jeromy
d3eb808ff4 add profile for bootstrappers 2020-05-14 09:27:07 -07:00
vyzo
e3f6e586ee use blake2b hash as the message ID function 2020-05-04 19:34:30 +03:00
vyzo
805d07bca6 turn off the mesh in bootstrappers 2020-05-04 19:04:24 +03:00
vyzo
112aca7896 pubsub-specific configuration 2020-05-04 18:30:54 +03:00
vyzo
43aca717d1 gossipsubv1.1: tweak score parameters 2020-04-29 23:15:29 +03:00
vyzo
7de882b4d0 gossipsubv1.1: use score parameter helpers 2020-04-29 22:50:51 +03:00
vyzo
f8f6e28985 fix linter complaint 2020-04-29 19:01:45 +03:00
vyzo
9570ebfe0a fix comparison logic for bootstrap peers 2020-04-29 18:56:58 +03:00
vyzo
667fb17b43 gossipsubv1.1: configure larger overlay D params 2020-04-29 17:09:39 +03:00
vyzo
7d7c83ef79 gossipsubv1.1: configure scores for bootstrapper PX 2020-04-29 17:03:41 +03:00
vyzo
6b56652768 gossipsubv1.1: score parameters and flood publishing 2020-04-29 16:41:44 +03:00