Commit Graph

75 Commits

Author SHA1 Message Date
Łukasz Magiera
a10c014ba6
Merge pull request #7398 from ChainSafe/libp2p-pubsub-tracer
Lotus extended pubsub tracer
2022-12-08 12:14:56 +01:00
Łukasz Magiera
2086b219d2 Don't use go-libp2p-core 2022-08-25 14:20:41 -04:00
Łukasz Magiera
05cdeb80c3 chore: remove redundant import prefixes 2022-06-15 12:06:22 +02:00
gammazero
eedcf910eb change scoring based on review 2022-02-10 10:53:07 -08:00
gammazero
b72cd90c19 Add indexer message scoring 2022-02-10 09:21:21 -08:00
Aarsh Shah
4691b2b809 changes to the indexer message relay PR 2022-02-04 12:15:01 +04:00
gammazero
c084130d3e Lotus chain nodes relay indexer pubsub messages
Content providers announce the availability of indexer data using gossip pubsub.  The content providers are not connected directly to indexers, so the pubsub messages are relayed to indexers via chain nodes. This PR makes chain nodes relay gossip pubsub messages, on the /indexer/ingest/<netname> topic.
2022-02-03 14:56:21 -08:00
Matija Petrunic
59040d4419 Trace reject messages in pubsub 2021-11-10 13:45:40 +01:00
Mak Muftic
30fc2387be Merge branch 'mpetrun5/lotus-extended-tracer' of github.com:ChainSafe/lotus into mpetrun5/lotus-extended-tracer 2021-09-24 14:16:31 +02:00
Mak Muftic
9332b9f399 Change json config naming 2021-09-24 13:53:31 +02:00
Mak Muftic
4438c4bd87 Move index name to config only and add default value 2021-09-24 13:43:25 +02:00
Matija Petrunic
0c390d12f7 Append source auth flag to lotus tracer event 2021-09-21 12:54:07 +02:00
Matija Petrunic
941a0f7153 Update peer score tracker creation to include lotus tracer 2021-09-16 16:31:36 +02:00
Matija Petrunic
9cdc5261c4 Fix lotus tracer being nil when remote tracer is not configured 2021-09-16 15:53:39 +02:00
Matija Petrunic
d067bc9f01 Move creating and opening file to json transport constructor 2021-09-16 15:22:18 +02:00
Matija Petrunic
e2206147cc Add source auth token to lotus traces 2021-09-16 12:21:57 +02:00
Mak Muftic
c25a5e06cf Use config string for elasticsearch client 2021-09-16 12:15:42 +02:00
Mak Muftic
add13c2646 Code cleanup 2021-09-15 16:05:44 +02:00
Mak Muftic
707faf57b5 Code cleanup 2021-09-15 15:11:34 +02:00
Mak Muftic
e20cd0ef27 Propagate error on creating transport 2021-09-15 14:58:36 +02:00
Mak Muftic
cf06096565 Fix tracer initialization 2021-09-15 14:54:20 +02:00
Mak Muftic
bb85ca031d Add elasticsearch transport 2021-09-15 14:50:27 +02:00
Matija Petrunic
8e6a01de6d Add configuration in pubsub to trace locally to json file 2021-09-15 13:40:54 +02:00
Matija Petrunic
b1dafd81b8 Add peer score tracing on pubsub peer score inspect 2021-08-30 14:49:10 +02:00
Matija Petrunic
99fbd7039e Update pubsub tracking to trace from lotus and lp2p tracers 2021-08-30 14:38:15 +02:00
vyzo
ed61642b3a
implement NodeStatus API
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2021-05-07 15:30:04 +02:00
vyzo
64646de761 add configuration option for pubsub IPColocationWhitelist subnets 2021-03-06 20:05:32 +02:00
vyzo
7933cf094f allow all drand topics 2020-10-08 21:48:55 +03:00
vyzo
4cd73f1560 use subscription filter in pubsub 2020-10-08 21:40:36 +03:00
vyzo
de390749fc set pubsub IPColocationFactor to 5 2020-10-06 09:11:44 +03:00
Jakub Sztandera
c71e1adc93 Integrate multiple drand networks with pubsub
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-09-10 17:41:55 -04:00
Jakub Sztandera
64fa6fd9e5 Draw the rest of the owl
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-09-10 17:41:55 -04:00
vyzo
0d0dd250ee use faster decay for bootstrappers 2020-09-07 19:54:38 +03:00
vyzo
c616958557 specify topic delivery weights, with priority for blocks 2020-09-07 13:40:48 +03:00
vyzo
453ab95e54 enable pubsub RED 2020-09-07 13:40:48 +03:00
vyzo
1c27a0c1cf adjust gossipsub gossip factor 2020-09-04 22:04:48 +03:00
Łukasz Magiera
84a632787c
Merge pull request #3313 from filecoin-project/feat/mpool-balance-tracking
Message Pool Rudimentary Spam Protection Measures
2020-08-28 22:35:30 +02:00
vyzo
20fbd66c90 tweak some pubsub parameters
- increase Bootstapp prune backoff to 5min from the default 1min
- reduce opportunistic graft threshold to 3.5 to account for low peer scores
2020-08-27 21:12:38 +03:00
vyzo
bedbdcaf13 give some score weight to the messages topic 2020-08-26 15:14:15 +03:00
vyzo
d1718369a1
Merge pull request #3205 from filecoin-project/fix/update-pubsub
update pubsub and bump behaviour penalty threshold to 6
2020-08-20 23:37:17 +03:00
vyzo
896edfe072 pubsub metrics for RPCs 2020-08-20 23:14:32 +03:00
vyzo
de05120e69 increase behaviour penalty threshold to 6 2020-08-20 22:32:41 +03:00
vyzo
6193f4e062 pubsub: increase gossip history length to 10 heartbeats 2020-08-20 18:09:17 +03:00
vyzo
98d6d25c74 pubsub: set behaviour penalty threshold, increase IWANT follow up time to 5s 2020-08-20 18:08:02 +03:00
vyzo
6c5a91735a fix drand topic first message delivery cap 2020-08-19 18:45:31 +03:00
vyzo
8cf9595d35 collect pubsub metrics through the tracer 2020-08-17 10:46:20 +03:00
vyzo
1649c32325 pubsub: only trace message for the blocks topic 2020-07-31 10:15:21 +03:00
Yusef Napora
b448de422e improve DrandConfig dependency injection 2020-06-23 16:01:10 -04:00
Jakub Sztandera
7762cd0a68
Assign positive scores to drand bootstrappers
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-06-08 11:34:46 +02:00
Jakub Sztandera
e91cc9cd08
Add drand topic scores
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-06-08 11:34:46 +02:00