gammazero
1dc6a2fea6
Add indexer pubsub message authentication and rate limiting
2022-02-08 02:53:25 -08:00
Aarsh Shah
e155eb9fa3
Merge pull request #8016 from filecoin-project/nonsense/add-fullnode-api
...
add indexProvider host to markets
2022-02-04 12:56:36 +04:00
Aarsh Shah
4691b2b809
changes to the indexer message relay PR
2022-02-04 12:15:01 +04:00
Aarsh Shah
3ecf478ff0
Merge pull request #8026 from gammazero/feat/cid-to-piece-idx
...
Lotus chain nodes relay indexer pubsub messages
2022-02-04 12:05:46 +04:00
gammazero
c084130d3e
Lotus chain nodes relay indexer pubsub messages
...
Content providers announce the availability of indexer data using gossip pubsub. The content providers are not connected directly to indexers, so the pubsub messages are relayed to indexers via chain nodes. This PR makes chain nodes relay gossip pubsub messages, on the /indexer/ingest/<netname> topic.
2022-02-03 14:56:21 -08:00
Will Scott
7247f8e41f
add net protect api methods
...
fix #8015
2022-02-03 17:24:49 +01:00
Anton Evangelatov
dde2ab59ae
fixup
2022-02-03 15:53:46 +01:00
Anton Evangelatov
595ad44ee7
refactor indexprovider libp2p host connection to fullnode with meshcreator
2022-02-03 15:44:18 +01:00
Masih H. Derkani
575e6add43
Rename IndexerProvider to IndexProvider and add more docs
...
Rename the config section corresponding to indexing to `IndexProvider`
for better readability.
Update existing docs for better clarity and add docs for config
parameters embedded from `index-provider` `Ingest` config library.
2022-02-03 13:10:47 +00:00
Masih H. Derkani
235377585d
Clarify the purpose of MaxSimultaneousTransfers config
...
Clarify the documentation of `MaxSimultaneousTransfers` to state that
the "transfer" refers to multihash syncing only and not the data itself.
2022-02-03 11:51:01 +00:00
Anton Evangelatov
faa3a79a5f
use NetAddrListener iface
2022-02-02 16:01:19 +01:00
Anton Evangelatov
2790cf35af
change fullnodeApi to listen addrs
2022-02-02 13:06:53 +01:00
Anton Evangelatov
f9b63c5f8c
add idxProvHost to StorageProvider
2022-02-02 13:03:41 +01:00
Anton Evangelatov
db5e4da268
add fullnodeApi to StorageProvider
2022-02-02 13:03:41 +01:00
Masih H. Derkani
5d72ebe0cc
Upgrade index-provider and update topic name
...
Update the topic name to be consistent with default
configured in storetheindex.
Upgrade to the latest `index-provider`.
2022-01-27 09:48:10 +00:00
Aarsh Shah
b8bf2af3e3
upgrade on master
2022-01-20 16:34:13 +04:00
Aarsh Shah
9ee940098d
Merge remote-tracking branch 'origin/master' into feat/cid-to-piece-idx
2022-01-20 16:21:48 +04:00
vyzo
73ec10a49e
close the rcmgr on shutdown
2022-01-20 11:47:39 +02:00
vyzo
325a4c0e5b
fix lint
2022-01-20 11:46:39 +02:00
vyzo
554848fe6b
add resource manager Net(Set)Limit api
2022-01-20 11:36:11 +02:00
vyzo
d05d5bcb70
add resource manager NetStat api
2022-01-20 11:36:11 +02:00
vyzo
8d3f98fe38
instantiate resource manager in DI
2022-01-20 11:36:11 +02:00
vyzo
826cdb2186
use the libp2p connmgr
2022-01-20 11:36:11 +02:00
hannahhoward
92d56d82f4
feat(deps): update markets stack
...
update go-fil-markets, go-data-transfer 1.13.0, go-graphsync 0.12.0
2022-01-14 17:21:04 -08:00
c r
da6752eccb
feat: #7747 sealing: Adding conf variable for capping number of concurrent unsealing jobs ( #7884 )
...
* adding the new variables- now time for logic
* putting parameters into right placeS
* adding unsealing throttle
* fixing linter issues
* removing one last thing...
2022-01-13 12:26:13 -06:00
Aarsh Shah
8459d75597
update index provider config
2022-01-13 16:15:43 +04:00
Aarsh Shah
b780a64ed9
send markets multiaddrs to the engine
2022-01-13 15:31:15 +04:00
Aarsh Shah
8c8652e7bb
add a new cli
2022-01-12 18:06:48 +04:00
Aarsh Shah
dec79c70a1
fix compilation
2022-01-12 15:03:46 +04:00
Aarsh Shah
21a8f71859
compiles
2022-01-12 14:59:09 +04:00
Aarsh Shah
edfc2c215c
Merge remote-tracking branch 'origin/main' into feat/cid-to-piece-idx
2022-01-12 12:48:54 +04:00
zenground0
33f2d24f54
Snap Deals Integration
...
- FSM handles the actual cc upgrade process including error states
- PoSting (winning and window) works over upgraded and upgrading sectors
- Integration test and changes to itest framework to reduce flakes
- Update CLI to handle new upgrade
- Update dependencies
2022-01-10 15:39:38 +05:30
hannahhoward
1078dff3a9
feat(storageminer): also list data transfers with no id
2021-12-22 13:41:56 -08:00
hannahhoward
8a923fb420
fix(storageminer): fix conditional
2021-12-22 13:41:56 -08:00
hannahhoward
177282d9f9
fix(storageminer): lint/mod-tidy/extra checks
2021-12-22 13:41:55 -08:00
hannahhoward
cddf63efe9
feat(storageminer): add api for transfer diagnostics
...
Add API + CLI for inspecting in depth diagnostics on graphsync transfers with a given peer
2021-12-22 13:41:29 -08:00
Aayush Rajasekaran
1bc987772c
Merge pull request #7818 from filecoin-project/asr/vm-nvfactor
...
Refactor: VM: Remove the NetworkVersionGetter
2021-12-21 12:19:53 -05:00
Aayush Rajasekaran
3f4eaa99d5
Refactor: State: Rename stmgr::GetNtwkVersion to GetNetworkVersion
2021-12-17 18:43:39 -05:00
Dirk McCormick
b1734f84b3
feat: retrieval ask CLI command
2021-12-17 15:55:12 +01:00
Łukasz Magiera
a4728d3c72
Merge pull request #7578 from filecoin-project/rvagg/SimultaneousTransfersForStoragePerClient
...
feat(graphsync): allow setting of per-peer incoming requests for miners
2021-12-17 14:27:15 +01:00
vyzo
dd327f0b22
plumb more contexts
2021-12-17 11:42:09 +02:00
Rod Vagg
9e7d9affbe
feat(graphsync): allow setting of per-peer incoming requests for miners
2021-12-17 15:04:16 +11:00
vyzo
22ce395130
fix some unit tests
2021-12-14 17:05:10 +02:00
vyzo
716b4a3b09
hook a great context in the sky to satisfy DI; sigh...
2021-12-14 16:57:09 +02:00
vyzo
eb48dc9b68
fix issues with new peerstore constructor signature in DI
2021-12-14 16:21:55 +02:00
vyzo
f157ac9b68
update for new ConnManager constructor
2021-12-14 15:30:29 +02:00
Dirk McCormick
a51b08e386
feat: add IndexerProvider AnnounceAddress config
2021-12-13 18:24:05 +01:00
Masih H. Derkani
6b7b9793ab
Set default index provider ingest config values
...
Set default values for index-provider ingest config.
Leave a TODO to use provider config APIs once defaults exposed.
Run `go mod tidy`
2021-12-13 14:44:56 +00:00
vyzo
84710cf27e
plumb more contexts in lotus
2021-12-13 14:26:59 +02:00
Aayush Rajasekaran
dfb65ed89f
Plumb contexts through
2021-12-11 17:04:00 -05:00
