cerc-io/lotus
16
0
Fork 0
Code Issues Pull Requests Packages Projects Releases 27 Wiki Activity
16,980 Commits 24 Branches 342 Tags 314 MiB
5b96496a8d
Commit Graph

1406 Commits

Author SHA1 Message Date
Łukasz Magiera
92e4caa151 Merge remote-tracking branch 'origin/master' into feat/post-worker 2022-03-21 12:09:47 +01:00
vyzo
7fea2e4d6c update go-libp2p to v0.18 2022-03-21 12:33:07 +02:00
Łukasz Magiera
6ddbe41376 Merge remote-tracking branch 'origin/master' into feat/post-worker 2022-03-18 10:54:44 +01:00
Jennifer Wang
3c252e1d87 bump the version to v1.15.1-rc1 2022-03-17 17:42:45 -04:00
koalacxr
7f26ce614b modify quantile imports error 2022-03-16 13:10:03 +08:00
Jennifer Wang
8a2a2d065d Merge branch 'releases' into jen/backport 2022-03-15 02:07:35 -04:00
Łukasz Magiera
135aef78d7 Merge remote-tracking branch 'origin/master' into feat/post-worker 2022-03-11 17:04:58 +01:00
vyzo
65e599fb8e update go-libp2p and go-libp2p-resource-manager 
- go-libp2p at v0.18.0-rc6, which includes fixes for some severe bugs in mplex
- go-libp2p-resource-manager at v0.1.5, which improves debug logging
 2022-03-10 18:20:11 +02:00
Łukasz Magiera
9c4f8254ee post workers: Fix build post-merge 2022-03-10 14:20:07 +01:00
hannahhoward
49742f8fdc feat(deps): update to graphsync v0.13.0 with 2.0 protocol 2022-03-09 18:06:35 +00:00
Łukasz Magiera
28d751b2e0 mod tidy 2022-03-03 14:21:28 +00:00
Masih H. Derkani
1bb65189af
Upgrade to go-path v0.2.1 and remove replace directive 
The dependency was used in the chain API. Integrated the new fetcher
factory.
 2022-03-03 13:29:32 +00:00
Masih H. Derkani
8cf6f24f4d
Upgrade go-fil-markets to include index provider metadata changes 
Upgrade to the latest `go-fil-markets` that integrates concrete
multicodec for the indexing metadata.
 2022-03-03 12:57:09 +00:00
Aayush
1bc1cd3366 Upgrade to go-fil-markets 1.19.2 2022-03-02 15:41:53 -05:00
Aayush
898f523162 Upgrade to go-data-transfer 1.14.1 2022-03-02 15:41:41 -05:00
Aayush
08bbfed825 Revert "go mod: go-libp2p@v0.18.0-rc1" 
This reverts commit 2fb5837a55.
 2022-03-02 15:39:24 -05:00
Aayush
04f2d3543b Revert "go mod: go-libp2p-resource-manager" 
This reverts commit c394fbdfc3.
 2022-03-02 15:39:23 -05:00
Aayush
11fc068cfe Revert "go mod: go-libp2p-resource-manager@v0.1.1" 
This reverts commit 62c0f35b5a.
 2022-03-02 15:39:19 -05:00
Aayush
f9f6f35b93 Revert "go mod: update go-libp2p-pubsub" 
This reverts commit aa599bfaf9.
 2022-03-02 15:39:19 -05:00
Aayush
581cb34b11 Revert "go mod: update go-yamux@v3.0.2" 
This reverts commit 83427c478f.
 2022-03-02 15:39:18 -05:00
Aayush
4968babb32 Revert "go mod: update go-libp2p-resource-manager@v0.1.2" 
This reverts commit 6260271b78.
 2022-03-02 15:39:17 -05:00
Aayush
a7e02f7207 Revert "update go-fil-markets@v0.19.0-rc1" 
This reverts commit 2e5474e864.
 2022-03-02 15:39:16 -05:00
Aayush
6dc696b745 Revert "feat: update to go-fil-markets v1.19.0" 
This reverts commit 8a47a71772.
 2022-03-02 15:29:25 -05:00
Aayush
2aab4d4f05 Revert "update go-libp2p to v0.18.0-rc2" 
This reverts commit 6e5f521463.
 2022-03-02 15:22:06 -05:00
Aayush
94678bacea Revert "update go-libp2p to v0.18.0-rc3" 
This reverts commit e78c4ab9b3.
 2022-03-02 15:21:31 -05:00
Aayush
7207740af4 Revert "update libp2p to v0.18.0-rc4" 
This reverts commit 80e9f76261.
 2022-03-02 15:21:10 -05:00
Aayush
5329f18938 Revert "update go-libp2p to v0.18.0-rc5" 
This reverts commit a575947294.
 2022-03-02 15:20:18 -05:00
Łukasz Magiera
a52b4b72e9 gomod: Use latest cbor-gen 2022-03-02 20:23:47 +01:00
Masih H. Derkani
444a2bf355
Integrate the latest index-provider with config to disable announcements 
Integrate the latest `index-provider` and reflect the changes to engine
configuration. Note that this commit disables announcements of indices
on the network by default as requested for initial merge to master.

Introduce dedicated index provider configuration parameters with
documentation and defaults that match the defaults in index-provider.

Re-generate code as needed.
 2022-03-02 13:45:09 +00:00
Masih H. Derkani
769b0f30ef
Address review comments 
- Add comment to clarify the reason for loop in testkit
- Trim common prefix in state printed in CLI commands for better
  readability
- Upgrade to a tagged release of `go-fil-markets` that includes indexing
  work; see: https://github.com/filecoin-project/go-fil-markets/pull/673
- Fix typo in CLI usage.
- Add comments to note that it is safe to use fx `OnStart` context when
  starting the provider engine.
- Fix string concatenation in error message formatting.
 2022-03-02 11:04:50 +00:00
zenground0
77a954c7c3 Merge branch 'master' into feat/cid-to-piece-idx 2022-02-28 12:57:11 -07:00
Jiaying Wang
b8eb4ddb0b
Merge pull request #8193 from filecoin-project/jen/v15 
chore: build: backport releases
 2022-02-25 21:13:42 -05:00
jennijuju
254f821564 get actor v7 (same commit as v7-rc1) 2022-02-25 21:03:46 -05:00
jennijuju
c6361b391c Merge branch 'releases' into jen/v15 2022-02-25 21:01:31 -05:00
Peter Rabbitson
3c366160bb Retract force-pushed v1.14.0 to work around stale gomod caches 2022-02-24 17:59:38 -05:00
Łukasz Magiera
7c2f653323
Merge pull request #8168 from filecoin-project/feat/ufs-selectors 
feat: market utils: Support unixfsnode in TraverseDag
 2022-02-23 22:35:24 +01:00
Masih H. Derkani
b802ddb848
Upgrade dependency to markets 2022-02-23 14:41:55 +00:00
Masih H. Derkani
c3b406c5c2
Update indexing and markets dependencies 
Update indexing dependencies to latest along with go-fil-markets
dependency, to the head of:
- https://github.com/filecoin-project/go-fil-markets/pull/673
 2022-02-23 14:10:38 +00:00
vyzo
a575947294 update go-libp2p to v0.18.0-rc5 2022-02-22 11:04:21 -05:00
vyzo
012cf96d60 update go-libp2p to v0.18.0-rc5 2022-02-22 12:19:26 +02:00
Łukasz Magiera
a05a462c8c market utils: Support unixfsnode in TraverseDag 2022-02-22 10:51:57 +01:00
Aarsh Shah
3fd83e9345 dagstore size bloating fix 2022-02-21 13:57:29 +04:00
Peter Rabbitson
9bb9bb5682 Retract force-pushed v1.14.0 to work around stale gomod caches 2022-02-19 16:25:18 +01:00
Aarsh Shah
e3f5b7c59f update dagstore top level index db 2022-02-18 14:00:01 +04:00
Masih H. Derkani
031bfaf120 Update to the head of go-fil-markets#673 
Update to the head of the PR that introduces indexing integration in
`go-fil-markets` so that failure to connect to full node is logged only
instead of crashing markets process.

Relates to:
 - https://github.com/filecoin-project/go-fil-markets/pull/673
 - https://github.com/filecoin-project/index-provider/issues/177
 2022-02-15 12:37:13 +00:00
vyzo
b260c849f7 deps: update go-libp2p-resource-manager to v0.1.4 2022-02-14 19:43:07 +02:00
Łukasz Magiera
a1098f6dc2 Cleanup go.mod 2022-02-10 17:37:09 -05:00
Łukasz Magiera
263de5b0c1 Use tagged specs-storage 2022-02-10 17:29:57 -05:00
Łukasz Magiera
212f5ddb4f wip FinalizeReplicaUpdate 2022-02-10 17:24:26 -05:00
Will
296eab3045
Merge pull request #8045 from gammazero/feat/cid-to-piece-idx 
Add indexer pubsub message authentication and rate limiting
 2022-02-10 13:49:58 -08:00
Masih H. Derkani
f0accce286 Upgrade index-provider and go-fil-markets to latest 
See: https://github.com/filecoin-project/go-fil-markets/pull/680
 2022-02-10 14:04:11 +00:00
gammazero
9481fa0a4b Use new indexer pubsub message encoding 2022-02-09 16:40:27 -08:00
Łukasz Magiera
e7038d286d
Merge pull request #8018 from filecoin-project/feat/fru 
FinalizeReplicaUpdate
 2022-02-09 17:40:47 +00:00
Łukasz Magiera
67e3f182f5 Use tagged specs-storage 2022-02-09 11:28:48 +01:00
Aayush Rajasekaran
316836f43b deps: update go-paramfetch to v0.0.4 2022-02-08 12:00:55 -05:00
Aayush Rajasekaran
9df19ae436 deps: update go-paramfetch to v0.0.4 2022-02-08 12:00:19 -05:00
Łukasz Magiera
142ba6660a wip FinalizeReplicaUpdate 2022-02-08 17:22:41 +01:00
Masih H. Derkani
cc61650f86 Upgrade to latest index-provider and set miner ID as extra gossip data 
Upgrade to the latest `index-provider` which upgrades the go-legs
protocol to allow the inclusion of extra gossip data that may be used
for gossip validation purposes. In the case of lotus gossip message
validators the miner ID is used to verify the sender's peer ID on chain.

Relates to:
- https://github.com/filecoin-project/lotus/pull/8045
 2022-02-08 14:32:03 +00:00
vyzo
80e9f76261 update libp2p to v0.18.0-rc4 2022-02-08 11:51:14 +02:00
Aarsh Shah
399a1afd94 Merge remote-tracking branch 'origin/master' into feat/cid-to-piece-idx 2022-02-08 12:37:57 +04:00
vyzo
e78c4ab9b3 update go-libp2p to v0.18.0-rc3 2022-02-03 19:32:30 +02:00
Anton Evangelatov
b6b5046cce upgrade go-fil-markets 2022-02-03 16:26:04 +01:00
Anton Evangelatov
595ad44ee7 refactor indexprovider libp2p host connection to fullnode with meshcreator 2022-02-03 15:44:18 +01:00
Anton Evangelatov
c3d41d4e17 upgrade go-fil-markets 2022-02-02 16:14:44 +01:00
Anton Evangelatov
03dd33dbbe upgrade go-fil-markets 2022-02-02 14:07:41 +01:00
Anton Evangelatov
2790cf35af change fullnodeApi to listen addrs 2022-02-02 13:06:53 +01:00
Masih H. Derkani
ad348c8e2f
Upgrade to the latest index provider 
Upgrade to the latest index provider which rolls out a more compact ad
signature mechanism along with dependency updates.
 2022-02-01 09:53:57 +00:00
Masih H. Derkani
5d72ebe0cc
Upgrade index-provider and update topic name 
Update the topic name to be consistent with default
configured in storetheindex.

Upgrade to the latest `index-provider`.
 2022-01-27 09:48:10 +00:00
Aarsh Shah
211ad166af update markets deps 2022-01-26 15:53:27 +04:00
Aarsh Shah
4dd93e5bbb update deps 2022-01-26 10:58:44 +04:00
Masih H. Derkani
5da2995bcd
Upgrade to index-provider v0.2.3 
Upgrade index provider to latest so that on engine restart the head
advertisement is published.
 2022-01-25 09:37:44 +00:00
Aarsh Shah
8d062bc880 update index provider 2022-01-24 14:26:17 +04:00
Aarsh Shah
9e2d46b33f Merge remote-tracking branch 'origin/master' into feat/cid-to-piece-idx 2022-01-23 10:32:54 +04:00
vyzo
6e5f521463 update go-libp2p to v0.18.0-rc2 2022-01-21 10:45:45 +02:00
Aarsh Shah
b8bf2af3e3 upgrade on master 2022-01-20 16:34:13 +04:00
Dirk McCormick
8a47a71772 feat: update to go-fil-markets v1.19.0 2022-01-20 11:46:17 +01:00
vyzo
2e5474e864 update go-fil-markets@v0.19.0-rc1 2022-01-20 11:37:08 +02:00
vyzo
6260271b78 go mod: update go-libp2p-resource-manager@v0.1.2 2022-01-20 11:36:11 +02:00
vyzo
83427c478f go mod: update go-yamux@v3.0.2 2022-01-20 11:36:11 +02:00
vyzo
aa599bfaf9 go mod: update go-libp2p-pubsub 2022-01-20 11:36:11 +02:00
vyzo
62c0f35b5a go mod: go-libp2p-resource-manager@v0.1.1 2022-01-20 11:36:11 +02:00
vyzo
c394fbdfc3 go mod: go-libp2p-resource-manager 2022-01-20 11:36:11 +02:00
vyzo
2fb5837a55 go mod: go-libp2p@v0.18.0-rc1 2022-01-20 11:36:11 +02:00
Łukasz Magiera
7dba12fc81
Merge pull request #7967 from filecoin-project/chore/mod-comments 
chore: Cleanup go.mod
 2022-01-18 15:18:19 +01:00
Dirk McCormick
1ce1dbbc50 feat: update go-fil-markets to tagged release 2022-01-18 14:29:59 +01:00
Łukasz Magiera
d677826312
Cleanup go.mod 2022-01-18 10:24:43 +01:00
hannahhoward
92d56d82f4 feat(deps): update markets stack 
update go-fil-markets, go-data-transfer 1.13.0, go-graphsync 0.12.0
 2022-01-14 17:21:04 -08:00
Aayush
2b29ceab83 Use go-libp2p-connmgr v0.3.1 2022-01-14 17:38:56 -05:00
Aayush Rajasekaran
b9474cf0a2 Implement an autobatcher 2022-01-14 17:15:20 -05:00
Aayush Rajasekaran
074a4cc3e4 Update to actors v7.0.0-rc1 2022-01-14 17:15:20 -05:00
Aayush Rajasekaran
790ba155b8 Fast migration for v15 2022-01-14 17:15:15 -05:00
zenground0
d6aa17e21f Snap Deals Integration 
- FSM handles the actual cc upgrade process including error states
- PoSting (winning and window) works over upgraded and upgrading sectors
- Integration test and changes to itest framework to reduce flakes
- Update CLI to handle new upgrade
- Update dependencies
 2022-01-14 17:14:32 -05:00
Aayush Rajasekaran
ceb11bfe77 Update go-paramfetch 2022-01-14 17:14:32 -05:00
zenground0
d1480c36c0 RemoveData and Decode 
- Unsealing replica update with sector key works and tested
- Sector key generation added and tested
 2022-01-14 17:14:32 -05:00
zenground0
93656e65f8 WIP sector storage and integration test 2022-01-14 17:14:32 -05:00
Aayush Rajasekaran
c0bb554d8d Update actors 2022-01-14 17:14:32 -05:00
Aayush Rajasekaran
393d8541e2 Update deps 2022-01-14 17:14:32 -05:00
Aayush Rajasekaran
1ef780d96f Plug in the FFI call 2022-01-14 17:14:32 -05:00
Aayush Rajasekaran
a8cb027c08 Integrate v7 actors 2022-01-14 17:14:32 -05:00
Aayush Rajasekaran
25768a291e Implement an autobatcher 2022-01-11 17:20:10 -05:00
Aayush Rajasekaran
19bd9cf945 Update to actors v7.0.0-rc1 2022-01-11 17:20:08 -05:00
Aayush Rajasekaran
8aabe1b488 Fast migration for v15 2022-01-11 17:19:38 -05:00
Aayush Rajasekaran
207d33eaba
Merge pull request #7810 from filecoin-project/feat/snap-deals 
Snap Deals Lotus Integration: FSM Posting and integration test
 2022-01-11 12:46:55 -05:00
Aayush Rajasekaran
9614f6db8d Update go-paramfetch 2022-01-10 19:03:26 -05:00
zenground0
33f2d24f54 Snap Deals Integration 
- FSM handles the actual cc upgrade process including error states
- PoSting (winning and window) works over upgraded and upgrading sectors
- Integration test and changes to itest framework to reduce flakes
- Update CLI to handle new upgrade
- Update dependencies
 2022-01-10 15:39:38 +05:30
hannahhoward
cddf63efe9 feat(storageminer): add api for transfer diagnostics 
Add API + CLI for inspecting in depth diagnostics on graphsync transfers with a given peer
 2021-12-22 13:41:29 -08:00
Dirk McCormick
6db8a862bb feat: update to go-fil-markets v1.14.1 2021-12-21 16:36:47 +01:00
Dirk McCormick
6311e53a76 feat: update to go-fil-markets v1.14.0 2021-12-21 11:23:38 +01:00
Dirk McCormick
839fc8df7d fix: when retrying Add Piece, first seek to start of reader 2021-12-17 14:44:51 +01:00
Łukasz Magiera
bc384c01e3 Merge remote-tracking branch 'origin/master' into deps/update-ctx-dsbs 2021-12-17 13:01:22 +01:00
Aayush Rajasekaran
62de84d5b6 Deps: Update drand to 1.3.0 2021-12-15 18:34:21 -05:00
Aayush Rajasekaran
0e2278cc76 Merge branch 'master' into deps/update-ctx-dsbs 2021-12-14 18:08:29 -05:00
Aayush Rajasekaran
bdd56d2516 Deps: Update go-car to v0.3.3 2021-12-14 18:06:28 -05:00
Aayush Rajasekaran
02b00c025a Deps: Update go-fil-markets to v1.13.5 2021-12-14 17:55:55 -05:00
Aayush Rajasekaran
8935c4386c Deps: Update go-ipld-cbor to v0.0.6 2021-12-14 17:53:11 -05:00
Aayush Rajasekaran
bcd2c71031 Deps: Update go-storedcounter to v0.1.0 2021-12-14 17:51:49 -05:00
Aayush Rajasekaran
69495f5b59 Deps: Update dagstore to v0.4.4 2021-12-14 17:50:18 -05:00
Aayush Rajasekaran
3f703ff8a4 Deps: Update go-car/v2 to v2.1.1 2021-12-14 16:54:22 -05:00
Aayush Rajasekaran
46d8ae47dc Deps: Update go-ipld-prime to v0.14.3 2021-12-14 16:41:34 -05:00
Aayush Rajasekaran
5bc4ee257f Deps: Update go-ds-badger2 to v0.1.2 2021-12-14 16:33:38 -05:00
Aayush Rajasekaran
aac6d88f72 Deps: Update actors v2 to v2.3.6 2021-12-14 12:49:18 -05:00
Aayush Rajasekaran
a3ea3ad911 Deps: Update actors v2 2021-12-14 11:39:06 -05:00
vyzo
73ca65a6ff update drand 2021-12-14 15:55:00 +02:00
vyzo
773f896bcd update go-libp2p-connmgr to v0.3 2021-12-14 15:27:34 +02:00
vyzo
0001a6bad0 update go-libp2p to v0.17 2021-12-14 15:26:15 +02:00
Aayush Rajasekaran
80d5e52923 Merge branch 'master' into next 2021-12-13 13:24:28 -05:00
vyzo
73c7e9edf1 go mod tidy 2021-12-13 14:47:01 +02:00
vyzo
7ed40c1ec7 go get drand@release/v1.3 2021-12-13 14:17:05 +02:00
vyzo
97a91f23f1 update go-ds-measure and go-filestore 2021-12-13 14:12:14 +02:00
Aayush Rajasekaran
e5895af4a2 Update go-ipld-cbor 2021-12-11 18:15:35 -05:00
Aayush Rajasekaran
dfb65ed89f Plumb contexts through 2021-12-11 17:04:00 -05:00
Aayush Rajasekaran
6c31cecc7d Update markets 2021-12-11 14:37:37 -05:00
Aayush Rajasekaran
095361bead Update carv2 2021-12-10 19:15:53 -05:00
Aayush Rajasekaran
702a7815b9 Update go-car 2021-12-09 22:46:30 -05:00
Aayush Rajasekaran
276eabd4e5 Update go-storedcounter and go-ds-versioning 2021-12-09 22:31:46 -05:00
Jennifer Wang
29cdee761b update to ipld-legacy to v0.1.1 2021-12-09 21:06:56 -05:00
Jennifer Wang
f7a49e7be7 update to ipld-legacy to v0.1.1 2021-12-09 21:02:24 -05:00
vyzo
a9e22df765 update deps 2021-12-09 15:14:48 +02:00
Aayush Rajasekaran
b9b4a2659d Update go-data-transfer 2021-12-09 14:12:25 +02:00
whyrusleeping
072297e661 WIP: updating to new datastore/blockstore code with contexts 2021-12-09 14:12:25 +02:00
Łukasz Magiera
b4bdb89f65 CARv2 v2.1.0 2021-12-08 01:52:00 -05:00
Łukasz Magiera
84c48de5d9 CARv2 v2.1.0 2021-12-06 15:39:03 +01:00
zenground0
a5be80828a RemoveData and Decode 
- Unsealing replica update with sector key works and tested
- Sector key generation added and tested
 2021-12-03 15:21:06 -05:00
hannahhoward
f3b691d618 feat(tracing): switch to OpenTelemetry 
Switch the underlying tracing library to OpenTelemetry, with a bridge to OpenCensus for
compatibility
 2021-12-01 16:19:47 -08:00
Clint Armstrong
e2a1ca7caa Use cgroup limits in worker memory calculations 
Worker processes may have memory limitations imposed by Systemd. But
/proc/meminfo shows the entire system memory regardless of these limits.
This results in the scheduler believing the worker has the entire system
memory avaliable and the worker being allocated too many tasks.

This change attempts to read cgroup memory limits for the worker
process. It supports cgroups v1 and v2, and compares cgroup limits
against the system memory and returns the most conservative values to
prevent the worker from being allocated too many tasks and potentially
triggering an OOM event.
 2021-11-30 02:06:58 +01:00
hannahhoward
d4074e45cf feat(deps): update go-graphsync v0.10.6 2021-11-29 13:29:12 -08:00
Łukasz Magiera
f39942283b
Merge pull request #7706 from filecoin-project/feat/ret-matchding-cars 
retrieval: Only output matching nodes, MatchPath dagspec
 2021-11-29 22:14:25 +01:00
Łukasz Magiera
4d51980cb5 deps: Use tagged go-ipld-selector-text-lite 2021-11-29 21:22:30 +01:00
Łukasz Magiera
61791b90ea retrieval: Only output matching nodes, MatchPath dagspec 2021-11-29 20:40:55 +01:00
zenground0
7d2b3f05db WIP sector storage and integration test 2021-11-29 10:24:00 -05:00