Shrenuj Bansal
99e7c322eb
More wip
2022-09-27 16:08:04 +00:00
Aayush
99db94f476
build: set version to v1.18.0-dev
2022-09-20 15:56:57 -04:00
Łukasz Magiera
3ffedead7a
v1.17.2-rc1
2022-09-20 18:31:06 +02:00
Łukasz Magiera
8ca1f89ba6
build: Bump version to v1.17.3-dev
2022-09-20 18:24:42 +02:00
Łukasz Magiera
859c2606f0
sealing: Address review
2022-09-19 12:13:06 +02:00
Łukasz Magiera
fec9c0f981
sector import: Fix lint
2022-09-19 12:13:06 +02:00
Łukasz Magiera
061a990eb8
sector import: RemoteSealingDoneEndpoint
2022-09-19 12:13:06 +02:00
Łukasz Magiera
c17ab761c5
sector import: Remote Commit2
2022-09-19 12:13:06 +02:00
Łukasz Magiera
9f03569cd0
sector import: Remote Commit1
2022-09-19 12:13:06 +02:00
Łukasz Magiera
3caa010779
sector import: Update type-gen
2022-09-19 12:13:06 +02:00
Łukasz Magiera
ea99bd9763
sector import: Sector data download
2022-09-19 12:13:05 +02:00
Łukasz Magiera
fbb487ae2b
sector import: Plumbing for DownloadSectorData in the sealing system
2022-09-19 12:13:05 +02:00
Łukasz Magiera
2318419291
sector import: Fix missing perm tag on SectorReceive
2022-09-19 12:13:05 +02:00
Łukasz Magiera
29135aa77c
sector import: Initial api scaffolding
2022-09-19 12:13:03 +02:00
Geoff Stuart
21906b5a63
add api and cli calls for beneficiary withdrawl
2022-09-14 12:26:35 -04:00
Shrenuj Bansal
4be8861f41
Merge branch 'master' into sbansal/nonce-coordination-and-consensus-for-chain-nodes
2022-09-13 17:41:06 -04:00
Shrenuj Bansal
a1f2fdb706
Merge branch 'master' into sbansal/nonce-coordination-and-consensus-for-chain-nodes
2022-09-12 16:23:24 -04:00
Shrenuj Bansal
8f1b1bb1ff
WIP: Raft consensus for lotus nodes in a cluster
2022-09-12 16:10:15 -04:00
Aayush
e9a3235291
more fixes
2022-09-09 21:40:15 -04:00
LexLuthr
67d4f905e6
feat: proving: Introduce manual sector fault recovery ( #9144 )
...
* rebase
* fix lint error
* fix errors
* add itest
* make gen after rebase
* apply suggestion from review
* make gen after latest rebase
* gen after rebase
* fix waitgroup
* change as per review
* refactor Recovery Batches
* fix CLI
* gen after rebase
* close the channel
2022-09-06 21:17:30 +05:30
Łukasz Magiera
08b22edd89
fix make gen
2022-08-29 16:25:30 +02:00
Łukasz Magiera
335f5df3ec
numassigner: SectorNumReserveCount
2022-08-24 11:25:37 -04:00
Łukasz Magiera
b290dac3cb
Merge remote-tracking branch 'origin/master' into feat/sectornum-mgmt
2022-08-23 11:44:43 -04:00
Łukasz Magiera
64290b69c9
numassigner: Fix missing api perms
2022-08-22 17:41:41 -04:00
Geoff Stuart
7d07ddd837
Reintroduce StateActorManifestCID
2022-08-22 17:17:01 -04:00
Łukasz Magiera
129eba2b5d
sealing: numassign: itests/bug fixes
2022-08-22 16:58:36 -04:00
Łukasz Magiera
00bef607ca
sealing: numassign: take on-chain allocated numbers into account
2022-08-22 16:55:44 -04:00
Łukasz Magiera
ef2080a800
cli for managing sector reservations
2022-08-22 16:55:41 -04:00
Shrenuj Bansal
b7227d3a6b
run make gen
2022-08-16 15:56:32 -04:00
Yu
0ad96858ff
chore: do make docsgen
2022-08-12 15:12:22 +08:00
Shrenuj Bansal
f390c186e6
Close all storage paths on worker shutdown
2022-08-10 17:06:01 -04:00
Geoff Stuart
f536257d3c
Bump version
2022-08-09 13:38:28 -04:00
ZenGround0
0c91b0dc10
feat:chain:splitstore chain prune ( #9056 )
...
* Splitstore chain prune
* Protect on reification for simpler logic and sound cold compact protect
* Recovery from checkpoint during chain prune
* Splitstore (discard and universal mode) running in itests
* Add pause and restart functions to itest block miner
* Add config options to itest full nodes
* Add FsRepo support for itest full ndoes
Co-authored-by: zenground0 <ZenGround0@users.noreply.github.com>
2022-08-05 16:34:16 -04:00
Łukasz Magiera
cb2b4fa4aa
Merge remote-tracking branch 'origin/master' into feat/storage-redeclare
2022-08-05 21:26:15 +02:00
Łukasz Magiera
11e4914531
Merge branch 'feat/SchedRemoveRequest' of github.com:LexLuthr/lotus into LexLuthr-feat/SchedRemoveRequest
2022-08-05 10:40:45 +02:00
Łukasz Magiera
8a39b79ee8
Merge branch 'desc' of github.com:ysrotciv/lotus into docs/ysrotciv-desc
2022-08-05 09:33:26 +02:00
Łukasz Magiera
e196742ece
cli: Update docsgen, don't require args in storage redeclare
2022-08-05 09:05:46 +02:00
LexLuthr
25bec140fb
make gen after rebase
2022-08-04 02:07:22 +05:30
LexLuthr
c736dedfa6
move requestremove inside runSched
2022-08-04 02:00:24 +05:30
LexLuthr
cf78fa99ee
Rebase on master
2022-08-04 01:59:48 +05:30
Łukasz Magiera
4b47881950
Merge branch 'master' into sbansal/lotus-worker-stop-cmd
2022-08-03 10:42:19 +02:00
Łukasz Magiera
01a6cdaf03
Merge branch 'feat/minerWithdrawBalanceAPI' of github.com:LexLuthr/lotus into LexLuthr-feat/minerWithdrawBalanceAPI
2022-08-03 10:33:09 +02:00
Aayush
468a4ff2ac
feat: build: run fiximports on make actors-gen
2022-08-02 18:05:57 -04:00
LexLuthr
f5a7a650e7
rename to ActorWithdrawBalance
2022-08-02 13:04:54 +05:30
LexLuthr
e0e0b0b62f
don't wait for msg to land on chain
2022-08-01 23:41:24 +05:30
Shrenuj Bansal
e7bace9341
Update API docs
2022-08-01 11:36:34 -04:00
LexLuthr
9e9a3825aa
rerun make gen
2022-07-29 20:32:05 +05:30
LexLuthr
4f03486011
miner withdrawbalance API
2022-07-29 20:09:49 +05:30
Łukasz Magiera
6ac5c16d2b
storage: Path type filters
2022-07-12 21:45:12 +02:00
Łukasz Magiera
413183e4fa
fix: Delegate storage auth on market nodes
2022-07-06 22:22:41 +02:00
Jennifer Wang
c3f3eb0812
Merge branch 'releases' into jen/masterbp
2022-06-27 15:13:12 -04:00
Jennifer Wang
83d796f34d
bump the version to v1.16.0
2022-06-23 17:20:39 -04:00
Geoff Stuart
83d7db88cf
review fixes
2022-06-23 14:32:14 -04:00
Geoff Stuart
e684248f48
Added api call to get actors cids
2022-06-23 14:07:23 -04:00
Jennifer Wang
69b7594aec
fix the the upgrade epoch in changelog
2022-06-22 22:20:21 -04:00
Jennifer Wang
ea823558de
bump version to v1.16.0-rc2
2022-06-22 14:27:15 -04:00
Łukasz Magiera
58416d0881
storage: Don't depend on specs-storage, move to storiface
2022-06-17 13:36:33 +02:00
Łukasz Magiera
7de400b5ac
Merge remote-tracking branch 'origin/master' into chore/drop-pipeline-adapters
2022-06-17 11:31:05 +02:00
Jennifer Wang
8375cc9f3e
make gen
2022-06-16 16:19:56 -04:00
Łukasz Magiera
9c4d10ec73
api: handle no-precommit in StateSectorPreCommitInfo gracefully
2022-06-16 15:20:58 +02:00
Łukasz Magiera
2dc1df878d
api: Move StateComputeDataCID to full-node
2022-06-16 13:29:35 +02:00
Jennifer Wang
b3adf6f09c
docsgen
2022-06-13 23:12:19 -04:00
Geoff Stuart
b7010c9e60
Implement function to migrate actors with only code changes
2022-06-10 15:52:32 -04:00
Geoff Stuart
801c670edd
Remove ChainPutMany
2022-06-10 14:09:05 -04:00
Geoff Stuart
3c4792d3e9
review fixes
2022-06-10 11:35:01 -04:00
Geoff Stuart
5c0f2c8ae6
Add putObj and putMany to apiBlockstore
2022-06-09 15:13:42 -04:00
Aayush
b28c11a57d
Merge branch 'feat/nv16'
2022-06-03 14:01:49 -04:00
Jennifer Wang
2e59d0129d
Merge branch 'release/v1.15.3' into jen/mergev1153to16
2022-05-31 16:33:18 -04:00
Łukasz Magiera
032e598962
feat: gateway: OpenRPC support
2022-05-27 17:03:56 +02:00
Aayush Rajasekaran
6924a3d5f2
Fix calculation of Drand round from Filecoin epochs
2022-05-25 12:43:52 -04:00
Łukasz Magiera
2bdc729fe7
Merge remote-tracking branch 'origin/master' into feat/worker-task-count-limits
2022-05-25 18:25:15 +02:00
Łukasz Magiera
666dc00e63
docsgen
2022-05-25 16:37:40 +02:00
Jennifer Wang
4c6598e861
bump the version to v1.15.3-rc2
2022-05-24 14:01:01 -04:00
jennijuju
dbe146b0c9
bump the version to v1.15.4-rc1
2022-05-23 19:02:26 +02:00
Aayush
8cca9b1970
Use new go-state-types accessors
2022-05-17 15:21:27 -04:00
jennijuju
5d65d9f7c8
release v1.15.3-rc1
2022-05-13 02:03:38 -04:00
LexLuthr
6115bd02f1
run make gen
2022-05-13 00:27:26 +05:30
Raúl Kripalani
10d77f1f0c
run gen.
2022-05-10 15:00:58 +01:00
Raúl Kripalani
e0a52da4f7
run gen.
2022-05-10 14:32:52 +01:00
Jennifer Wang
304fa02d59
v1.15.2 prep
2022-05-06 01:57:03 -04:00
simlecode
962e37e893
add StateGetNetworkParams api
2022-05-05 14:16:30 +08:00
jennijuju
7020892631
v1.15.3-rc3 prep
2022-05-03 15:46:43 -04:00
Łukasz Magiera
d7c52f8adf
sealing: ComputeDataCid miner API
2022-04-26 21:37:48 +02:00
jennijuju
48c54605ae
release v1.15.2-rc2
2022-04-26 21:19:03 +02:00
Łukasz Magiera
1aed631fe5
sealing: DataCid on workers
2022-04-26 20:36:23 +02:00
Geoff Stuart
49d6c07280
Implemented StateLoockupRobustAddress
2022-04-14 17:41:18 -04:00
jennijuju
372dd2ced9
v1.15.2-rc1
2022-04-13 19:11:02 +02:00
jennijuju
787bcef130
bump the version to v1.15.3
2022-04-12 15:53:45 +02:00
Łukasz Magiera
6bef1aeb82
feat: cli: lotus client list-asks --protocols
2022-04-11 19:49:52 +02:00
Łukasz Magiera
54cb55a7ae
feat: miner: API/CLI to compute window-post
2022-03-28 17:06:51 -04:00
Łukasz Magiera
82343a06e7
Merge remote-tracking branch 'origin/master' into feat/post-worker
2022-03-25 16:49:46 -04:00
Łukasz Magiera
701d0a111e
Merge branch 'feat/net-ping' of github.com:ychiaoli18/lotus into feat/net-ping
2022-03-21 13:06:11 +01:00
Łukasz Magiera
cca69a6c16
gen
2022-03-21 10:49:30 +01:00
Łukasz Magiera
aa124cf414
fix lint issues
2022-03-18 11:38:27 +01:00
Jennifer Wang
56b80c41b6
bump the master version to v1.15.2-dev
2022-03-15 19:32:28 -04:00
hannahhoward
49742f8fdc
feat(deps): update to graphsync v0.13.0 with 2.0 protocol
2022-03-09 18:06:35 +00:00
Masih H. Derkani
aacc246ba3
Merge branch 'master' into feat/cid-to-piece-idx
2022-03-02 14:06:30 +00:00
Łukasz Magiera
e9a6f5f287
Merge remote-tracking branch 'origin/master' into feat/paych-avail-reuse
2022-03-02 12:56:56 +00:00
zenground0
77a954c7c3
Merge branch 'master' into feat/cid-to-piece-idx
2022-02-28 12:57:11 -07:00
zenground0
abe04c33c1
Fix fault tracker to handle snap deals
2022-02-23 09:56:47 -07:00
Łukasz Magiera
a0cb6094c6
Merge remote-tracking branch 'origin/master' into feat/paych-avail-reuse
2022-02-22 10:55:03 +01:00
Aarsh Shah
e3f5b7c59f
update dagstore top level index db
2022-02-18 14:00:01 +04:00
Kevin Li
ba72eff3e6
feat: cli/net: implement 'net ping' command
2022-02-17 17:22:52 +08:00
Łukasz Magiera
384999556c
paychmgr: AvailableAmt -> NonReservedAmt
2022-02-16 20:39:43 +01:00
Łukasz Magiera
681b90768a
Merge remote-tracking branch 'origin/master' into feat/paych-avail-reuse
2022-02-16 10:06:36 +01:00
Kevin Li
f677995603
feat: add MsigGetVestingSchedule to gateway api
...
expose MsigGetVestingSchedule method to gateway api
2022-02-16 16:11:46 +08:00
Łukasz Magiera
f61eb23f8f
api: separate method for paych funding
2022-02-14 19:56:02 +01:00
Łukasz Magiera
10af768c60
Merge commit 'origin/release/v1.15.0~2' into feat/paych-avail-reuse
2022-02-14 19:27:12 +01:00
Jennifer Wang
99d5ad097c
Merge remote-tracking branch 'origin/master' into jen/v151
2022-02-11 00:16:52 -05:00
Jennifer Wang
1b2bbd3888
bump master version to v1.15.1-dev
2022-02-11 00:13:18 -05:00
Jennifer Wang
de1f4792cd
Merge remote-tracking branch 'origin/master' into jen/v15
2022-02-09 19:27:34 -05:00
Jennifer Wang
6ed97f0d04
Merge branch 'release/v1.14.0' into jen/v15
2022-02-09 03:17:38 -05:00
Łukasz Magiera
4ad97f6a36
make gen
2022-02-08 17:22:41 +01:00
Łukasz Magiera
e271bae5ec
try ClearCache for update cache
2022-02-08 17:22:41 +01:00
Jennifer Wang
b8f3d936c4
bump the version to v1.14.0-rc6
2022-02-08 01:53:15 -05:00
Will Scott
7247f8e41f
add net protect api methods
...
fix #8015
2022-02-03 17:24:49 +01:00
Aayush
40485eb88a
Lotus release v1.14.0-rc5
2022-01-27 15:36:25 -05:00
Aayush
6cc9eecc85
Lotus release v1.14.0-rc4
2022-01-25 13:28:03 -05:00
Aayush
6b7b488e00
Lotus release v1.14.0-rc3
2022-01-25 13:02:08 -05:00
Aayush
1b18236f91
feat: sealer: allow users to abort in-flight snap upgrades
2022-01-25 13:01:51 -05:00
Aayush Rajasekaran
a3c5fadcc0
feat: sealing: Add ReplicaUpdate work to Resource table
2022-01-25 13:01:05 -05:00
Łukasz Magiera
550e2743d7
paych: Don't return settling/collected chennals from OutboundActiveByFromTo
2022-01-20 18:24:01 +01:00
Aarsh Shah
b8bf2af3e3
upgrade on master
2022-01-20 16:34:13 +04:00
vyzo
b360c9403f
make gen and friends
2022-01-20 11:44:01 +02:00
Aayush Rajasekaran
3ff23ecbfa
:fix: checkReplica incorrectly returns ErrBadPR
2022-01-19 12:00:27 -05:00
Aayush Rajasekaran
ca57546ef5
Remove unnecessary params from VerifyWinningPost
2022-01-14 17:14:32 -05:00
zenground0
d6aa17e21f
Snap Deals Integration
...
- FSM handles the actual cc upgrade process including error states
- PoSting (winning and window) works over upgraded and upgrading sectors
- Integration test and changes to itest framework to reduce flakes
- Update CLI to handle new upgrade
- Update dependencies
2022-01-14 17:14:32 -05:00
Jennifer Wang
ba816a1c13
bump the version to v1.14.0-rc1
2022-01-14 17:14:32 -05:00
zenground0
d1480c36c0
RemoveData and Decode
...
- Unsealing replica update with sector key works and tested
- Sector key generation added and tested
2022-01-14 17:14:32 -05:00
Jennifer Wang
e24b454a1f
Bump the master version to v1.13.3-dev
2022-01-14 17:14:32 -05:00
zenground0
93656e65f8
WIP sector storage and integration test
2022-01-14 17:14:32 -05:00
Aayush Rajasekaran
3a7c364562
Address review
2022-01-14 17:14:32 -05:00
Aayush Rajasekaran
a8cb027c08
Integrate v7 actors
2022-01-14 17:14:32 -05:00
Jennifer Wang
c1d04a9d13
bump master version to v1.15.0-dev
2022-01-12 19:28:08 -05:00
Aayush Rajasekaran
d645c5fbab
Remove unnecessary params from VerifyWinningPost
2022-01-11 12:06:39 -05:00
zenground0
33f2d24f54
Snap Deals Integration
...
- FSM handles the actual cc upgrade process including error states
- PoSting (winning and window) works over upgraded and upgrading sectors
- Integration test and changes to itest framework to reduce flakes
- Update CLI to handle new upgrade
- Update dependencies
2022-01-10 15:39:38 +05:30
Jennifer Wang
20d1a5db70
bump the version to v1.13.2
2022-01-09 22:39:09 -05:00
Jennifer Wang
09cd258780
lotus v1.13.2-rc7
2022-01-05 19:27:00 -05:00
Jennifer Wang
ff949d84ad
v1.13.2-rc6 prep
2022-01-04 17:58:18 -05:00
zl
4172a3c8b7
ExampleValue for a silce is nil
2022-01-04 14:27:10 +08:00
hannahhoward
cddf63efe9
feat(storageminer): add api for transfer diagnostics
...
Add API + CLI for inspecting in depth diagnostics on graphsync transfers with a given peer
2021-12-22 13:41:29 -08:00
Jennifer Wang
eabb9639a3
v1.13.2-rc5 prep
2021-12-17 15:02:42 -05:00
Dirk McCormick
b1734f84b3
feat: retrieval ask CLI command
2021-12-17 15:55:12 +01:00
Aayush Rajasekaran
80d5e52923
Merge branch 'master' into next
2021-12-13 13:24:28 -05:00
Jennifer Wang
1ffc3ed3a6
v1.13.2-rc4
2021-12-10 16:58:58 -05:00
Jennifer Wang
3f9f9eb667
v1.13.2-rc3
2021-12-09 21:15:49 -05:00
Jennifer Wang
4768c425d1
bump version to v1.13.2-rc2
2021-12-08 02:04:39 -05:00
zenground0
a5be80828a
RemoveData and Decode
...
- Unsealing replica update with sector key works and tested
- Sector key generation added and tested
2021-12-03 15:21:06 -05:00
Łukasz Magiera
727765b248
Command to list active sector locks
2021-12-03 12:33:23 +01:00
Jennifer Wang
027017d0d2
update the version to v1.13.2-rc1
2021-11-30 19:03:24 -05:00
Jennifer Wang
c3ecf8355d
docs gen
2021-11-30 18:29:13 -05:00
Łukasz Magiera
6d52d8552b
Fix docsgen
2021-11-30 02:06:58 +01:00
Łukasz Magiera
5b5e6b9e44
retrieval: DagSpec.MatchPath -> ExportMerkleProof
2021-11-29 21:14:00 +01:00
Łukasz Magiera
9538fc9723
mod tidy, docsgen
2021-11-29 20:56:40 +01:00
zenground0
7d2b3f05db
WIP sector storage and integration test
2021-11-29 10:24:00 -05:00
Łukasz Magiera
135796d4fa
Merge remote-tracking branch 'origin/master' into feat/partret-ux
2021-11-23 19:08:56 +01:00
Łukasz Magiera
83f65a673b
retrieval: Docsgen
2021-11-23 17:45:56 +01:00
Łukasz Magiera
e362d47903
Add optional group flags to storage attach commands
2021-11-23 16:11:04 +01:00
Łukasz Magiera
f88c514be9
make lint happy
2021-11-22 12:52:11 +01:00
Travis Person
17cb5117f4
add additional methods to lotus gateway
2021-11-22 12:19:27 +01:00
Aayush Rajasekaran
5f1783c9a5
Address review
2021-11-19 15:11:13 -05:00
Aayush Rajasekaran
32fc03886d
CLI: Add a lotus multisig cancel command
2021-11-18 19:21:17 -05:00
Aayush Rajasekaran
1449644c34
Integrate v7 actors
2021-11-17 15:55:14 -05:00
Jennifer Wang
14c26567b2
bump the master version to v1.13.2-dev
2021-10-26 21:58:02 -04:00
Anton Evangelatov
6e5ccc87cf
cli: add retry for deals stuck in Publish with no funds
2021-10-11 14:03:55 +02:00
Aayush Rajasekaran
1723793c35
Bugfix: Use current startup network versions
2021-10-10 14:26:10 -04:00
Jennifer Wang
4221461ede
bump master to v1.13.1-dev
2021-10-06 00:31:41 -04:00
Peter Rabbitson
5e6aceeb0e
Merge remote-tracking branch 'origin/master' into feat/datamodel-selector-retrieval
2021-10-05 18:15:51 +02:00
Peter Rabbitson
2a1094fc17
Merge banch feat/go-fil-markets-v1.13.0 into feat/datamodel-selector-retrieval
2021-10-04 21:56:11 +02:00
Jennifer Wang
38e01cba83
Merge branch 'release/v1.12.0' into jen/12tomaster
2021-10-04 02:38:00 -04:00
Jennifer Wang
2931be5fc5
bump the version to v1.12.0-rc1
2021-10-01 19:45:49 -04:00
Aayush Rajasekaran
50ce475701
Upgrade to actors v6-rc1
2021-10-01 17:57:32 -04:00
Aayush Rajasekaran
7b4c657e90
Add v6 actors
2021-09-21 14:23:14 -04:00
Aayush Rajasekaran
b9bfcc4b69
Randomness: Move getters from ChainAPI to StateAPI
2021-09-21 14:20:15 -04:00
Aayush Rajasekaran
1d6db306ec
Randomness: Move getters from ChainAPI to StateAPI
2021-09-15 00:03:13 +02:00
Peter Rabbitson
0444435589
Expose basic text-based datamodel selector on retrieval
...
Syntaxt of selection is located at
https://pkg.go.dev/github.com/ipld/go-ipld-selector-text-lite#SelectorSpecFromPath
Example use, assuming that:
- The root of the deal is a plain dag-pb unixfs directory
- The directory is not sharded
- The user wants to retrieve the first entry in that directory
lotus client retrieve --miner f0XXXXX --datamodel-path-selector 'Links/0/Hash' bafyROOTCID ~/output
For a much more elaborate example see the top of ./itests/deals_partial_retrieval_test.go
2021-09-10 09:44:11 +02:00
Jennifer Wang
6907797783
version bump v1.11.3-rc1
2021-09-08 01:31:23 -04:00
Jennifer Wang
612befc962
bump master to v1.11.4-dev
2021-09-08 01:23:35 -04:00
Łukasz Magiera
8b9e9fede4
docsgen
2021-09-07 18:49:53 +02:00
Steven Allen
1cf556c3a2
feat: expose ChainGetPath on the gateway
2021-08-30 16:43:21 -07:00
Łukasz Magiera
1ba427f638
alerting: Address review
2021-08-26 16:09:18 +02:00
Aayush Rajasekaran
de79bf57e5
Bump version to v1.11.13-dev
2021-08-25 11:18:38 -04:00
Łukasz Magiera
12875a9664
api/command for encoding actor params
2021-08-20 17:32:57 +02:00
Aarsh Shah
d7076778e2
integrate DAG store and CARv2 in deal-making ( #6671 )
...
This commit removes badger from the deal-making processes, and
moves to a new architecture with the dagstore as the cental
component on the miner-side, and CARv2s on the client-side.
Every deal that has been handed off to the sealing subsystem becomes
a shard in the dagstore. Shards are mounted via the LotusMount, which
teaches the dagstore how to load the related piece when serving
retrievals.
When the miner starts the Lotus for the first time with this patch,
we will perform a one-time migration of all active deals into the
dagstore. This is a lightweight process, and it consists simply
of registering the shards in the dagstore.
Shards are backed by the unsealed copy of the piece. This is currently
a CARv1. However, the dagstore keeps CARv2 indices for all pieces, so
when it's time to acquire a shard to serve a retrieval, the unsealed
CARv1 is joined with its index (safeguarded by the dagstore), to form
a read-only blockstore, thus taking the place of the monolithic
badger.
Data transfers have been adjusted to interface directly with CARv2 files.
On inbound transfers (client retrievals, miner storage deals), we stream
the received data into a CARv2 ReadWrite blockstore. On outbound transfers
(client storage deals, miner retrievals), we serve the data off a CARv2
ReadOnly blockstore.
Client-side imports are managed by the refactored *imports.Manager
component (when not using IPFS integration). Just like it before, we use
the go-filestore library to avoid duplicating the data from the original
file in the resulting UnixFS DAG (concretely the leaves). However, the
target of those imports are what we call "ref-CARv2s": CARv2 files placed
under the `$LOTUS_PATH/imports` directory, containing the intermediate
nodes in full, and the leaves as positional references to the original file
on disk.
Client-side retrievals are placed into CARv2 files in the location:
`$LOTUS_PATH/retrievals`.
A new set of `Dagstore*` JSON-RPC operations and `lotus-miner dagstore`
subcommands have been introduced on the miner-side to inspect and manage
the dagstore.
Despite moving to a CARv2-backed system, the IPFS integration has been
respected, and it continues to be possible to make storage deals with data
held in an IPFS node, and to perform retrievals directly into an IPFS node.
NOTE: because the "staging" and "client" Badger blockstores are no longer
used, existing imports on the client will be rendered useless. On startup,
Lotus will enumerate all imports and print WARN statements on the log for
each import that needs to be reimported. These log lines contain these
messages:
- import lacks carv2 path; import will not work; please reimport
- import has missing/broken carv2; please reimport
At the end, we will print a "sanity check completed" message indicating
the count of imports found, and how many were deemed broken.
Co-authored-by: Aarsh Shah <aarshkshah1992@gmail.com>
Co-authored-by: Dirk McCormick <dirkmdev@gmail.com>
Co-authored-by: Raúl Kripalani <raul@protocol.ai>
Co-authored-by: Dirk McCormick <dirkmdev@gmail.com>
2021-08-16 23:34:32 +01:00
ZenGround0
bfda864c1b
Fix docsgen
2021-08-11 09:49:23 -04:00
ZenGround0
b914e95f34
revert pricelist by version to pricelist by epoch
2021-08-11 09:49:23 -04:00
Steven Allen
57bf5c2143
feat: add ChainGetTipSetAfterHeight
...
This is identical to ChainGetTipSetByHeight, but returns the tipset
following any null tipsets. This is what the user usually wants anyways.
(and I need it for another PR)
2021-08-05 12:07:14 -07:00
Raúl Kripalani
07f40b9488
fix docs and nits.
2021-07-28 20:03:25 +01:00
Anton Evangelatov
de4a847078
add RuntimeSubsystems API method; use it in lotus-miner info
2021-07-28 16:02:05 +03:00
Jennifer Wang
f9595b58ee
make gen
2021-07-27 23:02:54 -04:00
Mike Greenberg
76a9f4241b
feat: Graceful error when api impl is nil
2021-07-26 13:51:37 +02:00
vyzo
77604db716
make gen
2021-07-26 08:33:25 +03:00
vyzo
21bb2bda09
make gen
2021-07-25 11:25:29 +03:00
ZenGround0
c130d2cb87
Rebase fix
2021-07-22 09:50:43 -04:00
Łukasz Magiera
660829703a
Merge remote-tracking branch 'origin/master' into feat/split-net-api
2021-07-22 15:38:06 +02:00
Łukasz Magiera
c9bc247732
api gen
2021-07-22 11:23:43 +02:00
Łukasz Magiera
812dc266cf
builder: Don't require specific NetAPI impl in StorageMinerAPI
2021-07-15 12:01:13 +02:00
hunjixin
d023026cb0
fix confilct
2021-07-15 14:55:03 +08:00
Anton Evangelatov
d89ddb9315
resolve conflicts
2021-07-12 11:34:37 +02:00
Łukasz Magiera
2dc27d6ab4
itests: Fix deal provider collateral flakiness
2021-07-07 19:41:46 +02:00
