lotus/storage/pipeline
Łukasz Magiera 9e03fcab83
feat: sealing: Support nv22 DDO features in the sealing pipeline (#11226)
* Initial work supporting DDO pieces in lotus-miner

* sealing: Update pipeline input to operate on UniversalPiece

* sealing: Update pipeline checks/sealing states to operate on UniversalPiece

* sealing: Make pipeline build with UniversalPiece

* move PieceDealInfo out of api

* make gen

* make sealing pipeline unit tests pass

* fix itest ensemble build

* don't panic in SectorsStatus with deals

* stop linter from complaining about checkPieces

* fix sector import tests

* mod tidy

* sealing: Add logic for (pre)committing DDO sectors

* sealing: state-types with method defs

* DDO non-snap pipeline works(?), DDO Itests

* DDO support in snapdeals pipeline

* make gen

* update actor bundles

* update the gst market fix

* fix: chain: use PreCommitSectorsBatch2 when setting up genesis

* some bug fixes

* integration working changes

* update actor bundles

* Make TestOnboardRawPieceSnap pass

* Appease the linter

* Make deadlines test pass with v12 actors

* Update go-state-types, abstract market DealState

* make gen

* mod tidy, lint fixes

* Fix some more tests

* Bump version in master

Bump version in master

* Make gen

Make gen

* fix sender

* fix: lotus-provider: Fix winning PoSt

* fix: sql Scan cannot write to an object

* Actually show miner-addrs in info-log

Actually show miner-addrs in lotus-provider info-log

* [WIP] feat: Add nv22 skeleton

Addition of Network Version 22 skeleton

* update FFI

* ddo is now nv22

* make gen

* temp actor bundle with ddo

* use working go-state-types

* gst with v13 market migration

* update bundle, builtin.MethodsMiner.ProveCommitSectors2 -> 3

* actually working v13 migration, v13 migration itest

* Address review

* sealing: Correct DDO snap pledge math

* itests: Mixed ddo itest

* pipeline: Fix sectorWeight

* sealing: convert market deals into PAMs in mixed sectors

* sealing: make market to ddo conversion work

* fix lint

* update gst

* Update actors and GST to lastest integ branch

* commit batcher: Update ProveCommitSectors3Params builder logic

* make gen

* use builtin-actors master

* ddo: address review

* itests: Add commd assertions to ddo tests

* make gen

* gst with fixed types

* config knobs for RequireActivationSuccess

* storage: Drop obsolete flaky tasts

---------

Co-authored-by: Jennifer Wang <jiayingw703@gmail.com>
Co-authored-by: Aayush <arajasek94@gmail.com>
Co-authored-by: Shrenuj Bansal <shrenuj.bansal@protocol.ai>
Co-authored-by: Phi <orjan.roren@gmail.com>
Co-authored-by: Andrew Jackson (Ajax) <snadrus@gmail.com>
Co-authored-by: TippyFlits <james.bluett@protocol.ai>
2024-01-25 15:15:55 +01:00
..
gen sealing: Drop redundant Piece type 2022-09-19 12:13:05 +02:00
lib/nullreader storage: Move extern/storage-sealing to storage/pipeline 2022-06-14 19:41:59 +02:00
mocks feat: sealing: Support nv22 DDO features in the sealing pipeline (#11226) 2024-01-25 15:15:55 +01:00
piece feat: sealing: Support nv22 DDO features in the sealing pipeline (#11226) 2024-01-25 15:15:55 +01:00
sealiface feat: sealing: Support nv22 DDO features in the sealing pipeline (#11226) 2024-01-25 15:15:55 +01:00
cbor_gen.go feat: sealing: Support nv22 DDO features in the sealing pipeline (#11226) 2024-01-25 15:15:55 +01:00
checks.go feat: sealing: Support nv22 DDO features in the sealing pipeline (#11226) 2024-01-25 15:15:55 +01:00
commit_batch.go feat: sealing: Support nv22 DDO features in the sealing pipeline (#11226) 2024-01-25 15:15:55 +01:00
constants.go storage: Move extern/storage-sealing to storage/pipeline 2022-06-14 19:41:59 +02:00
currentdealinfo_test.go feat: sealing: Support nv22 DDO features in the sealing pipeline (#11226) 2024-01-25 15:15:55 +01:00
currentdealinfo.go update markets 2022-10-06 11:06:21 -04:00
fsm_events.go feat: sealing: Support nv22 DDO features in the sealing pipeline (#11226) 2024-01-25 15:15:55 +01:00
fsm_test.go sealing pipeline: Fix unit tests 2023-08-29 13:47:18 +02:00
fsm.go sealing pipeline: Drop legacy single-pc1 submit path 2023-08-29 13:46:29 +02:00
garbage.go storage: Don't depend on specs-storage, move to storiface 2022-06-17 13:36:33 +02:00
input.go feat: sealing: Support nv22 DDO features in the sealing pipeline (#11226) 2024-01-25 15:15:55 +01:00
numassign.go strle, sealing: address review 2022-08-25 10:19:39 -04:00
pledge.go feat: sealing: Support nv22 DDO features in the sealing pipeline (#11226) 2024-01-25 15:15:55 +01:00
precommit_batch.go feat: sealing: Support nv22 DDO features in the sealing pipeline (#11226) 2024-01-25 15:15:55 +01:00
precommit_policy_test.go feat: sealing: Support nv22 DDO features in the sealing pipeline (#11226) 2024-01-25 15:15:55 +01:00
precommit_policy.go feat: sealing: Support nv22 DDO features in the sealing pipeline (#11226) 2024-01-25 15:15:55 +01:00
receive.go feat: sealing: Support nv22 DDO features in the sealing pipeline (#11226) 2024-01-25 15:15:55 +01:00
sealing.go feat: sealing: Support nv22 DDO features in the sealing pipeline (#11226) 2024-01-25 15:15:55 +01:00
sector_state.go sealing pipeline: Drop legacy single-pc1 submit path 2023-08-29 13:46:29 +02:00
states_failed_test.go feat: sealing: Support nv22 DDO features in the sealing pipeline (#11226) 2024-01-25 15:15:55 +01:00
states_failed.go feat: sealing: Support nv22 DDO features in the sealing pipeline (#11226) 2024-01-25 15:15:55 +01:00
states_proving.go fix: sealing pipeline: Allow nil message in TerminateWait 2023-04-19 15:43:50 +02:00
states_replica_update.go feat: sealing: Support nv22 DDO features in the sealing pipeline (#11226) 2024-01-25 15:15:55 +01:00
states_sealing.go feat: sealing: Support nv22 DDO features in the sealing pipeline (#11226) 2024-01-25 15:15:55 +01:00
stats.go fix: miner info: Show correct sector state counts 2023-11-23 21:23:42 +01:00
terminate_batch.go sealing pipeline: Remove useless storage adapter code 2022-08-09 13:40:06 +02:00
types_test.go feat: sealing: Support nv22 DDO features in the sealing pipeline (#11226) 2024-01-25 15:15:55 +01:00
types.go feat: sealing: Support nv22 DDO features in the sealing pipeline (#11226) 2024-01-25 15:15:55 +01:00
upgrade_queue.go feat: sealing: Support nv22 DDO features in the sealing pipeline (#11226) 2024-01-25 15:15:55 +01:00
utils_test.go storage: Move extern/storage-sealing to storage/pipeline 2022-06-14 19:41:59 +02:00
utils.go sealing pipeline: Drop legacy single-pc1 submit path 2023-08-29 13:46:29 +02:00