cerc-io/lotus
16
0
Fork 0
Code Issues Pull Requests Packages Projects Releases 27 Wiki Activity
01ec229749
lotus/curiosrc/seal
History
Łukasz Magiera 01ec229749
feat: curio: Keep more sector metadata in the DB long-term (#11933) 
* feat: curio: Migrate lotus-miner sector metadata into Curio DB

* curio seal: Transfer seal pipeline entries to long-term sector metadata table

* curio: Only open db in sectors migrate cmd

* curio: Add an envvar to force migration

* curio: Debugging sector migration

* curio: Fix typo in table name

* curio: Plumb KeepUnsealed into the sealing pipeline

* Don't add redundant keep_data to sdr pipeline pieces table

* fix transferFinalizedSectorData where check

* ui for sector fail

---------

Co-authored-by: Andrew Jackson (Ajax) <snadrus@gmail.com>
2024-05-07 13:03:51 +02:00
..
finalize_pieces.go Merge remote-tracking branch 'origin/master' into feat/lpdeal-cache 2024-03-17 17:31:26 +01:00
poller_commit_msg.go feat: Curio - Easy Migration (#11617) 2024-03-15 16:38:13 -05:00
poller_precommit_msg.go curio: feat: break trees task into TreeD(prefetch) and TreeRC (#11895) 2024-05-02 11:17:33 +02:00
poller.go curio: feat: break trees task into TreeD(prefetch) and TreeRC (#11895) 2024-05-02 11:17:33 +02:00
README.md rename lotus-provider 2024-04-04 14:32:06 +02:00
sector_num_alloc.go feat: Curio - Easy Migration (#11617) 2024-03-15 16:38:13 -05:00
task_finalize.go Merge remote-tracking branch 'origin/master' into feat/lpdeal-cache 2024-03-17 17:31:26 +01:00
task_movestorage.go curio: feat: break trees task into TreeD(prefetch) and TreeRC (#11895) 2024-05-02 11:17:33 +02:00
task_porep.go fix: curio seal: Failed commit retry strategy (#11870) 2024-04-30 11:16:44 +02:00
task_sdr.go curio: feat: break trees task into TreeD(prefetch) and TreeRC (#11895) 2024-05-02 11:17:33 +02:00
task_submit_commit.go feat: curio: Keep more sector metadata in the DB long-term (#11933) 2024-05-07 13:03:51 +02:00
task_submit_precommit.go fix: curio: Check deal start epoch passed in PrecommitSubmit (#11873) 2024-04-15 10:48:45 -05:00
task_treed_test.go curio: feat: break trees task into TreeD(prefetch) and TreeRC (#11895) 2024-05-02 11:17:33 +02:00
task_treed.go curio: feat: break trees task into TreeD(prefetch) and TreeRC (#11895) 2024-05-02 11:17:33 +02:00
task_treerc.go curio: feat: break trees task into TreeD(prefetch) and TreeRC (#11895) 2024-05-02 11:17:33 +02:00

README.md

Curio Sealer

Overview

The Curio sealer is a collection of harmony tasks and a common poller which implement the sealing functionality of the Filecoin protocol.

Pipeline Tasks

  • SDR pipeline
    • SDR - Generate SDR layers
    • SDRTrees - Generate tree files (TreeD, TreeR, TreeC)
    • PreCommitSubmit - Submit precommit message to the network
    • PoRep - Generate PoRep proof
    • CommitSubmit - Submit commit message to the network

Poller

The poller is a background process running on every node which runs any of the SDR pipeline tasks. It periodically checks the state of sectors in the SDR pipeline and schedules any tasks to run which will move the sector along the pipeline.

Error Handling

  • Pipeline tasks are expected to always finish successfully as harmonytask tasks. If a sealing task encounters an error, it should mark the sector pipeline entry as failed and exit without erroring. The poller will then figure out a recovery strategy for the sector.