lotus/curiosrc/seal
LexLuthr 00edad4e4d
curio: feat: break trees task into TreeD(prefetch) and TreeRC (#11895)
* break trees task

* fix TreeD reservation

* fix nil pointer err

* apply suggestions

* fix allocate file types

* fix dbIndex inserts

* set resource, move release func

* refactor func(), update memory

* remove extra release
2024-05-02 11:17:33 +02:00
..
finalize_pieces.go Merge remote-tracking branch 'origin/master' into feat/lpdeal-cache 2024-03-17 17:31:26 +01:00
poller_commit_msg.go feat: Curio - Easy Migration (#11617) 2024-03-15 16:38:13 -05:00
poller_precommit_msg.go curio: feat: break trees task into TreeD(prefetch) and TreeRC (#11895) 2024-05-02 11:17:33 +02:00
poller.go curio: feat: break trees task into TreeD(prefetch) and TreeRC (#11895) 2024-05-02 11:17:33 +02:00
README.md rename lotus-provider 2024-04-04 14:32:06 +02:00
sector_num_alloc.go feat: Curio - Easy Migration (#11617) 2024-03-15 16:38:13 -05:00
task_finalize.go Merge remote-tracking branch 'origin/master' into feat/lpdeal-cache 2024-03-17 17:31:26 +01:00
task_movestorage.go curio: feat: break trees task into TreeD(prefetch) and TreeRC (#11895) 2024-05-02 11:17:33 +02:00
task_porep.go fix: curio seal: Failed commit retry strategy (#11870) 2024-04-30 11:16:44 +02:00
task_sdr.go curio: feat: break trees task into TreeD(prefetch) and TreeRC (#11895) 2024-05-02 11:17:33 +02:00
task_submit_commit.go feat: Curio - Easy Migration (#11617) 2024-03-15 16:38:13 -05:00
task_submit_precommit.go fix: curio: Check deal start epoch passed in PrecommitSubmit (#11873) 2024-04-15 10:48:45 -05:00
task_treed_test.go curio: feat: break trees task into TreeD(prefetch) and TreeRC (#11895) 2024-05-02 11:17:33 +02:00
task_treed.go curio: feat: break trees task into TreeD(prefetch) and TreeRC (#11895) 2024-05-02 11:17:33 +02:00
task_treerc.go curio: feat: break trees task into TreeD(prefetch) and TreeRC (#11895) 2024-05-02 11:17:33 +02:00

Curio Sealer

Overview

The Curio sealer is a collection of harmony tasks and a common poller which implement the sealing functionality of the Filecoin protocol.

Pipeline Tasks

  • SDR pipeline
    • SDR - Generate SDR layers
    • SDRTrees - Generate tree files (TreeD, TreeR, TreeC)
    • PreCommitSubmit - Submit precommit message to the network
    • PoRep - Generate PoRep proof
    • CommitSubmit - Submit commit message to the network

Poller

The poller is a background process running on every node which runs any of the SDR pipeline tasks. It periodically checks the state of sectors in the SDR pipeline and schedules any tasks to run which will move the sector along the pipeline.

Error Handling

  • Pipeline tasks are expected to always finish successfully as harmonytask tasks. If a sealing task encounters an error, it should mark the sector pipeline entry as failed and exit without erroring. The poller will then figure out a recovery strategy for the sector.