lotus/curiosrc/seal
LexLuthr 7e3846c669
feat: curio: allow multiple pieces per sector (#11935)
* multiple piece per sector, DDO deals

* in memory to DB

* sql parser

* add seal command

* multi piece TreeD

* redo filler pieces

* remove psql exception handling

* fix deal sectors porep

* fix tests

* ddo deals

* lower SDR cpu for test

* devnet cpu 0

* get params for itest

* fix itest sector size

* revert sdr devnet cpu

* improve SectorStatus API

* account for verified constraints
2024-05-22 10:08:32 +02:00
..
finalize_pieces.go Merge remote-tracking branch 'origin/master' into feat/lpdeal-cache 2024-03-17 17:31:26 +01:00
poller_commit_msg.go feat: Curio - Easy Migration (#11617) 2024-03-15 16:38:13 -05:00
poller_precommit_msg.go curio: feat: break trees task into TreeD(prefetch) and TreeRC (#11895) 2024-05-02 11:17:33 +02:00
poller.go Remove "provider" relics (#11992) 2024-05-14 14:50:31 -05:00
README.md rename lotus-provider 2024-04-04 14:32:06 +02:00
sector_num_alloc.go feat: Curio - Easy Migration (#11617) 2024-03-15 16:38:13 -05:00
task_finalize.go fix: curio: Drop FKs from pipeline to fix retry loops (#11973) 2024-05-15 17:40:40 +02:00
task_movestorage.go fix: curio: Drop FKs from pipeline to fix retry loops (#11973) 2024-05-15 17:40:40 +02:00
task_porep.go feat: curio: allow multiple pieces per sector (#11935) 2024-05-22 10:08:32 +02:00
task_sdr.go feat: curio: allow multiple pieces per sector (#11935) 2024-05-22 10:08:32 +02:00
task_submit_commit.go feat: curio: allow multiple pieces per sector (#11935) 2024-05-22 10:08:32 +02:00
task_submit_precommit.go feat: curio: allow multiple pieces per sector (#11935) 2024-05-22 10:08:32 +02:00
task_treed_test.go curio: feat: break trees task into TreeD(prefetch) and TreeRC (#11895) 2024-05-02 11:17:33 +02:00
task_treed.go feat: curio: allow multiple pieces per sector (#11935) 2024-05-22 10:08:32 +02:00
task_treerc.go feat: curio: allow multiple pieces per sector (#11935) 2024-05-22 10:08:32 +02:00

Curio Sealer

Overview

The Curio sealer is a collection of harmony tasks and a common poller which implement the sealing functionality of the Filecoin protocol.

Pipeline Tasks

  • SDR pipeline
    • SDR - Generate SDR layers
    • SDRTrees - Generate tree files (TreeD, TreeR, TreeC)
    • PreCommitSubmit - Submit precommit message to the network
    • PoRep - Generate PoRep proof
    • CommitSubmit - Submit commit message to the network

Poller

The poller is a background process running on every node which runs any of the SDR pipeline tasks. It periodically checks the state of sectors in the SDR pipeline and schedules any tasks to run which will move the sector along the pipeline.

Error Handling

  • Pipeline tasks are expected to always finish successfully as harmonytask tasks. If a sealing task encounters an error, it should mark the sector pipeline entry as failed and exit without erroring. The poller will then figure out a recovery strategy for the sector.