History

Łukasz Magiera 2293ecd8e8 Reduce lotus-miner startup spam		2021-08-27 19:41:54 +02:00
..
docs
ffiwrapper	resolve merge conflicts	2021-06-22 11:28:23 +02:00
fr32
fsutil
mock	resolve merge conflicts	2021-06-22 11:28:23 +02:00
partialfile	do not depend on filecoin-ffi in api package	2021-06-07 11:51:25 +02:00
sealtasks
stores	Update extern/sector-storage/stores/remote.go	2021-07-06 17:24:56 +02:00
storiface	integrate DAG store and CARv2 in deal-making (#6671 )	2021-08-16 23:34:32 +01:00
tarutil
cbor_gen.go	integrate DAG store and CARv2 in deal-making (#6671 )	2021-08-16 23:34:32 +01:00
faults.go	fix: don't check for t_aux when proving	2021-08-09 11:07:35 -07:00
manager_calltracker.go
manager_test.go
manager.go	Reduce lotus-miner startup spam	2021-08-27 19:41:54 +02:00
piece_provider_test.go	fix signature	2021-07-06 18:12:30 +02:00
piece_provider.go
README.md
request_queue_test.go
request_queue.go
resources.go
roprov.go
sched_resources.go	move scheduling filtering logic down.	2021-06-21 20:49:16 +01:00
sched_test.go	add a unit test.	2021-06-21 20:49:24 +01:00
sched_worker.go	move scheduling filtering logic down.	2021-06-21 20:49:16 +01:00
sched.go	move scheduling filtering logic down.	2021-06-21 20:49:16 +01:00
selector_alloc.go
selector_existing.go
selector_task.go
stats.go
teststorage_test.go
testworker_test.go
worker_calltracker.go
worker_local.go	add ability to ignore worker resources when scheduling.	2021-06-21 20:08:18 +01:00
worker_tracked.go

README.md

sector-storage

a concrete implementation of the specs-storage interface

The sector-storage project provides a implementation-nonspecific reference implementation of the specs-storage interface.

Disclaimer

Please report your issues with regards to sector-storage at the lotus issue tracker

Architecture

`Manager`

Manages is the top-level piece of the storage system gluing all the other pieces together. It also implements scheduling logic.

`package stores`

This package implements the sector storage subsystem. Fundamentally the storage is divided into paths, each path has it's UUID, and stores a set of sector 'files'. There are currently 3 types of sector files - unsealed, sealed, and cache.

Paths can be shared between nodes by sharing the underlying filesystem.

`stores.Local`

The Local store implements SectorProvider for paths mounted in the local filesystem. Paths can be shared between nodes, and support shared filesystems such as NFS.

stores.Local implements all native filesystem-related operations

`stores.Remote`

The Remote store extends Local store, handles fetching sector files into a local store if needed, and handles removing sectors from non-local stores.

`stores.Index`

The Index is a singleton holding metadata about storage paths, and a mapping of sector files to paths

`LocalWorker`

LocalWorker implements the Worker interface with ffiwrapper.Sealer and a store.Store instance

License

The Filecoin Project is dual-licensed under Apache 2.0 and MIT terms:

Apache License, Version 2.0, (LICENSE-APACHE or http://www.apache.org/licenses/LICENSE-2.0)
MIT license (LICENSE-MIT or http://opensource.org/licenses/MIT)