Commit Graph

43 Commits

Author SHA1 Message Date
Łukasz Magiera
9fd91bb70a sched: function to dump scheduler state 2020-07-27 12:17:50 +02:00
Łukasz Magiera
ff9ffddd57 remote: Limit parallel fetches 2020-07-24 16:43:46 +02:00
Łukasz Magiera
c7da20e53c Add api to get active tasks 2020-07-21 20:01:25 +02:00
Łukasz Magiera
f1b3837186 fix worker setup/cleanup raciness 2020-07-17 12:59:12 +02:00
Łukasz Magiera
be6b88f406 Some sched tests 2020-07-16 23:41:04 +02:00
Łukasz Magiera
0bc41d562d Move statfs to fsutil 2020-07-08 16:58:18 +02:00
Łukasz Magiera
77cf6e49a0
Merge pull request #65 from filecoin-project/feat/local-space-alloc
Better storage reservation logic
2020-07-08 01:27:59 +02:00
Łukasz Magiera
c5a96fdd08 Change PathType to string 2020-07-06 16:13:42 +02:00
Łukasz Magiera
636bf90f84 Don't error in ReleaseUnsealed 2020-07-03 22:23:36 +02:00
Łukasz Magiera
57bda914f9 fix: Don't try to move removed unsealed sector files 2020-06-24 00:04:02 +02:00
Łukasz Magiera
07cf84cbc7 Update specs-storage, sector removing support 2020-06-22 17:06:09 +02:00
yaohcn
92a6ba8a57 finalize not sched on unsealed worker 2020-06-19 09:43:19 +08:00
Łukasz Magiera
13176e8b53 Cleanup PathType usages 2020-06-04 23:30:20 +02:00
Łukasz Magiera
b3cde66bd2 Recover from half-successful FinalizeSector 2020-06-04 21:15:15 +02:00
Łukasz Magiera
b5674f12f0 Allow FinalizeSector on all nodes 2020-06-03 23:45:05 +02:00
Łukasz Magiera
a39bc94c58 Integrate index locks into manager 2020-06-03 22:00:43 +02:00
Łukasz Magiera
d9d3ccf6c6 index: Implement basic global sector locking system 2020-06-03 21:21:27 +02:00
Łukasz Magiera
2184f21dd2 make unseal actually work in lotus 2020-05-29 18:57:44 +02:00
Łukasz Magiera
793d332002 Move UnpaddedByteIndex from FFI wrapper 2020-05-26 10:25:17 +02:00
Łukasz Magiera
8898eb8206 Merge remote-tracking branch 'origin/master' into feat/unseal 2020-05-20 22:29:05 +02:00
Łukasz Magiera
33673a30c7 Wire up unsealing logic, track primary sector copies 2020-05-20 18:36:46 +02:00
Łukasz Magiera
a9631587f0
Merge pull request #33 from filecoin-project/feat/sched-sequential-ids
sched: Take sector numbers into accout when scheduling work
2020-05-18 15:31:36 +02:00
Łukasz Magiera
f577c2120c Partial Files, use for sealing 2020-05-18 15:22:35 +02:00
Łukasz Magiera
450b0b8acb very simple fault check function 2020-05-16 23:08:24 +02:00
Łukasz Magiera
4065c94c1f Scaffolding for UnsealRange 2020-05-16 01:10:04 +02:00
Łukasz Magiera
617d34b9de sched: Take sector numbers into accout when scheduling work 2020-05-14 01:58:01 +02:00
Łukasz Magiera
cb0bb31d06 sched: Handle closing workers 2020-05-01 20:00:17 +02:00
Łukasz Magiera
d399312786 sched: virtual resource pool for prefetching sector data 2020-04-27 22:50:30 +02:00
Łukasz Magiera
8c4dc60e75 move scheduling logic to a separate struct 2020-04-27 20:37:36 +02:00
Łukasz Magiera
5bea676ce3 worker: Fetch task type 2020-04-27 14:55:37 +02:00
Łukasz Magiera
9eb049a833 move WorkerInfo to not require importing ffi 2020-04-24 00:20:53 +02:00
Łukasz Magiera
afebab334e Update imports; Add build scripts 2020-03-28 00:21:36 +01:00
Łukasz Magiera
9be406482b sectorstorage: Untangle from lotus deps 2020-03-27 22:35:33 +01:00
Łukasz Magiera
617e3135c1 Cleanup after dropping sectorbuilder 2020-03-26 20:35:16 +01:00
Łukasz Magiera
e8e90300f0 Merge sectorbuilder into sectorstorage 2020-03-26 03:51:06 +01:00
Łukasz Magiera
db93e784ab workers: gofmt 2020-03-25 21:20:24 +01:00
Łukasz Magiera
817e699738 sectorstorage: wire up closing logic 2020-03-25 00:52:55 +01:00
Łukasz Magiera
2900bb099f storageminer: Config for local worker task types 2020-03-24 20:38:00 +01:00
Łukasz Magiera
dce6d8e4ae workers: Address review 2020-03-24 19:01:04 +01:00
Łukasz Magiera
290b7ebd26 storageminer: More storage stats in storage list 2020-03-23 23:43:38 +01:00
Łukasz Magiera
6842b4cb46 sectorstorage: Enable sealing on the local worker by default 2020-03-23 17:28:40 +01:00
Łukasz Magiera
68e279b399 workers: Basic monitoring tools 2020-03-23 15:56:22 +01:00
Łukasz Magiera
e40c5d441d Rename agvmgr+sealmgr to sectorstorage 2020-03-23 12:47:10 +01:00