Łukasz Magiera
6981f776f4
Lower PC2 memory requirements
2020-10-01 00:54:53 +02:00
Łukasz Magiera
1b7cdb9341
Fix storage manager tests
2020-10-01 00:54:34 +02:00
Łukasz Magiera
5e08d56630
sched: Allow some single-thread tasks to run in parallel with PC2/C2
2020-10-01 00:28:44 +02:00
Łukasz Magiera
bc85e3ce50
Merge pull request #4107 from shaodan/worker-no-swap
...
Add --no-swap flag for worker
2020-09-30 09:25:57 +02:00
Dan Shao
1affd498c1
Add --no-swap flag for worker
2020-09-30 14:23:35 +08:00
Łukasz Magiera
baef3c8dd2
sectorstorage: Fix potential panic in FinalizeSector
2020-09-29 15:22:46 +02:00
Łukasz Magiera
70faa36b7f
Merge remote-tracking branch 'origin/master' into refactor/net-upgrade
2020-09-18 19:29:06 +02:00
Łukasz Magiera
e632643801
api: Test return types
2020-09-17 12:24:50 +02:00
hannahhoward
7dc091052a
feat(manager): less restrictive storage lock
...
Use initial less restrictive storage lock when trying to read unsealed data before acquiring more
restrictive lock needed for unsealing
2020-09-14 18:48:14 -07:00
Łukasz Magiera
bbac86f745
gofmt, mod tidy
2020-09-10 22:07:20 +02:00
Łukasz Magiera
c7b0241a48
ffiwrapper: Test skipping corrupted sectors in PoSt
2020-09-10 21:19:26 +02:00
Łukasz Magiera
5e7737f55d
wdpost: Handle skipped sectors correctly
2020-09-10 02:59:37 +02:00
whyrusleeping
7a6ceebb34
windowed post generation now returns faulty sectors
2020-09-09 14:00:15 -07:00
Dirk McCormick
17c15a74a2
fix: return true from Sealer.ReadPiece() on success
2020-09-08 13:50:56 +02:00
Dirk McCormick
8bbdf2e7cb
fix: storage manager - bail out on undefined unsealed cid
2020-09-08 12:54:01 +02:00
Aayush Rajasekaran
d678fe4bfa
Fix tests
2020-09-07 15:48:42 -04:00
Aayush Rajasekaran
39755a294a
Update to specs v0.9.6
2020-09-07 15:48:41 -04:00
Łukasz Magiera
47c59afea0
Revert "storage manager: bail out with an error if unsealed cid is undefined"
2020-09-07 20:12:29 +02:00
Dirk McCormick
a97f978cad
fix: storage manager - dont fail on successful read piece
2020-09-07 16:14:19 +02:00
Dirk McCormick
07a4553e6e
fix: storage manager - bail out with an error if unsealed cid is undefined
2020-09-07 16:04:12 +02:00
Łukasz Magiera
b774563ec3
Merge pull request #3492 from filecoin-project/fix/readpiece-panic
...
ffiwrapper: Fix ReadPiece panic
2020-09-02 18:59:22 +02:00
Łukasz Magiera
ca7aa69597
ffiwrapper: More correct error check on openPartialFile
2020-09-02 18:45:07 +02:00
Łukasz Magiera
5a2b439773
sched: Fix tests
2020-09-02 17:37:19 +02:00
Łukasz Magiera
7fe8580da5
sealing sched: Fix deadlock between worker.wndLk / workersLk
2020-09-02 17:06:48 +02:00
Star.LI
82f5984de1
fix crash - segment fault when partialFile.Allocated() is invoked.
...
When openPartialFile is invoked, more errors than "existed error" are
returned. If only existing error is checked, the allocated field of
partialFile may be nil.
Signed-off-by: Star.LI <star@trapdoortech.com>
2020-09-01 11:41:26 +02:00
Łukasz Magiera
e14c80360d
sealing sched: Factor worker queues into utilization calc
2020-08-31 13:41:34 +02:00
Łukasz Magiera
98d51d3d80
storage: Correcty move unsealed sectors in FinalizeSector
2020-08-31 12:45:57 +02:00
Łukasz Magiera
28ac2fce61
sched: Fix panic in workerCompactWindows
2020-08-29 06:41:19 +02:00
Łukasz Magiera
9d0c8ae3dd
sectorstorage: update sched tests for new logic
2020-08-28 21:38:21 +02:00
Łukasz Magiera
4a75e1e4b4
sectorstorage: Don't require tasks within a window to run in order
2020-08-28 19:38:55 +02:00
Łukasz Magiera
11b11e416b
sectorstorage: Compact assigned windows
2020-08-28 18:26:38 +02:00
Łukasz Magiera
5ee85dc263
sectorstorage: Fix tests
2020-08-28 16:33:41 +02:00
Łukasz Magiera
6d1682a27e
storagefsm: wire up RecoverDealIDs fully
2020-08-28 11:44:15 +02:00
Łukasz Magiera
1097d29213
sealing sched: Call trySched less when there are many tasks
2020-08-28 00:03:42 +02:00
Łukasz Magiera
59d2034cbb
sealing sched: Wait a bit for tasks to come in on restart
2020-08-27 23:58:37 +02:00
Łukasz Magiera
7fdffc0340
sealing sched: Give more priority to tasks (re)moving data
2020-08-27 23:29:39 +02:00
Łukasz Magiera
f2bd680cc5
gofmt
2020-08-27 23:14:46 +02:00
Łukasz Magiera
59f554b658
sealing sched: Show waiting tasks assigned to workers in sealing jobs cli
2020-08-27 23:14:33 +02:00
Steven Allen
0155a31d1f
Fix PoSt with bad sectors
...
"skipped" sectors must be replaced with a substitute "good" sector, or the
entire partition must be skipped. They should not just be omitted.
This patch also fixes the test to verify the _entire_ proof instead of just
verifying that the proof includes the correct sectors.
2020-08-26 09:56:51 -07:00
Łukasz Magiera
d9796cd25c
sectorstorage: Make trySched less very slow
2020-08-24 19:16:16 +02:00
Łukasz Magiera
4311c96a44
Merge pull request #3225 from filecoin-project/fix/sched-missing-worker
...
check that worker referenced by task is actually still there.
2020-08-22 22:16:32 +02:00
whyrusleeping
54862be3ff
check that worker referenced by task is actually still there.
2020-08-21 10:33:36 -07:00
Steven Allen
5733c71c50
Lint everything
...
We were ignoring quite a few error cases, and had one case where we weren't
actually updating state where we wanted to. Unfortunately, if the linter doesn't
pass, nobody has any reason to actually check lint failures in CI.
There are three remaining XXXs marked in the code for lint.
2020-08-20 20:46:36 -07:00
Łukasz Magiera
6ef7a30b19
Merge pull request #3089 from filecoin-project/integrate/storage-fsm
...
integrate extern/{storage-fsm,sector-storage} into lotus source tree
2020-08-17 18:37:54 +02:00
Raúl Kripalani
1f016262cd
readd int64 cast + nolint directive.
2020-08-17 17:26:07 +01:00
Raúl Kripalani
efdc428d5d
keep storage-fsm (renamed to storage-sealing) and sector-storage in extern.
2020-08-17 14:26:18 +01:00
yaohcn
39bcfab37c
make addpiece configurable
2020-08-17 17:39:50 +08:00
Raúl Kripalani
3c17cd655e
integrate extern/sector-storage into lotus proper.
2020-08-16 11:09:58 +01:00
Łukasz Magiera
632fd36205
sealing sched: Fix deadlock in worker watcher
2020-08-13 12:17:24 +02:00
yaohcn
1555984785
change to RLock
2020-08-13 17:31:18 +08:00
