Łukasz Magiera
80133aaa79
feat: sched: Improve worker assigning logic
2022-04-06 18:24:14 -04:00
Łukasz Magiera
6de4e3d4cd
feat: sched: Cache worker tasks
2022-04-06 18:24:14 -04:00
Łukasz Magiera
68f3e4483f
fix: sealing: Release unsealed sector files after snapdeals abort
2022-04-05 16:45:07 -04:00
Łukasz Magiera
e1ef1b759e
Merge pull request #8206 from firesWu/fix/optimize-worker-tracker-lock
...
release worker tracker lock when call cb func
2022-04-05 12:53:09 -04:00
Łukasz Magiera
2ad3a117f1
fix: sealing: Fix PR1 worker selection
2022-03-31 23:06:17 -04:00
Łukasz Magiera
ac82366b9e
fix: sealing: Fix PR1 worker selection
2022-03-31 17:01:33 -04:00
simlecode
f0944030b7
Added error checking
2022-03-30 10:28:56 +08:00
Łukasz Magiera
3ce467a25f
Merge pull request #8391 from filecoin-project/feat/parallel-fault-check
...
feat: storage: Parallel proving checks
2022-03-29 16:36:12 -04:00
Łukasz Magiera
0710342317
fix waiting in sector proving checks
2022-03-29 15:28:37 -04:00
Łukasz Magiera
ebd34f1884
feat: storage: Parallel proving checks
2022-03-29 11:45:08 -04:00
Aarsh Shah
d0af0eff9f
thread safe piecereader
2022-03-29 19:41:06 +05:30
Łukasz Magiera
7a009abcdd
sealing: Fix TaskType.WorkerType
2022-03-25 18:54:59 -04:00
Łukasz Magiera
82343a06e7
Merge remote-tracking branch 'origin/master' into feat/post-worker
2022-03-25 16:49:46 -04:00
Łukasz Magiera
f1ddb55252
worker: Fix challengeThrottle
2022-03-25 16:07:47 -04:00
Łukasz Magiera
69e8516d1f
stores: log 404 in remote.GenerateSingleVanillaProof
2022-03-25 15:37:35 -04:00
Łukasz Magiera
0b3144f566
workers: PoSt challenge throttle/timeout config
2022-03-24 19:42:44 -04:00
Łukasz Magiera
13701c7ce2
wdpost: Lock update files in snapped sectors
2022-03-24 18:43:08 -04:00
Łukasz Magiera
a53dc5a7c7
workers: WorkerType mehdod on SealTask
2022-03-24 18:28:45 -04:00
Łukasz Magiera
97a73f1c29
sealing: More SnapDeals config knobs
2022-03-21 12:04:23 +01:00
Łukasz Magiera
cca69a6c16
gen
2022-03-21 10:49:30 +01:00
Łukasz Magiera
5365ccfdb1
cli: Show separate worker types in miner info
2022-03-18 21:31:15 +01:00
Łukasz Magiera
36f1dd7bb3
itests: Fix flaky TestWindowPostWorkerSkipBadSector
2022-03-18 20:51:47 +01:00
Łukasz Magiera
7b81369c8c
wdpost: Don't attempt to snark with skipped sectors
2022-03-18 19:45:25 +01:00
Łukasz Magiera
7a1beacd00
ffiwrapper: Test some assumptions about GeneratePoStFallbackSectorChallenges
2022-03-18 13:11:14 +01:00
Łukasz Magiera
8715745feb
wdpost: Dedupe skipped sectors in generateWindowPoSt
2022-03-18 12:10:42 +01:00
Łukasz Magiera
aa124cf414
fix lint issues
2022-03-18 11:38:27 +01:00
Łukasz Magiera
6ddbe41376
Merge remote-tracking branch 'origin/master' into feat/post-worker
2022-03-18 10:54:44 +01:00
Łukasz Magiera
49a4c06a88
fix: sealing: FinalizeSector doesn't need sealed replica access
2022-03-17 17:08:25 +01:00
Łukasz Magiera
b366e2c91f
Merge pull request #8337 from filecoin-project/fix/fin-sealed-acc
...
fix: sealing: FinalizeSector doesn't need sealed replica access
2022-03-17 16:58:51 +01:00
Łukasz Magiera
9debd14b6c
fix: sealing: FinalizeSector doesn't need sealed replica access
2022-03-17 15:15:54 +01:00
Łukasz Magiera
1c055fe83b
Merge branch 'master' into test/t.TempDir
2022-03-17 12:06:52 +01:00
Łukasz Magiera
99c6ef564e
worker: RemoveCopies expects one type at a time
2022-03-16 19:07:42 +01:00
Łukasz Magiera
39e3ddb0ed
storagemgr: MoveStorage in separate steps
2022-03-16 19:07:42 +01:00
Łukasz Magiera
defdea7b49
worker: Call RemoveCopies in MoveStorage
2022-03-16 19:07:42 +01:00
Łukasz Magiera
d249eb3f93
stores: Support RemoveCopies on remote store
2022-03-16 19:07:42 +01:00
Łukasz Magiera
668c33fdcd
stores: http: Support multiple storage IDs in ?keep
2022-03-16 19:07:42 +01:00
Łukasz Magiera
c4259cb594
worker: RemoveCopies expects one type at a time
2022-03-16 12:28:56 +01:00
Łukasz Magiera
5ed5744cb6
storagemgr: MoveStorage in separate steps
2022-03-16 12:28:56 +01:00
Łukasz Magiera
a88edeb79d
worker: Call RemoveCopies in MoveStorage
2022-03-16 12:28:56 +01:00
Łukasz Magiera
4d65e0101d
stores: Support RemoveCopies on remote store
2022-03-16 12:28:56 +01:00
Łukasz Magiera
45b07674e5
stores: http: Support multiple storage IDs in ?keep
2022-03-16 12:28:56 +01:00
Eng Zer Jun
c229842f57
test: use T.TempDir to create temporary test directory
...
The directory created by `T.TempDir` is automatically removed when the
test and all its subtests complete.
Reference: https://pkg.go.dev/testing#T.TempDir
Signed-off-by: Eng Zer Jun <engzerjun@gmail.com>
2022-03-15 00:21:31 +08:00
Łukasz Magiera
ce99aad438
Fix provingCheckProvableCmd
2022-03-11 18:13:51 +01:00
Łukasz Magiera
135aef78d7
Merge remote-tracking branch 'origin/master' into feat/post-worker
2022-03-11 17:04:58 +01:00
Łukasz Magiera
ad66ad4f7d
fix: sealing fsm: Handle inputLk correctly
2022-03-11 13:34:14 +01:00
Łukasz Magiera
91ccb7fbda
fix: piece provider: Don't log CIDs as binary
2022-03-10 14:28:18 +01:00
Łukasz Magiera
046a9f8af0
Merge remote-tracking branch 'origin/master' into feat/post-worker
2022-03-09 16:27:03 +01:00
Łukasz Magiera
a6892f956e
Merge pull request #7844 from llifezou/add_workerName_in_sealing_err
...
feat: #6147 : Include worker name in sealing errors
2022-03-02 13:13:34 +00:00
zenground0
f138ae8882
Less verbose sector manager logging
2022-03-01 10:52:09 -07:00
Jerry
8f95cd4149
release worker tracker lock when call cb func
2022-02-28 16:55:04 +08:00
jennijuju
f21ddf0c50
Merge branch 'releases' into jen/releasesbacktomaster
2022-02-25 20:54:11 -05:00
llifezou
dac5518005
Update extern/sector-storage/worker_local.go
...
Co-authored-by: Łukasz Magiera <magik6k@users.noreply.github.com>
2022-02-25 11:12:18 +08:00
Jiaying Wang
ec6b786fbf
Merge pull request #8182 from filecoin-project/jen/backports
...
chore: backports: snappy related improvements/bug fixes
2022-02-24 18:07:41 -05:00
zenground0
e5de237990
Fix fault tracker to handle snap deals
2022-02-24 17:53:21 -05:00
Jiaying Wang
f9641d70af
fix: sealing: missing file type
2022-02-24 16:27:24 -05:00
zenground0
abe04c33c1
Fix fault tracker to handle snap deals
2022-02-23 09:56:47 -07:00
Aayush
56df886b55
fix: sealer: allow enable/disabling ReplicaUpdate tasks
2022-02-14 15:24:13 -05:00
Aayush
eebe784191
fix: sealer: allow enable/disabling ReplicaUpdate tasks
2022-02-14 15:08:28 -05:00
Łukasz Magiera
02c0fb7b65
ffiwrapper: Use ClearCache for update cache cleanup
2022-02-10 17:32:13 -05:00
Łukasz Magiera
9f54c4d002
Fix CheckProvable with updated sectors
2022-02-10 17:30:23 -05:00
Łukasz Magiera
ecc1f4b8f1
Make FinalizeReplicaUpdate actually do cleanup
2022-02-10 17:29:52 -05:00
Łukasz Magiera
ea32b415f0
Fix missing FinalizeReplicaUpdate in tests
2022-02-10 17:29:47 -05:00
Łukasz Magiera
53e1f75c2c
Add FinalizeReplicaUpdate into some more places
2022-02-10 17:27:49 -05:00
Łukasz Magiera
9a117fa39a
try ClearCache for update cache
2022-02-10 17:27:24 -05:00
Łukasz Magiera
212f5ddb4f
wip FinalizeReplicaUpdate
2022-02-10 17:24:26 -05:00
Łukasz Magiera
f33cf74d0f
ffiwrapper: Use ClearCache for update cache cleanup
2022-02-09 14:54:36 +01:00
Łukasz Magiera
b1a74d71f1
Fix CheckProvable with updated sectors
2022-02-09 14:41:36 +01:00
Łukasz Magiera
6123339baf
Make FinalizeReplicaUpdate actually do cleanup
2022-02-08 17:45:26 +01:00
Łukasz Magiera
c8e0341248
Fix missing FinalizeReplicaUpdate in tests
2022-02-08 17:22:41 +01:00
Łukasz Magiera
09cfad9d71
Add FinalizeReplicaUpdate into some more places
2022-02-08 17:22:41 +01:00
Łukasz Magiera
e271bae5ec
try ClearCache for update cache
2022-02-08 17:22:41 +01:00
Łukasz Magiera
142ba6660a
wip FinalizeReplicaUpdate
2022-02-08 17:22:41 +01:00
Łukasz Magiera
b74e085272
don't sort
2022-02-02 19:08:21 +00:00
Łukasz Magiera
efdb854a7c
fix some races
2022-01-31 20:53:25 +00:00
Łukasz Magiera
98f4d37f1a
Merge remote-tracking branch 'origin/master' into feat/post-worker
2022-01-31 19:50:52 +00:00
Darko Brdareski
e51ce5c508
Merge remote-tracking branch 'upstream/master' into bloxico/system-test-matrix
2022-01-27 10:57:56 +01:00
Aayush Rajasekaran
a6460be37b
remove a log
2022-01-25 13:02:45 -05:00
Aayush
e17ae2eaf4
fix: sealer: manager should lock Unsealed for ReplicaUpdate
2022-01-25 13:01:37 -05:00
Aayush
6d567b36e3
Fix: sealer: ReplicaUpdate should fetch the correct files
2022-01-25 13:01:27 -05:00
Aayush Rajasekaran
7b7ab016db
create replica update paths in acquireSectors
2022-01-25 13:01:18 -05:00
Aayush Rajasekaran
a3c5fadcc0
feat: sealing: Add ReplicaUpdate work to Resource table
2022-01-25 13:01:05 -05:00
Aayush Rajasekaran
2d0929e305
remove a log
2022-01-25 12:55:56 -05:00
Aayush Rajasekaran
92e6f29cc8
chore: sealer: quieten a log
2022-01-24 18:28:52 -05:00
Aayush
5cafdc2f29
fix: sealer: manager should lock Unsealed for ReplicaUpdate
2022-01-21 11:12:12 -05:00
Aayush Rajasekaran
ff845aa793
Merge pull request #7977 from filecoin-project/chore/sealtasks-comment
...
chore: remove inaccurate comment in sealtasks
2022-01-21 10:53:04 -05:00
Łukasz Magiera
f148397e1b
post workers: Fix race in setting vproofs
2022-01-21 12:31:24 +01:00
Łukasz Magiera
82c9e72aab
post workers: Fix skipped handling
2022-01-21 10:39:14 +01:00
Łukasz Magiera
4682e72cf4
Address review
2022-01-21 10:11:04 +01:00
Łukasz Magiera
1e5e69ec9d
Typos
...
Co-authored-by: Aayush Rajasekaran <arajasek94@gmail.com>
2022-01-21 10:02:00 +01:00
Aayush
752f4a3d67
Fix: sealer: ReplicaUpdate should fetch the correct files
2022-01-20 15:06:53 -05:00
Łukasz Magiera
33dfcf2663
stores: Fix single post proof reading with updated sectors
2022-01-20 15:27:42 +01:00
Łukasz Magiera
e476cf7968
Merge remote-tracking branch 'origin/master' into feat/post-worker
2022-01-20 13:15:48 +01:00
Aayush Rajasekaran
ab8bf393c2
create replica update paths in acquireSectors
2022-01-19 11:41:38 -05:00
Aayush Rajasekaran
d0390181ec
feat: sealing: Add ReplicaUpdate work to Resource table
2022-01-19 11:41:32 -05:00
Łukasz Magiera
c41ccb6c37
chore: remove inaccurate comment in sealtasks
2022-01-19 10:46:37 +01:00
Łukasz Magiera
fa09b9afb1
post workers: Share resource accounting code
2022-01-18 16:02:37 +01:00
Łukasz Magiera
8ac20305df
Fix double unlock in WorkerStats
2022-01-18 12:40:04 +01:00
Łukasz Magiera
c79f2b9d38
post workers: Fix lint
2022-01-18 12:11:59 +01:00
Łukasz Magiera
b38141601c
Untangle ffi from api
2022-01-18 11:57:04 +01:00
Łukasz Magiera
03fa955e9e
Cleanup imports
2022-01-18 11:37:24 +01:00
