Łukasz Magiera
f2c0ba1df5
Merge pull request #8329 from filecoin-project/fix/snap-worker-cleanup
...
fix: sealing: Remove sector copies from workers after snapdeals
2022-03-16 18:48:21 +01:00
Łukasz Magiera
193c84811a
feat: sealing: Linter did have a good point
2022-03-16 17:45:22 +01:00
Łukasz Magiera
aef2ec513f
feat: sealing: Sector upgrade queue
2022-03-16 17:33:05 +01:00
Aayush
16128a0212
Merge branch 'master' into feat/fvm
2022-03-16 11:57:46 -04:00
Łukasz Magiera
9f6f94bd02
Merge pull request #8215 from filecoin-project/feat/remove-mark-for-upgrade
...
chore:sealing:remove endpoint from cli
2022-03-16 15:33:21 +01:00
Łukasz Magiera
c4259cb594
worker: RemoveCopies expects one type at a time
2022-03-16 12:28:56 +01:00
Łukasz Magiera
5ed5744cb6
storagemgr: MoveStorage in separate steps
2022-03-16 12:28:56 +01:00
Łukasz Magiera
a88edeb79d
worker: Call RemoveCopies in MoveStorage
2022-03-16 12:28:56 +01:00
Łukasz Magiera
4d65e0101d
stores: Support RemoveCopies on remote store
2022-03-16 12:28:56 +01:00
Łukasz Magiera
45b07674e5
stores: http: Support multiple storage IDs in ?keep
2022-03-16 12:28:56 +01:00
Aayush
6c51adc334
Update FFI: fix cargo.lock
2022-03-15 11:07:25 -04:00
Eng Zer Jun
c229842f57
test: use T.TempDir to create temporary test directory
...
The directory created by `T.TempDir` is automatically removed when the
test and all its subtests complete.
Reference: https://pkg.go.dev/testing#T.TempDir
Signed-off-by: Eng Zer Jun <engzerjun@gmail.com>
2022-03-15 00:21:31 +08:00
Aayush
67889b473c
Merge branch 'master' into feat/fvm
2022-03-12 11:12:23 -05:00
Aayush
d2054e8653
FVM: support nv15
2022-03-11 17:03:34 -05:00
Łukasz Magiera
ce99aad438
Fix provingCheckProvableCmd
2022-03-11 18:13:51 +01:00
Łukasz Magiera
135aef78d7
Merge remote-tracking branch 'origin/master' into feat/post-worker
2022-03-11 17:04:58 +01:00
Łukasz Magiera
ad66ad4f7d
fix: sealing fsm: Handle inputLk correctly
2022-03-11 13:34:14 +01:00
Łukasz Magiera
91ccb7fbda
fix: piece provider: Don't log CIDs as binary
2022-03-10 14:28:18 +01:00
Łukasz Magiera
046a9f8af0
Merge remote-tracking branch 'origin/master' into feat/post-worker
2022-03-09 16:27:03 +01:00
zenground0
b81d189ec1
Log instead of error normal shutdown of state machine
2022-03-02 13:03:03 -07:00
zenground0
874124c4e7
Handle finalize failures in fsm
2022-03-02 09:33:33 -07:00
Aayush
0a67b6e222
Merge branch 'master' into feat/fvm
2022-03-02 11:24:48 -05:00
Łukasz Magiera
6d464c478e
Merge pull request #8160 from filecoin-project/fix/addpiece-idempotent
...
feat: Make add piece idempotent
2022-03-02 15:10:16 +00:00
Łukasz Magiera
a6892f956e
Merge pull request #7844 from llifezou/add_workerName_in_sealing_err
...
feat: #6147 : Include worker name in sealing errors
2022-03-02 13:13:34 +00:00
Jiaying Wang
e0922a7dd2
pay for the collateral difference needed if the miner available balance is insufficient
2022-03-01 21:56:12 -05:00
zenground0
59ef2fe1b8
Remove unused fields from sealing
2022-03-01 11:46:36 -07:00
zenground0
a463c90057
remove endpoint from cli
2022-03-01 11:27:03 -07:00
zenground0
f138ae8882
Less verbose sector manager logging
2022-03-01 10:52:09 -07:00
Aayush
dd91857bf6
Merge branch 'master' into feat/fvm
2022-02-28 22:17:20 -05:00
Jerry
8f95cd4149
release worker tracker lock when call cb func
2022-02-28 16:55:04 +08:00
jennijuju
f21ddf0c50
Merge branch 'releases' into jen/releasesbacktomaster
2022-02-25 20:54:11 -05:00
llifezou
dac5518005
Update extern/sector-storage/worker_local.go
...
Co-authored-by: Łukasz Magiera <magik6k@users.noreply.github.com>
2022-02-25 11:12:18 +08:00
Jiaying Wang
ec6b786fbf
Merge pull request #8182 from filecoin-project/jen/backports
...
chore: backports: snappy related improvements/bug fixes
2022-02-24 18:07:41 -05:00
zenground0
e5de237990
Fix fault tracker to handle snap deals
2022-02-24 17:53:21 -05:00
Jiaying Wang
f9641d70af
fix: sealing: missing file type
2022-02-24 16:27:24 -05:00
zenground0
abe04c33c1
Fix fault tracker to handle snap deals
2022-02-23 09:56:47 -07:00
Aarsh Shah
f0f2b3e1f4
changes as per review
2022-02-22 14:22:51 +04:00
Aarsh Shah
8e62fec1d3
address review
2022-02-22 13:48:39 +04:00
Aarsh Shah
56926b349a
changes as per review
2022-02-21 18:27:51 +04:00
Aarsh Shah
c2522e8ca9
idempotent add piece
2022-02-21 13:51:43 +04:00
Aarsh Shah
1245871004
guard with ctx
2022-02-21 11:56:49 +04:00
Aarsh Shah
26707a5e03
make add piece idempotent
2022-02-21 11:51:25 +04:00
Aayush
d35216434f
Merge branch 'releases' into asr/releases-master
2022-02-18 13:45:08 -05:00
Aayush
6e1d5c5733
Merge branch 'master' into feat/fvm
2022-02-18 13:33:06 -05:00
Aayush
393479ea69
Fvm: impl VerifyConsensusFault
2022-02-18 13:21:01 -05:00
Aayush
b708fbcd20
sealer: fix error message
2022-02-17 14:31:59 -05:00
Steven Allen
d835cade15
chore: update FFI
...
Updates the FVM
2022-02-16 17:47:25 -08:00
Aayush
36aa243c56
sealer: fix error message
2022-02-16 19:26:00 -05:00
Aayush
56df886b55
fix: sealer: allow enable/disabling ReplicaUpdate tasks
2022-02-14 15:24:13 -05:00
Aayush
eebe784191
fix: sealer: allow enable/disabling ReplicaUpdate tasks
2022-02-14 15:08:28 -05:00
Aayush
ee6989970f
Merge branch 'master' into feat/fvm
2022-02-13 14:25:39 -05:00
zenground0
407c6cf120
Stop recovery attempts after fault
2022-02-10 17:33:57 -05:00
Łukasz Magiera
9e76a788e2
sealing: Use ChainAt in handleUpdateActivating
2022-02-10 17:32:31 -05:00
Łukasz Magiera
02c0fb7b65
ffiwrapper: Use ClearCache for update cache cleanup
2022-02-10 17:32:13 -05:00
Łukasz Magiera
a5bddbcdc6
proofs master
2022-02-10 17:32:04 -05:00
Łukasz Magiera
9f54c4d002
Fix CheckProvable with updated sectors
2022-02-10 17:30:23 -05:00
Łukasz Magiera
4289ce10e4
fsm: Call ReleaseSectorKey after WinningPoSt lookback period
2022-02-10 17:30:18 -05:00
Łukasz Magiera
ecc1f4b8f1
Make FinalizeReplicaUpdate actually do cleanup
2022-02-10 17:29:52 -05:00
Łukasz Magiera
ea32b415f0
Fix missing FinalizeReplicaUpdate in tests
2022-02-10 17:29:47 -05:00
Łukasz Magiera
53e1f75c2c
Add FinalizeReplicaUpdate into some more places
2022-02-10 17:27:49 -05:00
Łukasz Magiera
9a117fa39a
try ClearCache for update cache
2022-02-10 17:27:24 -05:00
Łukasz Magiera
212f5ddb4f
wip FinalizeReplicaUpdate
2022-02-10 17:24:26 -05:00
Steven Allen
7ef1513f9b
ffi: update fvm
2022-02-10 07:56:27 -08:00
Jennifer Wang
1d67b7ffb6
undo ffi
2022-02-09 19:31:50 -05:00
Jennifer Wang
de1f4792cd
Merge remote-tracking branch 'origin/master' into jen/v15
2022-02-09 19:27:34 -05:00
Steven Allen
0d6eb7fefc
ffi: update for fixed FVM lifetime management
2022-02-09 14:13:58 -08:00
Łukasz Magiera
e7038d286d
Merge pull request #8018 from filecoin-project/feat/fru
...
FinalizeReplicaUpdate
2022-02-09 17:40:47 +00:00
Łukasz Magiera
84d70caa87
sealing: Use ChainAt in handleUpdateActivating
2022-02-09 17:50:56 +01:00
Łukasz Magiera
cce77196cd
proofs v11.0.2
2022-02-09 16:22:35 +01:00
Łukasz Magiera
f33cf74d0f
ffiwrapper: Use ClearCache for update cache cleanup
2022-02-09 14:54:36 +01:00
Łukasz Magiera
6cb411e5bb
proofs master
2022-02-09 14:46:29 +01:00
Łukasz Magiera
b1a74d71f1
Fix CheckProvable with updated sectors
2022-02-09 14:41:36 +01:00
Łukasz Magiera
947000c94f
fsm: Call ReleaseSectorKey after WinningPoSt lookback period
2022-02-09 12:41:39 +01:00
Jennifer Wang
6ed97f0d04
Merge branch 'release/v1.14.0' into jen/v15
2022-02-09 03:17:38 -05:00
Steven Allen
743862857e
ffi: update FFI for fvm changes
2022-02-08 20:57:20 -08:00
zenground0
1e524b7210
Review Response
2022-02-08 12:39:35 -05:00
zenground0
a19c0a8255
Remove extra file
2022-02-08 12:39:35 -05:00
zenground0
4d8b912acc
New config for turning off auto deal creation
2022-02-08 12:39:35 -05:00
zenground0
1af8987c79
StartEpochSealingBuffer triggers packing on timer
2022-02-08 12:39:35 -05:00
zenground0
6fdf76b5d2
Stop recovery attempts after fault
...
Check sector is active before PRU
Fix log
nit: edit a comment
2022-02-08 12:25:24 -05:00
Aayush Rajasekaran
899ae8aa8e
Merge pull request #8014 from filecoin-project/fix/8011
...
fix: sealing: Stop recovery attempts after fault
2022-02-08 12:06:55 -05:00
Aayush Rajasekaran
b6c141c059
nit: edit a comment
2022-02-08 12:06:33 -05:00
Łukasz Magiera
6123339baf
Make FinalizeReplicaUpdate actually do cleanup
2022-02-08 17:45:26 +01:00
Łukasz Magiera
c8e0341248
Fix missing FinalizeReplicaUpdate in tests
2022-02-08 17:22:41 +01:00
Łukasz Magiera
09cfad9d71
Add FinalizeReplicaUpdate into some more places
2022-02-08 17:22:41 +01:00
Łukasz Magiera
e271bae5ec
try ClearCache for update cache
2022-02-08 17:22:41 +01:00
Łukasz Magiera
142ba6660a
wip FinalizeReplicaUpdate
2022-02-08 17:22:41 +01:00
Aayush Rajasekaran
f476aa937e
update to latest FFI
2022-02-08 10:45:58 -05:00
Steven Allen
279cdd0760
fvm: fix implicit messages and message inclusion gas charging
2022-02-07 10:33:57 -08:00
zenground0
1ab2744c84
Fix log
2022-02-07 09:15:23 -05:00
zenground0
47ffceef0d
Check sector is active before PRU
2022-02-07 07:41:48 -05:00
Steven Allen
04092f3e6b
update ffi
2022-02-04 12:46:15 -08:00
Steven Allen
fc74a6c8ca
update fvm/ffi bindings
2022-02-04 12:46:15 -08:00
Aayush Rajasekaran
2a669b95fb
:Hook up the FVM
2022-02-04 12:46:15 -08:00
Jennifer Wang
33b53c4a0d
update to ffi v11.0.1
2022-02-03 11:15:47 -05:00
Łukasz Magiera
b74e085272
don't sort
2022-02-02 19:08:21 +00:00
zenground0
13ccb8cbfe
Stop recovery attempts after fault
2022-02-01 11:39:42 +05:30
Łukasz Magiera
efdb854a7c
fix some races
2022-01-31 20:53:25 +00:00
Łukasz Magiera
98f4d37f1a
Merge remote-tracking branch 'origin/master' into feat/post-worker
2022-01-31 19:50:52 +00:00
Aayush
37a345b39d
Update FFI
2022-01-27 15:30:01 -05:00
Darko Brdareski
e51ce5c508
Merge remote-tracking branch 'upstream/master' into bloxico/system-test-matrix
2022-01-27 10:57:56 +01:00
Aayush
817c155287
chore: deps: update to latest proofs
2022-01-25 13:23:00 -05:00
Aayush Rajasekaran
a6460be37b
remove a log
2022-01-25 13:02:45 -05:00
Aayush
e7123d1a8e
fix: sealer: correctly pipe through errors for SectorAbortUpgrade
2022-01-25 13:02:00 -05:00
Aayush
50aba9a8e6
fix: sealer: don't replica update sectors unless they have deals in them
2022-01-25 13:01:56 -05:00
Aayush
1b18236f91
feat: sealer: allow users to abort in-flight snap upgrades
2022-01-25 13:01:51 -05:00
Aayush
e17ae2eaf4
fix: sealer: manager should lock Unsealed for ReplicaUpdate
2022-01-25 13:01:37 -05:00
Aayush
6d567b36e3
Fix: sealer: ReplicaUpdate should fetch the correct files
2022-01-25 13:01:27 -05:00
Aayush Rajasekaran
7b7ab016db
create replica update paths in acquireSectors
2022-01-25 13:01:18 -05:00
Aayush Rajasekaran
0c9c94bad1
fix: checkReplica incorrectly returns ErrBadPR
2022-01-25 13:01:12 -05:00
Aayush Rajasekaran
a3c5fadcc0
feat: sealing: Add ReplicaUpdate work to Resource table
2022-01-25 13:01:05 -05:00
Aayush Rajasekaran
2d0929e305
remove a log
2022-01-25 12:55:56 -05:00
Aayush Rajasekaran
92e6f29cc8
chore: sealer: quieten a log
2022-01-24 18:28:52 -05:00
Aayush
5cafdc2f29
fix: sealer: manager should lock Unsealed for ReplicaUpdate
2022-01-21 11:12:12 -05:00
Aayush Rajasekaran
ff845aa793
Merge pull request #7977 from filecoin-project/chore/sealtasks-comment
...
chore: remove inaccurate comment in sealtasks
2022-01-21 10:53:04 -05:00
Łukasz Magiera
f148397e1b
post workers: Fix race in setting vproofs
2022-01-21 12:31:24 +01:00
Łukasz Magiera
82c9e72aab
post workers: Fix skipped handling
2022-01-21 10:39:14 +01:00
Łukasz Magiera
4682e72cf4
Address review
2022-01-21 10:11:04 +01:00
Łukasz Magiera
1e5e69ec9d
Typos
...
Co-authored-by: Aayush Rajasekaran <arajasek94@gmail.com>
2022-01-21 10:02:00 +01:00
Aayush
752f4a3d67
Fix: sealer: ReplicaUpdate should fetch the correct files
2022-01-20 15:06:53 -05:00
Łukasz Magiera
33dfcf2663
stores: Fix single post proof reading with updated sectors
2022-01-20 15:27:42 +01:00
Łukasz Magiera
e476cf7968
Merge remote-tracking branch 'origin/master' into feat/post-worker
2022-01-20 13:15:48 +01:00
Aayush Rajasekaran
3ff23ecbfa
:fix: checkReplica incorrectly returns ErrBadPR
2022-01-19 12:00:27 -05:00
Aayush Rajasekaran
ab8bf393c2
create replica update paths in acquireSectors
2022-01-19 11:41:38 -05:00
Aayush Rajasekaran
d0390181ec
feat: sealing: Add ReplicaUpdate work to Resource table
2022-01-19 11:41:32 -05:00
Łukasz Magiera
c41ccb6c37
chore: remove inaccurate comment in sealtasks
2022-01-19 10:46:37 +01:00
Łukasz Magiera
fa09b9afb1
post workers: Share resource accounting code
2022-01-18 16:02:37 +01:00
Łukasz Magiera
8ac20305df
Fix double unlock in WorkerStats
2022-01-18 12:40:04 +01:00
Łukasz Magiera
c79f2b9d38
post workers: Fix lint
2022-01-18 12:11:59 +01:00
Łukasz Magiera
b38141601c
Untangle ffi from api
2022-01-18 11:57:04 +01:00
Łukasz Magiera
03fa955e9e
Cleanup imports
2022-01-18 11:37:24 +01:00
Łukasz Magiera
f2496d87c9
post workers: Snapdeals updates
2022-01-18 11:25:04 +01:00
Łukasz Magiera
0c062f9c08
Merge remote-tracking branch 'origin/master' into feat/post-worker
2022-01-18 10:49:42 +01:00
Aayush Rajasekaran
aad8aa0893
Appease the linter
2022-01-14 17:15:44 -05:00
Jennifer Wang
30013c1f06
fix lint
2022-01-14 17:15:44 -05:00
Jennifer Wang
6901e998e6
Check piece before PRU2 instead of PRU1 as PRU2 is the heavy computation part
2022-01-14 17:15:44 -05:00
Jennifer Wang
8939d5982f
just use checkPiece
2022-01-14 17:15:44 -05:00
Jennifer Wang
a20916f9af
Add more deal expiration handling for snap deals
2022-01-14 17:15:44 -05:00
Jennifer Wang
ac3bea489b
Integrate proof v11.0.0
2022-01-14 17:14:32 -05:00
Aayush Rajasekaran
ca57546ef5
Remove unnecessary params from VerifyWinningPost
2022-01-14 17:14:32 -05:00
zenground0
5b0a0baa9a
Fix hande deal recover return value bug
2022-01-14 17:14:32 -05:00
zenground0
a9a523d8c0
Fix TooManyMarkedForUpgrade
2022-01-14 17:14:32 -05:00
zenground0
d6aa17e21f
Snap Deals Integration
...
- FSM handles the actual cc upgrade process including error states
- PoSting (winning and window) works over upgraded and upgrading sectors
- Integration test and changes to itest framework to reduce flakes
- Update CLI to handle new upgrade
- Update dependencies
2022-01-14 17:14:32 -05:00
Aayush Rajasekaran
3a8ac6dffa
Update FFI
2022-01-14 17:14:32 -05:00
zenground0
d1480c36c0
RemoveData and Decode
...
- Unsealing replica update with sector key works and tested
- Sector key generation added and tested
2022-01-14 17:14:32 -05:00
zenground0
4936b4ea44
Review Response
2022-01-14 17:14:32 -05:00
zenground0
c4069824f7
WIP
2022-01-14 17:14:32 -05:00
zenground0
93656e65f8
WIP sector storage and integration test
2022-01-14 17:14:32 -05:00
Aayush Rajasekaran
073b7b4ff5
Update FFI
2022-01-14 17:14:32 -05:00
Aayush Rajasekaran
393d8541e2
Update deps
2022-01-14 17:14:32 -05:00
