Łukasz Magiera
53e1f75c2c
Add FinalizeReplicaUpdate into some more places
2022-02-10 17:27:49 -05:00
Łukasz Magiera
9a117fa39a
try ClearCache for update cache
2022-02-10 17:27:24 -05:00
Łukasz Magiera
212f5ddb4f
wip FinalizeReplicaUpdate
2022-02-10 17:24:26 -05:00
zenground0
6fdf76b5d2
Stop recovery attempts after fault
...
Check sector is active before PRU
Fix log
nit: edit a comment
2022-02-08 12:25:24 -05:00
Jennifer Wang
33b53c4a0d
update to ffi v11.0.1
2022-02-03 11:15:47 -05:00
Aayush
37a345b39d
Update FFI
2022-01-27 15:30:01 -05:00
Aayush
817c155287
chore: deps: update to latest proofs
2022-01-25 13:23:00 -05:00
Aayush Rajasekaran
a6460be37b
remove a log
2022-01-25 13:02:45 -05:00
Aayush
e7123d1a8e
fix: sealer: correctly pipe through errors for SectorAbortUpgrade
2022-01-25 13:02:00 -05:00
Aayush
50aba9a8e6
fix: sealer: don't replica update sectors unless they have deals in them
2022-01-25 13:01:56 -05:00
Aayush
1b18236f91
feat: sealer: allow users to abort in-flight snap upgrades
2022-01-25 13:01:51 -05:00
Aayush
e17ae2eaf4
fix: sealer: manager should lock Unsealed for ReplicaUpdate
2022-01-25 13:01:37 -05:00
Aayush
6d567b36e3
Fix: sealer: ReplicaUpdate should fetch the correct files
2022-01-25 13:01:27 -05:00
Aayush Rajasekaran
7b7ab016db
create replica update paths in acquireSectors
2022-01-25 13:01:18 -05:00
Aayush Rajasekaran
0c9c94bad1
fix: checkReplica incorrectly returns ErrBadPR
2022-01-25 13:01:12 -05:00
Aayush Rajasekaran
a3c5fadcc0
feat: sealing: Add ReplicaUpdate work to Resource table
2022-01-25 13:01:05 -05:00
Aayush Rajasekaran
aad8aa0893
Appease the linter
2022-01-14 17:15:44 -05:00
Jennifer Wang
30013c1f06
fix lint
2022-01-14 17:15:44 -05:00
Jennifer Wang
6901e998e6
Check piece before PRU2 instead of PRU1 as PRU2 is the heavy computation part
2022-01-14 17:15:44 -05:00
Jennifer Wang
8939d5982f
just use checkPiece
2022-01-14 17:15:44 -05:00
Jennifer Wang
a20916f9af
Add more deal expiration handling for snap deals
2022-01-14 17:15:44 -05:00
Jennifer Wang
ac3bea489b
Integrate proof v11.0.0
2022-01-14 17:14:32 -05:00
Aayush Rajasekaran
ca57546ef5
Remove unnecessary params from VerifyWinningPost
2022-01-14 17:14:32 -05:00
zenground0
5b0a0baa9a
Fix hande deal recover return value bug
2022-01-14 17:14:32 -05:00
zenground0
a9a523d8c0
Fix TooManyMarkedForUpgrade
2022-01-14 17:14:32 -05:00
zenground0
d6aa17e21f
Snap Deals Integration
...
- FSM handles the actual cc upgrade process including error states
- PoSting (winning and window) works over upgraded and upgrading sectors
- Integration test and changes to itest framework to reduce flakes
- Update CLI to handle new upgrade
- Update dependencies
2022-01-14 17:14:32 -05:00
Aayush Rajasekaran
3a8ac6dffa
Update FFI
2022-01-14 17:14:32 -05:00
zenground0
d1480c36c0
RemoveData and Decode
...
- Unsealing replica update with sector key works and tested
- Sector key generation added and tested
2022-01-14 17:14:32 -05:00
zenground0
4936b4ea44
Review Response
2022-01-14 17:14:32 -05:00
zenground0
c4069824f7
WIP
2022-01-14 17:14:32 -05:00
zenground0
93656e65f8
WIP sector storage and integration test
2022-01-14 17:14:32 -05:00
Aayush Rajasekaran
073b7b4ff5
Update FFI
2022-01-14 17:14:32 -05:00
Aayush Rajasekaran
393d8541e2
Update deps
2022-01-14 17:14:32 -05:00
Aayush Rajasekaran
1ef780d96f
Plug in the FFI call
2022-01-14 17:14:32 -05:00
Aayush Rajasekaran
a8cb027c08
Integrate v7 actors
2022-01-14 17:14:32 -05:00
Łukasz Magiera
ba3c96f8c6
stores: Reduce log spam during retrievals
2021-12-10 16:47:32 -05:00
Łukasz Magiera
dafdb7689c
Fix mock ReadPiece
2021-12-10 16:47:12 -05:00
Łukasz Magiera
46ba2b6b4f
fr32: Reduce MTTresh from 32M to 512k per core
...
This results in 64x less bytes allocated when spawning new readers
for larger pieces.
Results in about 30% speedup in 1G unpad benchmark on AMD TR 2950x
2021-12-10 16:47:07 -05:00
Łukasz Magiera
b4c1e340ea
piecereader: Avoid allocating 1024MB slices per read
2021-12-10 16:47:01 -05:00
Łukasz Magiera
a438e6fa73
piecereader: Avoid redundant roundtrips when seeking
2021-12-10 16:46:57 -05:00
Łukasz Magiera
b21d3ded2f
piecereader: Move closer to storage
2021-12-10 16:46:52 -05:00
Łukasz Magiera
71329f6c41
Address Scheduler enhancements ( #7703 ) review
2021-11-30 20:50:40 +01:00
Łukasz Magiera
001ecbb561
fix lint
2021-11-30 02:06:58 +01:00
Łukasz Magiera
a597b072b8
fix sched tests
2021-11-30 02:06:58 +01:00
Łukasz Magiera
f25efecb74
worker: Test resource table overrides
2021-11-30 02:06:58 +01:00
Łukasz Magiera
6d52d8552b
Fix docsgen
2021-11-30 02:06:58 +01:00
Łukasz Magiera
c9a2ff4007
cleanup worker resource overrides
2021-11-30 02:06:58 +01:00
Łukasz Magiera
b961e1aab5
sched resources: Separate Parallelism defaults depending on GPU presence
2021-11-30 02:06:58 +01:00
Łukasz Magiera
36868a8749
sched: C2 is not all-core load
2021-11-30 02:06:58 +01:00
Clint Armstrong
4ef8543128
Permit workers to override resource table
...
In an environment with heterogenious worker nodes, a universal resource
table for all workers does not allow effective scheduling of tasks. Some
workers may have different proof cache settings, changing the required
memory for different tasks. Some workers may have a different count of
CPUs per core-complex, changing the max parallelism of PC1.
This change allows workers to customize these parameters with
environment variables. A worker could set the environment variable
PC1_MIN_MEMORY for example to customize the minimum memory requirement
for PC1 tasks. If no environment variables are specified, the resource
table on the miner is used, except for PC1 parallelism.
If PC1_MAX_PARALLELISM is not specified, and
FIL_PROOFS_USE_MULTICORE_SDR is set, PC1_MAX_PARALLELSIM will
automatically be set to FIL_PROOFS_MULTICORE_SDR_PRODUCERS + 1.
2021-11-30 02:06:58 +01:00
