Łukasz Magiera
|
a7122d424b
|
Merge pull request #5527 from filcloud/handle-ticket-expire
fix precommit ticket expiration handling
|
2021-03-29 22:55:43 +02:00 |
|
Łukasz Magiera
|
1aea1ebb9d
|
Merge pull request #5801 from filecoin-project/fix/fsm-input-stuck
storagefsm: Trigger input processing when below limits
|
2021-03-12 19:02:15 +01:00 |
|
Łukasz Magiera
|
0974e02089
|
storagefsm: common createSector method
|
2021-03-12 18:42:17 +01:00 |
|
Steven Allen
|
b74b1658b2
|
test: mock proof side effects on verify as well
|
2021-03-12 09:06:41 -08:00 |
|
Łukasz Magiera
|
d9923125ff
|
mock sealer: Simulate randomness sideeffects
|
2021-03-12 17:33:43 +01:00 |
|
Łukasz Magiera
|
e5b5bf1c1b
|
storagefsm: Update sector stats atomically with sector creation
|
2021-03-12 17:25:24 +01:00 |
|
Łukasz Magiera
|
679f5f7661
|
storagefsm: Helper stat functions in updateSector
|
2021-03-12 17:00:20 +01:00 |
|
Łukasz Magiera
|
957d3f0636
|
storgefsm: Use locks correctly
|
2021-03-12 15:01:00 +01:00 |
|
Łukasz Magiera
|
5c605d99e2
|
storgefsm: Fix tests
|
2021-03-12 14:56:46 +01:00 |
|
Łukasz Magiera
|
f5ed25371b
|
storagefsm: Trigger input processing wheen below limits
|
2021-03-12 14:54:10 +01:00 |
|
Łukasz Magiera
|
d0243904f7
|
Merge pull request #5779 from filecoin-project/feat/storagefsm-no-restart-log
storagefsm: Don't log the SectorRestart event
|
2021-03-11 15:18:32 +01:00 |
|
Łukasz Magiera
|
881c722025
|
storagefsm: Fix double unlock with ready WaitDeals sectors
|
2021-03-11 15:03:51 +01:00 |
|
Łukasz Magiera
|
a1b6a2f011
|
storagefsm: Don't log the SectorRestart event
|
2021-03-11 12:52:34 +01:00 |
|
Łukasz Magiera
|
cc490b983a
|
Merge pull request #5761 from filecoin-project/fix/testunpadreader-go116
Fix TestUnpadReader on Go 1.16
|
2021-03-10 13:13:27 +01:00 |
|
Łukasz Magiera
|
7fbb4bdd3b
|
Fix TestUnpadReader on Go 1.16
|
2021-03-10 13:05:25 +01:00 |
|
Łukasz Magiera
|
40fdf6c180
|
Merge pull request #5624 from filecoin-project/feat/miner-storage-limit
Configurable storage path storage limit
|
2021-03-10 11:15:28 +01:00 |
|
Łukasz Magiera
|
df0a8d9507
|
Merge pull request #5759 from filecoin-project/asr/terminate-livecheck
Check liveness of sectors when processing termination batches
|
2021-03-10 11:14:11 +01:00 |
|
Aayush Rajasekaran
|
47064f987c
|
Check liveness of sectors when processing termination batches
|
2021-03-09 23:36:30 -05:00 |
|
Łukasz Magiera
|
fe230f901e
|
Collect worker task metrics
|
2021-03-05 12:48:17 +01:00 |
|
Łukasz Magiera
|
29c9fa3137
|
Merge pull request #5612 from filecoin-project/feat/cc-fsm-cleanup
storagefsm: Cleanup CC sector creation
|
2021-02-26 11:39:28 +01:00 |
|
Łukasz Magiera
|
e49a412f6d
|
Merge pull request #5375 from filecoin-project/feat/refactor-fsm-input
storagefsm: Rewrite input handling
|
2021-02-25 14:28:04 +01:00 |
|
Łukasz Magiera
|
2b9ed9fa3d
|
Remove sectors with all deals expired in RecoverDealIDs
|
2021-02-22 21:03:51 +01:00 |
|
Łukasz Magiera
|
35759fa07e
|
Merge pull request #5635 from filecoin-project/deps/cbg-soft-map
Update markets, cbor-gen with soft map decoding
|
2021-02-22 18:27:38 +01:00 |
|
Aayush Rajasekaran
|
6732758d0f
|
Tweak mock ProveCommits to respect proof sizes
|
2021-02-19 17:22:59 -05:00 |
|
Łukasz Magiera
|
26399dba70
|
Update markets, cbor-gen with soft map decoding
|
2021-02-19 20:11:43 +01:00 |
|
Łukasz Magiera
|
37b1fb97fb
|
Configurable storage path storage limit
|
2021-02-18 16:44:34 +01:00 |
|
yaohcn
|
3f66e731fa
|
fix drop sector
|
2021-02-18 12:00:28 +08:00 |
|
Łukasz Magiera
|
90b8612cf4
|
Merge remote-tracking branch 'origin/master' into feat/refactor-fsm-input
|
2021-02-16 22:39:06 +01:00 |
|
Łukasz Magiera
|
9ebeafb174
|
Update ffi
|
2021-02-16 22:04:08 +01:00 |
|
Łukasz Magiera
|
f719765069
|
storageminer: exit PledgeSector after sectors enter sealing pipeline
|
2021-02-16 17:41:58 +01:00 |
|
Łukasz Magiera
|
fc5e243c92
|
storagefsm: Cleanup CC sector creation
|
2021-02-16 17:14:59 +01:00 |
|
Łukasz Magiera
|
dd82729f60
|
Merge remote-tracking branch 'origin/master' into feat/refactor-fsm-input
|
2021-02-16 13:45:39 +01:00 |
|
Aayush Rajasekaran
|
bb7fabb439
|
Update FFI
|
2021-02-15 17:22:25 -05:00 |
|
Łukasz Magiera
|
6907e5879d
|
Fix WaitDeals sector accounting
|
2021-02-11 13:52:00 +01:00 |
|
Łukasz Magiera
|
e27a530cbc
|
storagefsm: cleanup openSectors better; pendingPieces by pieceCid
|
2021-02-09 18:44:41 +01:00 |
|
He Weidong
|
0e2e1125d3
|
fix precommit ticket expiration handling
|
2021-02-05 10:45:15 +08:00 |
|
Łukasz Magiera
|
6e7fcb7ee6
|
Merge remote-tracking branch 'origin/master' into feat/refactor-fsm-input
|
2021-02-03 14:01:56 +01:00 |
|
Łukasz Magiera
|
1e7a107484
|
Merge pull request #5433 from filecoin-project/feat/keep-unsealed-cfg
Add miner config to always keep ensealed deal copies
|
2021-02-03 12:40:02 +01:00 |
|
Łukasz Magiera
|
94009f247f
|
Merge pull request #5411 from filecoin-project/feat/sealing-handle-batch-publish
Handle batch publish storage deals message in sealing recovery
|
2021-01-28 19:33:49 +01:00 |
|
Łukasz Magiera
|
aebf3cd64c
|
Update ffi with more portable blst
|
2021-01-27 22:36:51 +01:00 |
|
Łukasz Magiera
|
d4c7b63aac
|
Add miner config to always keep ensealed deal copies
|
2021-01-26 17:50:31 +01:00 |
|
Łukasz Magiera
|
fabcbb621d
|
Merge remote-tracking branch 'origin/master' into next
|
2021-01-26 00:47:22 +01:00 |
|
Łukasz Magiera
|
67780346e2
|
storagemgr: Always unseal full sectors
|
2021-01-25 21:39:15 +01:00 |
|
Łukasz Magiera
|
e4f4fa2c7d
|
Update FFI more, fix zero aggregate sigs
|
2021-01-25 20:05:03 +01:00 |
|
Dirk McCormick
|
1b494acc9e
|
feat: handle batch publish storage deals message in sealing recovery
|
2021-01-25 14:10:05 +01:00 |
|
Łukasz Magiera
|
9b62e224d5
|
Use filecoin-ffi master
|
2021-01-25 13:57:15 +01:00 |
|
Steven Allen
|
03cd3760bb
|
correctly pick the seal type based on the network version
Of course, we should really just run all of our tests post actors v2.
|
2021-01-21 15:21:20 -08:00 |
|
Aayush Rajasekaran
|
ab90a3b2bc
|
Actors update: MinerInfo.SealProofType has been removed
|
2021-01-21 15:21:19 -08:00 |
|
Łukasz Magiera
|
1070ad2289
|
storagefsm: Drop unused TargetWaitDealsSectors
|
2021-01-21 22:20:16 +01:00 |
|
Łukasz Magiera
|
ec4deb7e28
|
storagefsm: Fix unlocking in handleWaitDeals
|
2021-01-21 19:59:18 +01:00 |
|
Łukasz Magiera
|
1336d8855d
|
storagefsm: Drop addpiece wait after fixing storageadapter
|
2021-01-21 17:40:50 +01:00 |
|
Łukasz Magiera
|
df14f156e1
|
storagefsm: More logging for deal test debugging
|
2021-01-21 17:40:50 +01:00 |
|
Łukasz Magiera
|
b9a9f23204
|
storagefsm: Add stub AddPieceFailed state
|
2021-01-21 17:40:50 +01:00 |
|
Łukasz Magiera
|
f96f12c836
|
storagefsm: Add rest of checks in WaitDeals
|
2021-01-21 17:40:50 +01:00 |
|
Łukasz Magiera
|
069766ecc4
|
storagefsm: Don't persist piece assignment queue
|
2021-01-21 17:40:50 +01:00 |
|
Łukasz Magiera
|
270f2935a9
|
storagefsm: Check per-sector deal limits
|
2021-01-21 17:40:50 +01:00 |
|
Łukasz Magiera
|
fd67a41c75
|
storagefsm: Change sector CreationTime to unix ts
|
2021-01-21 17:40:50 +01:00 |
|
Łukasz Magiera
|
9857ad8378
|
storagefsm: Fix some deadlock cases
|
2021-01-21 17:40:50 +01:00 |
|
Łukasz Magiera
|
e5814dac4f
|
cbor-gen
|
2021-01-21 17:40:50 +01:00 |
|
Łukasz Magiera
|
542357a1df
|
storagefsm: Start packing correctly
|
2021-01-21 17:40:50 +01:00 |
|
Łukasz Magiera
|
239d6f8f4d
|
storagefsm: Rewrite input handling
|
2021-01-21 17:40:50 +01:00 |
|
dignifiedquire
|
3d9eb226fa
|
refactor: switch to filecoin-ffi bls api for bls signatures
|
2021-01-20 16:19:07 +01:00 |
|
dignifiedquire
|
187a499cca
|
remove extern/blst
|
2021-01-20 16:19:07 +01:00 |
|
Łukasz Magiera
|
48c6c55f68
|
Merge pull request #5384 from filecoin-project/fix-storage-size-estimation
fix FileSize to return correct disk usage recursively
|
2021-01-19 19:22:47 +01:00 |
|
Łukasz Magiera
|
560a127ce6
|
fsutil: Defensive check for Stat cast
|
2021-01-19 18:53:37 +01:00 |
|
Anton Evangelatov
|
834a6148b0
|
use stat.Blocks and not info.Size
|
2021-01-19 18:07:37 +01:00 |
|
Anton Evangelatov
|
16d07d3f18
|
fix FileSize to return correct disk usage recursively
|
2021-01-19 15:21:31 +01:00 |
|
Łukasz Magiera
|
0eaa6d9983
|
storagefsm: Send correct event on ErrExpiredTicket in CommitFailed
|
2021-01-17 22:29:07 +01:00 |
|
Łukasz Magiera
|
80b8d4b9d7
|
Address review
|
2021-01-14 20:27:15 +01:00 |
|
Łukasz Magiera
|
32885e1129
|
termination batcher: Notify based on what was sent
|
2021-01-14 17:14:26 +01:00 |
|
Łukasz Magiera
|
4015ddbb4f
|
fsm: Fix panic in precommit check in handleTerminating
|
2021-01-14 16:13:32 +01:00 |
|
Łukasz Magiera
|
49abdd7d7d
|
Sector termination support - address review
|
2021-01-14 15:46:57 +01:00 |
|
Łukasz Magiera
|
7ddf1d1feb
|
Add terminating states to state lists
|
2021-01-14 12:44:27 +01:00 |
|
Łukasz Magiera
|
144b5a1350
|
perning termination API
|
2021-01-14 12:37:23 +01:00 |
|
Łukasz Magiera
|
1564db1fce
|
Sector termination test
|
2021-01-14 00:11:41 +01:00 |
|
Łukasz Magiera
|
3522c8d45a
|
SectorTerminateFlush API
|
2021-01-13 23:32:04 +01:00 |
|
Łukasz Magiera
|
174c595acc
|
Don't declare in proving window
|
2021-01-13 22:19:10 +01:00 |
|
Łukasz Magiera
|
52cc2cd3eb
|
Initial sector termination support
|
2021-01-13 00:42:01 +01:00 |
|
Łukasz Magiera
|
5462ecf6da
|
gofmt
|
2021-01-11 16:44:11 +01:00 |
|
Łukasz Magiera
|
9e74c3c4e8
|
Multicore AddPiece CommP
|
2021-01-11 16:44:11 +01:00 |
|
Łukasz Magiera
|
299e72458e
|
storagefsm: Fix unsealedInfoMap.lk init race
|
2021-01-10 14:01:29 +01:00 |
|
Łukasz Magiera
|
2c9f4ad5ad
|
Merge pull request #5251 from liismn/master
Fix deadlock in runWorker in sched_worker.go
|
2021-01-05 19:35:49 +01:00 |
|
Łukasz Magiera
|
44a56c7e33
|
Merge pull request #5208 from jsign/jsign/imprreadpiece
sector-storage/mock: improve mocked readpiece
|
2021-01-05 18:37:48 +01:00 |
|
15ho
|
5b235db366
|
fix: stores.FetchHandler: defer close file and increase buffer size
|
2020-12-29 10:07:28 +08:00 |
|
liismn
|
e9cc697ee8
|
Update sched_worker.go
Avoid possible deadlock by sh.workersLk
|
2020-12-25 15:05:01 +08:00 |
|
quanzhan lu
|
d806fafee8
|
update weight canSeal and canStore when attach
update weight canSeal and canStore when attach storage
|
2020-12-22 19:07:17 +08:00 |
|
Ignacio Hagopian
|
f6cf27c781
|
improve mocked readpiece
Signed-off-by: Ignacio Hagopian <jsign.uy@gmail.com>
|
2020-12-16 10:15:38 -03:00 |
|
zzx234234
|
7db5e8061d
|
fix a coding error in truncating sector log
|
2020-12-11 11:31:36 +08:00 |
|
Łukasz Magiera
|
46a5013dc1
|
stores: Simplify remote copy buf size logic
|
2020-12-10 20:54:42 +01:00 |
|
Łukasz Magiera
|
53a6c4eac6
|
Merge branch 'iosize' of github.com:acautman/lotus into acautman-iosize
|
2020-12-10 20:48:04 +01:00 |
|
caoao
|
d4582fb32e
|
write size according to RegisteredSealProof
|
2020-12-10 11:59:09 +08:00 |
|
stirlingx
|
3c50baaf5b
|
fix curSealing out of MaxSealingSectors limit
|
2020-12-10 11:04:42 +08:00 |
|
beck
|
d3fa728894
|
Remove extra spaces
|
2020-12-09 19:22:21 +08:00 |
|
Łukasz Magiera
|
1502ca6460
|
storagefsm: Fix addr selection for commits
|
2020-12-03 12:30:41 +01:00 |
|
Łukasz Magiera
|
562f5839b7
|
Fix lint
|
2020-12-02 22:01:09 +01:00 |
|
Łukasz Magiera
|
2fd93a55ac
|
plumb AddressSelector to stoage fsm
|
2020-12-02 21:47:54 +01:00 |
|
Łukasz Magiera
|
289ef910a0
|
fix imports, docsgen
|
2020-12-02 00:39:55 +01:00 |
|
Łukasz Magiera
|
95eaf13b5a
|
sectorstorage: Fix tests
|
2020-12-02 00:36:32 +01:00 |
|
Łukasz Magiera
|
c6f85886bf
|
miner: Add slow mode to proving check
|
2020-12-02 00:32:14 +01:00 |
|
Łukasz Magiera
|
614f45dcfb
|
Merge pull request #5041 from filecoin-project/feat/5013
Sector check command
|
2020-12-01 14:59:01 +01:00 |
|
Łukasz Magiera
|
a4f3758f4c
|
worker api: better grouping
|
2020-11-30 23:16:30 +01:00 |
|
Łukasz Magiera
|
e8d2560581
|
Fix tests
|
2020-11-27 16:47:48 +01:00 |
|
Łukasz Magiera
|
3672053ae9
|
worker: Support setting task types at runtime
|
2020-11-26 17:33:34 +01:00 |
|
Łukasz Magiera
|
2304ea0077
|
Merge pull request #5016 from filecoin-project/fix/fsm-rm-unceroverable
storagefsm: Add missing planners
|
2020-11-26 12:22:48 +01:00 |
|
Łukasz Magiera
|
74f040f9d5
|
storagefsm: Add SubmitCommit to toStatState switch
|
2020-11-26 12:02:35 +01:00 |
|
Łukasz Magiera
|
eeb38fa649
|
storagefsm: Test fsmPlanners map
|
2020-11-26 10:58:07 +01:00 |
|
Łukasz Magiera
|
ba87cb4fa9
|
storagefsm: Add missing planners
|
2020-11-26 10:57:47 +01:00 |
|
Łukasz Magiera
|
65653a1747
|
storagefsm: Add GetTicket to some maps
|
2020-11-26 10:53:31 +01:00 |
|
s1m0n21
|
663b3f4f21
|
add a sector check command
|
2020-11-26 15:02:43 +08:00 |
|
Łukasz Magiera
|
89493fe2b8
|
storagefsm: newDealSector review
|
2020-11-25 18:55:58 +01:00 |
|
Łukasz Magiera
|
6166204bac
|
storagefsm: Improve new deal sector logic
|
2020-11-25 16:40:04 +01:00 |
|
Łukasz Magiera
|
214f46bc88
|
Merge pull request #4876 from filecoin-project/fix/miner-ticket-loop
storagefsm: Fix expired ticket retry loop
|
2020-11-24 19:54:41 +01:00 |
|
Łukasz Magiera
|
a63ef1dcd5
|
Merge pull request #4984 from yaohcn/fix-log-warn
fix log format
|
2020-11-24 18:01:56 +01:00 |
|
Łukasz Magiera
|
7c831101f3
|
Merge pull request #4727 from filecoin-project/nonsense/integrate-testplans-to-lotus
move testground/lotus-soup testplan from oni to lotus
|
2020-11-24 17:05:29 +01:00 |
|
Łukasz Magiera
|
fe92a6e2d4
|
Merge pull request #4024 from zgfzgf/sector-sched
modify for unsafe
|
2020-11-24 16:19:17 +01:00 |
|
yaohcn
|
7c0b6f41d8
|
fix log format
|
2020-11-24 19:09:48 +08:00 |
|
Anton Evangelatov
|
fd640864cb
|
Merge branch 'master' into nonsense/integrate-testplans-to-lotus
|
2020-11-23 20:20:44 +01:00 |
|
Łukasz Magiera
|
83b1009837
|
storagefsm: check getticket precommit expication correctly
|
2020-11-23 19:12:54 +01:00 |
|
Łukasz Magiera
|
85e592bbe2
|
storagefsm: Retry pushing messages when out-of-funds
|
2020-11-23 19:03:31 +01:00 |
|
Łukasz Magiera
|
e2a6b99144
|
storagefsm: Fix expired ticket retry loop
|
2020-11-23 19:03:31 +01:00 |
|
Łukasz Magiera
|
0e39e760e5
|
Merge pull request #4929 from filecoin-project/feat/update-markets-commp-extraction
Remove all temp file generation for deals
|
2020-11-23 18:43:00 +01:00 |
|
Dirk McCormick
|
3634ca50ca
|
fix: sector-storage tests
|
2020-11-23 16:09:57 +01:00 |
|
Dirk McCormick
|
c965696586
|
fix: ffiwrapper sealer test
|
2020-11-23 14:21:46 +01:00 |
|
Dan Shao
|
f3838a47c7
|
Format workerID as string
|
2020-11-23 15:07:50 +08:00 |
|
zgfzgf
|
b6893b0a3f
|
solve merage problem
|
2020-11-22 16:15:30 +08:00 |
|
hannahhoward
|
218f7c2c5d
|
feat(markets): update markets, extract commp
|
2020-11-20 13:29:14 -08:00 |
|
Łukasz Magiera
|
f0eac01a3c
|
Merge remote-tracking branch 'origin/master' into nonsense/integrate-testplans-to-lotus
|
2020-11-20 15:22:10 +01:00 |
|
S1M0N21
|
2b611b3a99
|
Remove unused key
|
2020-11-19 23:48:28 +08:00 |
|
Aayush Rajasekaran
|
68a16afeda
|
Merge branch 'master' into release/v1.2.0
|
2020-11-17 19:40:05 -05:00 |
|
Łukasz Magiera
|
00335878ab
|
Merge pull request #4712 from filecoin-project/fix/commitfailed-checks
Check (pre)commit receipt before other checks in failed states
|
2020-11-18 01:26:02 +01:00 |
|
Łukasz Magiera
|
b242d69805
|
Make storiface.CallError json-friendly
|
2020-11-17 16:28:41 +01:00 |
|
Łukasz Magiera
|
b8853aa4d5
|
Add error codes to worker return
|
2020-11-17 16:17:55 +01:00 |
|
Łukasz Magiera
|
e0ade92b29
|
Fix lint warnings
|
2020-11-16 19:20:18 +01:00 |
|
Łukasz Magiera
|
444239a643
|
update ffi
|
2020-11-16 19:17:07 +01:00 |
|
Łukasz Magiera
|
cd0cb1407d
|
update ffi
|
2020-11-16 19:03:30 +01:00 |
|
Łukasz Magiera
|
915c5e0fdd
|
Get most tests to pass
|
2020-11-16 19:03:30 +01:00 |
|
Łukasz Magiera
|
2a7e4af5ee
|
Fix lotus-miner/lotus-worker build
|
2020-11-16 19:03:30 +01:00 |
|
Steven Allen
|
584907269a
|
make sector-storage compile
|
2020-11-16 19:03:30 +01:00 |
|
Łukasz Magiera
|
6bea9dd178
|
Making sealing logic work with multiple seal proof types
|
2020-11-16 19:03:30 +01:00 |
|
Łukasz Magiera
|
6bb67f2fe9
|
Merge pull request #4834 from filecoin-project/feat/sector-gc
miner: Basic storage cleanup command
|
2020-11-13 00:03:17 +01:00 |
|
Łukasz Magiera
|
408183c7a6
|
docsgen: Fix CI
|
2020-11-12 20:15:57 +01:00 |
|
Łukasz Magiera
|
11b041224e
|
fsm: Allow manually resurrecting removed sectors
|
2020-11-12 19:37:54 +01:00 |
|
Łukasz Magiera
|
8409e155d4
|
docsgen: Support miner/worker structs
|
2020-11-12 10:29:42 +01:00 |
|
Łukasz Magiera
|
8ac495723e
|
gofmt
|
2020-11-11 17:42:23 +01:00 |
|
Łukasz Magiera
|
09f9f871a3
|
Create a command to abort sealing calls
|
2020-11-11 17:39:12 +01:00 |
|
Łukasz Magiera
|
bd71bf2379
|
Expand sched-diag
|
2020-11-11 16:47:44 +01:00 |
|
Łukasz Magiera
|
18aa97f962
|
Merge pull request #4779 from filecoin-project/feat/work-track-hostname
storage: Track worker hostnames with work
|
2020-11-10 20:38:44 +01:00 |
|
Łukasz Magiera
|
5caa277261
|
storage: Track abandoned work more correctly
|
2020-11-09 23:38:20 +01:00 |
|
Łukasz Magiera
|
f819e71d12
|
storage: Separate returned jobs in jobs cli
|
2020-11-09 23:13:29 +01:00 |
|
Łukasz Magiera
|
27a9dd3bbb
|
storage: Track worker hostnames with work
|
2020-11-09 23:09:04 +01:00 |
|