Łukasz Magiera
db676acdf8
storage: Cleanup interfaces a bit
2022-06-17 13:52:19 +02:00
Łukasz Magiera
58416d0881
storage: Don't depend on specs-storage, move to storiface
2022-06-17 13:36:33 +02:00
Łukasz Magiera
4a4d64f528
sealing pipeline: Rename 'tok' to 'tsk'
2022-06-17 11:20:33 +02:00
Łukasz Magiera
d56241603a
sealing pipeline: Remove adapter code!
2022-06-16 17:22:50 +02:00
Łukasz Magiera
59a4fe1e56
sealing pipeline: Don't adapt MpoolPushMessage
2022-06-16 15:54:15 +02:00
Łukasz Magiera
9c4d10ec73
api: handle no-precommit in StateSectorPreCommitInfo gracefully
2022-06-16 15:20:58 +02:00
Łukasz Magiera
06b3e555c5
sealing pipeline: Drop ChainBaseFee, don't wrap StateSectorPartition
2022-06-16 14:00:37 +02:00
Łukasz Magiera
db842224b8
sealing pipeline: Drop StateMarketStorageDealProposal
2022-06-16 13:33:59 +02:00
Łukasz Magiera
2dc1df878d
api: Move StateComputeDataCID to full-node
2022-06-16 13:29:35 +02:00
Łukasz Magiera
a084445e6c
sealing pipeline: Use non-special ChainHead
2022-06-16 13:15:49 +02:00
Łukasz Magiera
048bfe6d5b
sealing pipeline: Use non-special msg wait APIs
2022-06-16 12:47:19 +02:00
Łukasz Magiera
cd4514bddf
sealing pipeline: Drop StateMinerActiveSectors
2022-06-16 12:34:29 +02:00
Łukasz Magiera
9fad80ce9a
sealing pipeline: Drop unused miner-info related methods
2022-06-16 12:18:24 +02:00
Łukasz Magiera
9aa5659d24
sealing pipeline: Drop TipSetToken, use TipSetKey directly
2022-06-16 12:05:58 +02:00
Łukasz Magiera
05cdeb80c3
chore: remove redundant import prefixes
2022-06-15 12:06:22 +02:00
Łukasz Magiera
39cede946c
chore: Fix more imports with '2' suffix
2022-06-14 21:37:54 +02:00
Łukasz Magiera
a581d73548
chore: Fix imports with '2' suffix
2022-06-14 20:36:33 +02:00
Łukasz Magiera
28099a3905
storage: Move storage/sealer/stores to storage/paths
2022-06-14 20:25:52 +02:00
Łukasz Magiera
82857e6d5d
chore: rerun gen with moved packages
2022-06-14 20:13:31 +02:00
Łukasz Magiera
a9600b8a6f
storage: Move extern/sector-storage to storage/sealer
2022-06-14 20:03:38 +02:00
Łukasz Magiera
98a48a47f8
storage: Move extern/storage-sealing to storage/pipeline
2022-06-14 19:41:59 +02:00
Łukasz Magiera
cf835fcc0c
fix wdpost unit tests
2022-06-14 19:33:57 +02:00
Łukasz Magiera
717bda63b1
storage: Move control address logic to storage/ctladdr
2022-06-14 19:32:29 +02:00
Łukasz Magiera
dff1bf2868
storage: Move window-post logic into a separate package
2022-06-14 19:27:09 +02:00
Łukasz Magiera
12c91bb41d
storage: Move mock PreCommit helper to the mock package
2022-06-14 19:23:14 +02:00
Łukasz Magiera
6afb43afbb
wallet: Move key.go into separate pkg to avoid import loops
2022-06-14 19:21:40 +02:00
Łukasz Magiera
e65fae28de
chore: fix imports
2022-06-14 17:00:51 +02:00
Geoff Stuart
b7010c9e60
Implement function to migrate actors with only code changes
2022-06-10 15:52:32 -04:00
Geoff Stuart
801c670edd
Remove ChainPutMany
2022-06-10 14:09:05 -04:00
Geoff Stuart
5c0f2c8ae6
Add putObj and putMany to apiBlockstore
2022-06-09 15:13:42 -04:00
Aayush
b28c11a57d
Merge branch 'feat/nv16'
2022-06-03 14:01:49 -04:00
Łukasz Magiera
af510e2cd7
feat: wdpost: Ignore faults in lotus-miner proving compute window-post
2022-05-27 13:14:47 +02:00
Aayush
b2b20e469f
Fix tests
2022-05-17 15:21:27 -04:00
Aayush
8cca9b1970
Use new go-state-types accessors
2022-05-17 15:21:27 -04:00
zenground0
60d09579be
More fixes
2022-04-14 19:32:56 +03:00
Aayush
339b7db2b7
Integrate FIP 0027
2022-04-14 19:32:56 +03:00
Łukasz Magiera
54cb55a7ae
feat: miner: API/CLI to compute window-post
2022-03-28 17:06:51 -04:00
Łukasz Magiera
36f1dd7bb3
itests: Fix flaky TestWindowPostWorkerSkipBadSector
2022-03-18 20:51:47 +01:00
Łukasz Magiera
7b81369c8c
wdpost: Don't attempt to snark with skipped sectors
2022-03-18 19:45:25 +01:00
Łukasz Magiera
6ddbe41376
Merge remote-tracking branch 'origin/master' into feat/post-worker
2022-03-18 10:54:44 +01:00
Łukasz Magiera
a3bdd29615
Merge pull request #8330 from filecoin-project/feat/snap-queue
...
feat: sealing: Sector upgrade queue
2022-03-16 22:24:45 +01:00
Łukasz Magiera
4d4739497d
sealing: Use bitfields in sectorActive
2022-03-16 19:53:00 +01:00
Darko Brdareski
79453663b3
feat: Add additional test annotations ( #8272 )
...
* Annotate api,proxy_util,blockstore_badger, policy tests
* Annotate splitstore: bsbadger / markset
* Annotate splitstore feature
* Annotate union/timed blockstore tests
* Annotate openrpc, diff_adt tests
* Annotate error,drand,events tests
* Annotate predicates_test
* Fix annotations
* Annotate tscache, gen tests
* Annotate fundmanager test
* Annotate repub and selection tests
* Annotate statetree_test
* Annotate forks_test
* Annotate searchwait_test.go
* Fix duplicated @@ symbols
* Annotate chain stmgr/store tests
* Annotate more (types) tests
* More tests annotated
* Annotate conformance chaos actor tests
* Annotate more integration tests
* Annotate journal system tests
* Annotate more tests.
* Annotate gas,head buffer behaviors
* Fix markset annotations
* doc: test annotations for the markets dagstore wrapper
* Annotate miner_api test in dagstore
* Annotate more test files
* Remove bad annotations from fsrepo
* Annotate wdpost system
* Remove bad annotations
* Renamce "conformance" to "chaos_actor" tests
* doc: stm annotations for blockheader & election proof tests
* Annotate remaining "A" tests
* annotate: stm for error_test
* memrepo_test.go
* Annotate "b" file tests
* message_test.go
* doc: stm annotate for fsrepo_test
* Annotate "c" file tests
* Annotate "D" test files
* message_test.go
* doc: stm annotate for chain, node/config & client
* docs: stm annotate node_test
* Annotate u,v,wl tests
* doc: stm annotations for various test files
* Annotate "T" test files
* doc: stm annotate for proxy_util_test & policy_test
* doc: stm annotate for various tests
* doc: final few stm annotations
* Add mempool unit tests
* Add two more memPool Add tests
* Update submodules
* Add check function tests
* Add stm annotations, refactor test helper
* Annotate api,proxy_util,blockstore_badger, policy tests
* Annotate splitstore: bsbadger / markset
solving merge conflicts
* Annotate splitstore feature
* Annotate union/timed blockstore tests
* Annotate openrpc, diff_adt tests
* Annotate error,drand,events tests
* Annotate predicates_test
* Fix annotations
* Annotate tscache, gen tests
* Annotate fundmanager test
* Annotate statetree_test
* Annotate forks_test
* Annotate searchwait_test.go
* Fix duplicated @@ symbols
* Annotate chain stmgr/store tests
* Annotate more (types) tests
* More tests annotated
* Annotate conformance chaos actor tests
* Annotate more integration tests
* Annotate journal system tests
* Annotate more tests.
* Annotate gas,head buffer behaviors
solve merge conflict
* Fix markset annotations
* Annotate miner_api test in dagstore
* Annotate more test files
* doc: test annotations for the markets dagstore wrapper
* Annotate wdpost system
* Renamce "conformance" to "chaos_actor" tests
* Annotate remaining "A" tests
* doc: stm annotations for blockheader & election proof tests
* annotate: stm for error_test
* Annotate "b" file tests
* memrepo_test.go
* Annotate "c" file tests
* message_test.go
* Annotate "D" test files
* doc: stm annotate for fsrepo_test
* Annotate u,v,wl tests
* message_test.go
* doc: stm annotate for chain, node/config & client
* docs: stm annotate node_test
* Annotate "T" test files
* doc: stm annotations for various test files
* Add mempool unit tests
solve merge conflict
* doc: stm annotate for proxy_util_test & policy_test
* doc: stm annotate for various tests
* doc: final few stm annotations
* Add two more memPool Add tests
* Update submodules
* Add check function tests
solve conflict
* Add stm annotations, refactor test helper
solve merge conflict
* Change CLI test kinds to "unit"
* Fix double merged test
* Fix ccupgrade_test merge
* Fix lint issues
* Add stm annotation to types_Test
* Test vectors submodule
* Add file annotation to burn_test
Co-authored-by: Nikola Divic <divicnikola@gmail.com>
Co-authored-by: TheMenko <themenkoprojects@gmail.com>
2022-03-16 18:37:34 +01:00
Łukasz Magiera
ce99aad438
Fix provingCheckProvableCmd
2022-03-11 18:13:51 +01:00
Łukasz Magiera
046a9f8af0
Merge remote-tracking branch 'origin/master' into feat/post-worker
2022-03-09 16:27:03 +01:00
zenground0
a463c90057
remove endpoint from cli
2022-03-01 11:27:03 -07:00
zenground0
abe04c33c1
Fix fault tracker to handle snap deals
2022-02-23 09:56:47 -07:00
Jennifer Wang
6ed97f0d04
Merge branch 'release/v1.14.0' into jen/v15
2022-02-09 03:17:38 -05:00
Aayush
1b18236f91
feat: sealer: allow users to abort in-flight snap upgrades
2022-01-25 13:01:51 -05:00
Łukasz Magiera
33dfcf2663
stores: Fix single post proof reading with updated sectors
2022-01-20 15:27:42 +01:00
Łukasz Magiera
b115e2879a
don't defer in a loop
2022-01-20 11:19:57 +01:00
Łukasz Magiera
03fa955e9e
Cleanup imports
2022-01-18 11:37:24 +01:00
Łukasz Magiera
f2496d87c9
post workers: Snapdeals updates
2022-01-18 11:25:04 +01:00
Łukasz Magiera
0c062f9c08
Merge remote-tracking branch 'origin/master' into feat/post-worker
2022-01-18 10:49:42 +01:00
Aayush Rajasekaran
ca57546ef5
Remove unnecessary params from VerifyWinningPost
2022-01-14 17:14:32 -05:00
zenground0
d6aa17e21f
Snap Deals Integration
...
- FSM handles the actual cc upgrade process including error states
- PoSting (winning and window) works over upgraded and upgrading sectors
- Integration test and changes to itest framework to reduce flakes
- Update CLI to handle new upgrade
- Update dependencies
2022-01-14 17:14:32 -05:00
Aayush Rajasekaran
a8cb027c08
Integrate v7 actors
2022-01-14 17:14:32 -05:00
Łukasz Magiera
4a874eff70
post workers: Cleanup, tests
2022-01-14 14:17:52 +01:00
Aayush Rajasekaran
d645c5fbab
Remove unnecessary params from VerifyWinningPost
2022-01-11 12:06:39 -05:00
Łukasz Magiera
cf7dd36829
Merge branch 'feat/decoupling-post-worker' of github.com:wusirdcenter/lotus into feat/decoupling-post-worker
2022-01-10 15:06:04 +01:00
zenground0
33f2d24f54
Snap Deals Integration
...
- FSM handles the actual cc upgrade process including error states
- PoSting (winning and window) works over upgraded and upgrading sectors
- Integration test and changes to itest framework to reduce flakes
- Update CLI to handle new upgrade
- Update dependencies
2022-01-10 15:39:38 +05:30
mz-sirius
3fd55fa56b
decoupling winningpost and windowpost from lotus-miner
2022-01-05 01:50:49 +08:00
pefish
f82a262ffe
Update wdpost_run.go
2021-12-29 17:37:37 +08:00
Łukasz Magiera
bc384c01e3
Merge remote-tracking branch 'origin/master' into deps/update-ctx-dsbs
2021-12-17 13:01:22 +01:00
Aayush Rajasekaran
80d5e52923
Merge branch 'master' into next
2021-12-13 13:24:28 -05:00
Aayush Rajasekaran
dfb65ed89f
Plumb contexts through
2021-12-11 17:04:00 -05:00
Łukasz Magiera
5b7bf6ca9f
Merge pull request #7572 from filecoin-project/asr/post
...
Wdpost worker: Reduce challenge confidence to 1 epoch
2021-11-22 12:21:41 +01:00
Aayush Rajasekaran
1449644c34
Integrate v7 actors
2021-11-17 15:55:14 -05:00
hunjixin
eaac4b6de4
add log for restart windows post scheduler
2021-11-10 14:47:42 +08:00
Aayush Rajasekaran
6455b0edcc
Wdpost worker: Reduce challenge confidence to 1 epoch
2021-10-27 11:32:37 -04:00
Aayush Rajasekaran
1d6db306ec
Randomness: Move getters from ChainAPI to StateAPI
2021-09-15 00:03:13 +02:00
Łukasz Magiera
e4044151f0
Show deal sizes is sealing sectors
2021-09-07 18:49:53 +02:00
Steven Allen
3846170302
refactor events system
2021-08-30 16:43:21 -07:00
Aayush Rajasekaran
a52352b13a
PreCommitPolicy: Don't try to align expirations on proving period boundaries
2021-08-11 12:44:12 -04:00
ZenGround0
6da26dcefc
Remove network version panic
2021-08-10 13:07:30 -04:00
Steven Allen
57bf5c2143
feat: add ChainGetTipSetAfterHeight
...
This is identical to ChainGetTipSetByHeight, but returns the tipset
following any null tipsets. This is what the user usually wants anyways.
(and I need it for another PR)
2021-08-05 12:07:14 -07:00
He Weidong
00e32d1ede
fix skipCount
2021-07-29 19:51:25 +08:00
Mike Greenberg
7ee46ad4e0
fix: PreCommitPolicy unit tests
2021-07-22 15:07:03 -04:00
Mike Greenberg
adb62a3fff
chore: Move cfg getter into PCPolicy; Clamp values on get
2021-07-22 15:07:03 -04:00
Mike Greenberg
9e34cce1f2
feat(config): support configurable CC sector expiration
2021-07-22 15:07:03 -04:00
Łukasz Magiera
91107df701
Merge branch 'master' into fix/new-rand
2021-07-22 12:51:05 +02:00
Anton Evangelatov
9ad408a0ba
add SealProof in sector builder
2021-07-21 16:45:57 +02:00
Steven Allen
c49dbf0999
fix: on randomness change, use new rand
2021-07-20 20:19:36 -07:00
Łukasz Magiera
583a8a13d9
Merge pull request #6629 from filecoin-project/feat/pledge-from-miner-balance
...
Config for collateral from miner available balance
2021-07-13 17:22:00 +02:00
Łukasz Magiera
7526a074d9
sealing: collateral buffer / falback config
2021-07-13 17:04:58 +02:00
Anton Evangelatov
d89ddb9315
resolve conflicts
2021-07-12 11:34:37 +02:00
Łukasz Magiera
ee97aa0a8a
dealpublisher: Use address selector
2021-07-07 19:12:03 +02:00
Łukasz Magiera
8f5c0c60f5
Config for deal publishing control addresses
2021-07-07 18:00:54 +02:00
Anton Evangelatov
10dc90f7fe
addressing comments
2021-07-06 17:33:47 +02:00
Raúl Kripalani
1869de7662
unwire host from storage.Miner.
2021-07-01 13:53:20 +01:00
Anton Evangelatov
9ec7cd7239
enable libp2p options
2021-06-30 12:55:43 +02:00
Anton Evangelatov
6720463799
resolve merge conflicts
2021-06-22 11:28:23 +02:00
Łukasz Magiera
b37a66c7c9
Merge remote-tracking branch 'origin/release/v1.10.0' into chore/merge-1.10
2021-06-21 17:03:03 +02:00
Steven Allen
526674cefa
fix: pick the correct partitions-per-post limit
2021-06-16 16:56:30 -07:00
Steven Allen
653b1d8231
fix: pick the correct partitions-per-post limit
2021-06-16 16:53:52 -07:00
Łukasz Magiera
1f914053b4
sealing: Wire up context to batchers
2021-06-16 11:43:06 +02:00
Aayush Rajasekaran
520a0091f5
Merge branch 'releases' into release/v1.10.0
2021-06-15 17:40:36 -04:00
Anton Evangelatov
31e6fb154e
resolve conflicts
2021-06-14 11:27:54 +02:00
Łukasz Magiera
f0a2e97cb5
fee config for sector batching
2021-06-09 14:23:06 -04:00
Aayush Rajasekaran
dede1b4758
Merge branch 'release/v1.10.0' into asr/merge-release
2021-06-09 14:05:41 -04:00
Aayush Rajasekaran
b0c9dd49f0
Fund miners with the aggregate fee when ProveCommitting
2021-06-09 13:08:54 -04:00
Łukasz Magiera
78171055e7
fee config for sector batching
2021-06-08 15:45:32 +02:00
Anton Evangelatov
8bd09e39ca
resolve merge conflicts
2021-06-04 16:17:00 +02:00
Łukasz Magiera
dc642d0b7b
Merge remote-tracking branch 'origin/feat/nv13' into feat/nv13-1.11
2021-06-01 21:06:58 +02:00
Łukasz Magiera
b6b56320bf
Fix StateComputeDataCommitment
2021-06-01 20:34:24 +02:00
Łukasz Magiera
482e1110c2
precommit batcher: Improve error propagation
2021-06-01 14:35:30 +02:00
Łukasz Magiera
9fcb564bef
Make commit batcher more robust
2021-06-01 11:56:19 +02:00
Aayush Rajasekaran
85873f6057
Wdpost run should respect AddressedPartitionsMax
2021-05-31 19:28:49 -04:00
Anton Evangelatov
d195a12565
Merge branch 'master' into nonsense/split-market-miner-processes
2021-05-31 11:26:11 +02:00
Łukasz Magiera
1e4456138e
Merge master into feat/nv13
2021-05-27 12:28:20 +02:00
Łukasz Magiera
d71334cc24
Address self-review
2021-05-20 18:04:07 +02:00
Anton Evangelatov
76bb424de0
update StorageMinerAPI
2021-05-20 13:01:14 +02:00
Łukasz Magiera
a5677d1b7a
ffiwrapper: Separate Prover interface
2021-05-19 15:20:23 +02:00
Anton Evangelatov
1295c924e1
confirm that Miner struct satisfies sectorblocks.SectorBuilder
2021-05-19 13:22:00 +02:00
Anton Evangelatov
a989f60e27
add SectorAddPieceToAny and SectorUnsealPiece to StorageMiner iface; model moved to api package - PieceDealInfo, DealSchedule
2021-05-19 13:05:07 +02:00
Łukasz Magiera
c7ba083fa4
Import precommit batcher
2021-05-18 16:51:06 +02:00
Łukasz Magiera
2afe725933
Get PreCommitting to work
2021-05-17 22:02:23 +02:00
Łukasz Magiera
6278bdc69a
Make things build
2021-05-17 20:47:41 +02:00
Raúl Kripalani
50360e68ae
rename {changeHandlerAPI=>wdPoStCommands} + add docs.
2021-05-15 15:07:02 +01:00
Raúl Kripalani
c77f8fb382
adopt clearer method names; fix typo.
2021-05-15 15:07:02 +01:00
Raúl Kripalani
9912212949
minor refactor to anonymize interface.
2021-05-14 20:08:22 +01:00
Raúl Kripalani
28efa9357c
rename {setSender=>prepareMessage}.
2021-05-14 19:49:05 +01:00
Raúl Kripalani
0f4270126f
rename {submitPost=>submitPoStMessage}.
2021-05-14 19:48:38 +01:00
Raúl Kripalani
89dfb0ba19
minor refactor, renames, docs in Miner#Run.
2021-05-14 19:47:50 +01:00
Raúl Kripalani
0187aa6d9c
imports reorder.
2021-05-14 19:46:46 +01:00
Raúl Kripalani
2d7f4b1c61
docs: add godocs to storage module.
2021-05-14 19:45:47 +01:00
Raúl Kripalani
c7d50fe195
rename {storageMinerApi=>fullNodeFilteredAPI}; add docs.
2021-05-13 14:36:16 +01:00
Raúl Kripalani
1d6941b0eb
rename storage/{sealing=>miner_sealing}.go
2021-05-13 14:33:35 +01:00
Raúl Kripalani
df7631df77
docs: rename some wdpost methods; add docs.
2021-05-13 13:07:42 +01:00
Łukasz Magiera
506f39b294
WIP: Integrate FIP0013
2021-05-11 22:10:29 -04:00
Aayush Rajasekaran
d794b49df3
Use EmptyTSK where appropriate
2021-04-29 01:00:03 -04:00
Łukasz Magiera
cf96ad4fdb
fix lint
2021-04-06 14:30:49 +02:00
Łukasz Magiera
e8f28d7b9f
Fix tests
2021-04-06 12:24:58 +02:00
Łukasz Magiera
81bd27911f
Propagate StateMsg api changes
2021-04-05 19:56:53 +02:00
Łukasz Magiera
deb2b90b6a
Fix lotus/miner build
2021-04-05 13:23:46 +02:00
Łukasz Magiera
728d86cd36
wdpost: Always head tipset to get randomness
2021-03-11 09:59:26 +01:00
刘林欣
9095babf8c
fix window post rand check
2021-03-11 15:10:19 +08:00
Steven Allen
84f721e373
fix: retry proof when randomness changes
...
Simply warning isn't enough.
2021-03-10 10:24:58 -08:00
Łukasz Magiera
6315523fe9
Merge remote-tracking branch 'origin/master' into next
2021-03-10 15:58:28 +01:00
Łukasz Magiera
a0d7604e7c
wdpost: Use chain head tsk in post rand check
2021-03-10 13:36:34 +01:00
Łukasz Magiera
ca3d22683a
gofmt
2021-03-10 12:27:37 +01:00
Łukasz Magiera
ea4a54e083
wdpost: Fix tests
2021-03-10 10:01:28 +01:00
Łukasz Magiera
57fe04ba6e
wdpost: double-check randomness
2021-03-10 09:19:38 +01:00
Steven Allen
b7fab5f937
fix: wait a bit before starting to compute window post proofs
...
Due to a (now consensus critical) bug in randomness selection, "beacon"
randomness depends on whether the epoch in which the beacon occurred was
a null block. Unfortunately, this means:
1. If a challenge lands on a non-null round but that non-null round gets
re-orged to a null round, the randomness will change to the beacon in
the first preceding non-null block.
2. If a challenge lands on a null round but that null round gets
re-orged to a non-null round, the randomness will change to the beacon
in the new non-null round.
The correct solution is to change the way the beacon is selected:
1. Wait until a non-null round.
2. The block in this round will contain all beacons from the null
rounds, select the beacon from the target epoch.
Unfortunately, this requires a mandatory network upgrade.
Instead, this patch just waits a bit before beginning to compute window
post after passing the challenge round to wait-out any reorgs.
2021-03-09 22:03:05 -08:00
Łukasz Magiera
06b360325a
handle terminate control addrs in address selection correctly
2021-03-08 22:09:04 +01:00
Łukasz Magiera
305c2ec77d
miner: Config to disable owner/worker addcess fallback
2021-03-08 21:33:46 +01:00
Łukasz Magiera
8bd5173a54
Merge branch 'next' into refactor/lib/blockstore
2021-03-01 19:04:40 +01:00
Raúl Kripalani
7f0f7d0b36
Merge branch 'master' into refactor/lib/blockstore
2021-02-28 19:55:23 +00:00
Łukasz Magiera
f719765069
storageminer: exit PledgeSector after sectors enter sealing pipeline
2021-02-16 17:41:58 +01:00
Łukasz Magiera
fc5e243c92
storagefsm: Cleanup CC sector creation
2021-02-16 17:14:59 +01:00
Łukasz Magiera
0c6aef221d
Fix error logging format strings
2021-02-11 12:00:26 +01:00
Łukasz Magiera
9b65793509
Merge pull request #5404 from filecoin-project/feat/test-window-post
...
Retry proofs if we generate an incorrect one
2021-02-03 13:04:33 +01:00
Łukasz Magiera
d64f4e84d5
add small cooldown if windowpost fails to verify
2021-02-03 12:42:19 +01:00
Raúl Kripalani
b0cbc932bd
consolidate all blockstores in blockstore package.
2021-01-29 20:01:00 +00:00
Łukasz Magiera
94009f247f
Merge pull request #5411 from filecoin-project/feat/sealing-handle-batch-publish
...
Handle batch publish storage deals message in sealing recovery
2021-01-28 19:33:49 +01:00
Dirk McCormick
1b494acc9e
feat: handle batch publish storage deals message in sealing recovery
2021-01-25 14:10:05 +01:00
Steven Allen
8de4e5e005
retry proofs if we generate an incorrect one
2021-01-22 13:31:47 -08:00
Aayush Rajasekaran
ab90a3b2bc
Actors update: MinerInfo.SealProofType has been removed
2021-01-21 15:21:19 -08:00
Jack Yao
41e9345da0
Update storage/addresses.go
...
Co-authored-by: Jakub Sztandera <kubuxu@protonmail.ch>
2021-01-19 09:36:35 +08:00
yaohcn
10b2ec55b5
correct log in maybeUseAddress
2021-01-15 12:31:47 +08:00
Łukasz Magiera
32885e1129
termination batcher: Notify based on what was sent
2021-01-14 17:14:26 +01:00
Łukasz Magiera
144b5a1350
perning termination API
2021-01-14 12:37:23 +01:00
Łukasz Magiera
3522c8d45a
SectorTerminateFlush API
2021-01-13 23:32:04 +01:00
Łukasz Magiera
174c595acc
Don't declare in proving window
2021-01-13 22:19:10 +01:00
Łukasz Magiera
52cc2cd3eb
Initial sector termination support
2021-01-13 00:42:01 +01:00
Jakub Sztandera
6ca5caef31
Refactor DefaultMessageSendSpec
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-12-08 20:51:27 +01:00
Łukasz Magiera
a5a72a41eb
miner: Fix control address lookup
2020-12-04 17:02:23 +01:00
Łukasz Magiera
58695dc1bc
miner: fix tests
2020-12-03 12:37:11 +01:00
Łukasz Magiera
2fd93a55ac
plumb AddressSelector to stoage fsm
2020-12-02 21:47:54 +01:00
Łukasz Magiera
f74a1b70ab
miner: Fix actor control list cli
2020-12-02 20:46:07 +01:00
Łukasz Magiera
7246ef273f
miner: Control address config for (pre)commits
2020-12-02 19:58:00 +01:00
Łukasz Magiera
95eaf13b5a
sectorstorage: Fix tests
2020-12-02 00:36:32 +01:00
Łukasz Magiera
c6f85886bf
miner: Add slow mode to proving check
2020-12-02 00:32:14 +01:00
Łukasz Magiera
054327b72a
wdpost: Update comment
...
Co-authored-by: dirkmc <dirkmdev@gmail.com>
2020-12-01 14:50:51 +01:00
Łukasz Magiera
e8d2560581
Fix tests
2020-11-27 16:47:48 +01:00
s1m0n21
663b3f4f21
add a sector check command
2020-11-26 15:02:43 +08:00
hannahhoward
218f7c2c5d
feat(markets): update markets, extract commp
2020-11-20 13:29:14 -08:00
Łukasz Magiera
1999156d06
wdpost: always pick least-bad address
2020-11-19 20:59:54 +01:00
Łukasz Magiera
b4fa099257
wdpost: fix TestWDPostDoPost
2020-11-19 18:57:43 +01:00
Łukasz Magiera
b7a282decc
wdpost: fix build
2020-11-19 18:30:53 +01:00
Łukasz Magiera
9f807f4aeb
storageminer: Simplify AddressFor
2020-11-19 18:02:20 +01:00
Łukasz Magiera
16dbbadddf
Set lower feecap on PoSt messages with low balance
2020-11-19 18:02:20 +01:00
15ho
ba56d02a1c
fix: WindowPoStScheduler.checkSectors() delete useless judgment
2020-11-19 19:48:32 +08:00
Łukasz Magiera
915c5e0fdd
Get most tests to pass
2020-11-16 19:03:30 +01:00
Steven Allen
05db5ce426
load proof types in window post logic
...
This is going to be inefficient, but it should be fine in practice.
2020-11-16 19:03:30 +01:00
Steven Allen
219c695967
fix storage adapter miner
2020-11-16 19:03:30 +01:00
Łukasz Magiera
6bea9dd178
Making sealing logic work with multiple seal proof types
2020-11-16 19:03:30 +01:00
Steven Allen
077bc83f7f
explicitly abort PoSt on context cancellation
2020-10-30 14:00:54 -07:00
Steven Allen
6985af5e88
keep retrying the proof until we run out of sectors to skip
...
If we have a bunch of corrupted but not missing sectors on disk, we may need to
retry many times before we get a proof to pass. Simply giving up doesn't help anyone.
2020-10-30 13:21:34 -07:00
Łukasz Magiera
4100f6eead
fix TestWDPostDoPost
2020-10-28 15:23:21 +01:00
Łukasz Magiera
e1da874258
Merge remote-tracking branch 'origin/master' into feat/async-restartable-workers
2020-10-27 03:31:07 +01:00
Steven Allen
0d06f8fa2b
Add commands to change the worker key
2020-10-26 18:16:24 -07:00
wangchao
e65aa4cf17
worker key should change when set sender found key not equal with the value on chain
2020-10-26 15:20:09 +08:00
Łukasz Magiera
4d87473053
Fix lint
2020-10-23 23:31:18 +02:00
Łukasz Magiera
660236b224
Merge remote-tracking branch 'origin/master' into feat/async-restartable-workers
2020-10-23 23:25:35 +02:00
Steven Allen
109b326ae2
Use older randomness for the PoSt commit on specs-actors version 2
...
After the upgrade, we're allowed to use randomness up to the challenge epoch.
This safe-guards us against very large reorgs where a miner computes a PoSt very
quickly.
2020-10-23 12:45:11 -07:00
Łukasz Magiera
29e334de54
Merge pull request #4511 from filecoin-project/steb/generalize-window-post
...
Manage sectors by size instead of proof type.
2020-10-22 21:27:48 +02:00
Steven Allen
bcabe7b3b5
migrate methods to abstracted methods
...
Method numbers never change anyways. At worst, we'll deprecate old methods and
have to explicitly import them from the correct actors version to use them.
2020-10-21 12:18:37 -07:00
Steven Allen
4e730b5ec8
port to v2 imports
2020-10-21 12:16:23 -07:00
Steven Allen
00dcb1bce9
Manage sectors by size instead of proof type.
...
* We may have multiple sectors with the same size and different proof types, but all these management functions stay the same.
* This simplifies PoSt logic.
2020-10-20 18:30:56 -07:00
Łukasz Magiera
8d06cca073
sched: Handle workers using sessions instead of connections
2020-10-18 12:36:06 +02:00
Łukasz Magiera
b74a3229f8
fsm: process expired-ticket sectors
2020-10-13 21:35:41 +02:00
Jakub Sztandera
2b21fdef33
Refactor from crypto.SigType to types.KeyType
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-10-12 00:07:53 +02:00
Steven Allen
748d2e82a7
unshare the journal
...
Motivation:
* Run lotus with the race detector enabled (primary motivation).
* Allow multiple lotus nodes in a process (not a high priority).
Previously, the journal was shared between all lotus instances, but it was
initialized for every new node. This caused safety problems in tests (at a
minimum).
This patch explicitly passes the journal to all services that need it.
2020-10-09 13:23:07 -07:00
Steven Allen
196bf39574
use non-faulty sectors, instead of active, in post proof
...
In actors v2, active doesn't include "new" (unproven) sectors.
2020-09-30 17:35:14 -07:00
Łukasz Magiera
90be8d801b
Merge branch 'master' into post-trace
2020-09-30 10:03:54 +02:00
Łukasz Magiera
7a3a2f8db9
Merge pull request #3924 from filecoin-project/feat/dont-recompute-PoST-redux
...
Dont recompute post on revert <<redux>>
2020-09-30 09:18:46 +02:00
Łukasz Magiera
ef28ebb14a
Ignition upgrades, much excite.
2020-09-25 23:55:37 -07:00
Dirk McCormick
80a7ed8116
refactor: use abstract types instead of specs-actors
2020-09-25 15:54:27 +02:00
zgfzgf
13b38815c2
add trace wdpost
2020-09-25 20:31:07 +08:00
Dirk McCormick
7eb9bec13f
feat: dont recompute post on submit redux
2020-09-24 14:38:33 +02:00
Steven Allen
63f026f7c3
migrate some more imports
2020-09-21 15:24:45 -07:00
Steven Allen
4cf0c105eb
optimize sector loading
...
And avoid exposing "arrays" via the miner abstraction. We may change these
structures later.
2020-09-21 12:12:08 -07:00
Łukasz Magiera
a307e4593a
wdpost: Fix TestWDPostDoPost
2020-09-21 10:06:19 +02:00
Steven Allen
35bce5a5c6
revert post changes
...
1. Calling the specific partition/deadline APIs is faster.
2. It's _much_ easier to test this way.
2020-09-18 15:40:49 -07:00
Steven Allen
1bf3b4989d
rename imports to match actors code
...
`sed -i 's/\bv0\(\w\)\(\w*\)/\L\1\E\20/g' **/*.go`
2020-09-18 14:59:27 -07:00
Łukasz Magiera
ccd0a67b01
wip fixing wdpost tests
2020-09-18 20:34:23 +02:00
Łukasz Magiera
70faa36b7f
Merge remote-tracking branch 'origin/master' into refactor/net-upgrade
2020-09-18 19:29:06 +02:00
Łukasz Magiera
26bbd9fb9d
wdpost: append is hard
2020-09-18 03:00:31 +02:00
Łukasz Magiera
8419dda84b
wdpost: Only add proven partitions to message params
2020-09-18 02:39:08 +02:00
Łukasz Magiera
6eda53565f
Most tests passing
2020-09-17 17:30:24 +02:00
Aayush Rajasekaran
31ff5230bb
Get State API almost working
2020-09-17 05:05:32 -04:00
hannahhoward
691bd9f442
feat(markets): complete markets conversion
...
complete markets conversion to using chain/actors types, also replacing DealProposal/DealState
interfaces with structs
2020-09-17 00:43:14 -07:00
Aayush Rajasekaran
b5ba7a0fad
Miner migration
2020-09-17 02:21:16 -04:00
jennijuju
5c69249ba3
Use window post for window PoSt related log messages.
2020-09-15 21:22:29 -04:00
Steven Allen
c64f983900
migrate StateMinserSectorCount
2020-09-15 12:09:39 -07:00
Łukasz Magiera
4dabab5ce6
state manager progress
2020-09-15 13:04:45 +02:00
Dirk McCormick
db998e9c0f
fix: storage - move rand generation after proofs
2020-09-15 09:52:55 +02:00
Dirk McCormick
f0f15f899c
feat: split window PoST messages into batches
2020-09-15 09:43:18 +02:00
Steven Allen
36f920bcd7
progress
2020-09-14 21:55:49 -07:00
Steven Allen
02dcb5e182
Merge branch 'master' into refactor/net-upgrade
2020-09-14 14:53:57 -07:00
Steven Allen
2088335b9d
rename to simplify merge
2020-09-14 14:40:52 -07:00
Steven Allen
9804310cc8
Update specs-actors to 0.9.10
...
Moves the Keyer type (and helpers) into go-state-types.
2020-09-14 14:32:57 -07:00
Łukasz Magiera
8a05fe86d6
wdpost: Skip sectors correctly
2020-09-14 20:33:54 +02:00
Łukasz Magiera
06ec571c20
Merge remote-tracking branch 'origin/master' into refactor/net-upgrade
2020-09-14 15:09:52 +02:00
Raúl Kripalani
6d29d75724
Merge branch 'master' into inmem-journal
2020-09-14 12:17:45 +01:00
Steven Allen
d3594835c4
[WIP] Network upgrade support
...
This patch starts adding support for network upgrades.
* It adds an actors abstraction layer for loading abstract (cross-version) actors.
* It starts switching over to a shared deadline type.
* It adds an abstraction for ADTs (hamt/amt).
* It removes the callback-based API in the StateManager (difficult to abstract
across actor versions).
* It _does not_ actually add support for actors v2. We can do that in a followup
patch but that should be relatively easy.
This patch is heavily WIP and does not compile. Feel free to push changes
directly to this branch.
Notes:
* State tree access now needs a network version, because the HAMT type will change.
* I haven't figured out a nice way to abstract over changes to the _message_
types. However, many of them will be type aliased to actors v0 in actors v2 so
we can likely continue using the v0 versions (or use the v2 versions
everywhere). I've been renaming imports to `v0*` to make it clear that we're
importing types from a _specific_ actors version.
TODO:
* Consider merging incremental improvements? We'd have to get this compiling
again first but we could merge in the new abstractions, and slowly switch over.
* Finish migrating to the new abstractions.
* Remove all actor state types from the public API. See `miner.State.Info()` for
the planned approach here.
* Fix the tests. This is likely going to be a massive pain.
2020-09-11 20:16:29 -07:00
Łukasz Magiera
d0175392c0
Merge remote-tracking branch 'origin/master' into feat/window-post-faulty-sectors
2020-09-11 10:47:39 +02:00
Aayush Rajasekaran
774e068436
Update to specs-actors v0.9.8
2020-09-10 17:41:55 -04:00
Łukasz Magiera
5e7737f55d
wdpost: Handle skipped sectors correctly
2020-09-10 02:59:37 +02:00
whyrusleeping
7a6ceebb34
windowed post generation now returns faulty sectors
2020-09-09 14:00:15 -07:00
Steven Allen
afa913f2ed
Remove hard-coded late-fee in window PoSt
...
This is no longer necessary, and doesn't really serve any purpose.
2020-09-09 11:34:55 -07:00
Aayush Rajasekaran
d678fe4bfa
Fix tests
2020-09-07 15:48:42 -04:00
Aayush Rajasekaran
39755a294a
Update to specs v0.9.6
2020-09-07 15:48:41 -04:00
Raúl Kripalani
3206f92063
Merge branch 'master' into inmem-journal
2020-09-02 19:50:52 +01:00
Raúl Kripalani
f046af337a
split wdpost event into finer-grained ones.
2020-09-02 19:45:25 +01:00
Raúl Kripalani
ac152abc75
shuffle code to journal wdpost events.
2020-09-02 19:15:25 +01:00
Łukasz Magiera
7806a9885a
storagefsm: Record publish deals message CID
2020-08-27 17:50:50 +02:00
Steven Allen
0155a31d1f
Fix PoSt with bad sectors
...
"skipped" sectors must be replaced with a substitute "good" sector, or the
entire partition must be skipped. They should not just be omitted.
This patch also fixes the test to verify the _entire_ proof instead of just
verifying that the proof includes the correct sectors.
2020-08-26 09:56:51 -07:00
Raúl Kripalani
efdfd3ee3e
Merge branch 'master' into inmem-journal
2020-08-26 16:38:23 +01:00
Raúl Kripalani
4e1ef09751
make journal a global var.
2020-08-26 16:09:37 +01:00
Łukasz Magiera
a236957538
Merge pull request #3232 from filecoin-project/asr/marked-for-upgrade
...
Indicate whether a sector has been marked for upgrade
2020-08-22 21:48:45 +02:00
Aayush Rajasekaran
984e52acbc
Indicate whether a sector has been marked for upgrade
2020-08-21 15:53:39 -04:00
Steven Allen
5733c71c50
Lint everything
...
We were ignoring quite a few error cases, and had one case where we weren't
actually updating state where we wanted to. Unfortunately, if the linter doesn't
pass, nobody has any reason to actually check lint failures in CI.
There are three remaining XXXs marked in the code for lint.
2020-08-20 20:46:36 -07:00
Łukasz Magiera
a4807b18bc
gofmt, api docstring
2020-08-20 01:26:13 +02:00
Łukasz Magiera
71cf358ee3
Fix windowpost test
2020-08-20 01:18:01 +02:00
Łukasz Magiera
5ea61abfe1
Wire up miner control addresses, use for post
2020-08-20 01:17:03 +02:00
whyrusleeping
f5dcd4a25f
set missing miner ID field
2020-08-19 13:42:34 -07:00
Łukasz Magiera
3fd4921ea3
Merge pull request #3147 from filecoin-project/feat/fsm-seal-limits
...
fsm: Config for limiting max sealing sectors
2020-08-18 21:54:41 +02:00
Peter Rabbitson
02d21c2833
Missing error argument
2020-08-18 21:08:20 +02:00
Łukasz Magiera
886d9cd5eb
fsm: handle already-precommitted CommitFailed sectors correctly
2020-08-18 18:02:25 +02:00
Łukasz Magiera
65ffde9e4b
fsm: Config for max WaitDeals sectors
2020-08-18 16:20:31 +02:00
Raúl Kripalani
862bafc63a
fix lint errors.
2020-08-17 14:39:33 +01:00
Raúl Kripalani
efdc428d5d
keep storage-fsm (renamed to storage-sealing) and sector-storage in extern.
2020-08-17 14:26:18 +01:00
Raúl Kripalani
4f6d01d2ea
fix path in failing test.
2020-08-16 12:28:39 +01:00
Raúl Kripalani
2b511d2f57
fix lint errors.
2020-08-16 11:44:22 +01:00
Raúl Kripalani
1eed341951
fix test compilation error.
2020-08-16 11:14:24 +01:00
Raúl Kripalani
3c17cd655e
integrate extern/sector-storage into lotus proper.
2020-08-16 11:09:58 +01:00
Raúl Kripalani
fb0ccc9260
integrate extern/storage-fsm into lotus proper.
2020-08-16 10:42:13 +01:00
Łukasz Magiera
42bb91c2e6
gofmt
2020-08-14 23:40:41 +02:00
Łukasz Magiera
25cb3a15e7
wdpost: Wait for the correct confidence
2020-08-14 21:03:20 +02:00
Łukasz Magiera
12f7e2d9bf
Use a struct for send metadata in MpoolPushMessage
2020-08-12 22:17:29 +02:00
Łukasz Magiera
e1a1b325bc
Merge remote-tracking branch 'origin/next' into feat/max-msg-fee-config
2020-08-12 21:55:03 +02:00
Łukasz Magiera
6f890a3edd
Miner fee config
2020-08-12 19:47:09 +02:00
Steven Allen
6f031993ba
Use the deadline open as the wpost commit epoch
2020-08-12 10:33:18 -07:00
Steven Allen
e18904bff5
[WIP] fix post submission
2020-08-12 10:33:18 -07:00
Steven Allen
9135a5d048
Pass bitfields by-value
...
This ensures we can't end up decoding nil bitfields from clients when not
expecting them.
Part of https://github.com/filecoin-project/specs-actors/issues/895 . Please see
this issue for details and leave any comments there.
2020-08-12 10:32:39 -07:00
Łukasz Magiera
d0147aa50f
Add maxFee param to MpoolPushMessage
2020-08-12 19:06:16 +02:00
Raúl Kripalani
cc859d3948
journal: wdpost: record proofs_processed even if no eligible partitions.
2020-08-11 16:49:18 +01:00
Raúl Kripalani
b534ab9d3c
panic recovery in MaybeRecordEvent; handle nil current tipsets in wdpost.
2020-08-11 14:28:00 +01:00
Raúl Kripalani
92598237c3
Merge branch 'next' into inmem-journal
2020-08-11 12:41:11 +01:00
Anton Evangelatov
9fa42680fe
rationalise annoying logs.
2020-08-07 15:53:55 +02:00
Jakub Sztandera
ab08858b45
Delete GasPrice from this world
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-08-06 23:08:42 +02:00
刘勇
35e519179a
submit wdpost proof without waitting for recovery and fault messages appear on chain
2020-08-06 14:01:58 +08:00
Łukasz Magiera
9681ac3fb9
Update FSM with sealing fixes
2020-08-05 03:35:40 +02:00
Łukasz Magiera
d7e1a526f6
Fix Fault/Recovery declaration timing
2020-08-03 20:29:58 +02:00
Jakub Sztandera
81a65fe1bc
Swich gas-price to 0 in many places
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-08-01 16:23:13 +02:00
Łukasz Magiera
4d328cad54
Get things to mostly work
2020-07-30 14:31:50 +02:00
Łukasz Magiera
ed04c80bb1
Fix precommit deposit
2020-07-28 20:55:31 +02:00
Łukasz Magiera
927ee2406a
Downgrade actors, get tests to pass
2020-07-28 19:51:58 +02:00
Łukasz Magiera
10362ab9b4
markets: Fix offset in LocatePieceForDealWithinSector
2020-07-28 01:22:20 +02:00
Łukasz Magiera
1e6afb3b73
wdpost: Correctly skip partitions with no sectors
2020-07-23 11:13:02 +02:00
Jakub Sztandera
a3589e4487
Enable gas estimation for SubmitWindowPost
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-07-22 19:28:04 +02:00
Łukasz Magiera
47a930ae53
Drop commented-out code
2020-07-22 18:12:31 +02:00
chunqizhi
8d28b72741
Fix bug when run windowPost
2020-07-22 17:02:46 +08:00
Raúl Kripalani
b8475114ba
Merge branch 'next' into inmem-journal
2020-07-21 17:42:51 +01:00
Raúl Kripalani
4e82cf369c
rename journal entries to journal events.
2020-07-21 17:32:01 +01:00
Raúl Kripalani
d6e6eedd58
pipe sealing events to the journal.
2020-07-21 13:02:51 +01:00
Łukasz Magiera
66c44d24ff
Merge pull request #2484 from filecoin-project/feat/gas-estim
...
Add gas estimation
2020-07-21 01:09:16 +02:00
Jakub Sztandera
7da629d03b
Update gas prices
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-07-20 21:31:05 +02:00
Łukasz Magiera
901f9c3760
wdpost: Actually set post.Proofs
2020-07-20 19:21:10 +02:00
Raúl Kripalani
226786c1da
wip
2020-07-20 14:45:17 +01:00
Łukasz Magiera
4b74aa5768
wdpost: Correctly prove 0 sectors
2020-07-17 16:47:16 +02:00
Łukasz Magiera
06acda0ab9
mod tidy, gofmt
2020-07-17 15:18:40 +02:00
Łukasz Magiera
cb6767a02b
Merge remote-tracking branch 'origin/next' into feat/actors-miner-refactor
2020-07-17 15:18:11 +02:00
Peter Rabbitson
e266f3b955
Bump fil-commcid and filecoin-ffi deps
...
Propagates correct on-chain commX CIDs
2020-07-17 00:38:42 +02:00
Jakub Sztandera
7b14d445b4
Update message gas limits
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-07-15 20:01:57 +02:00
Raúl Kripalani
a44e80c829
Merge branch 'next' into mock-clock
2020-07-15 15:51:11 +01:00
Lucas Molas
0313ab4e49
debug: standard PoSt tag
2020-07-14 19:22:25 -03:00
Łukasz Magiera
0ccc9f65a6
gofmt
2020-07-14 19:10:37 +02:00
Łukasz Magiera
af87b9aa98
Fix widowed PoSt scheduler
2020-07-14 19:10:31 +02:00
Raúl Kripalani
0484496d92
Merge branch 'next' into mock-clock
2020-07-14 18:08:26 +01:00
Łukasz Magiera
f53bd6bdba
StateSectorPartition api
2020-07-14 14:32:17 +02:00
Łukasz Magiera
2e4ed57363
Merge remote-tracking branch 'origin/master' into next
2020-07-13 13:34:56 +02:00
Aayush Rajasekaran
858513559b
API improvements
2020-07-11 23:54:58 -04:00
Raúl Kripalani
13de81b3b2
introduce the ability to mock time.
2020-07-10 15:51:45 +01:00
Łukasz Magiera
d16de56280
gofmt
2020-07-08 14:35:53 +02:00
Łukasz Magiera
c97af35176
Merge pull request #2285 from filecoin-project/asr/timer
...
Update storage-FSM, add API to set sector seal delay
2020-07-07 21:43:14 +02:00
Aayush Rajasekaran
411c82ae8f
Update storage-FSM, add API to set sector seal delay
2020-07-07 15:23:23 -04:00
Łukasz Magiera
e7aec53631
Merge remote-tracking branch 'origin/master' into next
2020-07-06 23:02:24 +02:00
Leo Cheung
874cb46cb3
Update storage/wdpost_run.go
...
Co-authored-by: Łukasz Magiera <magik6k@users.noreply.github.com>
2020-07-06 06:20:41 -05:00
Leo Cheung
ddba20ccdf
Update storage/wdpost_run.go
...
Co-authored-by: Łukasz Magiera <magik6k@users.noreply.github.com>
2020-07-06 06:19:47 -05:00
Leo Cheung
4e12c4cb69
Update wdpost_run.go
...
if some unrecovered sectors can not recovered (such as cache file is missing) , miner should not send message "DeclareFaultsRecovered"
2020-07-06 15:52:58 +08:00
Łukasz Magiera
82e2cd4746
Basic CC Upgrade support
2020-07-01 17:01:06 +02:00
Łukasz Magiera
5b73b48dc8
Fix tests post actor update
2020-07-01 14:04:37 +02:00
Łukasz Magiera
5d6fcbeccf
Change initial pledge calc to PrecommitInfo
2020-06-26 18:00:50 +02:00
Łukasz Magiera
24f4c96fc3
apitest: auto-start sealing precoss
2020-06-26 17:28:05 +02:00
Łukasz Magiera
a7c372efff
storage-fsm updates for sector packing
2020-06-26 15:13:18 +02:00
Łukasz Magiera
f1e686f706
Merge pull request #2107 from chunqizhi/zc
...
An incorrect sector was detected, but also run windowPoSt
2020-06-24 12:40:16 +02:00
Łukasz Magiera
0b1fa54a4d
wdpost: Remove commented code
2020-06-24 12:38:46 +02:00
奇
55ed45f108
Get the good sectors to run windowPost
2020-06-23 20:46:41 +08:00
Łukasz Magiera
5adc188466
miner: Command to remove sectors
2020-06-22 19:35:14 +02:00
Łukasz Magiera
e60dd219dc
wdpost: Don't return nil from checkSectors
2020-06-17 18:21:40 +02:00
Łukasz Magiera
0230362d33
Merge pull request #2025 from filecoin-project/deps/specs-actors-v0.6
...
specs-actors v0.6
2020-06-15 21:30:37 +02:00
Łukasz Magiera
907364ce67
Update deps, fix more tests
2020-06-15 18:30:49 +02:00
Łukasz Magiera
0200e3def5
wdpost: Submit recoveries for sectors within a deadline
2020-06-11 20:38:29 +02:00
Aayush Rajasekaran
5cf76ba8b3
Create an api.MinerInfo that has peerID as a Peer ID
2020-06-09 19:07:53 -04:00
Łukasz Magiera
28f895cec2
Update sector-storage with better post faults
2020-06-08 23:20:19 +02:00
Łukasz Magiera
7ae9d26cd1
Merge remote-tracking branch 'origin/next' into fix/sealing-betterering
2020-06-05 14:00:47 +02:00
Jakub Sztandera
0bc174697a
Fix WindowPoStScheduler
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-06-05 00:52:45 +02:00
Łukasz Magiera
f9f0d86ddf
Merge pull request #1913 from acruikshank/feat/1853-confirmations-in-StateWaitMsg2
...
Add confidence and timeout to message wait
2020-06-04 23:23:15 +02:00
Łukasz Magiera
c625b30781
Update fsm adapter
2020-06-04 21:26:29 +02:00
acruikshank
da960a9de4
more import rearrangement
2020-06-04 09:54:37 -04:00
acruikshank
04f0130530
remove timeout
2020-06-03 17:42:06 -04:00
acruikshank
5574e4f11b
add confidence and timeout to message wait
2020-06-03 15:38:37 -04:00
Łukasz Magiera
ee29a92021
Add a test for Window Post
2020-06-01 14:49:48 +02:00
Łukasz Magiera
cd2bf04a6b
wdpost: Better fault handling
2020-05-29 21:36:11 +02:00
Łukasz Magiera
785eeb1eee
Merge pull request #1850 from filecoin-project/chore/lint
...
Cleanup many lint warnings
2020-05-29 18:06:06 +02:00
Jeromy
e2a554c2e6
update specs actors to version with batch porep verification
2020-05-28 13:19:18 -07:00
Jeromy
8e55c91cd2
check neq zero exit code
2020-05-28 22:11:49 +02:00
Jeromy
b807bdbea0
check neq zero exit code
2020-05-28 08:45:34 -07:00
Jakub Sztandera
d6615b6286
Cleanup many lint warnings
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-05-27 22:53:20 +02:00
waynewyang
94a7ef1c10
add deadline index for wdpost
2020-05-27 17:01:48 +08:00
Łukasz Magiera
9089aadbbf
Merge pull request #1821 from filecoin-project/deps/update-ffi
...
update to latest ffi
2020-05-26 19:34:02 +02:00
waynewyang
b799af3e9a
Fix:the input sectors of wpost must match with the minerActor
2020-05-26 17:58:20 +08:00
waynewyang
da6768c94d
Set largest gaslimit for wdpost
2020-05-26 11:43:17 +08:00
Jeromy
646800b8a8
update to latest ffi
2020-05-22 09:26:14 -07:00
Łukasz Magiera
3da1a0d8cc
post: Declare recoveries for the next deadline
2020-05-20 19:07:31 +02:00
Travis Person
a293bd798f
init map
2020-05-20 18:41:22 +02:00
Łukasz Magiera
ae60001dcc
post: Handle Recovering sectors
2020-05-20 18:41:20 +02:00
Łukasz Magiera
4e13d284b7
events: Fix revert+apply of msg execution, but not the message
2020-05-14 00:48:36 +02:00
Łukasz Magiera
89b19af43f
specs-actors v0.3
2020-04-29 20:06:05 +02:00
Łukasz Magiera
41d925ab8a
Merge pull request #1630 from filecoin-project/asr/misc
...
Minor / irrelevant improvements go here
2020-04-29 00:21:45 +02:00
Łukasz Magiera
ac6573cca7
Merge pull request #1629 from filecoin-project/deps/update-specs-actors
...
WIP: updating to specs actors v0.2.0
2020-04-28 22:56:47 +02:00
Jeromy
6a27c65201
updating to specs actors v0.2.0
2020-04-28 13:52:07 -07:00
Aayush Rajasekaran
ae47bc15ff
Remove / rename fallback post stuff
2020-04-28 13:39:35 -04:00
Łukasz Magiera
9dcb42328e
gofmt
2020-04-28 19:27:13 +02:00
Łukasz Magiera
55f7c81aaf
specs-actors: Fix miner cron on null blocks
2020-04-24 19:12:30 +02:00
Jeromy
ef1d485c6e
move head change type out of chainstore package
2020-04-23 15:28:59 -07:00
Whyrusleeping
faa9002cce
working on sector pledge requirements after specs-actors 1.0.0 ( #1584 )
...
* WIP: working on sector pledge requirements after specs-actors 1.0.0
* update storage-fsm with pledge collateral logic
* Set bigger balances for miners
* Return only additional required pledge
* split collateral methods into two methods
Co-authored-by: Łukasz Magiera <magik6k@gmail.com>
2020-04-23 12:39:34 -07:00
Łukasz Magiera
262d7b2372
post: Don't send empty posts
2020-04-22 21:16:19 +02:00
Łukasz Magiera
9f9ae155e3
windowed post: Review cleanup
2020-04-21 23:38:33 +02:00
Łukasz Magiera
8be9494672
windowed post: Get correct sector set
2020-04-21 19:22:53 +02:00
Łukasz Magiera
a86595bc88
Use nicer DeadlineInfo struct
2020-04-20 19:34:08 +02:00
Łukasz Magiera
3b7ae0d6d9
mod tidy, gofmt
2020-04-18 00:02:43 +02:00
Łukasz Magiera
e6270e4291
Update fsm; get sectorset form correct ts
2020-04-17 21:49:32 +02:00
Łukasz Magiera
bab352fb44
Wireup WinningPost validation
2020-04-17 16:47:19 +02:00
Jeromy
708988244d
WIP: working on winning post integration
2020-04-16 22:39:55 -07:00
Łukasz Magiera
6eaafcf79d
wireup windowPost scheduling logic to miner actor
2020-04-16 22:11:07 +02:00
Łukasz Magiera
afdfc8807d
api: Single method for static miner info
2020-04-16 19:36:36 +02:00
Łukasz Magiera
8338be3a6e
Fix genesis creation
2020-04-16 19:17:56 +02:00
Łukasz Magiera
85993848be
bring back api.StateMinerProvingSet
2020-04-15 22:40:46 +02:00
Łukasz Magiera
0336b32fcd
windowpost: Wire up challenge generation
2020-04-15 22:22:58 +02:00
Łukasz Magiera
5bf80a60f1
Get proof type in NewWinningPoStProver constructor
2020-04-13 23:25:46 +02:00
Łukasz Magiera
bb3789b130
Fix ADT uses
2020-04-13 23:06:11 +02:00
Łukasz Magiera
704978a6ba
genesis: Set ssize in VerifyDealsOnSectorProveCommitParams
2020-04-11 01:46:55 +02:00
Łukasz Magiera
a2554952d1
Some electionPoSt -> winningPoSt renaming
2020-04-11 00:22:45 +02:00
Łukasz Magiera
d3ffe48fcb
Get things to mostly build
2020-04-10 23:29:05 +02:00
Łukasz Magiera
e053cd6b9c
Merge remote-tracking branch 'origin/testnet/3' into feat/windowed-post
2020-04-10 23:09:01 +02:00
Łukasz Magiera
613e61222b
mostly wire up WindowedPoSt
2020-04-10 23:07:18 +02:00
laser
19573c0319
adjust imports to conform to convention
2020-04-10 08:22:28 -07:00
laser
4a12a98451
set pre-commit expiration to 10000000, which was original value in FSM
2020-04-10 08:22:28 -07:00
laser
6dffe9377f
provide deal scheduling info to FSM so that it can set pre-commit expiry
2020-04-10 08:22:28 -07:00
Łukasz Magiera
e36f356908
wip changes for windowed post
2020-04-07 21:55:34 +02:00
Łukasz Magiera
f2dd0f046e
wdpost: Make chain notif loop reconnect friendly
2020-04-07 20:02:52 +02:00
Łukasz Magiera
5524241645
fpost -> windowPost renaming
2020-04-07 19:41:41 +02:00
laser
110c869dd3
cut over to storage-fsm, deleting local sealing package
2020-04-07 09:34:09 -07:00
laser
43f4db2308
SectorID -> SectorNumber
2020-04-06 15:31:33 -07:00
laser
0170418fc1
revert name change
2020-04-06 14:05:26 -07:00
laser
2f4732760a
update CBOR encoders/decoders
2020-04-06 13:35:29 -07:00
laser
ab44ae1354
move to types
2020-04-06 13:31:49 -07:00
laser
f53250ee90
reorder imports
2020-04-06 13:27:14 -07:00
laser
dcd9e7da27
miscellaneous fixes post-rebase
2020-04-06 13:23:37 -07:00
laser
650a31b050
remove all lotus types from sealing package in preparation for extraction
...
events adapter
implement StateWaitMsg and StateComputeDataCommitment
implement StateGetSectorPreCommitOnChainInfo
implement ChainHead and SendMsg
implement remaining methods
2020-04-06 12:57:55 -07:00
Łukasz Magiera
f05be81275
fsm: Get correct interactive randomness if it lands on a nullblock
2020-04-04 04:57:05 +02:00
Łukasz Magiera
303d4a31fe
fsm: Handle invalid Commits
2020-04-04 03:50:05 +02:00
Łukasz Magiera
4d92798f5b
fsm: Update cbor-gen
2020-04-03 21:34:20 +02:00
Łukasz Magiera
6284fad33e
fsm: Implement handlers for Commit errors
2020-04-03 19:45:48 +02:00
Łukasz Magiera
a63a0b3077
sealing fsm: Separate precommit 1/2
2020-04-03 18:54:15 +02:00
Łukasz Magiera
147e18e28e
fsm: Fix tests after changisg SectorState to a string
2020-04-03 18:36:48 +02:00
Łukasz Magiera
a1b35aa9d5
Change api.SectorState to a string
2020-04-03 18:29:31 +02:00
Łukasz Magiera
95ee1c1cde
Extract sector-storage
2020-03-28 01:32:39 +01:00
Łukasz Magiera
c66d3dfad7
sectorstorage: Untangle from lotus deps
2020-03-27 22:35:33 +01:00
Łukasz Magiera
f882c5b229
sectorstorage: Address review
2020-03-27 18:45:32 +01:00
Łukasz Magiera
e050e0307e
Cleanup after dropping sectorbuilder
2020-03-26 20:35:16 +01:00
Łukasz Magiera
4be54a976c
Merge sectorbuilder into sectorstorage
2020-03-26 03:51:06 +01:00
Łukasz Magiera
6399499e9b
Fix sealing sectors with multiple pieces
2020-03-26 02:18:13 +01:00
Łukasz Magiera
d686fce7f9
stores: Mute serve-stat debug log
2020-03-25 22:23:01 +01:00
Łukasz Magiera
42c9d53ae1
workers: gofmt
2020-03-25 21:20:24 +01:00
Łukasz Magiera
05f52b1fad
stores: 'None' file type
2020-03-25 21:19:58 +01:00
Łukasz Magiera
00cfb3bdcf
sectorstorage: Move sealed sectors to storage in FinalizeSector
2020-03-25 19:21:53 +01:00
Łukasz Magiera
201d0a4b19
Merge remote-tracking branch 'origin/testnet/3' into feat/new-workers
2020-03-25 01:02:23 +01:00
Łukasz Magiera
cfc65f525a
sectorstorage: wire up closing logic
2020-03-25 00:52:55 +01:00
Łukasz Magiera
ecf53f88ce
workers: More review related fixes
2020-03-25 00:37:40 +01:00
Łukasz Magiera
146bfe75f8
sectorstorage: Remove unsealed sector in FinalizeSector
2020-03-24 21:28:07 +01:00
Łukasz Magiera
5de17e903c
storageminer: Config for local worker task types
2020-03-24 20:38:00 +01:00
Łukasz Magiera
66a682b55d
Merge remote-tracking branch 'origin/testnet/3' into feat/new-workers
2020-03-24 19:09:02 +01:00
Łukasz Magiera
726c9c1fe7
workers: Address review
2020-03-24 19:01:04 +01:00
Aayush Rajasekaran
d350a9d415
Re: #1412 : Add a non-blocking version of StateWaitMsg
...
- This commit adds a new method called StateSearchMsg
- We can probably overhaul StateWaitMsg onto this new method at a later point in time
2020-03-24 06:43:15 -04:00
Łukasz Magiera
8559c89560
storageminer: More storage stats in storage list
2020-03-23 23:43:38 +01:00
Łukasz Magiera
8d1fab1e05
sectorstorage: Enable sealing on the local worker by default
2020-03-23 17:28:40 +01:00
Łukasz Magiera
0bb37d1fd6
sectorstorage: Fix remote sector deletion
2020-03-23 16:40:36 +01:00
Łukasz Magiera
a3ba8eb0d7
workers: Basic monitoring tools
2020-03-23 15:56:22 +01:00
Łukasz Magiera
cb1e7bd1b1
sector index: Don't add duplicate storage URLs
2020-03-23 13:12:43 +01:00
Łukasz Magiera
5e4a7e54df
Rename agvmgr+sealmgr to sectorstorage
2020-03-23 12:47:10 +01:00
Łukasz Magiera
cd618dfdbd
gofmt
2020-03-22 22:39:27 +01:00
Łukasz Magiera
09c9fcce00
workers: fix panics with schedQueue
2020-03-22 21:45:12 +01:00
Łukasz Magiera
66d71d9974
sealing: Improve sector log
2020-03-22 21:44:27 +01:00
Łukasz Magiera
971fe6fdfd
workers: Drop sectors from origin after transfers
2020-03-22 05:27:28 +01:00
Jeromy
f3781e8329
update and rerun cbor gen
2020-03-21 14:17:01 -07:00
Łukasz Magiera
c57c0e7f55
workers: Memory based scheduling
2020-03-20 23:30:17 +01:00
Łukasz Magiera
076cc428af
workers: Fix moving storage around in later steps
2020-03-20 01:55:49 +01:00
Łukasz Magiera
e0c15b24fc
storageminer: Fix preseal meta import for genesis miners
2020-03-20 01:20:01 +01:00
Łukasz Magiera
978a718159
storage: storage find command
2020-03-19 20:51:33 +01:00
Łukasz Magiera
314fba049f
workers: get sectors back to miner process after precommit
2020-03-19 20:17:58 +01:00
Łukasz Magiera
80cca91584
workers: get to executing tasks remotely!
2020-03-19 18:11:45 +01:00
Łukasz Magiera
d87b7c264d
stores: Use index in local store
2020-03-19 16:11:04 +01:00
Łukasz Magiera
2fa3f2578f
impl: Move CommonAPI into a separate pkg
2020-03-19 03:31:53 +01:00
Łukasz Magiera
1ed7779701
Merge remote-tracking branch 'origin/testnet/3' into feat/new-workers
2020-03-19 03:28:55 +01:00
Łukasz Magiera
2d1e30ae3b
workers: Call find* on remote
2020-03-19 03:23:21 +01:00
