laser
650a31b050
remove all lotus types from sealing package in preparation for extraction
...
events adapter
implement StateWaitMsg and StateComputeDataCommitment
implement StateGetSectorPreCommitOnChainInfo
implement ChainHead and SendMsg
implement remaining methods
2020-04-06 12:57:55 -07:00
Łukasz Magiera
f05be81275
fsm: Get correct interactive randomness if it lands on a nullblock
2020-04-04 04:57:05 +02:00
Łukasz Magiera
303d4a31fe
fsm: Handle invalid Commits
2020-04-04 03:50:05 +02:00
Łukasz Magiera
4d92798f5b
fsm: Update cbor-gen
2020-04-03 21:34:20 +02:00
Łukasz Magiera
6284fad33e
fsm: Implement handlers for Commit errors
2020-04-03 19:45:48 +02:00
Łukasz Magiera
a63a0b3077
sealing fsm: Separate precommit 1/2
2020-04-03 18:54:15 +02:00
Łukasz Magiera
147e18e28e
fsm: Fix tests after changisg SectorState to a string
2020-04-03 18:36:48 +02:00
Łukasz Magiera
a1b35aa9d5
Change api.SectorState to a string
2020-04-03 18:29:31 +02:00
Łukasz Magiera
95ee1c1cde
Extract sector-storage
2020-03-28 01:32:39 +01:00
Łukasz Magiera
c66d3dfad7
sectorstorage: Untangle from lotus deps
2020-03-27 22:35:33 +01:00
Łukasz Magiera
f882c5b229
sectorstorage: Address review
2020-03-27 18:45:32 +01:00
Łukasz Magiera
e050e0307e
Cleanup after dropping sectorbuilder
2020-03-26 20:35:16 +01:00
Łukasz Magiera
4be54a976c
Merge sectorbuilder into sectorstorage
2020-03-26 03:51:06 +01:00
Łukasz Magiera
6399499e9b
Fix sealing sectors with multiple pieces
2020-03-26 02:18:13 +01:00
Łukasz Magiera
d686fce7f9
stores: Mute serve-stat debug log
2020-03-25 22:23:01 +01:00
Łukasz Magiera
42c9d53ae1
workers: gofmt
2020-03-25 21:20:24 +01:00
Łukasz Magiera
05f52b1fad
stores: 'None' file type
2020-03-25 21:19:58 +01:00
Łukasz Magiera
00cfb3bdcf
sectorstorage: Move sealed sectors to storage in FinalizeSector
2020-03-25 19:21:53 +01:00
Łukasz Magiera
201d0a4b19
Merge remote-tracking branch 'origin/testnet/3' into feat/new-workers
2020-03-25 01:02:23 +01:00
Łukasz Magiera
cfc65f525a
sectorstorage: wire up closing logic
2020-03-25 00:52:55 +01:00
Łukasz Magiera
ecf53f88ce
workers: More review related fixes
2020-03-25 00:37:40 +01:00
Łukasz Magiera
146bfe75f8
sectorstorage: Remove unsealed sector in FinalizeSector
2020-03-24 21:28:07 +01:00
Łukasz Magiera
5de17e903c
storageminer: Config for local worker task types
2020-03-24 20:38:00 +01:00
Łukasz Magiera
66a682b55d
Merge remote-tracking branch 'origin/testnet/3' into feat/new-workers
2020-03-24 19:09:02 +01:00
Łukasz Magiera
726c9c1fe7
workers: Address review
2020-03-24 19:01:04 +01:00
Aayush Rajasekaran
d350a9d415
Re: #1412 : Add a non-blocking version of StateWaitMsg
...
- This commit adds a new method called StateSearchMsg
- We can probably overhaul StateWaitMsg onto this new method at a later point in time
2020-03-24 06:43:15 -04:00
Łukasz Magiera
8559c89560
storageminer: More storage stats in storage list
2020-03-23 23:43:38 +01:00
Łukasz Magiera
8d1fab1e05
sectorstorage: Enable sealing on the local worker by default
2020-03-23 17:28:40 +01:00
Łukasz Magiera
0bb37d1fd6
sectorstorage: Fix remote sector deletion
2020-03-23 16:40:36 +01:00
Łukasz Magiera
a3ba8eb0d7
workers: Basic monitoring tools
2020-03-23 15:56:22 +01:00
Łukasz Magiera
cb1e7bd1b1
sector index: Don't add duplicate storage URLs
2020-03-23 13:12:43 +01:00
Łukasz Magiera
5e4a7e54df
Rename agvmgr+sealmgr to sectorstorage
2020-03-23 12:47:10 +01:00
Łukasz Magiera
cd618dfdbd
gofmt
2020-03-22 22:39:27 +01:00
Łukasz Magiera
09c9fcce00
workers: fix panics with schedQueue
2020-03-22 21:45:12 +01:00
Łukasz Magiera
66d71d9974
sealing: Improve sector log
2020-03-22 21:44:27 +01:00
Łukasz Magiera
971fe6fdfd
workers: Drop sectors from origin after transfers
2020-03-22 05:27:28 +01:00
Jeromy
f3781e8329
update and rerun cbor gen
2020-03-21 14:17:01 -07:00
Łukasz Magiera
c57c0e7f55
workers: Memory based scheduling
2020-03-20 23:30:17 +01:00
Łukasz Magiera
076cc428af
workers: Fix moving storage around in later steps
2020-03-20 01:55:49 +01:00
Łukasz Magiera
e0c15b24fc
storageminer: Fix preseal meta import for genesis miners
2020-03-20 01:20:01 +01:00
Łukasz Magiera
978a718159
storage: storage find command
2020-03-19 20:51:33 +01:00
Łukasz Magiera
314fba049f
workers: get sectors back to miner process after precommit
2020-03-19 20:17:58 +01:00
Łukasz Magiera
80cca91584
workers: get to executing tasks remotely!
2020-03-19 18:11:45 +01:00
Łukasz Magiera
d87b7c264d
stores: Use index in local store
2020-03-19 16:11:04 +01:00
Łukasz Magiera
2fa3f2578f
impl: Move CommonAPI into a separate pkg
2020-03-19 03:31:53 +01:00
Łukasz Magiera
1ed7779701
Merge remote-tracking branch 'origin/testnet/3' into feat/new-workers
2020-03-19 03:28:55 +01:00
Łukasz Magiera
2d1e30ae3b
workers: Call find* on remote
2020-03-19 03:23:21 +01:00
Łukasz Magiera
94ebbd9d90
workers: Actually register in miner
2020-03-19 00:23:32 +01:00
whyrusleeping
ddf1beac6c
change gas limit to be a normal int64
2020-03-18 13:45:37 -07:00
Łukasz Magiera
d8c8832a37
stores: fix StorageList
2020-03-18 05:40:25 +01:00
Łukasz Magiera
5f2caffb51
Fix tests after specs-storage changes
2020-03-18 02:08:11 +01:00
Łukasz Magiera
d8ce5078d9
Use new specs-storage interface
2020-03-17 21:19:52 +01:00
Łukasz Magiera
de1c984b48
workers: Handle init on first run
2020-03-16 19:46:02 +01:00
Łukasz Magiera
7e997e40f3
workers: Simple storage diagnostics
2020-03-16 18:50:07 +01:00
Łukasz Magiera
e6ec20b4ca
Merge branch 'testnet/3' into feat/new-workers
2020-03-13 17:58:13 +01:00
Łukasz Magiera
96730bae75
workers: Report sectors paths after worker creates them
2020-03-13 17:54:55 +01:00
Łukasz Magiera
2c7f579838
workers: Implement SectorIndex
2020-03-13 12:59:19 +01:00
Łukasz Magiera
a75ad492f1
workers: Declare sectors after fetching in remote store
2020-03-13 11:40:24 +01:00
Łukasz Magiera
bc7fede68b
workers: Wire up most pieces
2020-03-13 02:37:38 +01:00
Łukasz Magiera
86871e5abc
workers: Basic Remote store
2020-03-13 01:23:05 +01:00
Łukasz Magiera
56968d858c
workers: Make LocalWorker public
2020-03-11 22:23:16 +01:00
Łukasz Magiera
71afcb0333
workrs: refactor sector store for more composability
2020-03-11 08:22:21 +01:00
whyrusleeping
16d087cce4
get fallback post running successfully!
2020-03-10 23:30:48 -07:00
Łukasz Magiera
7e2e30f94b
workers: Transfer logic refactoring
2020-03-11 06:49:17 +01:00
Łukasz Magiera
eb61a36fd7
workers: RPC scaffolding
2020-03-11 02:58:02 +01:00
Łukasz Magiera
b3d8273a03
storage: Referance path struct by pointer
2020-03-09 20:41:05 +01:00
Łukasz Magiera
01087e01d2
storage: Improve thread safety
2020-03-09 20:22:30 +01:00
Łukasz Magiera
6981cfb8bc
Merge pull request #1365 from filecoin-project/feat/miner-storage-add
...
storageminer: 'storage attach' command
2020-03-09 07:28:11 +01:00
Whyrusleeping
93137b02be
Merge pull request #1364 from filecoin-project/feat/no-path-storage
...
storage: Allow starting with no paths
2020-03-08 23:15:53 -07:00
Łukasz Magiera
4b576cde50
storagemgr: Actually set updated config in AddLocalStorage
2020-03-09 06:56:32 +01:00
Łukasz Magiera
f01e8bc509
storage: Allow starting with no paths
2020-03-09 06:52:12 +01:00
whyrusleeping
ab51c7e2d2
Fix fallback post scheduling to hopefully do the right thing
2020-03-08 00:19:38 -08:00
whyrusleeping
24bf720a9a
Merge branch 'master' into testnet/3
2020-03-07 16:46:12 -08:00
whyrusleeping
f41f324fbc
fixup fallback post
2020-03-06 21:26:00 -08:00
Whyrusleeping
84a887cc58
Merge pull request #1345 from filecoin-project/fix/noop-plan-loop
...
sealing: Fix noop plan loop
2020-03-06 15:39:52 -08:00
Łukasz Magiera
a2f4d467fd
sealing: Fix noop plan loop
2020-03-07 00:03:57 +01:00
whyrusleeping
4101147a5b
one more miner init issue
2020-03-06 14:23:21 -08:00
Aayush Rajasekaran
2d63b007f2
Unify MethodCall and ReplayResults into SimulationResult
...
- Call and Replay now return the same type, which includes both Message and MessageReceipt
2020-03-06 11:10:40 -08:00
Łukasz Magiera
3d1a5f4bf3
libs: Use go-statemachine
2020-03-06 20:01:03 +01:00
Łukasz Magiera
e51fa5c9ac
libs: Use zerocomm from sectorbuilder
2020-03-06 19:50:41 +01:00
Łukasz Magiera
7d3e16986c
sectorbuilder type updates
2020-03-06 06:38:59 +01:00
Łukasz Magiera
16cb27b5f9
Get node_test to pass
2020-03-05 23:27:30 +01:00
Łukasz Magiera
1461e475da
storage: Support adding paths at runtime
2020-03-05 23:02:01 +01:00
Łukasz Magiera
a5e5918fc5
mod tidy; gofmt
2020-03-05 20:21:06 +01:00
Łukasz Magiera
f06bf6721e
sealmgr: Implement all sealing steps
2020-03-05 19:19:32 +01:00
Łukasz Magiera
4beed065b6
sealmgr: Working local addpiece
2020-03-05 03:18:22 +01:00
Łukasz Magiera
c91d970c41
storageminer: Init with default local storage
2020-03-05 02:12:52 +01:00
Łukasz Magiera
7db1dd52bd
storagemgr: Wire up most of AddPiece logic
2020-03-05 01:38:07 +01:00
Łukasz Magiera
4e46d00eb6
Merge remote-tracking branch 'origin/testnet/3' into feat/4stage-seal
2020-03-04 04:01:13 +01:00
Łukasz Magiera
12d870e274
sealmgr: Read only multi-path file manager
2020-03-04 03:24:08 +01:00
whyrusleeping
7b11224130
go mod updates, and a couple small fixes
2020-03-03 16:07:27 -08:00
Łukasz Magiera
a0dbb6bdd6
Storage Manager refactor
2020-03-03 23:19:22 +01:00
Łukasz Magiera
3abb59a550
sealmgr: Interfaces; simple initial impl
2020-03-03 01:46:58 +01:00
whyrusleeping
60b19c51ef
more misc fixes
2020-03-01 17:09:38 -08:00
Łukasz Magiera
f54a555aa8
Merge remote-tracking branch 'origin/testnet/3' into feat/4stage-seal
2020-02-29 03:21:01 +01:00
whyrusleeping
cf2eefdfbe
Fix up client storage deal matcher
2020-02-28 16:05:56 -08:00
whyrusleeping
713059275d
progress is made incrementally
2020-02-28 14:00:34 -08:00
whyrusleeping
5b657a2905
pass on proper sector types
2020-02-28 12:52:14 -08:00
whyrusleeping
0945d8725e
fixing miner logic to make more tests pass
2020-02-28 11:31:28 -08:00
Łukasz Magiera
5a4f917c60
4-stage v23 lotus-bench
2020-02-28 19:06:59 +01:00
Łukasz Magiera
d5b8defcbb
Begin work on integrating new sectorbuilder interfaces
2020-02-28 18:17:40 +01:00
Łukasz Magiera
58f8481a12
sbmock: Set commR with correct cid codec
2020-02-28 00:49:28 +01:00
Łukasz Magiera
f83bbc2cbe
Regen cbor marshalers
2020-02-28 00:34:48 +01:00
whyrusleeping
df6e3e83bf
make it all build finally
2020-02-27 13:45:31 -08:00
Łukasz Magiera
48619dc238
Merge branch 'feat/update-sectorbuilder' of github.com:filecoin-project/go-lotus into feat/update-sectorbuilder
2020-02-27 01:56:15 +01:00
Łukasz Magiera
2aeab13aae
zerocomm: 'Fix' the test
2020-02-27 01:56:09 +01:00
whyrusleeping
6c12068fb7
more fixes for random garbage
2020-02-26 16:42:39 -08:00
whyrusleeping
767392332e
WIP: update sectorbuilder
2020-02-26 14:54:34 -08:00
Łukasz Magiera
cb09e48e8c
Some test fixes
2020-02-26 10:05:22 +01:00
Łukasz Magiera
0a9e0acc6f
types: Drop some redundant alias types
2020-02-25 22:09:22 +01:00
Łukasz Magiera
ae634ef7df
actors: Remove addrass aliases
2020-02-25 21:54:58 +01:00
Łukasz Magiera
cd10a3126b
actors: drop a bunch of type aliases
2020-02-25 21:35:15 +01:00
Łukasz Magiera
794429dd55
post-upstream-merge fixes
2020-02-24 18:45:25 +01:00
Łukasz Magiera
d787aa5007
Merge branch 'testnet/3' into feat/specs-actors
2020-02-24 18:32:02 +01:00
Łukasz Magiera
1d417685d1
Fix Sealing in TestAPIDealFlow
2020-02-23 21:33:10 +01:00
Łukasz Magiera
917df9a5b8
More unified randomness handling
2020-02-23 21:00:47 +01:00
Łukasz Magiera
a82d156ccb
Deal flow fixes
2020-02-23 16:50:36 +01:00
Łukasz Magiera
226685dc1c
Implement committed capacity sectors
2020-02-23 01:47:47 +01:00
Łukasz Magiera
1381baf088
Generate zero CommP table
2020-02-22 15:06:38 +01:00
Łukasz Magiera
b8428423a1
get chain to runnable state
2020-02-22 14:10:46 +01:00
Łukasz Magiera
18627e77ff
gofmt; mod tidy
2020-02-21 20:28:20 +01:00
Łukasz Magiera
4e98f2e438
some test fixes
2020-02-21 20:28:01 +01:00
Łukasz Magiera
a6268f055d
storageminer: Update api interfaces
2020-02-21 18:43:44 +01:00
Łukasz Magiera
57c43183e6
update specs-actors
2020-02-21 17:57:40 +01:00
whyrusleeping
00d7bd1a77
chain/gen tests now pass!
2020-02-20 00:37:10 -08:00
Łukasz Magiera
69ec3c205a
Merge remote-tracking branch 'origin/master' into testnet/3
2020-02-19 22:10:14 +01:00
whyrusleeping
6d0eec6395
working towards a working genesis generator
2020-02-17 23:15:30 -08:00
Aayush Rajasekaran
60970008c8
Re: #1250 : API methods should receive TipSetKeys, not TipSets, as input
2020-02-17 19:53:43 -05:00
Łukasz Magiera
b6354dfb74
vm: Partially fix vm runtime shim
2020-02-16 23:15:12 +01:00
Łukasz Magiera
5ced1ab905
gofmt
2020-02-14 22:38:30 +01:00
Łukasz Magiera
c544c2b5c5
Set hamt bitwidth
2020-02-14 15:14:39 +01:00
Łukasz Magiera
48c5494cf9
use specs-actors birfields
2020-02-14 01:24:24 +01:00
Łukasz Magiera
74bf9119cc
spects-actors: More type propagation
2020-02-13 04:50:45 +01:00
Łukasz Magiera
36aed6f871
Update cbor-gen
2020-02-13 02:37:28 +01:00
Łukasz Magiera
e5ab64a3ab
Fix client market impl, gofmt
2020-02-13 01:15:33 +01:00
Łukasz Magiera
91b2d2c2fe
cbor-gen fixes
2020-02-13 01:10:07 +01:00
Łukasz Magiera
255f511abd
storageminer: Updates to new types
2020-02-12 23:12:11 +01:00
Łukasz Magiera
0aaf7b25a9
Propagate spec actor types more
2020-02-12 08:44:20 +01:00
Łukasz Magiera
a4f6b739be
genesis: Change template types
2020-02-12 01:58:55 +01:00
Łukasz Magiera
63e801e00f
genesis: Cleanup the structure
2020-02-11 21:48:03 +01:00
Łukasz Magiera
3343e82307
wip gengen fixing
2020-02-11 04:31:28 +01:00
Łukasz Magiera
4d5c4d89ce
stmgr: Update stmgr utils
2020-02-11 03:33:27 +01:00
Łukasz Magiera
07ae3e49a3
mocksb: Update to the new interface
2020-02-11 02:23:03 +01:00
Łukasz Magiera
fa2c6605c2
Fix compilation after dep updates
2020-02-11 02:11:58 +01:00
Łukasz Magiera
c0ed0dda8e
specs-actors: Fis some test compilation errors
2020-02-10 20:16:36 +01:00
Łukasz Magiera
c72727b4fd
specs-actors: Fix most compilation errors
2020-02-09 07:06:32 +01:00
Łukasz Magiera
41daf5ad28
gofmt
2020-02-08 03:18:37 +01:00
Łukasz Magiera
13435aebdc
Spec Actors integration
2020-02-08 03:18:32 +01:00
Łukasz Magiera
72c89ab89b
Merge pull request #1223 from filecoin-project/fix/squash-forks
...
squash forks and use correct amt library everywhere
2020-02-06 20:14:55 +01:00
Łukasz Magiera
cbf63aab1e
Merge branch 'master' into testnet/3
2020-02-05 21:27:04 +01:00
whyrusleeping
faf05cafcf
squash forks and use correct amt library everywhere
2020-02-04 18:26:42 -08:00
Łukasz Magiera
4bd6d7be1a
storageminer: Work around broken fastPledgeCommitment
2020-02-04 21:46:31 +01:00
Łukasz Magiera
0e81c1cf7e
Merge branch 'testnet/3' into feat/update-markets
2020-02-04 07:17:22 +01:00
Łukasz Magiera
90ecfbe0e4
Merge branch 'master' into feat/new-sb-fs
2020-02-04 04:15:25 +01:00
laser
ea2f53745e
split FPoStScheduler from Miner
...
Rationale: Nodes want to handle scheduling of PoSts. Splitting the
FPoStScheduler from the Miner allows nodes to reuse the Miner w/out
having to reuse the PoSt scheduler.
2020-02-03 15:48:11 -08:00
Łukasz Magiera
e453a38865
sealing: fix finalize with cache only
2020-02-02 20:36:15 +01:00
Łukasz Magiera
37929ff75f
sealing: more logging in pledge sector flow
2020-01-31 20:22:31 +01:00
Łukasz Magiera
b6ba0ed47c
fix pledgeReader with small sectors
2020-01-31 20:07:20 +01:00
Łukasz Magiera
95f344540e
Fix tests
2020-01-31 02:27:38 +01:00
Łukasz Magiera
ee9060aa14
Update sectorbuilder
2020-01-31 02:18:48 +01:00
Łukasz Magiera
db50d01db9
Merge remote-tracking branch 'origin/master' into feat/new-sb-fs
2020-01-30 07:46:47 +01:00
Łukasz Magiera
cec2085790
sealing: Fix pledgeReader
2020-01-30 07:41:30 +01:00
Łukasz Magiera
75ee71e35a
Merge branch 'master' into feat/new-sb-fs
2020-01-30 07:39:52 +01:00
Łukasz Magiera
d27187b1de
Fix fast pledge math
2020-01-30 02:01:10 +01:00
Łukasz Magiera
4aaa758543
fpost: better fault checks
2020-01-30 01:50:58 +01:00
Łukasz Magiera
03f07042ff
fpost: print message apply result
2020-01-29 23:47:28 +01:00
Łukasz Magiera
e2b2026fa5
actually call finalizeSector
2020-01-29 23:37:31 +01:00
Łukasz Magiera
4b8b79dbe0
sealing: FinalizeSector step
2020-01-29 22:25:06 +01:00
Whyrusleeping
9e5cc46638
Merge pull request #1158 from filecoin-project/feat/par-pledge
...
sealing: Parallel CommP calc in pledge sector
2020-01-29 12:15:22 -08:00
Łukasz Magiera
ba542cf67a
test fastPledgeCommitment
2020-01-29 21:01:20 +01:00
Łukasz Magiera
25f544f3db
sealing: round parts in fastPledgeCommitment
2020-01-29 20:12:27 +01:00
Łukasz Magiera
5af64c53b6
initial sectorbuilder FS refactor integration
2020-01-29 00:08:02 +01:00
hannahhoward
00941e4461
fix(sectorblocks): minor cleanups
...
add error check, slice keys
2020-01-28 14:15:12 -08:00
hannahhoward
71289b58ff
feat(markets): update to support car files
...
Upgrades lotus version of go-fil-markets to its head, which supports car files and handles tracking
of pieces, reducing the size of sectorBlocks
2020-01-28 14:08:13 -08:00
laser
1cdf29244c
write basic test affirming state change
2020-01-28 12:39:07 -08:00
laser
cb665caf9e
planCommitting must handle SectorCommitFailed
...
The SectorCommitFailed struct can be created from within Sealing#handleCommitting, and is created if actors.SerializeParams(params) produces an error or if m.api.MpoolPushMessage(ctx.Context(), msg) produces an error.
2020-01-28 11:46:26 -08:00
Łukasz Magiera
c9c437cb3b
sealing: Parallel CommP calc in pledge sector
2020-01-25 12:15:28 +01:00
Łukasz Magiera
2f2e7be12a
sealing: docstrings for sanity-checks
2020-01-24 21:15:02 +01:00
Łukasz Magiera
b5660b58b3
Merge remote-tracking branch 'origin/master' into feat/sector-recovery
2020-01-24 01:53:58 +01:00
Łukasz Magiera
6b2b22782b
sealing: PreCommitFailed can go to SealFailed
2020-01-23 18:45:57 +01:00
Łukasz Magiera
de52d3cadd
sealing: Handlef for PreCommitFailed
2020-01-23 18:34:04 +01:00
Łukasz Magiera
7e43c40529
storageminer: Use tabwriter in sectors list
2020-01-23 17:15:45 +01:00
Łukasz Magiera
df9dfa9d0c
sealing: Don't infinite-loop on fatal errors
2020-01-23 17:11:58 +01:00
Łukasz Magiera
08a2e0f82c
sealing: Errors are hard
2020-01-23 17:02:55 +01:00
Łukasz Magiera
01dc9c767e
sealing: Error types that can actually be checked
2020-01-23 16:57:50 +01:00
Łukasz Magiera
67b441838b
sealing: Actually call handleSealFailed
2020-01-23 16:47:33 +01:00
Łukasz Magiera
94f2948020
sealing: implement handler for sealFailed
2020-01-23 16:38:10 +01:00
Łukasz Magiera
558e4c7669
Fix tests after sectorbuilder update
2020-01-23 15:33:28 +01:00
Łukasz Magiera
c3a5da8586
storageminer: log flag for sector status
2020-01-23 15:18:05 +01:00
Łukasz Magiera
02c8ab7839
sealing: Check ticket expiration
2020-01-23 15:05:44 +01:00
Łukasz Magiera
26e6bc32ee
sealing: check deal expiration
2020-01-23 13:17:45 +01:00
Łukasz Magiera
e67ee227a3
sealing: Nonzero exit on commit isn't fatal
2020-01-23 11:02:20 +01:00
Łukasz Magiera
7fb3360d6f
storage: Fix handing stop call
2020-01-23 10:46:46 +01:00
Łukasz Magiera
e43174f2af
sealing: Not getting seal ticket isn't fatal
2020-01-22 22:16:45 +01:00
Łukasz Magiera
d3a9006272
sealing: Wire up sector event log
2020-01-22 21:29:19 +01:00
Łukasz Magiera
ba5a5d1248
sealing: wire up checkPieces and checkSeal
2020-01-22 20:47:29 +01:00
Łukasz Magiera
052b090bbf
sealing: Fix planOne for global events
2020-01-22 19:30:56 +01:00
Łukasz Magiera
1e877eae86
sealing: Add Log field to SectorInfo
2020-01-22 03:41:39 +01:00
Łukasz Magiera
3c934ea21f
Merge branch 'master' into feat/sector-recovery
2020-01-22 03:27:11 +01:00
Łukasz Magiera
08e1b52281
Fix master build
2020-01-21 19:51:17 +01:00
Łukasz Magiera
cf153f89df
Merge pull request #1131 from filecoin-project/feat/soft-map-cbg
...
cbor-gen: Soft struct-map unmarshaling
2020-01-21 19:44:39 +01:00
Łukasz Magiera
d2401bc339
Update cbor-gen, error on unknown fields
2020-01-21 17:28:55 +01:00
Łukasz Magiera
fd0bfc8777
Merge pull request #1089 from filecoin-project/feat/state-call-cmd
...
implement state call command for easy method calling
2020-01-21 17:16:54 +01:00
Łukasz Magiera
2076cb106d
cobr-gen: Soft struct-map unmarshaling
2020-01-21 17:05:10 +01:00
Łukasz Magiera
5b304fa20a
fpost: More logging
2020-01-21 16:01:42 +01:00
Łukasz Magiera
e4de5c55ac
sealing: Some state renaming
2020-01-20 23:04:46 +01:00
Łukasz Magiera
efaf2c720b
sealing: WIP SectorInfo sanity checks
2020-01-20 23:04:27 +01:00
dtynn
b2fcca87ff
small fixes
2020-01-20 16:23:56 +08:00
Łukasz Magiera
ff4b0c8f5d
Merge pull request #1110 from filecoin-project/fix/nil-newts-fpost-panic
...
fpost: Don't panic with nil new tipset
2020-01-19 21:17:51 +01:00
Łukasz Magiera
be2d138aac
fpost: Don't panic with nil new tipset
2020-01-18 16:00:22 +01:00
Łukasz Magiera
1e782b3de2
Merge branch 'master' into feat/event-states
2020-01-18 14:40:59 +01:00
whyrusleeping
0a45e97699
implement state call command for easy method calling
2020-01-17 18:27:29 -08:00
whyrusleeping
2a7dcb6e17
fixup bitfield serialization in manual faulty sector handler
2020-01-17 00:13:00 -08:00
Łukasz Magiera
0aebec6697
Merge branch 'master' into feat/event-states
2020-01-16 03:59:14 +01:00
Łukasz Magiera
d4c50b8ea0
sealing: gofmt
2020-01-16 03:54:57 +01:00
Łukasz Magiera
cc424d64fe
sealing: Handle events based on current state
2020-01-16 03:53:59 +01:00
Łukasz Magiera
ffdd436b52
sealing: Handle seed changes more correctly
2020-01-16 02:25:49 +01:00
Łukasz Magiera
e9ca6c0871
sealing: More cleanup
2020-01-15 21:53:14 +01:00
Łukasz Magiera
604bf64ef6
Move miner sealing logic into a separate package
2020-01-15 21:49:11 +01:00
Łukasz Magiera
925e057acb
Some sector fsm tests
2020-01-15 21:04:02 +01:00
Łukasz Magiera
23472aa4f2
statemachine: don't force users to see reflect
2020-01-15 01:08:20 +01:00
Łukasz Magiera
8a9707788c
Merge branch 'master' into feat/event-states
2020-01-14 16:31:10 +01:00
Łukasz Magiera
94a21e3aeb
Update deps
2020-01-14 03:05:46 +01:00
Łukasz Magiera
2ca0c152ba
Deal tests on mock sectorbuilder
2020-01-14 03:05:46 +01:00
Łukasz Magiera
a2bcc1fec2
Mostly functional mock sectorbuilder
2020-01-14 03:05:35 +01:00
Łukasz Magiera
2ef8c1ae0c
statemachine: Better naming
2020-01-13 18:44:59 +01:00
Łukasz Magiera
2fea9433d8
sectors: Correctly set CommitMessage
2020-01-13 18:18:52 +01:00
Łukasz Magiera
e06c19b51c
update deps
2020-01-13 17:39:54 +01:00
Łukasz Magiera
34abc3d023
Merge branch 'feat/testnet2' into feat/event-states
2020-01-13 15:52:43 +01:00
Łukasz Magiera
f6d41ee77d
Port sector state maching to evtsm
2020-01-10 20:24:15 +01:00
Łukasz Magiera
469136ee86
Merge pull request #1040 from filecoin-project/feat/fork-signaling
...
Add fork signaling to blockheader
2020-01-10 13:33:29 +01:00
Łukasz Magiera
5f460b380d
Merge pull request #1045 from filecoin-project/feat/mock-sectorbuilder
...
WIP: implement mock sectorbuilder for easier storage miner testing
2020-01-10 01:33:43 +01:00
whyrusleeping
6c9289df0a
don't require signatures for self deals
2020-01-09 14:18:06 -08:00
Łukasz Magiera
da2a11ed76
Event-based state machine
2020-01-09 22:23:31 +01:00
whyrusleeping
7534ac1e1a
add ability to control seal operations completion time
2020-01-09 12:50:45 -08:00
whyrusleeping
bda85e4097
more features, better locking
2020-01-09 11:23:42 -08:00
whyrusleeping
5e16aab51b
fix tests, expand interfaces a little
2020-01-09 10:28:14 -08:00
whyrusleeping
cc56389dbb
attempt to fix the DI loading, still not working
2020-01-08 20:51:18 -08:00
whyrusleeping
60969c69a7
implement a mocked out sectorbuilder, probably not useful yet
2020-01-08 20:27:14 -08:00
whyrusleeping
d08898ef37
make storage miner acccept an interface to the sectorbuilder
2020-01-08 17:10:17 -08:00
Jakub Sztandera
8cfb4aafcd
Add fork signaling to blockheader
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-01-08 20:31:08 +01:00
Jakub Sztandera
1ed62628a7
Update go-log to v2
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-01-08 20:22:31 +01:00
laser
20321bb476
handle rebase
2020-01-07 08:18:35 -08:00
acruikshank
7873213b11
switch sectorbuilder from lib to external module
...
point to correct version of sectorbuilder + ensure go-datastore stays at 0.1.1
replace local address type with go-address
consume paramfetch.GetParams instead of local paramfetch.go
remove constants now defined in sectorbuilder
2020-01-07 07:48:43 -08:00
Łukasz Magiera
1e7f10e387
gofmt
2020-01-07 15:00:10 +01:00
hannahhoward
718acb0a86
refactor(cborutil): extract cborutil library
...
Use extracted cborutil library
2020-01-07 14:59:35 +01:00
hannahhoward
8418464d91
refactor(address): use extracted address library
...
Switch to using extracted address library
2020-01-07 14:53:27 +01:00
Łukasz Magiera
2e95a53679
Wire up faults in fPoSt
2019-12-17 23:33:08 +01:00
whyrusleeping
28a325efe6
soft fail messages that cause precomitted sectors map to become too large
2019-12-13 00:00:20 +01:00
Whyrusleeping
9eb1371896
Merge pull request #860 from filecoin-project/fix/soft-sectors-load-err
...
sectors: Handle sector state reload errors more gracefully
2019-12-11 15:48:45 +01:00
Łukasz Magiera
c579b2c56f
Merge pull request #824 from filecoin-project/fix/retrieval-unsealed
...
Don't allow retrieval of unsealed data
2019-12-11 15:28:00 +01:00
Łukasz Magiera
613bb25297
sectors: Handle sector state reload errors more gracefully
2019-12-11 15:17:38 +01:00
Łukasz Magiera
9246788bff
Don't allow retrieval of unsealed data
2019-12-10 00:19:46 +01:00
Łukasz Magiera
d750723405
Merge remote-tracking branch 'origin/testnet-staging' into feat/cleanup-sectorstate-structs
2019-12-09 21:27:20 +01:00
Łukasz Magiera
2f2a5824b3
storage: Use fatal instead of .to.error
2019-12-09 21:19:46 +01:00
whyrusleeping
d2448912a6
Implement basic fault handling
...
WIP: miner actor tests
working miner actor test
rebase and fix tests
2019-12-09 20:53:43 +01:00
Łukasz Magiera
ff963dfea5
Merge pull request #780 from filecoin-project/feat/storage-deal-cleanup
...
Clean up storage deal structures
2019-12-09 18:31:18 +01:00
Łukasz Magiera
94df2c656e
Use map encoders for some structs
2019-12-09 17:40:15 +01:00
Łukasz Magiera
1d7dd4711d
Cleanup sectorinfo struct
2019-12-09 16:42:47 +01:00
Łukasz Magiera
0b4db5530c
Merge pull request #804 from filecoin-project/fix/retrieve-large
...
Fix retrieval of large files
2019-12-09 16:28:47 +01:00
Łukasz Magiera
e3d1f5b362
storage: Better errors when starting sectorStateLoop
2019-12-09 16:11:54 +01:00
Łukasz Magiera
570d725ce5
type-gen
2019-12-09 15:41:44 +01:00
Łukasz Magiera
f29e1eacff
storage: set sector state correctly
2019-12-09 14:32:58 +01:00
whyrusleeping
eba3f4af86
address PR review
2019-12-08 23:39:08 +01:00
Łukasz Magiera
0efc625405
type-gen
2019-12-08 23:35:46 +01:00
Łukasz Magiera
ef0d45e406
storage: addres review around nonces in sector states
2019-12-08 23:35:46 +01:00
Łukasz Magiera
1766987be5
Fancy math to update nonces on precommit revert
2019-12-08 23:35:46 +01:00
Łukasz Magiera
55c1432347
Handle reverts in precommit more correctly
2019-12-08 23:35:46 +01:00
Łukasz Magiera
6d0e5997dd
Merge pull request #790 from filecoin-project/feat/pledge-capacity
...
Rename pledge-sector
2019-12-08 23:22:48 +01:00
Jakub Sztandera
7f537dce2d
More renames
...
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-08 22:48:20 +01:00
Łukasz Magiera
716b4cc652
Restart fPoSt after fail
2019-12-08 20:48:17 +01:00
whyrusleeping
98f252da65
better error message for sector failure
2019-12-07 21:36:15 +01:00
whyrusleeping
f0653decf3
Clean up storage deal structures
2019-12-07 21:29:37 +01:00
Łukasz Magiera
83924e6b97
sectorbuilder: Allow to restrict task types
...
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-07 19:05:15 +01:00
Łukasz Magiera
77b5490e57
Merge pull request #756 from filecoin-project/feat/more-sector-states
...
Improving storage miner sector states
2019-12-06 12:17:19 +01:00
whyrusleeping
14c7e1f0ac
Fix copying partial ticket arrays into slices
2019-12-06 00:32:57 -08:00
whyrusleeping
d92ba5fbba
Add separate state for waiting for commit message
2019-12-05 18:40:57 -08:00
Łukasz Magiera
3673a9110f
Merge pull request #743 from filecoin-project/feat/static-check-2
...
more of that sweet staticcheck goodness
2019-12-05 12:21:43 +01:00
whyrusleeping
40be53c9f9
add command for power users to manually update sector state
2019-12-04 20:43:54 -08:00
whyrusleeping
613a0a05a0
more of that sweet staticcheck goodness
2019-12-04 18:04:09 -08:00
whyrusleeping
1b475ba6fe
some fixes from staticcheck in ./chain
2019-12-04 17:18:30 -08:00
whyrusleeping
5133c357dc
Better error checks
2019-12-04 14:14:50 -08:00
Łukasz Magiera
2619567dfd
Merge pull request #716 from filecoin-project/fix/sectorstore-fails
...
Miner: improve sector state handling
2019-12-04 02:10:30 +01:00
Łukasz Magiera
d112fd18b1
Persist sector sealing errors
2019-12-04 01:44:29 +01:00
Łukasz Magiera
13c39452c1
storageminer: States for common failure modes
2019-12-04 00:59:40 +01:00
Łukasz Magiera
dbcb839b6f
Make sector state transitions more explicit
2019-12-04 00:42:22 +01:00
Łukasz Magiera
21629d005b
storageminer: separate sectorstore types
2019-12-03 23:57:47 +01:00
Łukasz Magiera
90dfb18ab8
Merge pull request #712 from filecoin-project/fix/clean-fpost-exit
...
storageminer: exit fpostScheduler loop cleanly
2019-12-03 23:46:44 +01:00
Łukasz Magiera
a7738af169
storageminer: exit fpostScheduler loop cleanly
2019-12-03 23:39:45 +01:00
Łukasz Magiera
a65320c970
storageminer: Don't start fPoSt with every head change
2019-12-03 23:00:04 +01:00
whyrusleeping
4500a36ec6
some useful log messages
2019-12-02 16:08:08 -08:00
Łukasz Magiera
d5b94884c8
Buch of lint fixes
2019-12-02 13:51:16 +01:00
Łukasz Magiera
c7cf20843e
actually set unsealed path in sectorbuilder
2019-12-01 22:22:39 +01:00
Łukasz Magiera
fd8f65248b
deals: Correctly set deal ID in provider states
2019-12-01 21:07:57 +01:00
Łukasz Magiera
a59d0f0f8c
Fix unsealing, sector based data refs
2019-12-01 18:58:31 +01:00
whyrusleeping
59d9c681ad
Rework miner test setups to fix tests
2019-11-30 17:21:11 -06:00
Łukasz Magiera
ad978949db
import sector/deal into state machines on init
2019-11-29 20:11:42 +01:00
Łukasz Magiera
367512d067
Some fpost fixes
2019-11-28 19:08:10 +01:00
Łukasz Magiera
920fd3ba9b
storageminer: New fallback post scheduler
2019-11-28 18:44:57 +01:00
whyrusleeping
45288b8810
WIP: uncomment out windowed post code, try to make it work
2019-11-27 21:36:34 -06:00
Łukasz Magiera
d2412f4f00
Fix pond
2019-11-27 15:18:51 +01:00
Łukasz Magiera
23e0008b81
Merge remote-tracking branch 'origin/master' into feat/election-post
2019-11-27 13:31:44 +01:00
laser
3623925f66
replace go-bls-sigs and go-sectorbuilder with filecoin-ffi
...
- remove old submodules and add new submodule
- update build tooling to consume new unified static library
- update consumers of old libs to use new package
2019-11-26 18:16:37 -08:00
Łukasz Magiera
871c30d2a0
WIP trying to get election post to compute
2019-11-26 16:15:41 +01:00
whyrusleeping
a0588d513d
Add lotus-gen, rewire genesis mining
2019-11-24 22:45:13 -06:00
Łukasz Magiera
a755ca5dae
stmgr: check for duplicate nonces when looking back for msg
2019-11-24 20:16:18 +01:00
Łukasz Magiera
c7b34153fb
more mpooland post sched fixes
2019-11-24 17:35:50 +01:00
Łukasz Magiera
2deae35dcc
Merge pull request #672 from filecoin-project/feat/no-pkg-error
...
Swtich to xerrors
2019-11-22 12:40:59 -06:00
Jakub Sztandera
36b7c5a32a
Swtich to xerrors
...
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-11-22 10:20:56 -06:00
Łukasz Magiera
a33462b01a
Make ppe == 0 error less scary
2019-11-22 17:15:33 +01:00
whyrusleeping
96482f456a
WIP: election post restructuring
2019-11-21 16:21:45 -06:00
whyrusleeping
0e816932e3
log more information when message execution fails
2019-11-20 22:18:04 -06:00
Łukasz Magiera
174f8f3a7e
sectors: Simple state restore
2019-11-20 20:58:09 +01:00
Łukasz Magiera
37792b149f
sync: fix some issues
2019-11-20 20:49:29 +01:00
Łukasz Magiera
0a6a0e5e39
Address review
2019-11-20 18:00:05 +01:00
Łukasz Magiera
ddf2e05dd0
post: More correct 'wait' logic
2019-11-20 18:00:05 +01:00
whyrusleeping
f8eabd3db4
Refactor mining logic to match specs ticket chain
2019-11-20 10:52:36 -06:00
Łukasz Magiera
4f9947a27b
Merge pull request #567 from filecoin-project/anorth/tskey
...
Add TipSetKey as a concatenation of block CIDs, and use if for ChainGetTipSet, ChainGetRandomness.
2019-11-13 22:07:24 +01:00
Łukasz Magiera
8f0e3ede24
Bunch of small fixes / improvements, gofmt
2019-11-13 15:48:57 +01:00
anorth
84a4766d8f
Add TipSetKey as a concatenation of block CIDs, and use if for ChainGetTipSet, ChainGetRandomness.
2019-11-13 15:23:37 +11:00
Łukasz Magiera
56d902c1bd
storageminer: Throttle GeneratePieceCommitment in storeGarbage
2019-11-12 19:05:03 +01:00
Łukasz Magiera
55697209a7
Merge pull request #556 from filecoin-project/fix/post-restart
...
Fix PoSt after storage miner restart
2019-11-11 18:33:33 +01:00
Łukasz Magiera
b8f46bff26
storageminer: Drop sortedSectorInfo log
2019-11-11 18:32:46 +01:00
whyrusleeping
bda6d7e119
Don't try syncing to a chain if its not clearly heavier
2019-11-09 12:14:40 -08:00
Łukasz Magiera
81bd0bc517
Test to reproduce post error after restart
2019-11-09 11:42:36 +01:00
Łukasz Magiera
3b6c079014
Some final parameter setting for devent 7
2019-11-09 01:18:15 +01:00
Łukasz Magiera
ed64e52e3a
sectorbuilder: apply some review suggestions
2019-11-09 00:21:04 +01:00
Łukasz Magiera
aaacfd15cd
Add comments to fillersFromRem
2019-11-09 00:06:07 +01:00
Łukasz Magiera
8c39486736
some import fixes
2019-11-08 21:11:56 +01:00
Łukasz Magiera
071f05fa95
Storage miner API improvements
2019-11-08 19:23:58 +01:00
Łukasz Magiera
34846c538e
sectorbuilder: Use StandaloneWriteWithAlignment
2019-11-07 21:43:57 +01:00
Łukasz Magiera
f6a49ab9f9
Wip fixing a thing
2019-11-07 20:54:24 +01:00
Łukasz Magiera
f40eb8a521
More post-refactor fixes
2019-11-07 19:43:23 +01:00
Łukasz Magiera
68adf519c7
cbor-gen
2019-11-07 19:27:23 +01:00
Łukasz Magiera
2d26a4edf7
Sector storage refactor
2019-11-07 19:22:59 +01:00
Łukasz Magiera
1549269773
Make multiple deals per almost work
2019-11-07 15:45:53 +01:00
Łukasz Magiera
3fbe0abb75
cborrpc -> cborutil
2019-11-07 15:11:39 +01:00
Łukasz Magiera
be0d07e143
pass deal IDs in SectorPreCommitInfo
2019-11-07 13:03:18 +01:00
whyrusleeping
54722a0d38
WIP: fixing the tests by waiting for chain activity
2019-11-06 23:57:10 -08:00
Łukasz Magiera
cfac6f3272
Fix TestSectorStore
2019-11-07 00:50:37 +01:00
Łukasz Magiera
74ea4d71c5
post-rebase fixes
2019-11-07 00:47:48 +01:00
whyrusleeping
41d13b12a0
test is getting close to passing
2019-11-07 00:39:34 +01:00
whyrusleeping
9863942fe2
WIP: trying to write a test to reproduce the storage deal error
2019-11-07 00:39:34 +01:00
whyrusleeping
e075eb163f
Add a test for the sectorstore
2019-11-07 00:39:34 +01:00
Łukasz Magiera
f7651f180b
Create filler deals
2019-11-07 00:09:48 +01:00
Łukasz Magiera
37721b2a22
Get some deals to work
2019-11-06 20:00:04 +01:00
Łukasz Magiera
68c2d4f58a
deals: Set correct Refs
2019-11-06 18:38:42 +01:00
Łukasz Magiera
40b1f91843
fix sector block ref serialization
2019-11-06 13:22:08 +01:00
Łukasz Magiera
cb3965bcf5
Improve errors around deal handling
2019-11-06 13:04:33 +01:00
Łukasz Magiera
1fc0971db0
sectorstore: test computePaddedSize
2019-11-06 13:03:36 +01:00
