Commit Graph

522 Commits

Author SHA1 Message Date
Łukasz Magiera
a3ba8eb0d7 workers: Basic monitoring tools 2020-03-23 15:56:22 +01:00
Łukasz Magiera
cb1e7bd1b1 sector index: Don't add duplicate storage URLs 2020-03-23 13:12:43 +01:00
Łukasz Magiera
5e4a7e54df Rename agvmgr+sealmgr to sectorstorage 2020-03-23 12:47:10 +01:00
Łukasz Magiera
cd618dfdbd gofmt 2020-03-22 22:39:27 +01:00
Łukasz Magiera
09c9fcce00 workers: fix panics with schedQueue 2020-03-22 21:45:12 +01:00
Łukasz Magiera
66d71d9974 sealing: Improve sector log 2020-03-22 21:44:27 +01:00
Łukasz Magiera
971fe6fdfd workers: Drop sectors from origin after transfers 2020-03-22 05:27:28 +01:00
Jeromy
f3781e8329 update and rerun cbor gen 2020-03-21 14:17:01 -07:00
Łukasz Magiera
c57c0e7f55 workers: Memory based scheduling 2020-03-20 23:30:17 +01:00
Łukasz Magiera
076cc428af workers: Fix moving storage around in later steps 2020-03-20 01:55:49 +01:00
Łukasz Magiera
e0c15b24fc storageminer: Fix preseal meta import for genesis miners 2020-03-20 01:20:01 +01:00
Łukasz Magiera
978a718159 storage: storage find command 2020-03-19 20:51:33 +01:00
Łukasz Magiera
314fba049f workers: get sectors back to miner process after precommit 2020-03-19 20:17:58 +01:00
Łukasz Magiera
80cca91584 workers: get to executing tasks remotely! 2020-03-19 18:11:45 +01:00
Łukasz Magiera
d87b7c264d stores: Use index in local store 2020-03-19 16:11:04 +01:00
Łukasz Magiera
2fa3f2578f impl: Move CommonAPI into a separate pkg 2020-03-19 03:31:53 +01:00
Łukasz Magiera
1ed7779701 Merge remote-tracking branch 'origin/testnet/3' into feat/new-workers 2020-03-19 03:28:55 +01:00
Łukasz Magiera
2d1e30ae3b workers: Call find* on remote 2020-03-19 03:23:21 +01:00
Łukasz Magiera
94ebbd9d90 workers: Actually register in miner 2020-03-19 00:23:32 +01:00
whyrusleeping
ddf1beac6c change gas limit to be a normal int64 2020-03-18 13:45:37 -07:00
Łukasz Magiera
d8c8832a37 stores: fix StorageList 2020-03-18 05:40:25 +01:00
Łukasz Magiera
5f2caffb51 Fix tests after specs-storage changes 2020-03-18 02:08:11 +01:00
Łukasz Magiera
d8ce5078d9 Use new specs-storage interface 2020-03-17 21:19:52 +01:00
Łukasz Magiera
de1c984b48 workers: Handle init on first run 2020-03-16 19:46:02 +01:00
Łukasz Magiera
7e997e40f3 workers: Simple storage diagnostics 2020-03-16 18:50:07 +01:00
Łukasz Magiera
e6ec20b4ca Merge branch 'testnet/3' into feat/new-workers 2020-03-13 17:58:13 +01:00
Łukasz Magiera
96730bae75 workers: Report sectors paths after worker creates them 2020-03-13 17:54:55 +01:00
Łukasz Magiera
2c7f579838 workers: Implement SectorIndex 2020-03-13 12:59:19 +01:00
Łukasz Magiera
a75ad492f1 workers: Declare sectors after fetching in remote store 2020-03-13 11:40:24 +01:00
Łukasz Magiera
bc7fede68b workers: Wire up most pieces 2020-03-13 02:37:38 +01:00
Łukasz Magiera
86871e5abc workers: Basic Remote store 2020-03-13 01:23:05 +01:00
Łukasz Magiera
56968d858c workers: Make LocalWorker public 2020-03-11 22:23:16 +01:00
Łukasz Magiera
71afcb0333 workrs: refactor sector store for more composability 2020-03-11 08:22:21 +01:00
whyrusleeping
16d087cce4 get fallback post running successfully! 2020-03-10 23:30:48 -07:00
Łukasz Magiera
7e2e30f94b workers: Transfer logic refactoring 2020-03-11 06:49:17 +01:00
Łukasz Magiera
eb61a36fd7 workers: RPC scaffolding 2020-03-11 02:58:02 +01:00
Łukasz Magiera
b3d8273a03 storage: Referance path struct by pointer 2020-03-09 20:41:05 +01:00
Łukasz Magiera
01087e01d2 storage: Improve thread safety 2020-03-09 20:22:30 +01:00
Łukasz Magiera
6981cfb8bc Merge pull request #1365 from filecoin-project/feat/miner-storage-add
storageminer: 'storage attach' command
2020-03-09 07:28:11 +01:00
Whyrusleeping
93137b02be Merge pull request #1364 from filecoin-project/feat/no-path-storage
storage: Allow starting with no paths
2020-03-08 23:15:53 -07:00
Łukasz Magiera
4b576cde50 storagemgr: Actually set updated config in AddLocalStorage 2020-03-09 06:56:32 +01:00
Łukasz Magiera
f01e8bc509 storage: Allow starting with no paths 2020-03-09 06:52:12 +01:00
whyrusleeping
ab51c7e2d2 Fix fallback post scheduling to hopefully do the right thing 2020-03-08 00:19:38 -08:00
whyrusleeping
24bf720a9a Merge branch 'master' into testnet/3 2020-03-07 16:46:12 -08:00
whyrusleeping
f41f324fbc fixup fallback post 2020-03-06 21:26:00 -08:00
Whyrusleeping
84a887cc58 Merge pull request #1345 from filecoin-project/fix/noop-plan-loop
sealing: Fix noop plan loop
2020-03-06 15:39:52 -08:00
Łukasz Magiera
a2f4d467fd sealing: Fix noop plan loop 2020-03-07 00:03:57 +01:00
whyrusleeping
4101147a5b one more miner init issue 2020-03-06 14:23:21 -08:00
Aayush Rajasekaran
2d63b007f2 Unify MethodCall and ReplayResults into SimulationResult
- Call and Replay now return the same type, which includes both Message and MessageReceipt
2020-03-06 11:10:40 -08:00
Łukasz Magiera
3d1a5f4bf3 libs: Use go-statemachine 2020-03-06 20:01:03 +01:00
Łukasz Magiera
e51fa5c9ac libs: Use zerocomm from sectorbuilder 2020-03-06 19:50:41 +01:00
Łukasz Magiera
7d3e16986c sectorbuilder type updates 2020-03-06 06:38:59 +01:00
Łukasz Magiera
16cb27b5f9 Get node_test to pass 2020-03-05 23:27:30 +01:00
Łukasz Magiera
1461e475da storage: Support adding paths at runtime 2020-03-05 23:02:01 +01:00
Łukasz Magiera
a5e5918fc5 mod tidy; gofmt 2020-03-05 20:21:06 +01:00
Łukasz Magiera
f06bf6721e sealmgr: Implement all sealing steps 2020-03-05 19:19:32 +01:00
Łukasz Magiera
4beed065b6 sealmgr: Working local addpiece 2020-03-05 03:18:22 +01:00
Łukasz Magiera
c91d970c41 storageminer: Init with default local storage 2020-03-05 02:12:52 +01:00
Łukasz Magiera
7db1dd52bd storagemgr: Wire up most of AddPiece logic 2020-03-05 01:38:07 +01:00
Łukasz Magiera
4e46d00eb6 Merge remote-tracking branch 'origin/testnet/3' into feat/4stage-seal 2020-03-04 04:01:13 +01:00
Łukasz Magiera
12d870e274 sealmgr: Read only multi-path file manager 2020-03-04 03:24:08 +01:00
whyrusleeping
7b11224130 go mod updates, and a couple small fixes 2020-03-03 16:07:27 -08:00
Łukasz Magiera
a0dbb6bdd6 Storage Manager refactor 2020-03-03 23:19:22 +01:00
Łukasz Magiera
3abb59a550 sealmgr: Interfaces; simple initial impl 2020-03-03 01:46:58 +01:00
whyrusleeping
60b19c51ef more misc fixes 2020-03-01 17:09:38 -08:00
Łukasz Magiera
f54a555aa8 Merge remote-tracking branch 'origin/testnet/3' into feat/4stage-seal 2020-02-29 03:21:01 +01:00
whyrusleeping
cf2eefdfbe Fix up client storage deal matcher 2020-02-28 16:05:56 -08:00
whyrusleeping
713059275d progress is made incrementally 2020-02-28 14:00:34 -08:00
whyrusleeping
5b657a2905 pass on proper sector types 2020-02-28 12:52:14 -08:00
whyrusleeping
0945d8725e fixing miner logic to make more tests pass 2020-02-28 11:31:28 -08:00
Łukasz Magiera
5a4f917c60 4-stage v23 lotus-bench 2020-02-28 19:06:59 +01:00
Łukasz Magiera
d5b8defcbb Begin work on integrating new sectorbuilder interfaces 2020-02-28 18:17:40 +01:00
Łukasz Magiera
58f8481a12 sbmock: Set commR with correct cid codec 2020-02-28 00:49:28 +01:00
Łukasz Magiera
f83bbc2cbe Regen cbor marshalers 2020-02-28 00:34:48 +01:00
whyrusleeping
df6e3e83bf make it all build finally 2020-02-27 13:45:31 -08:00
Łukasz Magiera
48619dc238 Merge branch 'feat/update-sectorbuilder' of github.com:filecoin-project/go-lotus into feat/update-sectorbuilder 2020-02-27 01:56:15 +01:00
Łukasz Magiera
2aeab13aae zerocomm: 'Fix' the test 2020-02-27 01:56:09 +01:00
whyrusleeping
6c12068fb7 more fixes for random garbage 2020-02-26 16:42:39 -08:00
whyrusleeping
767392332e WIP: update sectorbuilder 2020-02-26 14:54:34 -08:00
Łukasz Magiera
cb09e48e8c Some test fixes 2020-02-26 10:05:22 +01:00
Łukasz Magiera
0a9e0acc6f types: Drop some redundant alias types 2020-02-25 22:09:22 +01:00
Łukasz Magiera
ae634ef7df actors: Remove addrass aliases 2020-02-25 21:54:58 +01:00
Łukasz Magiera
cd10a3126b actors: drop a bunch of type aliases 2020-02-25 21:35:15 +01:00
Łukasz Magiera
794429dd55 post-upstream-merge fixes 2020-02-24 18:45:25 +01:00
Łukasz Magiera
d787aa5007 Merge branch 'testnet/3' into feat/specs-actors 2020-02-24 18:32:02 +01:00
Łukasz Magiera
1d417685d1 Fix Sealing in TestAPIDealFlow 2020-02-23 21:33:10 +01:00
Łukasz Magiera
917df9a5b8 More unified randomness handling 2020-02-23 21:00:47 +01:00
Łukasz Magiera
a82d156ccb Deal flow fixes 2020-02-23 16:50:36 +01:00
Łukasz Magiera
226685dc1c Implement committed capacity sectors 2020-02-23 01:47:47 +01:00
Łukasz Magiera
1381baf088 Generate zero CommP table 2020-02-22 15:06:38 +01:00
Łukasz Magiera
b8428423a1 get chain to runnable state 2020-02-22 14:10:46 +01:00
Łukasz Magiera
18627e77ff gofmt; mod tidy 2020-02-21 20:28:20 +01:00
Łukasz Magiera
4e98f2e438 some test fixes 2020-02-21 20:28:01 +01:00
Łukasz Magiera
a6268f055d storageminer: Update api interfaces 2020-02-21 18:43:44 +01:00
Łukasz Magiera
57c43183e6 update specs-actors 2020-02-21 17:57:40 +01:00
whyrusleeping
00d7bd1a77 chain/gen tests now pass! 2020-02-20 00:37:10 -08:00
Łukasz Magiera
69ec3c205a Merge remote-tracking branch 'origin/master' into testnet/3 2020-02-19 22:10:14 +01:00
whyrusleeping
6d0eec6395 working towards a working genesis generator 2020-02-17 23:15:30 -08:00
Aayush Rajasekaran
60970008c8 Re: #1250: API methods should receive TipSetKeys, not TipSets, as input 2020-02-17 19:53:43 -05:00
Łukasz Magiera
b6354dfb74 vm: Partially fix vm runtime shim 2020-02-16 23:15:12 +01:00
Łukasz Magiera
5ced1ab905 gofmt 2020-02-14 22:38:30 +01:00
Łukasz Magiera
c544c2b5c5 Set hamt bitwidth 2020-02-14 15:14:39 +01:00
Łukasz Magiera
48c5494cf9 use specs-actors birfields 2020-02-14 01:24:24 +01:00
Łukasz Magiera
74bf9119cc spects-actors: More type propagation 2020-02-13 04:50:45 +01:00
Łukasz Magiera
36aed6f871 Update cbor-gen 2020-02-13 02:37:28 +01:00
Łukasz Magiera
e5ab64a3ab Fix client market impl, gofmt 2020-02-13 01:15:33 +01:00
Łukasz Magiera
91b2d2c2fe cbor-gen fixes 2020-02-13 01:10:07 +01:00
Łukasz Magiera
255f511abd storageminer: Updates to new types 2020-02-12 23:12:11 +01:00
Łukasz Magiera
0aaf7b25a9 Propagate spec actor types more 2020-02-12 08:44:20 +01:00
Łukasz Magiera
a4f6b739be genesis: Change template types 2020-02-12 01:58:55 +01:00
Łukasz Magiera
63e801e00f genesis: Cleanup the structure 2020-02-11 21:48:03 +01:00
Łukasz Magiera
3343e82307 wip gengen fixing 2020-02-11 04:31:28 +01:00
Łukasz Magiera
4d5c4d89ce stmgr: Update stmgr utils 2020-02-11 03:33:27 +01:00
Łukasz Magiera
07ae3e49a3 mocksb: Update to the new interface 2020-02-11 02:23:03 +01:00
Łukasz Magiera
fa2c6605c2 Fix compilation after dep updates 2020-02-11 02:11:58 +01:00
Łukasz Magiera
c0ed0dda8e specs-actors: Fis some test compilation errors 2020-02-10 20:16:36 +01:00
Łukasz Magiera
c72727b4fd specs-actors: Fix most compilation errors 2020-02-09 07:06:32 +01:00
Łukasz Magiera
41daf5ad28 gofmt 2020-02-08 03:18:37 +01:00
Łukasz Magiera
13435aebdc Spec Actors integration 2020-02-08 03:18:32 +01:00
Łukasz Magiera
72c89ab89b Merge pull request #1223 from filecoin-project/fix/squash-forks
squash forks and use correct amt library everywhere
2020-02-06 20:14:55 +01:00
Łukasz Magiera
cbf63aab1e Merge branch 'master' into testnet/3 2020-02-05 21:27:04 +01:00
whyrusleeping
faf05cafcf squash forks and use correct amt library everywhere 2020-02-04 18:26:42 -08:00
Łukasz Magiera
4bd6d7be1a storageminer: Work around broken fastPledgeCommitment 2020-02-04 21:46:31 +01:00
Łukasz Magiera
0e81c1cf7e Merge branch 'testnet/3' into feat/update-markets 2020-02-04 07:17:22 +01:00
Łukasz Magiera
90ecfbe0e4 Merge branch 'master' into feat/new-sb-fs 2020-02-04 04:15:25 +01:00
laser
ea2f53745e split FPoStScheduler from Miner
Rationale: Nodes want to handle scheduling of PoSts. Splitting the 
FPoStScheduler from the Miner allows nodes to reuse the Miner w/out 
having to reuse the PoSt scheduler.
2020-02-03 15:48:11 -08:00
Łukasz Magiera
e453a38865 sealing: fix finalize with cache only 2020-02-02 20:36:15 +01:00
Łukasz Magiera
37929ff75f sealing: more logging in pledge sector flow 2020-01-31 20:22:31 +01:00
Łukasz Magiera
b6ba0ed47c fix pledgeReader with small sectors 2020-01-31 20:07:20 +01:00
Łukasz Magiera
95f344540e Fix tests 2020-01-31 02:27:38 +01:00
Łukasz Magiera
ee9060aa14 Update sectorbuilder 2020-01-31 02:18:48 +01:00
Łukasz Magiera
db50d01db9 Merge remote-tracking branch 'origin/master' into feat/new-sb-fs 2020-01-30 07:46:47 +01:00
Łukasz Magiera
cec2085790 sealing: Fix pledgeReader 2020-01-30 07:41:30 +01:00
Łukasz Magiera
75ee71e35a Merge branch 'master' into feat/new-sb-fs 2020-01-30 07:39:52 +01:00
Łukasz Magiera
d27187b1de Fix fast pledge math 2020-01-30 02:01:10 +01:00
Łukasz Magiera
4aaa758543 fpost: better fault checks 2020-01-30 01:50:58 +01:00
Łukasz Magiera
03f07042ff fpost: print message apply result 2020-01-29 23:47:28 +01:00
Łukasz Magiera
e2b2026fa5 actually call finalizeSector 2020-01-29 23:37:31 +01:00
Łukasz Magiera
4b8b79dbe0 sealing: FinalizeSector step 2020-01-29 22:25:06 +01:00
Whyrusleeping
9e5cc46638
Merge pull request #1158 from filecoin-project/feat/par-pledge
sealing: Parallel CommP calc in pledge sector
2020-01-29 12:15:22 -08:00
Łukasz Magiera
ba542cf67a test fastPledgeCommitment 2020-01-29 21:01:20 +01:00
Łukasz Magiera
25f544f3db sealing: round parts in fastPledgeCommitment 2020-01-29 20:12:27 +01:00
Łukasz Magiera
5af64c53b6 initial sectorbuilder FS refactor integration 2020-01-29 00:08:02 +01:00
hannahhoward
00941e4461 fix(sectorblocks): minor cleanups
add error check, slice keys
2020-01-28 14:15:12 -08:00
hannahhoward
71289b58ff feat(markets): update to support car files
Upgrades lotus version of go-fil-markets to its head, which supports car files and handles tracking
of pieces, reducing the size of sectorBlocks
2020-01-28 14:08:13 -08:00
laser
1cdf29244c write basic test affirming state change 2020-01-28 12:39:07 -08:00
laser
cb665caf9e planCommitting must handle SectorCommitFailed
The SectorCommitFailed struct can be created from within Sealing#handleCommitting, and is created if actors.SerializeParams(params) produces an error or if m.api.MpoolPushMessage(ctx.Context(), msg) produces an error.
2020-01-28 11:46:26 -08:00
Łukasz Magiera
c9c437cb3b sealing: Parallel CommP calc in pledge sector 2020-01-25 12:15:28 +01:00
Łukasz Magiera
2f2e7be12a sealing: docstrings for sanity-checks 2020-01-24 21:15:02 +01:00
Łukasz Magiera
b5660b58b3 Merge remote-tracking branch 'origin/master' into feat/sector-recovery 2020-01-24 01:53:58 +01:00