cerc-io/lotus
16
0
Fork 0
Code Issues Pull Requests Packages Projects Releases 27 Wiki Activity
19,849 Commits 24 Branches 342 Tags 314 MiB
2d7a9b0551
Commit Graph

1119 Commits

Author SHA1 Message Date
Łukasz Magiera
2619567dfd
Merge pull request #716 from filecoin-project/fix/sectorstore-fails 
Miner: improve sector state handling
 2019-12-04 02:10:30 +01:00
Łukasz Magiera
d112fd18b1 Persist sector sealing errors 2019-12-04 01:44:29 +01:00
Łukasz Magiera
13c39452c1 storageminer: States for common failure modes 2019-12-04 00:59:40 +01:00
Łukasz Magiera
dbcb839b6f Make sector state transitions more explicit 2019-12-04 00:42:22 +01:00
Łukasz Magiera
21629d005b storageminer: separate sectorstore types 2019-12-03 23:57:47 +01:00
Łukasz Magiera
90dfb18ab8
Merge pull request #712 from filecoin-project/fix/clean-fpost-exit 
storageminer: exit fpostScheduler loop cleanly
 2019-12-03 23:46:44 +01:00
Łukasz Magiera
a7738af169 storageminer: exit fpostScheduler loop cleanly 2019-12-03 23:39:45 +01:00
Łukasz Magiera
a65320c970 storageminer: Don't start fPoSt with every head change 2019-12-03 23:00:04 +01:00
whyrusleeping
4500a36ec6 some useful log messages 2019-12-02 16:08:08 -08:00
Łukasz Magiera
d5b94884c8 Buch of lint fixes 2019-12-02 13:51:16 +01:00
Łukasz Magiera
c7cf20843e actually set unsealed path in sectorbuilder 2019-12-01 22:22:39 +01:00
Łukasz Magiera
fd8f65248b deals: Correctly set deal ID in provider states 2019-12-01 21:07:57 +01:00
Łukasz Magiera
a59d0f0f8c Fix unsealing, sector based data refs 2019-12-01 18:58:31 +01:00
whyrusleeping
59d9c681ad Rework miner test setups to fix tests 2019-11-30 17:21:11 -06:00
Łukasz Magiera
ad978949db import sector/deal into state machines on init 2019-11-29 20:11:42 +01:00
Łukasz Magiera
367512d067 Some fpost fixes 2019-11-28 19:08:10 +01:00
Łukasz Magiera
920fd3ba9b storageminer: New fallback post scheduler 2019-11-28 18:44:57 +01:00
whyrusleeping
45288b8810 WIP: uncomment out windowed post code, try to make it work 2019-11-27 21:36:34 -06:00
Łukasz Magiera
d2412f4f00 Fix pond 2019-11-27 15:18:51 +01:00
Łukasz Magiera
23e0008b81 Merge remote-tracking branch 'origin/master' into feat/election-post 2019-11-27 13:31:44 +01:00
laser
3623925f66 replace go-bls-sigs and go-sectorbuilder with filecoin-ffi 
- remove old submodules and add new submodule
- update build tooling to consume new unified static library
- update consumers of old libs to use new package
 2019-11-26 18:16:37 -08:00
Łukasz Magiera
871c30d2a0 WIP trying to get election post to compute 2019-11-26 16:15:41 +01:00
whyrusleeping
a0588d513d Add lotus-gen, rewire genesis mining 2019-11-24 22:45:13 -06:00
Łukasz Magiera
a755ca5dae stmgr: check for duplicate nonces when looking back for msg 2019-11-24 20:16:18 +01:00
Łukasz Magiera
c7b34153fb more mpooland post sched fixes 2019-11-24 17:35:50 +01:00
Łukasz Magiera
2deae35dcc
Merge pull request #672 from filecoin-project/feat/no-pkg-error 
Swtich to xerrors
 2019-11-22 12:40:59 -06:00
Jakub Sztandera
36b7c5a32a
Swtich to xerrors 
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2019-11-22 10:20:56 -06:00
Łukasz Magiera
a33462b01a Make ppe == 0 error less scary 2019-11-22 17:15:33 +01:00
whyrusleeping
96482f456a WIP: election post restructuring 2019-11-21 16:21:45 -06:00
whyrusleeping
0e816932e3 log more information when message execution fails 2019-11-20 22:18:04 -06:00
Łukasz Magiera
174f8f3a7e sectors: Simple state restore 2019-11-20 20:58:09 +01:00
Łukasz Magiera
37792b149f sync: fix some issues 2019-11-20 20:49:29 +01:00
Łukasz Magiera
0a6a0e5e39 Address review 2019-11-20 18:00:05 +01:00
Łukasz Magiera
ddf2e05dd0 post: More correct 'wait' logic 2019-11-20 18:00:05 +01:00
whyrusleeping
f8eabd3db4 Refactor mining logic to match specs ticket chain 2019-11-20 10:52:36 -06:00
Łukasz Magiera
4f9947a27b
Merge pull request #567 from filecoin-project/anorth/tskey 
Add TipSetKey as a concatenation of block CIDs, and use if for ChainGetTipSet, ChainGetRandomness.
 2019-11-13 22:07:24 +01:00
Łukasz Magiera
8f0e3ede24 Bunch of small fixes / improvements, gofmt 2019-11-13 15:48:57 +01:00
anorth
84a4766d8f Add TipSetKey as a concatenation of block CIDs, and use if for ChainGetTipSet, ChainGetRandomness. 2019-11-13 15:23:37 +11:00
Łukasz Magiera
56d902c1bd storageminer: Throttle GeneratePieceCommitment in storeGarbage 2019-11-12 19:05:03 +01:00
Łukasz Magiera
55697209a7
Merge pull request #556 from filecoin-project/fix/post-restart 
Fix PoSt after storage miner restart
 2019-11-11 18:33:33 +01:00
Łukasz Magiera
b8f46bff26 storageminer: Drop sortedSectorInfo log 2019-11-11 18:32:46 +01:00
whyrusleeping
bda6d7e119 Don't try syncing to a chain if its not clearly heavier 2019-11-09 12:14:40 -08:00
Łukasz Magiera
81bd0bc517 Test to reproduce post error after restart 2019-11-09 11:42:36 +01:00
Łukasz Magiera
3b6c079014 Some final parameter setting for devent 7 2019-11-09 01:18:15 +01:00
Łukasz Magiera
ed64e52e3a sectorbuilder: apply some review suggestions 2019-11-09 00:21:04 +01:00
Łukasz Magiera
aaacfd15cd Add comments to fillersFromRem 2019-11-09 00:06:07 +01:00
Łukasz Magiera
8c39486736 some import fixes 2019-11-08 21:11:56 +01:00
Łukasz Magiera
071f05fa95 Storage miner API improvements 2019-11-08 19:23:58 +01:00
Łukasz Magiera
34846c538e sectorbuilder: Use StandaloneWriteWithAlignment 2019-11-07 21:43:57 +01:00
Łukasz Magiera
f6a49ab9f9 Wip fixing a thing 2019-11-07 20:54:24 +01:00
Łukasz Magiera
f40eb8a521 More post-refactor fixes 2019-11-07 19:43:23 +01:00
Łukasz Magiera
68adf519c7 cbor-gen 2019-11-07 19:27:23 +01:00
Łukasz Magiera
2d26a4edf7 Sector storage refactor 2019-11-07 19:22:59 +01:00
Łukasz Magiera
1549269773 Make multiple deals per almost work 2019-11-07 15:45:53 +01:00
Łukasz Magiera
3fbe0abb75 cborrpc -> cborutil 2019-11-07 15:11:39 +01:00
Łukasz Magiera
be0d07e143 pass deal IDs in SectorPreCommitInfo 2019-11-07 13:03:18 +01:00
whyrusleeping
54722a0d38 WIP: fixing the tests by waiting for chain activity 2019-11-06 23:57:10 -08:00
Łukasz Magiera
cfac6f3272 Fix TestSectorStore 2019-11-07 00:50:37 +01:00
Łukasz Magiera
74ea4d71c5 post-rebase fixes 2019-11-07 00:47:48 +01:00
whyrusleeping
41d13b12a0 test is getting close to passing 2019-11-07 00:39:34 +01:00
whyrusleeping
9863942fe2 WIP: trying to write a test to reproduce the storage deal error 2019-11-07 00:39:34 +01:00
whyrusleeping
e075eb163f Add a test for the sectorstore 2019-11-07 00:39:34 +01:00
Łukasz Magiera
f7651f180b Create filler deals 2019-11-07 00:09:48 +01:00
Łukasz Magiera
37721b2a22 Get some deals to work 2019-11-06 20:00:04 +01:00
Łukasz Magiera
68c2d4f58a deals: Set correct Refs 2019-11-06 18:38:42 +01:00
Łukasz Magiera
40b1f91843 fix sector block ref serialization 2019-11-06 13:22:08 +01:00
Łukasz Magiera
cb3965bcf5 Improve errors around deal handling 2019-11-06 13:04:33 +01:00
Łukasz Magiera
1fc0971db0 sectorstore: test computePaddedSize 2019-11-06 13:03:36 +01:00
whyrusleeping
87616e1c03 use better math 2019-11-05 15:57:46 -08:00
whyrusleeping
ba1e8c6668 add proper piece padding in AddPiece 2019-11-05 13:30:44 -08:00
Łukasz Magiera
bcf9778b18 Update cbor-gen post-merge 2019-11-05 19:02:28 +01:00
Łukasz Magiera
daabe470a4 storageminer: tracing in computePost 2019-11-05 15:52:40 +01:00
Łukasz Magiera
eb28c45c00 events: Plumb context to callbacks 2019-11-05 15:03:59 +01:00
Łukasz Magiera
2a695611d5 Update sectorbuilder 2019-11-03 21:44:22 +01:00
Łukasz Magiera
c550e030b1 INTERACTIVE PROEP IS ALIVE 2019-11-02 16:07:26 +01:00
Łukasz Magiera
be8fe54ea3 Set correct Provider addr in StoreGarbage 2019-11-02 15:13:37 +01:00
Łukasz Magiera
3bc4a5dddf More progress on fixing storing garbage data 2019-11-02 00:43:54 +01:00
Łukasz Magiera
1dcebece71 Some smaller fixes 2019-11-01 23:44:55 +01:00
whyrusleeping
2fe1b5a538 some cleanup 2019-11-01 15:05:05 -07:00
Łukasz Magiera
82344649d3 Use state store for sectors 2019-11-01 15:06:49 +01:00
Łukasz Magiera
1583cf2593 Strip unused functionality from sectorstore 2019-11-01 11:05:48 +01:00
whyrusleeping
fc9091cc89 Get interactive porep sector sealing mostly working 2019-10-31 20:57:10 -07:00
whyrusleeping
34998d9362 add file i forgot 2019-10-31 11:46:53 -07:00
whyrusleeping
4e478330a4 more refactoring for interactive porep scheduling 2019-10-31 09:55:35 -07:00
whyrusleeping
759094198c Some more progress on interactive porep 2019-10-30 18:22:50 -07:00
Łukasz Magiera
7fa3e2db7a WIP Interactive PoRep 2019-10-30 19:10:29 +01:00
Łukasz Magiera
46d782b30b storageminer: Drop commitment tracker 2019-10-30 18:37:38 +01:00
Łukasz Magiera
a4c0610cc3 actors: Rename some storageminer stuff to match the spec 2019-10-30 16:55:55 +01:00
whyrusleeping
3e5654d575 initial actor changes for interactive porep 2019-10-30 16:05:31 +01:00
Łukasz Magiera
5a5c66600f storageminer: More correct listing of sealed sectors 2019-10-30 10:57:00 +01:00
Łukasz Magiera
922d8a90a5 storageminer: Restart sealing on restart 2019-10-29 23:19:58 +01:00
Łukasz Magiera
6c25c5384d commitment tracker: prefer new commitments 2019-10-29 23:04:08 +01:00
Łukasz Magiera
b7a78670ab storageminer: Call beginPosting before trying to commit a sector 2019-10-29 22:58:41 +01:00
Łukasz Magiera
3047c9d4c2 storageminer: Check on-chain commitments 2019-10-29 22:41:28 +01:00
Łukasz Magiera
44f4ee0de1 storageminer: cmd to list sector commitments 2019-10-29 21:41:30 +01:00
Łukasz Magiera
169c285fb3 storageminer: Handle uncommited sectors on start 2019-10-29 20:46:32 +01:00
Łukasz Magiera
237f8e8018 Set proving params matching the spec more closely 2019-10-28 17:51:45 +01:00
Łukasz Magiera
117ec636c5 paramfetch: check checksums in parallel 2019-10-27 10:18:27 +01:00
Łukasz Magiera
874be79958 very basic sector seal scheduling 2019-10-27 09:56:53 +01:00
whyrusleeping
874ab1456c WIP: updating to new proofs code 2019-10-25 18:07:34 +02:00
whyrusleeping
4890f577f5 give miners the ability to select different sector sizes 2019-10-25 17:26:15 +02:00
Łukasz Magiera
76f1e6e207 on chain deals: Put dealIDs in CommitSector messages 2019-10-24 16:24:31 +02:00
Łukasz Magiera
64bfb38834 on chain deals: Get things to actually run! 2019-10-23 12:44:00 +02:00
Jakub Sztandera
1bf713cb0a
Cleanup imports after rename 
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2019-10-18 13:47:41 +09:00
Jakub Sztandera
0cf45801f3
Increase gas limits 
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2019-10-18 13:08:36 +09:00
Jakub Sztandera
2ed308829a
Change PoSt confidence to 3 
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2019-10-17 09:42:32 +09:00
Jakub Sztandera
a38adb3b44
Skip over the bug 
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2019-10-16 21:13:34 +09:00
Jakub Sztandera
e11deb9551
Add bughunt Error log 
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2019-10-13 01:18:32 +02:00
Jakub Sztandera
49e3fe39f8
Structure logs 
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2019-10-11 02:00:04 +02:00
Jakub Sztandera
79ee959a90
Use log.Warn 
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2019-10-09 22:23:04 +02:00
whyrusleeping
14c4a8bee6 implement looking in the past for messages 2019-10-09 09:33:18 +02:00
whyrusleeping
f9ac86ab00 the doneset is for dropping sectors 2019-10-04 12:30:30 -06:00
Łukasz Magiera
6ffa4b164e storage: set ppe in beginPosting 2019-10-01 00:56:23 +02:00
Łukasz Magiera
a3081f1e12 storageminer: fix call to ProvingPeriodEnd in beginPosting 2019-09-28 01:00:07 +02:00
Łukasz Magiera
e0632a93ab Share ProvingPeriodEnd math 2019-09-27 21:47:47 +02:00
Łukasz Magiera
ba0559ae58 events: Fix tipSetCache at higher heights 2019-09-27 14:35:09 +02:00
Łukasz Magiera
fe8e1fe1e4 Almost working new post code 2019-09-27 01:07:40 +02:00
Łukasz Magiera
1024812559 storageminer: Update post scheduling 2019-09-26 23:32:47 +02:00
Łukasz Magiera
a167b9f5db storageminer: Set Value when posting post 2019-09-26 23:32:47 +02:00
Łukasz Magiera
ebb744f42f storageminer: retry PoSt 2019-09-26 23:32:47 +02:00
Łukasz Magiera
9a990dbd8a use new sectorbuilder file interfaces 2019-09-23 12:50:28 +02:00
Łukasz Magiera
73d1182121 post: More review addressing 2019-09-19 22:34:23 +02:00
Łukasz Magiera
fdb45aeeaa pond: +20k, +200k buttons 2019-09-19 22:17:26 +02:00
Łukasz Magiera
6c48ab3be4 Compute post more than once 2019-09-19 20:38:58 +02:00
Łukasz Magiera
839597012d Fix post seed height math 2019-09-19 19:38:56 +02:00
Łukasz Magiera
c40f89f2a9 Almost working PoSt submission 2019-09-19 18:17:54 +02:00
Łukasz Magiera
d55e872135 Merge remote-tracking branch 'origin/master' into feat/post-schedule 2019-09-19 16:42:50 +02:00
whyrusleeping
9a4ffe0a3f fix error handling in track commit sector msg 2019-09-18 22:11:19 -07:00
Łukasz Magiera
689b1e5b3c events: Safer restarting in listenHeadChanges 2019-09-18 20:07:39 +02:00
Łukasz Magiera
cc82cc9675 miner: Initial event system integration 2019-09-18 15:32:21 +02:00
Łukasz Magiera
76ce3d9bb2 events: Call ChainGetBlockMessages with the right CID 2019-09-18 13:45:52 +02:00
Łukasz Magiera
fe7efa753d events: Build on chain API calls 2019-09-18 13:01:52 +02:00
whyrusleeping
3e45088812 cleaning up a few types 2019-09-17 20:32:52 -07:00
whyrusleeping
b1e77748e7 scaffolding and refactoring to make post scheduler work 2019-09-17 19:50:03 -07:00
whyrusleeping
cc877f5c04 WIP: expanding API to serve post producer needs 2019-09-17 17:08:49 -07:00
whyrusleeping
11040f105b WIP: post scheduling 2019-09-17 15:51:46 -07:00
Łukasz Magiera
b9ab33f0ae storageminer: use switch in TrackCommitSectorMsg 2019-09-17 10:40:13 +02:00
Łukasz Magiera
f8a2ecaf52 gofmt; mod tidy 2019-09-16 23:26:19 +02:00
Łukasz Magiera
133ab265d4 storageminer: Call TrackCommitSectorMsg with the right address 2019-09-16 20:08:24 +02:00
Łukasz Magiera
55014becc8 commitment tracker: Fix deadlock 2019-09-16 20:08:24 +02:00
Łukasz Magiera
eda72468ce Sector Commitment tracker 2019-09-16 20:08:24 +02:00
Łukasz Magiera
874b33781d storageminer: fix getWorkerAddr 2019-09-13 19:59:10 +02:00
whyrusleeping
ed45d1c2b4 refactor state utilities into StateManager package, implement proper election proofs 2019-09-09 19:14:00 -07:00
Łukasz Magiera
bc0bb913f1 storageminer: Fix CommitSector 2019-09-07 00:42:01 +02:00
Łukasz Magiera
711c61cba1 Merge remote-tracking branch 'origin/master' into feat/retrieval 2019-08-29 20:59:03 +02:00
Łukasz Magiera
83748b40b6 retrieval: address some review comments 2019-08-29 20:55:20 +02:00
Łukasz Magiera
d7d42416d7 retrieval: Almost working chunked files 2019-08-29 17:50:19 +02:00
Łukasz Magiera
a5d3122ba5 Make deals work with chunked files 2019-08-29 17:50:19 +02:00
Łukasz Magiera
433550e9a4 gofmt 2019-08-29 17:50:19 +02:00
Łukasz Magiera
6714240653 SectorSize const 2019-08-29 17:50:19 +02:00
Łukasz Magiera
be30bc79a5 Retrieval works! 2019-08-29 17:50:19 +02:00
Łukasz Magiera
28d3eb38eb basic retrieval content discovery 2019-08-29 17:48:19 +02:00
Łukasz Magiera
cad3efb9ba Command to list sealed blocks 2019-08-29 17:48:19 +02:00
Łukasz Magiera
e0dc17bc1a Correctly construct sealbstore 2019-08-29 17:48:19 +02:00
Łukasz Magiera
9691211df1 Sealed blockstore 2019-08-29 17:48:19 +02:00
whyrusleeping
2013db604a switch to using AMT for sector set 2019-08-28 17:01:46 -07:00
Łukasz Magiera
baf4fbe309 sectorstore: Address review feetback 2019-08-15 00:46:15 +02:00
Łukasz Magiera
e6493afd46 move poller to sector store 2019-08-14 23:34:43 +02:00
Łukasz Magiera
399f91940b Sector store 2019-08-14 22:27:32 +02:00
Łukasz Magiera
5ab1b1caaf deals: Sealing handler 2019-08-12 23:48:28 +02:00
whyrusleeping
28ef081d0e use wallet has instead of list 2019-08-08 10:56:14 -07:00
whyrusleeping
959fe371b0 move storage miner keys to full node 2019-08-08 10:56:14 -07:00
whyrusleeping
95e7b230ec cleanup from self review 2019-08-07 18:23:44 -07:00
whyrusleeping
ba0d648546 sealing garbage data into a sector that gets accepted by the chain works! 2019-08-07 18:16:58 -07:00
whyrusleeping
5c32725510 sector commitments make it all the way to the chain 2019-08-07 16:22:35 -07:00
whyrusleeping
b7c6333fef implement sector commitments and proof verification 2019-08-06 23:35:57 -07:00
Łukasz Magiera
d8bd222cb1 Optional tipset param for ChainCall 2019-07-31 18:54:28 +02:00
whyrusleeping
ee224e5b21 Implement 'storage miner' module, wire up a few bits it needs to start 2019-07-29 17:46:56 -07:00
whyrusleeping
2576853426 begin work on storage miner processes 2019-07-29 14:01:31 -07:00