Łukasz Magiera
ad978949db
import sector/deal into state machines on init
2019-11-29 20:11:42 +01:00
Łukasz Magiera
367512d067
Some fpost fixes
2019-11-28 19:08:10 +01:00
Łukasz Magiera
920fd3ba9b
storageminer: New fallback post scheduler
2019-11-28 18:44:57 +01:00
whyrusleeping
45288b8810
WIP: uncomment out windowed post code, try to make it work
2019-11-27 21:36:34 -06:00
Łukasz Magiera
d2412f4f00
Fix pond
2019-11-27 15:18:51 +01:00
Łukasz Magiera
23e0008b81
Merge remote-tracking branch 'origin/master' into feat/election-post
2019-11-27 13:31:44 +01:00
laser
3623925f66
replace go-bls-sigs and go-sectorbuilder with filecoin-ffi
...
- remove old submodules and add new submodule
- update build tooling to consume new unified static library
- update consumers of old libs to use new package
2019-11-26 18:16:37 -08:00
Łukasz Magiera
871c30d2a0
WIP trying to get election post to compute
2019-11-26 16:15:41 +01:00
whyrusleeping
a0588d513d
Add lotus-gen, rewire genesis mining
2019-11-24 22:45:13 -06:00
Łukasz Magiera
a755ca5dae
stmgr: check for duplicate nonces when looking back for msg
2019-11-24 20:16:18 +01:00
Łukasz Magiera
c7b34153fb
more mpooland post sched fixes
2019-11-24 17:35:50 +01:00
Łukasz Magiera
2deae35dcc
Merge pull request #672 from filecoin-project/feat/no-pkg-error
...
Swtich to xerrors
2019-11-22 12:40:59 -06:00
Jakub Sztandera
36b7c5a32a
Swtich to xerrors
...
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-11-22 10:20:56 -06:00
Łukasz Magiera
a33462b01a
Make ppe == 0 error less scary
2019-11-22 17:15:33 +01:00
whyrusleeping
96482f456a
WIP: election post restructuring
2019-11-21 16:21:45 -06:00
whyrusleeping
0e816932e3
log more information when message execution fails
2019-11-20 22:18:04 -06:00
Łukasz Magiera
174f8f3a7e
sectors: Simple state restore
2019-11-20 20:58:09 +01:00
Łukasz Magiera
37792b149f
sync: fix some issues
2019-11-20 20:49:29 +01:00
Łukasz Magiera
0a6a0e5e39
Address review
2019-11-20 18:00:05 +01:00
Łukasz Magiera
ddf2e05dd0
post: More correct 'wait' logic
2019-11-20 18:00:05 +01:00
whyrusleeping
f8eabd3db4
Refactor mining logic to match specs ticket chain
2019-11-20 10:52:36 -06:00
Łukasz Magiera
4f9947a27b
Merge pull request #567 from filecoin-project/anorth/tskey
...
Add TipSetKey as a concatenation of block CIDs, and use if for ChainGetTipSet, ChainGetRandomness.
2019-11-13 22:07:24 +01:00
Łukasz Magiera
8f0e3ede24
Bunch of small fixes / improvements, gofmt
2019-11-13 15:48:57 +01:00
anorth
84a4766d8f
Add TipSetKey as a concatenation of block CIDs, and use if for ChainGetTipSet, ChainGetRandomness.
2019-11-13 15:23:37 +11:00
Łukasz Magiera
56d902c1bd
storageminer: Throttle GeneratePieceCommitment in storeGarbage
2019-11-12 19:05:03 +01:00
Łukasz Magiera
55697209a7
Merge pull request #556 from filecoin-project/fix/post-restart
...
Fix PoSt after storage miner restart
2019-11-11 18:33:33 +01:00
Łukasz Magiera
b8f46bff26
storageminer: Drop sortedSectorInfo log
2019-11-11 18:32:46 +01:00
whyrusleeping
bda6d7e119
Don't try syncing to a chain if its not clearly heavier
2019-11-09 12:14:40 -08:00
Łukasz Magiera
81bd0bc517
Test to reproduce post error after restart
2019-11-09 11:42:36 +01:00
Łukasz Magiera
3b6c079014
Some final parameter setting for devent 7
2019-11-09 01:18:15 +01:00
Łukasz Magiera
ed64e52e3a
sectorbuilder: apply some review suggestions
2019-11-09 00:21:04 +01:00
Łukasz Magiera
aaacfd15cd
Add comments to fillersFromRem
2019-11-09 00:06:07 +01:00
Łukasz Magiera
8c39486736
some import fixes
2019-11-08 21:11:56 +01:00
Łukasz Magiera
071f05fa95
Storage miner API improvements
2019-11-08 19:23:58 +01:00
Łukasz Magiera
34846c538e
sectorbuilder: Use StandaloneWriteWithAlignment
2019-11-07 21:43:57 +01:00
Łukasz Magiera
f6a49ab9f9
Wip fixing a thing
2019-11-07 20:54:24 +01:00
Łukasz Magiera
f40eb8a521
More post-refactor fixes
2019-11-07 19:43:23 +01:00
Łukasz Magiera
68adf519c7
cbor-gen
2019-11-07 19:27:23 +01:00
Łukasz Magiera
2d26a4edf7
Sector storage refactor
2019-11-07 19:22:59 +01:00
Łukasz Magiera
1549269773
Make multiple deals per almost work
2019-11-07 15:45:53 +01:00
Łukasz Magiera
3fbe0abb75
cborrpc -> cborutil
2019-11-07 15:11:39 +01:00
Łukasz Magiera
be0d07e143
pass deal IDs in SectorPreCommitInfo
2019-11-07 13:03:18 +01:00
whyrusleeping
54722a0d38
WIP: fixing the tests by waiting for chain activity
2019-11-06 23:57:10 -08:00
Łukasz Magiera
cfac6f3272
Fix TestSectorStore
2019-11-07 00:50:37 +01:00
Łukasz Magiera
74ea4d71c5
post-rebase fixes
2019-11-07 00:47:48 +01:00
whyrusleeping
41d13b12a0
test is getting close to passing
2019-11-07 00:39:34 +01:00
whyrusleeping
9863942fe2
WIP: trying to write a test to reproduce the storage deal error
2019-11-07 00:39:34 +01:00
whyrusleeping
e075eb163f
Add a test for the sectorstore
2019-11-07 00:39:34 +01:00
Łukasz Magiera
f7651f180b
Create filler deals
2019-11-07 00:09:48 +01:00
Łukasz Magiera
37721b2a22
Get some deals to work
2019-11-06 20:00:04 +01:00
Łukasz Magiera
68c2d4f58a
deals: Set correct Refs
2019-11-06 18:38:42 +01:00
Łukasz Magiera
40b1f91843
fix sector block ref serialization
2019-11-06 13:22:08 +01:00
Łukasz Magiera
cb3965bcf5
Improve errors around deal handling
2019-11-06 13:04:33 +01:00
Łukasz Magiera
1fc0971db0
sectorstore: test computePaddedSize
2019-11-06 13:03:36 +01:00
whyrusleeping
87616e1c03
use better math
2019-11-05 15:57:46 -08:00
whyrusleeping
ba1e8c6668
add proper piece padding in AddPiece
2019-11-05 13:30:44 -08:00
Łukasz Magiera
bcf9778b18
Update cbor-gen post-merge
2019-11-05 19:02:28 +01:00
Łukasz Magiera
daabe470a4
storageminer: tracing in computePost
2019-11-05 15:52:40 +01:00
Łukasz Magiera
eb28c45c00
events: Plumb context to callbacks
2019-11-05 15:03:59 +01:00
Łukasz Magiera
2a695611d5
Update sectorbuilder
2019-11-03 21:44:22 +01:00
Łukasz Magiera
c550e030b1
INTERACTIVE PROEP IS ALIVE
2019-11-02 16:07:26 +01:00
Łukasz Magiera
be8fe54ea3
Set correct Provider addr in StoreGarbage
2019-11-02 15:13:37 +01:00
Łukasz Magiera
3bc4a5dddf
More progress on fixing storing garbage data
2019-11-02 00:43:54 +01:00
Łukasz Magiera
1dcebece71
Some smaller fixes
2019-11-01 23:44:55 +01:00
whyrusleeping
2fe1b5a538
some cleanup
2019-11-01 15:05:05 -07:00
Łukasz Magiera
82344649d3
Use state store for sectors
2019-11-01 15:06:49 +01:00
Łukasz Magiera
1583cf2593
Strip unused functionality from sectorstore
2019-11-01 11:05:48 +01:00
whyrusleeping
fc9091cc89
Get interactive porep sector sealing mostly working
2019-10-31 20:57:10 -07:00
whyrusleeping
34998d9362
add file i forgot
2019-10-31 11:46:53 -07:00
whyrusleeping
4e478330a4
more refactoring for interactive porep scheduling
2019-10-31 09:55:35 -07:00
whyrusleeping
759094198c
Some more progress on interactive porep
2019-10-30 18:22:50 -07:00
Łukasz Magiera
7fa3e2db7a
WIP Interactive PoRep
2019-10-30 19:10:29 +01:00
Łukasz Magiera
46d782b30b
storageminer: Drop commitment tracker
2019-10-30 18:37:38 +01:00
Łukasz Magiera
a4c0610cc3
actors: Rename some storageminer stuff to match the spec
2019-10-30 16:55:55 +01:00
whyrusleeping
3e5654d575
initial actor changes for interactive porep
2019-10-30 16:05:31 +01:00
Łukasz Magiera
5a5c66600f
storageminer: More correct listing of sealed sectors
2019-10-30 10:57:00 +01:00
Łukasz Magiera
922d8a90a5
storageminer: Restart sealing on restart
2019-10-29 23:19:58 +01:00
Łukasz Magiera
6c25c5384d
commitment tracker: prefer new commitments
2019-10-29 23:04:08 +01:00
Łukasz Magiera
b7a78670ab
storageminer: Call beginPosting before trying to commit a sector
2019-10-29 22:58:41 +01:00
Łukasz Magiera
3047c9d4c2
storageminer: Check on-chain commitments
2019-10-29 22:41:28 +01:00
Łukasz Magiera
44f4ee0de1
storageminer: cmd to list sector commitments
2019-10-29 21:41:30 +01:00
Łukasz Magiera
169c285fb3
storageminer: Handle uncommited sectors on start
2019-10-29 20:46:32 +01:00
Łukasz Magiera
237f8e8018
Set proving params matching the spec more closely
2019-10-28 17:51:45 +01:00
Łukasz Magiera
117ec636c5
paramfetch: check checksums in parallel
2019-10-27 10:18:27 +01:00
Łukasz Magiera
874be79958
very basic sector seal scheduling
2019-10-27 09:56:53 +01:00
whyrusleeping
874ab1456c
WIP: updating to new proofs code
2019-10-25 18:07:34 +02:00
whyrusleeping
4890f577f5
give miners the ability to select different sector sizes
2019-10-25 17:26:15 +02:00
Łukasz Magiera
76f1e6e207
on chain deals: Put dealIDs in CommitSector messages
2019-10-24 16:24:31 +02:00
Łukasz Magiera
64bfb38834
on chain deals: Get things to actually run!
2019-10-23 12:44:00 +02:00
Jakub Sztandera
1bf713cb0a
Cleanup imports after rename
...
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-10-18 13:47:41 +09:00
Jakub Sztandera
0cf45801f3
Increase gas limits
...
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-10-18 13:08:36 +09:00
Jakub Sztandera
2ed308829a
Change PoSt confidence to 3
...
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-10-17 09:42:32 +09:00
Jakub Sztandera
a38adb3b44
Skip over the bug
...
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-10-16 21:13:34 +09:00
Jakub Sztandera
e11deb9551
Add bughunt Error log
...
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-10-13 01:18:32 +02:00
Jakub Sztandera
49e3fe39f8
Structure logs
...
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-10-11 02:00:04 +02:00
Jakub Sztandera
79ee959a90
Use log.Warn
...
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-10-09 22:23:04 +02:00
whyrusleeping
14c4a8bee6
implement looking in the past for messages
2019-10-09 09:33:18 +02:00
whyrusleeping
f9ac86ab00
the doneset is for dropping sectors
2019-10-04 12:30:30 -06:00
Łukasz Magiera
6ffa4b164e
storage: set ppe in beginPosting
2019-10-01 00:56:23 +02:00
Łukasz Magiera
a3081f1e12
storageminer: fix call to ProvingPeriodEnd in beginPosting
2019-09-28 01:00:07 +02:00
Łukasz Magiera
e0632a93ab
Share ProvingPeriodEnd math
2019-09-27 21:47:47 +02:00
Łukasz Magiera
ba0559ae58
events: Fix tipSetCache at higher heights
2019-09-27 14:35:09 +02:00
Łukasz Magiera
fe8e1fe1e4
Almost working new post code
2019-09-27 01:07:40 +02:00
Łukasz Magiera
1024812559
storageminer: Update post scheduling
2019-09-26 23:32:47 +02:00
Łukasz Magiera
a167b9f5db
storageminer: Set Value when posting post
2019-09-26 23:32:47 +02:00
Łukasz Magiera
ebb744f42f
storageminer: retry PoSt
2019-09-26 23:32:47 +02:00
Łukasz Magiera
9a990dbd8a
use new sectorbuilder file interfaces
2019-09-23 12:50:28 +02:00
Łukasz Magiera
73d1182121
post: More review addressing
2019-09-19 22:34:23 +02:00
Łukasz Magiera
fdb45aeeaa
pond: +20k, +200k buttons
2019-09-19 22:17:26 +02:00
Łukasz Magiera
6c48ab3be4
Compute post more than once
2019-09-19 20:38:58 +02:00
Łukasz Magiera
839597012d
Fix post seed height math
2019-09-19 19:38:56 +02:00
Łukasz Magiera
c40f89f2a9
Almost working PoSt submission
2019-09-19 18:17:54 +02:00
Łukasz Magiera
d55e872135
Merge remote-tracking branch 'origin/master' into feat/post-schedule
2019-09-19 16:42:50 +02:00
whyrusleeping
9a4ffe0a3f
fix error handling in track commit sector msg
2019-09-18 22:11:19 -07:00
Łukasz Magiera
689b1e5b3c
events: Safer restarting in listenHeadChanges
2019-09-18 20:07:39 +02:00
Łukasz Magiera
cc82cc9675
miner: Initial event system integration
2019-09-18 15:32:21 +02:00
Łukasz Magiera
76ce3d9bb2
events: Call ChainGetBlockMessages with the right CID
2019-09-18 13:45:52 +02:00
Łukasz Magiera
fe7efa753d
events: Build on chain API calls
2019-09-18 13:01:52 +02:00
whyrusleeping
3e45088812
cleaning up a few types
2019-09-17 20:32:52 -07:00
whyrusleeping
b1e77748e7
scaffolding and refactoring to make post scheduler work
2019-09-17 19:50:03 -07:00
whyrusleeping
cc877f5c04
WIP: expanding API to serve post producer needs
2019-09-17 17:08:49 -07:00
whyrusleeping
11040f105b
WIP: post scheduling
2019-09-17 15:51:46 -07:00
Łukasz Magiera
b9ab33f0ae
storageminer: use switch in TrackCommitSectorMsg
2019-09-17 10:40:13 +02:00
Łukasz Magiera
f8a2ecaf52
gofmt; mod tidy
2019-09-16 23:26:19 +02:00
Łukasz Magiera
133ab265d4
storageminer: Call TrackCommitSectorMsg with the right address
2019-09-16 20:08:24 +02:00
Łukasz Magiera
55014becc8
commitment tracker: Fix deadlock
2019-09-16 20:08:24 +02:00
Łukasz Magiera
eda72468ce
Sector Commitment tracker
2019-09-16 20:08:24 +02:00
Łukasz Magiera
874b33781d
storageminer: fix getWorkerAddr
2019-09-13 19:59:10 +02:00
whyrusleeping
ed45d1c2b4
refactor state utilities into StateManager package, implement proper election proofs
2019-09-09 19:14:00 -07:00
Łukasz Magiera
bc0bb913f1
storageminer: Fix CommitSector
2019-09-07 00:42:01 +02:00
Łukasz Magiera
711c61cba1
Merge remote-tracking branch 'origin/master' into feat/retrieval
2019-08-29 20:59:03 +02:00
Łukasz Magiera
83748b40b6
retrieval: address some review comments
2019-08-29 20:55:20 +02:00
Łukasz Magiera
d7d42416d7
retrieval: Almost working chunked files
2019-08-29 17:50:19 +02:00
Łukasz Magiera
a5d3122ba5
Make deals work with chunked files
2019-08-29 17:50:19 +02:00
Łukasz Magiera
433550e9a4
gofmt
2019-08-29 17:50:19 +02:00
Łukasz Magiera
6714240653
SectorSize const
2019-08-29 17:50:19 +02:00
Łukasz Magiera
be30bc79a5
Retrieval works!
2019-08-29 17:50:19 +02:00
Łukasz Magiera
28d3eb38eb
basic retrieval content discovery
2019-08-29 17:48:19 +02:00
Łukasz Magiera
cad3efb9ba
Command to list sealed blocks
2019-08-29 17:48:19 +02:00
Łukasz Magiera
e0dc17bc1a
Correctly construct sealbstore
2019-08-29 17:48:19 +02:00
Łukasz Magiera
9691211df1
Sealed blockstore
2019-08-29 17:48:19 +02:00
whyrusleeping
2013db604a
switch to using AMT for sector set
2019-08-28 17:01:46 -07:00
Łukasz Magiera
baf4fbe309
sectorstore: Address review feetback
2019-08-15 00:46:15 +02:00
Łukasz Magiera
e6493afd46
move poller to sector store
2019-08-14 23:34:43 +02:00
Łukasz Magiera
399f91940b
Sector store
2019-08-14 22:27:32 +02:00
Łukasz Magiera
5ab1b1caaf
deals: Sealing handler
2019-08-12 23:48:28 +02:00
whyrusleeping
28ef081d0e
use wallet has instead of list
2019-08-08 10:56:14 -07:00
whyrusleeping
959fe371b0
move storage miner keys to full node
2019-08-08 10:56:14 -07:00
whyrusleeping
95e7b230ec
cleanup from self review
2019-08-07 18:23:44 -07:00
whyrusleeping
ba0d648546
sealing garbage data into a sector that gets accepted by the chain works!
2019-08-07 18:16:58 -07:00
whyrusleeping
5c32725510
sector commitments make it all the way to the chain
2019-08-07 16:22:35 -07:00
whyrusleeping
b7c6333fef
implement sector commitments and proof verification
2019-08-06 23:35:57 -07:00
Łukasz Magiera
d8bd222cb1
Optional tipset param for ChainCall
2019-07-31 18:54:28 +02:00
whyrusleeping
ee224e5b21
Implement 'storage miner' module, wire up a few bits it needs to start
2019-07-29 17:46:56 -07:00
whyrusleeping
2576853426
begin work on storage miner processes
2019-07-29 14:01:31 -07:00