Łukasz Magiera
a2bcc1fec2
Mostly functional mock sectorbuilder
2020-01-14 03:05:35 +01:00
Łukasz Magiera
2ef8c1ae0c
statemachine: Better naming
2020-01-13 18:44:59 +01:00
Łukasz Magiera
2fea9433d8
sectors: Correctly set CommitMessage
2020-01-13 18:18:52 +01:00
Łukasz Magiera
e06c19b51c
update deps
2020-01-13 17:39:54 +01:00
Łukasz Magiera
34abc3d023
Merge branch 'feat/testnet2' into feat/event-states
2020-01-13 15:52:43 +01:00
Łukasz Magiera
f6d41ee77d
Port sector state maching to evtsm
2020-01-10 20:24:15 +01:00
Łukasz Magiera
469136ee86
Merge pull request #1040 from filecoin-project/feat/fork-signaling
...
Add fork signaling to blockheader
2020-01-10 13:33:29 +01:00
Łukasz Magiera
5f460b380d
Merge pull request #1045 from filecoin-project/feat/mock-sectorbuilder
...
WIP: implement mock sectorbuilder for easier storage miner testing
2020-01-10 01:33:43 +01:00
whyrusleeping
6c9289df0a
don't require signatures for self deals
2020-01-09 14:18:06 -08:00
Łukasz Magiera
da2a11ed76
Event-based state machine
2020-01-09 22:23:31 +01:00
whyrusleeping
7534ac1e1a
add ability to control seal operations completion time
2020-01-09 12:50:45 -08:00
whyrusleeping
bda85e4097
more features, better locking
2020-01-09 11:23:42 -08:00
whyrusleeping
5e16aab51b
fix tests, expand interfaces a little
2020-01-09 10:28:14 -08:00
whyrusleeping
cc56389dbb
attempt to fix the DI loading, still not working
2020-01-08 20:51:18 -08:00
whyrusleeping
60969c69a7
implement a mocked out sectorbuilder, probably not useful yet
2020-01-08 20:27:14 -08:00
whyrusleeping
d08898ef37
make storage miner acccept an interface to the sectorbuilder
2020-01-08 17:10:17 -08:00
Jakub Sztandera
8cfb4aafcd
Add fork signaling to blockheader
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-01-08 20:31:08 +01:00
Jakub Sztandera
1ed62628a7
Update go-log to v2
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-01-08 20:22:31 +01:00
laser
20321bb476
handle rebase
2020-01-07 08:18:35 -08:00
acruikshank
7873213b11
switch sectorbuilder from lib to external module
...
point to correct version of sectorbuilder + ensure go-datastore stays at 0.1.1
replace local address type with go-address
consume paramfetch.GetParams instead of local paramfetch.go
remove constants now defined in sectorbuilder
2020-01-07 07:48:43 -08:00
Łukasz Magiera
1e7f10e387
gofmt
2020-01-07 15:00:10 +01:00
hannahhoward
718acb0a86
refactor(cborutil): extract cborutil library
...
Use extracted cborutil library
2020-01-07 14:59:35 +01:00
hannahhoward
8418464d91
refactor(address): use extracted address library
...
Switch to using extracted address library
2020-01-07 14:53:27 +01:00
Łukasz Magiera
2e95a53679
Wire up faults in fPoSt
2019-12-17 23:33:08 +01:00
whyrusleeping
28a325efe6
soft fail messages that cause precomitted sectors map to become too large
2019-12-13 00:00:20 +01:00
Whyrusleeping
9eb1371896
Merge pull request #860 from filecoin-project/fix/soft-sectors-load-err
...
sectors: Handle sector state reload errors more gracefully
2019-12-11 15:48:45 +01:00
Łukasz Magiera
c579b2c56f
Merge pull request #824 from filecoin-project/fix/retrieval-unsealed
...
Don't allow retrieval of unsealed data
2019-12-11 15:28:00 +01:00
Łukasz Magiera
613bb25297
sectors: Handle sector state reload errors more gracefully
2019-12-11 15:17:38 +01:00
Łukasz Magiera
9246788bff
Don't allow retrieval of unsealed data
2019-12-10 00:19:46 +01:00
Łukasz Magiera
d750723405
Merge remote-tracking branch 'origin/testnet-staging' into feat/cleanup-sectorstate-structs
2019-12-09 21:27:20 +01:00
Łukasz Magiera
2f2a5824b3
storage: Use fatal instead of .to.error
2019-12-09 21:19:46 +01:00
whyrusleeping
d2448912a6
Implement basic fault handling
...
WIP: miner actor tests
working miner actor test
rebase and fix tests
2019-12-09 20:53:43 +01:00
Łukasz Magiera
ff963dfea5
Merge pull request #780 from filecoin-project/feat/storage-deal-cleanup
...
Clean up storage deal structures
2019-12-09 18:31:18 +01:00
Łukasz Magiera
94df2c656e
Use map encoders for some structs
2019-12-09 17:40:15 +01:00
Łukasz Magiera
1d7dd4711d
Cleanup sectorinfo struct
2019-12-09 16:42:47 +01:00
Łukasz Magiera
0b4db5530c
Merge pull request #804 from filecoin-project/fix/retrieve-large
...
Fix retrieval of large files
2019-12-09 16:28:47 +01:00
Łukasz Magiera
e3d1f5b362
storage: Better errors when starting sectorStateLoop
2019-12-09 16:11:54 +01:00
Łukasz Magiera
570d725ce5
type-gen
2019-12-09 15:41:44 +01:00
Łukasz Magiera
f29e1eacff
storage: set sector state correctly
2019-12-09 14:32:58 +01:00
whyrusleeping
eba3f4af86
address PR review
2019-12-08 23:39:08 +01:00
Łukasz Magiera
0efc625405
type-gen
2019-12-08 23:35:46 +01:00
Łukasz Magiera
ef0d45e406
storage: addres review around nonces in sector states
2019-12-08 23:35:46 +01:00
Łukasz Magiera
1766987be5
Fancy math to update nonces on precommit revert
2019-12-08 23:35:46 +01:00
Łukasz Magiera
55c1432347
Handle reverts in precommit more correctly
2019-12-08 23:35:46 +01:00
Łukasz Magiera
6d0e5997dd
Merge pull request #790 from filecoin-project/feat/pledge-capacity
...
Rename pledge-sector
2019-12-08 23:22:48 +01:00
Jakub Sztandera
7f537dce2d
More renames
...
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-08 22:48:20 +01:00
Łukasz Magiera
716b4cc652
Restart fPoSt after fail
2019-12-08 20:48:17 +01:00
whyrusleeping
98f252da65
better error message for sector failure
2019-12-07 21:36:15 +01:00
whyrusleeping
f0653decf3
Clean up storage deal structures
2019-12-07 21:29:37 +01:00
Łukasz Magiera
83924e6b97
sectorbuilder: Allow to restrict task types
...
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-07 19:05:15 +01:00
Łukasz Magiera
77b5490e57
Merge pull request #756 from filecoin-project/feat/more-sector-states
...
Improving storage miner sector states
2019-12-06 12:17:19 +01:00
whyrusleeping
14c7e1f0ac
Fix copying partial ticket arrays into slices
2019-12-06 00:32:57 -08:00
whyrusleeping
d92ba5fbba
Add separate state for waiting for commit message
2019-12-05 18:40:57 -08:00
Łukasz Magiera
3673a9110f
Merge pull request #743 from filecoin-project/feat/static-check-2
...
more of that sweet staticcheck goodness
2019-12-05 12:21:43 +01:00
whyrusleeping
40be53c9f9
add command for power users to manually update sector state
2019-12-04 20:43:54 -08:00
whyrusleeping
613a0a05a0
more of that sweet staticcheck goodness
2019-12-04 18:04:09 -08:00
whyrusleeping
1b475ba6fe
some fixes from staticcheck in ./chain
2019-12-04 17:18:30 -08:00
whyrusleeping
5133c357dc
Better error checks
2019-12-04 14:14:50 -08:00
Łukasz Magiera
2619567dfd
Merge pull request #716 from filecoin-project/fix/sectorstore-fails
...
Miner: improve sector state handling
2019-12-04 02:10:30 +01:00
Łukasz Magiera
d112fd18b1
Persist sector sealing errors
2019-12-04 01:44:29 +01:00
Łukasz Magiera
13c39452c1
storageminer: States for common failure modes
2019-12-04 00:59:40 +01:00
Łukasz Magiera
dbcb839b6f
Make sector state transitions more explicit
2019-12-04 00:42:22 +01:00
Łukasz Magiera
21629d005b
storageminer: separate sectorstore types
2019-12-03 23:57:47 +01:00
Łukasz Magiera
90dfb18ab8
Merge pull request #712 from filecoin-project/fix/clean-fpost-exit
...
storageminer: exit fpostScheduler loop cleanly
2019-12-03 23:46:44 +01:00
Łukasz Magiera
a7738af169
storageminer: exit fpostScheduler loop cleanly
2019-12-03 23:39:45 +01:00
Łukasz Magiera
a65320c970
storageminer: Don't start fPoSt with every head change
2019-12-03 23:00:04 +01:00
whyrusleeping
4500a36ec6
some useful log messages
2019-12-02 16:08:08 -08:00
Łukasz Magiera
d5b94884c8
Buch of lint fixes
2019-12-02 13:51:16 +01:00
Łukasz Magiera
c7cf20843e
actually set unsealed path in sectorbuilder
2019-12-01 22:22:39 +01:00
Łukasz Magiera
fd8f65248b
deals: Correctly set deal ID in provider states
2019-12-01 21:07:57 +01:00
Łukasz Magiera
a59d0f0f8c
Fix unsealing, sector based data refs
2019-12-01 18:58:31 +01:00
whyrusleeping
59d9c681ad
Rework miner test setups to fix tests
2019-11-30 17:21:11 -06:00
Łukasz Magiera
ad978949db
import sector/deal into state machines on init
2019-11-29 20:11:42 +01:00
Łukasz Magiera
367512d067
Some fpost fixes
2019-11-28 19:08:10 +01:00
Łukasz Magiera
920fd3ba9b
storageminer: New fallback post scheduler
2019-11-28 18:44:57 +01:00
whyrusleeping
45288b8810
WIP: uncomment out windowed post code, try to make it work
2019-11-27 21:36:34 -06:00
Łukasz Magiera
d2412f4f00
Fix pond
2019-11-27 15:18:51 +01:00
Łukasz Magiera
23e0008b81
Merge remote-tracking branch 'origin/master' into feat/election-post
2019-11-27 13:31:44 +01:00
laser
3623925f66
replace go-bls-sigs and go-sectorbuilder with filecoin-ffi
...
- remove old submodules and add new submodule
- update build tooling to consume new unified static library
- update consumers of old libs to use new package
2019-11-26 18:16:37 -08:00
Łukasz Magiera
871c30d2a0
WIP trying to get election post to compute
2019-11-26 16:15:41 +01:00
whyrusleeping
a0588d513d
Add lotus-gen, rewire genesis mining
2019-11-24 22:45:13 -06:00
Łukasz Magiera
a755ca5dae
stmgr: check for duplicate nonces when looking back for msg
2019-11-24 20:16:18 +01:00
Łukasz Magiera
c7b34153fb
more mpooland post sched fixes
2019-11-24 17:35:50 +01:00
Łukasz Magiera
2deae35dcc
Merge pull request #672 from filecoin-project/feat/no-pkg-error
...
Swtich to xerrors
2019-11-22 12:40:59 -06:00
Jakub Sztandera
36b7c5a32a
Swtich to xerrors
...
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-11-22 10:20:56 -06:00
Łukasz Magiera
a33462b01a
Make ppe == 0 error less scary
2019-11-22 17:15:33 +01:00
whyrusleeping
96482f456a
WIP: election post restructuring
2019-11-21 16:21:45 -06:00
whyrusleeping
0e816932e3
log more information when message execution fails
2019-11-20 22:18:04 -06:00
Łukasz Magiera
174f8f3a7e
sectors: Simple state restore
2019-11-20 20:58:09 +01:00
Łukasz Magiera
37792b149f
sync: fix some issues
2019-11-20 20:49:29 +01:00
Łukasz Magiera
0a6a0e5e39
Address review
2019-11-20 18:00:05 +01:00
Łukasz Magiera
ddf2e05dd0
post: More correct 'wait' logic
2019-11-20 18:00:05 +01:00
whyrusleeping
f8eabd3db4
Refactor mining logic to match specs ticket chain
2019-11-20 10:52:36 -06:00
Łukasz Magiera
4f9947a27b
Merge pull request #567 from filecoin-project/anorth/tskey
...
Add TipSetKey as a concatenation of block CIDs, and use if for ChainGetTipSet, ChainGetRandomness.
2019-11-13 22:07:24 +01:00
Łukasz Magiera
8f0e3ede24
Bunch of small fixes / improvements, gofmt
2019-11-13 15:48:57 +01:00
anorth
84a4766d8f
Add TipSetKey as a concatenation of block CIDs, and use if for ChainGetTipSet, ChainGetRandomness.
2019-11-13 15:23:37 +11:00
Łukasz Magiera
56d902c1bd
storageminer: Throttle GeneratePieceCommitment in storeGarbage
2019-11-12 19:05:03 +01:00
Łukasz Magiera
55697209a7
Merge pull request #556 from filecoin-project/fix/post-restart
...
Fix PoSt after storage miner restart
2019-11-11 18:33:33 +01:00
Łukasz Magiera
b8f46bff26
storageminer: Drop sortedSectorInfo log
2019-11-11 18:32:46 +01:00
whyrusleeping
bda6d7e119
Don't try syncing to a chain if its not clearly heavier
2019-11-09 12:14:40 -08:00
Łukasz Magiera
81bd0bc517
Test to reproduce post error after restart
2019-11-09 11:42:36 +01:00
Łukasz Magiera
3b6c079014
Some final parameter setting for devent 7
2019-11-09 01:18:15 +01:00
Łukasz Magiera
ed64e52e3a
sectorbuilder: apply some review suggestions
2019-11-09 00:21:04 +01:00
Łukasz Magiera
aaacfd15cd
Add comments to fillersFromRem
2019-11-09 00:06:07 +01:00
Łukasz Magiera
8c39486736
some import fixes
2019-11-08 21:11:56 +01:00
Łukasz Magiera
071f05fa95
Storage miner API improvements
2019-11-08 19:23:58 +01:00
Łukasz Magiera
34846c538e
sectorbuilder: Use StandaloneWriteWithAlignment
2019-11-07 21:43:57 +01:00
Łukasz Magiera
f6a49ab9f9
Wip fixing a thing
2019-11-07 20:54:24 +01:00
Łukasz Magiera
f40eb8a521
More post-refactor fixes
2019-11-07 19:43:23 +01:00
Łukasz Magiera
68adf519c7
cbor-gen
2019-11-07 19:27:23 +01:00
Łukasz Magiera
2d26a4edf7
Sector storage refactor
2019-11-07 19:22:59 +01:00
Łukasz Magiera
1549269773
Make multiple deals per almost work
2019-11-07 15:45:53 +01:00
Łukasz Magiera
3fbe0abb75
cborrpc -> cborutil
2019-11-07 15:11:39 +01:00
Łukasz Magiera
be0d07e143
pass deal IDs in SectorPreCommitInfo
2019-11-07 13:03:18 +01:00
whyrusleeping
54722a0d38
WIP: fixing the tests by waiting for chain activity
2019-11-06 23:57:10 -08:00
Łukasz Magiera
cfac6f3272
Fix TestSectorStore
2019-11-07 00:50:37 +01:00
Łukasz Magiera
74ea4d71c5
post-rebase fixes
2019-11-07 00:47:48 +01:00
whyrusleeping
41d13b12a0
test is getting close to passing
2019-11-07 00:39:34 +01:00
whyrusleeping
9863942fe2
WIP: trying to write a test to reproduce the storage deal error
2019-11-07 00:39:34 +01:00
whyrusleeping
e075eb163f
Add a test for the sectorstore
2019-11-07 00:39:34 +01:00
Łukasz Magiera
f7651f180b
Create filler deals
2019-11-07 00:09:48 +01:00
Łukasz Magiera
37721b2a22
Get some deals to work
2019-11-06 20:00:04 +01:00
Łukasz Magiera
68c2d4f58a
deals: Set correct Refs
2019-11-06 18:38:42 +01:00
Łukasz Magiera
40b1f91843
fix sector block ref serialization
2019-11-06 13:22:08 +01:00
Łukasz Magiera
cb3965bcf5
Improve errors around deal handling
2019-11-06 13:04:33 +01:00
Łukasz Magiera
1fc0971db0
sectorstore: test computePaddedSize
2019-11-06 13:03:36 +01:00
whyrusleeping
87616e1c03
use better math
2019-11-05 15:57:46 -08:00
whyrusleeping
ba1e8c6668
add proper piece padding in AddPiece
2019-11-05 13:30:44 -08:00
Łukasz Magiera
bcf9778b18
Update cbor-gen post-merge
2019-11-05 19:02:28 +01:00
Łukasz Magiera
daabe470a4
storageminer: tracing in computePost
2019-11-05 15:52:40 +01:00
Łukasz Magiera
eb28c45c00
events: Plumb context to callbacks
2019-11-05 15:03:59 +01:00
Łukasz Magiera
2a695611d5
Update sectorbuilder
2019-11-03 21:44:22 +01:00
Łukasz Magiera
c550e030b1
INTERACTIVE PROEP IS ALIVE
2019-11-02 16:07:26 +01:00
Łukasz Magiera
be8fe54ea3
Set correct Provider addr in StoreGarbage
2019-11-02 15:13:37 +01:00
Łukasz Magiera
3bc4a5dddf
More progress on fixing storing garbage data
2019-11-02 00:43:54 +01:00
Łukasz Magiera
1dcebece71
Some smaller fixes
2019-11-01 23:44:55 +01:00
whyrusleeping
2fe1b5a538
some cleanup
2019-11-01 15:05:05 -07:00
Łukasz Magiera
82344649d3
Use state store for sectors
2019-11-01 15:06:49 +01:00
Łukasz Magiera
1583cf2593
Strip unused functionality from sectorstore
2019-11-01 11:05:48 +01:00
whyrusleeping
fc9091cc89
Get interactive porep sector sealing mostly working
2019-10-31 20:57:10 -07:00
whyrusleeping
34998d9362
add file i forgot
2019-10-31 11:46:53 -07:00
whyrusleeping
4e478330a4
more refactoring for interactive porep scheduling
2019-10-31 09:55:35 -07:00
whyrusleeping
759094198c
Some more progress on interactive porep
2019-10-30 18:22:50 -07:00
Łukasz Magiera
7fa3e2db7a
WIP Interactive PoRep
2019-10-30 19:10:29 +01:00
Łukasz Magiera
46d782b30b
storageminer: Drop commitment tracker
2019-10-30 18:37:38 +01:00
Łukasz Magiera
a4c0610cc3
actors: Rename some storageminer stuff to match the spec
2019-10-30 16:55:55 +01:00
whyrusleeping
3e5654d575
initial actor changes for interactive porep
2019-10-30 16:05:31 +01:00
Łukasz Magiera
5a5c66600f
storageminer: More correct listing of sealed sectors
2019-10-30 10:57:00 +01:00
Łukasz Magiera
922d8a90a5
storageminer: Restart sealing on restart
2019-10-29 23:19:58 +01:00
Łukasz Magiera
6c25c5384d
commitment tracker: prefer new commitments
2019-10-29 23:04:08 +01:00
