Łukasz Magiera
d817dceb05
Show lost calls in sealing jobs cli
2020-09-23 19:26:35 +02:00
Łukasz Magiera
ce6b92484f
Merge remote-tracking branch 'origin/master' into feat/async-restartable-workers
2020-09-23 11:31:21 +02:00
Aayush Rajasekaran
31ff5230bb
Get State API almost working
2020-09-17 05:05:32 -04:00
hannahhoward
691bd9f442
feat(markets): complete markets conversion
...
complete markets conversion to using chain/actors types, also replacing DealProposal/DealState
interfaces with structs
2020-09-17 00:43:14 -07:00
Łukasz Magiera
5f08fe7ead
Merge remote-tracking branch 'origin/master' into feat/async-restartable-workers
2020-09-10 17:30:54 +02:00
Aayush Rajasekaran
39755a294a
Update to specs v0.9.6
2020-09-07 15:48:41 -04:00
Łukasz Magiera
9e6f974f3c
storage: Fix build
2020-09-07 16:12:55 +02:00
Ingar Shu
1608cd2d53
Add watch option to "lotus-miner storage-deals list"
2020-09-03 10:14:30 -07:00
Łukasz Magiera
df635579c4
storagefsm: Handle sectors with expired deals better
2020-08-27 13:51:38 +02:00
Łukasz Magiera
99ecef89b8
gofmt
2020-08-27 12:41:24 +02:00
Łukasz Magiera
e236173417
miner: Print (pre)commit message cids in sector status
2020-08-27 12:40:19 +02:00
Aayush Rajasekaran
984e52acbc
Indicate whether a sector has been marked for upgrade
2020-08-21 15:53:39 -04:00
hannahhoward
0086f76a90
feat(lotus-miner): add data transfer list cmd
...
add equivalent command to list data transfers on miner side, extract common functionality for reuse
2020-08-20 01:35:48 -07:00
Łukasz Magiera
65ffde9e4b
fsm: Config for max WaitDeals sectors
2020-08-18 16:20:31 +02:00
Raúl Kripalani
862bafc63a
fix lint errors.
2020-08-17 14:39:33 +01:00
Raúl Kripalani
efdc428d5d
keep storage-fsm (renamed to storage-sealing) and sector-storage in extern.
2020-08-17 14:26:18 +01:00
Raúl Kripalani
3c17cd655e
integrate extern/sector-storage into lotus proper.
2020-08-16 11:09:58 +01:00
Raúl Kripalani
fb0ccc9260
integrate extern/storage-fsm into lotus proper.
2020-08-16 10:42:13 +01:00
hannahhoward
75771d10d4
fix(markets): replicate unsealing bug
2020-08-06 13:17:16 -07:00
Ingar Shu
9e07b310d1
WIP
2020-08-05 17:27:08 +02:00
Łukasz Magiera
d7e1a526f6
Fix Fault/Recovery declaration timing
2020-08-03 20:29:58 +02:00
Aayush Rajasekaran
c33e38eef2
Update markets
2020-07-31 15:43:34 -04:00
whyrusleeping
146e59fe56
wire through new retrieval apis
2020-07-31 01:47:37 -04:00
whyrusleeping
5f091411c3
some client improvements
2020-07-31 01:33:44 -04:00
whyrusleeping
7fa4cd33f0
WIP: retrieval pieces inspection command
2020-07-31 01:33:30 -04:00
Łukasz Magiera
c133a37b7c
gofmt
2020-07-28 01:22:41 +02:00
Łukasz Magiera
d557c407c6
Merge pull request #2608 from filecoin-project/feat/storage-remote-improvements
...
Update sector-storage, sealing sched-diag
2020-07-27 15:17:38 +02:00
刘林欣
26998fca32
add on-chain-info to lotus-miner sectors status command
2020-07-27 13:58:59 +02:00
Łukasz Magiera
135b77dab5
Update sector-storage, sealing sched-diag
2020-07-27 13:23:43 +02:00
Łukasz Magiera
2633bdd838
miner: sealing jobs command
2020-07-21 20:08:03 +02:00
Aayush Rajasekaran
a5ef629cef
Add expected seal duration to custom deal logic, reject deals that start too early
2020-07-15 17:31:50 -04:00
Łukasz Magiera
8e0d33a1fd
Updates for sectors-storge next
2020-07-08 17:23:27 +02:00
Aayush Rajasekaran
411c82ae8f
Update storage-FSM, add API to set sector seal delay
2020-07-07 15:23:23 -04:00
Łukasz Magiera
82e2cd4746
Basic CC Upgrade support
2020-07-01 17:01:06 +02:00
Łukasz Magiera
cfdbc2312d
Merge branch 'master' into next
2020-07-01 11:22:57 +02:00
laser
b9180a99d4
toggle consideration of offline storage/retrieval deal proposals
2020-06-26 12:27:41 -07:00
laser
e910a045d0
big rename to allow for later introducing the "consider offline" config
2020-06-26 10:50:54 -07:00
laser
5d9a775699
replace enable/disable commands with selection commands
2020-06-26 10:33:06 -07:00
Łukasz Magiera
24f4c96fc3
apitest: auto-start sealing precoss
2020-06-26 17:28:05 +02:00
laser
176d0bb7c0
add "lotus-storage-miner retrieval-deals" subcommands
...
- enable retrieval
- disable retrieval
2020-06-24 08:08:10 -07:00
Łukasz Magiera
6f8c464393
Merge remote-tracking branch 'origin/master' into feat/sector-remove
2020-06-23 23:54:27 +02:00
Łukasz Magiera
5adc188466
miner: Command to remove sectors
2020-06-22 19:35:14 +02:00
laser
de7d6c255c
blacklist -> blocklist
2020-06-18 15:51:01 -07:00
laser
0c8d648998
specify which CID is being blacklisted (it's the piece)
2020-06-18 14:02:22 -07:00
laser
b0edf924b4
add commands for manipulating storage deal CID blacklist
2020-06-18 13:15:18 -07:00
laser
5eceed81e1
add "get-ask" command
2020-06-16 17:23:03 -07:00
laser
6253c39100
replace "set-price" with "set-ask"
...
Fixes #2027
2020-06-16 16:13:21 -07:00
hannahhoward
a422647819
fix(lint): fix lint error
...
fix lint error and update to tagged package
2020-06-15 15:53:39 -07:00
hannahhoward
9262661135
chore(deps): update to fil-markets 0.3.0
...
Updates to latest fil markets with resumability and other fixes
2020-06-15 15:43:47 -07:00
laser
36b327b57b
various symbol renames
2020-06-11 13:18:18 -07:00
laser
7587e6c08b
get and set storage deal acceptance through CLI
2020-06-11 12:59:50 -07:00
Łukasz Magiera
c625b30781
Update fsm adapter
2020-06-04 21:26:29 +02:00
Jakub Sztandera
5605aae269
Fix even more lint warnings
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-06-02 16:29:39 +02:00
Łukasz Magiera
f7325a69c1
Extract auth utils to go-jsonrpc
2020-05-20 20:37:45 +02:00
Jeromy
f4948dcba0
remove api dependency on sealing fsm package
2020-04-23 15:33:59 -07:00
Łukasz Magiera
309f54aa0c
Update sector-storage
2020-04-23 15:29:31 -07:00
Łukasz Magiera
86e7f5914b
testing: test 2-miner mining
2020-04-23 23:20:02 +02:00
Łukasz Magiera
afdfc8807d
api: Single method for static miner info
2020-04-16 19:36:36 +02:00
Łukasz Magiera
3426611340
Merge pull request #1526 from filecoin-project/feat/pass-deal-schedule-for-pre-commit-expiry-scheduling
...
provide deal scheduling info to FSM so that it can set pre-commit expiry
2020-04-10 23:05:50 +02:00
laser
6dffe9377f
provide deal scheduling info to FSM so that it can set pre-commit expiry
2020-04-10 08:22:28 -07:00
hannahhoward
00cd89750d
feat(deps): update fil-markets, graphsync
...
Updates dependencies for graphsync, fil-markets, data-transfer. Moves to new graphsync blockstore
swapping capabilities, and also locks down graphsync impl so it does not accept arbitrary requests
2020-04-07 23:25:29 -07:00
laser
110c869dd3
cut over to storage-fsm, deleting local sealing package
2020-04-07 09:34:09 -07:00
laser
43f4db2308
SectorID -> SectorNumber
2020-04-06 15:31:33 -07:00
laser
dcd9e7da27
miscellaneous fixes post-rebase
2020-04-06 13:23:37 -07:00
laser
650a31b050
remove all lotus types from sealing package in preparation for extraction
...
events adapter
implement StateWaitMsg and StateComputeDataCommitment
implement StateGetSectorPreCommitOnChainInfo
implement ChainHead and SendMsg
implement remaining methods
2020-04-06 12:57:55 -07:00
Łukasz Magiera
95ee1c1cde
Extract sector-storage
2020-03-28 01:32:39 +01:00
Łukasz Magiera
c66d3dfad7
sectorstorage: Untangle from lotus deps
2020-03-27 22:35:33 +01:00
Łukasz Magiera
e050e0307e
Cleanup after dropping sectorbuilder
2020-03-26 20:35:16 +01:00
Łukasz Magiera
4be54a976c
Merge sectorbuilder into sectorstorage
2020-03-26 03:51:06 +01:00
Łukasz Magiera
726c9c1fe7
workers: Address review
2020-03-24 19:01:04 +01:00
Łukasz Magiera
8559c89560
storageminer: More storage stats in storage list
2020-03-23 23:43:38 +01:00
Łukasz Magiera
a3ba8eb0d7
workers: Basic monitoring tools
2020-03-23 15:56:22 +01:00
Łukasz Magiera
5e4a7e54df
Rename agvmgr+sealmgr to sectorstorage
2020-03-23 12:47:10 +01:00
Łukasz Magiera
c57c0e7f55
workers: Memory based scheduling
2020-03-20 23:30:17 +01:00
Łukasz Magiera
978a718159
storage: storage find command
2020-03-19 20:51:33 +01:00
Łukasz Magiera
d87b7c264d
stores: Use index in local store
2020-03-19 16:11:04 +01:00
Łukasz Magiera
2fa3f2578f
impl: Move CommonAPI into a separate pkg
2020-03-19 03:31:53 +01:00
Łukasz Magiera
94ebbd9d90
workers: Actually register in miner
2020-03-19 00:23:32 +01:00
Łukasz Magiera
d8ce5078d9
Use new specs-storage interface
2020-03-17 21:19:52 +01:00
Łukasz Magiera
96730bae75
workers: Report sectors paths after worker creates them
2020-03-13 17:54:55 +01:00
Łukasz Magiera
2c7f579838
workers: Implement SectorIndex
2020-03-13 12:59:19 +01:00
Łukasz Magiera
bc7fede68b
workers: Wire up most pieces
2020-03-13 02:37:38 +01:00
Łukasz Magiera
7e2e30f94b
workers: Transfer logic refactoring
2020-03-11 06:49:17 +01:00
Łukasz Magiera
eb61a36fd7
workers: RPC scaffolding
2020-03-11 02:58:02 +01:00
Łukasz Magiera
16cb27b5f9
Get node_test to pass
2020-03-05 23:27:30 +01:00
Łukasz Magiera
1461e475da
storage: Support adding paths at runtime
2020-03-05 23:02:01 +01:00
Łukasz Magiera
a5e5918fc5
mod tidy; gofmt
2020-03-05 20:21:06 +01:00
Łukasz Magiera
799ff17c7c
Merge remote-tracking branch 'origin/testnet/3' into feat/4stage-seal
2020-03-04 06:37:11 +01:00
whyrusleeping
9169a073b6
add miner side commands and a few other goodies
2020-03-03 18:49:00 -08:00
whyrusleeping
99c842e027
integrate client interface to allow for offline deals
2020-03-03 16:18:08 -08:00
Łukasz Magiera
a0dbb6bdd6
Storage Manager refactor
2020-03-03 23:19:22 +01:00
whyrusleeping
df6e3e83bf
make it all build finally
2020-02-27 13:45:31 -08:00
Łukasz Magiera
d787aa5007
Merge branch 'testnet/3' into feat/specs-actors
2020-02-24 18:32:02 +01:00
Łukasz Magiera
226685dc1c
Implement committed capacity sectors
2020-02-23 01:47:47 +01:00
Łukasz Magiera
69ec3c205a
Merge remote-tracking branch 'origin/master' into testnet/3
2020-02-19 22:10:14 +01:00
Aayush Rajasekaran
60970008c8
Re: #1250 : API methods should receive TipSetKeys, not TipSets, as input
2020-02-17 19:53:43 -05:00
Łukasz Magiera
c72727b4fd
specs-actors: Fix most compilation errors
2020-02-09 07:06:32 +01:00
Łukasz Magiera
cbf63aab1e
Merge branch 'master' into testnet/3
2020-02-05 21:27:04 +01:00
Łukasz Magiera
63ee6b6791
remote: Fix put in commit
2020-02-04 08:01:13 +01:00
Łukasz Magiera
0e81c1cf7e
Merge branch 'testnet/3' into feat/update-markets
2020-02-04 07:17:22 +01:00
Łukasz Magiera
8da64d710e
sealing: Work around broken remote sector put
2020-02-03 04:48:56 +01:00
Łukasz Magiera
5af64c53b6
initial sectorbuilder FS refactor integration
2020-01-29 00:08:02 +01:00
hannahhoward
71289b58ff
feat(markets): update to support car files
...
Upgrades lotus version of go-fil-markets to its head, which supports car files and handles tracking
of pieces, reducing the size of sectorBlocks
2020-01-28 14:08:13 -08:00
Łukasz Magiera
c3a5da8586
storageminer: log flag for sector status
2020-01-23 15:18:05 +01:00
Łukasz Magiera
8a9707788c
Merge branch 'master' into feat/event-states
2020-01-14 16:31:10 +01:00
Łukasz Magiera
a2bcc1fec2
Mostly functional mock sectorbuilder
2020-01-14 03:05:35 +01:00
Łukasz Magiera
34abc3d023
Merge branch 'feat/testnet2' into feat/event-states
2020-01-13 15:52:43 +01:00
Łukasz Magiera
f6d41ee77d
Port sector state maching to evtsm
2020-01-10 20:24:15 +01:00
whyrusleeping
5e16aab51b
fix tests, expand interfaces a little
2020-01-09 10:28:14 -08:00
laser
20321bb476
handle rebase
2020-01-07 08:18:35 -08:00
hannahhoward
8418464d91
refactor(address): use extracted address library
...
Switch to using extracted address library
2020-01-07 14:53:27 +01:00
Łukasz Magiera
d750723405
Merge remote-tracking branch 'origin/testnet-staging' into feat/cleanup-sectorstate-structs
2019-12-09 21:27:20 +01:00
Łukasz Magiera
c49dc28a04
Move api struct to a seprate pkg
2019-12-09 18:22:11 +01:00
Łukasz Magiera
94df2c656e
Use map encoders for some structs
2019-12-09 17:40:15 +01:00
Łukasz Magiera
7d68d9a029
storage: print sector retries in sector info
2019-12-08 23:35:46 +01:00
Łukasz Magiera
ef0d45e406
storage: addres review around nonces in sector states
2019-12-08 23:35:46 +01:00
Łukasz Magiera
55c1432347
Handle reverts in precommit more correctly
2019-12-08 23:35:46 +01:00
Jakub Sztandera
7f537dce2d
More renames
...
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-08 22:48:20 +01:00
Łukasz Magiera
83924e6b97
sectorbuilder: Allow to restrict task types
...
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-07 19:05:15 +01:00
whyrusleeping
40be53c9f9
add command for power users to manually update sector state
2019-12-04 20:43:54 -08:00
Łukasz Magiera
b2001db9d5
worker: Fix rebaining bugs
2019-12-04 17:53:32 +01:00
Łukasz Magiera
28dde1a2d3
worker: Use system tar for moving cache around
2019-12-04 15:58:28 +01:00
Łukasz Magiera
edd30c7aa1
Merge branch 'master' into feat/remote-workers
2019-12-04 14:10:15 +01:00
Łukasz Magiera
d112fd18b1
Persist sector sealing errors
2019-12-04 01:44:29 +01:00
Łukasz Magiera
89556819ae
seal-worker: Handle cache
2019-11-30 14:22:50 +01:00
Łukasz Magiera
8767d8c16b
Merge branch 'feat/election-post' into feat/remote-workers
2019-11-30 09:42:28 +01:00
whyrusleeping
a0588d513d
Add lotus-gen, rewire genesis mining
2019-11-24 22:45:13 -06:00
Łukasz Magiera
3281e9448a
fix rspco serialization
2019-11-22 16:48:02 +01:00
Łukasz Magiera
b726b95298
WIP remote sector CommitSseal
2019-11-21 20:51:53 +01:00
Łukasz Magiera
d4197bbadc
Working remote PreCommit
2019-11-21 19:38:50 +01:00
Łukasz Magiera
98b1de33b6
Stats for remote workers
2019-11-21 17:23:42 +01:00
Łukasz Magiera
ba3ad75670
remote-worker: wire up storage miner endpoints
2019-11-21 15:10:51 +01:00
Łukasz Magiera
9725eb78bf
wip remote sectorbuilder workers
2019-11-21 01:53:06 +01:00
Łukasz Magiera
aaacfd15cd
Add comments to fillersFromRem
2019-11-09 00:06:07 +01:00
Łukasz Magiera
071f05fa95
Storage miner API improvements
2019-11-08 19:23:58 +01:00
Łukasz Magiera
2d26a4edf7
Sector storage refactor
2019-11-07 19:22:59 +01:00
Łukasz Magiera
13da5a5966
Put WorkerThreads on sectorbuilder.Config
2019-11-04 17:47:08 +01:00
Łukasz Magiera
be8fe54ea3
Set correct Provider addr in StoreGarbage
2019-11-02 15:13:37 +01:00
Łukasz Magiera
3bc4a5dddf
More progress on fixing storing garbage data
2019-11-02 00:43:54 +01:00
Łukasz Magiera
82344649d3
Use state store for sectors
2019-11-01 15:06:49 +01:00
Łukasz Magiera
3cde267a2a
Move statestore to lib
2019-10-31 22:01:44 +01:00
Łukasz Magiera
46d782b30b
storageminer: Drop commitment tracker
2019-10-30 18:37:38 +01:00
Łukasz Magiera
44f4ee0de1
storageminer: cmd to list sector commitments
2019-10-29 21:41:30 +01:00
Łukasz Magiera
8e1a9a71e6
Run store-garbage in background
2019-10-29 18:52:07 +01:00
Łukasz Magiera
874be79958
very basic sector seal scheduling
2019-10-27 09:56:53 +01:00
whyrusleeping
4890f577f5
give miners the ability to select different sector sizes
2019-10-25 17:26:15 +02:00
Łukasz Magiera
76f1e6e207
on chain deals: Put dealIDs in CommitSector messages
2019-10-24 16:24:31 +02:00
Jakub Sztandera
1bf713cb0a
Cleanup imports after rename
...
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-10-18 13:47:41 +09:00
whyrusleeping
e8a1b54740
Add more info to storage-miner info command output
2019-10-14 11:32:32 +09:00
Łukasz Magiera
5fa1a74e74
Bump test genesis token amount
2019-09-24 13:02:54 +02:00
