Łukasz Magiera
c41777dcd2
API proxy struct codegen ( #5854 )
...
* mostly working api proxy gen
* api: Consistent api names
* fix docsgen
* regenerate api struct
* api: expand external interfaces
* Add missing gen files
* apigen: fix perm detection
* api: Move perm tags to the interface
* gofmt
* worker perms
* docsgen
* docsgen: ignore tag comments
* apigen: add codegen warning
* gofmt
* missing actor type
* docsgen
* make linter happy
* fix lint
* apigen: use directives for tags
* docsgen
* regen openrpc docs
2021-03-23 13:42:56 +01:00
Łukasz Magiera
305c2ec77d
miner: Config to disable owner/worker addcess fallback
2021-03-08 21:33:46 +01:00
Łukasz Magiera
fd90c03018
Roturn SectorID from PledgeSector
2021-02-16 19:16:35 +01:00
Łukasz Magiera
3ff6a6f59f
address review; flush tablewriter
2021-02-05 22:33:53 +01:00
Łukasz Magiera
cfa73f34e4
market: miner CLI for managing pending deals
2021-02-05 21:55:43 +01:00
Łukasz Magiera
b3f4e50c58
market: APIs to manage pending deals
2021-02-05 18:58:55 +01:00
Łukasz Magiera
144b5a1350
perning termination API
2021-01-14 12:37:23 +01:00
Łukasz Magiera
3522c8d45a
SectorTerminateFlush API
2021-01-13 23:32:04 +01:00
Łukasz Magiera
52cc2cd3eb
Initial sector termination support
2021-01-13 00:42:01 +01:00
Łukasz Magiera
2e154ef6d0
Merge pull request #5176 from filecoin-project/shaodan-miner-sectors-info
...
Shaodan miner sectors info
2020-12-10 20:09:15 +01:00
Łukasz Magiera
0cb2f51549
Merge pull request #5094 from filecoin-project/asr/verified-only
...
Allow miners to filter (un)verified deals
2020-12-10 19:48:22 +01:00
Dan Shao
d56170d70e
Optimize sectors info loading
2020-12-07 13:42:37 +08:00
Łukasz Magiera
2fd93a55ac
plumb AddressSelector to stoage fsm
2020-12-02 21:47:54 +01:00
Łukasz Magiera
f74a1b70ab
miner: Fix actor control list cli
2020-12-02 20:46:07 +01:00
Aayush Rajasekaran
370817eb60
Allow miners to filter (un)verified deals
2020-12-02 01:32:34 -05:00
Łukasz Magiera
c6f85886bf
miner: Add slow mode to proving check
2020-12-02 00:32:14 +01:00
s1m0n21
663b3f4f21
add a sector check command
2020-11-26 15:02:43 +08:00
Łukasz Magiera
09f9f871a3
Create a command to abort sealing calls
2020-11-11 17:39:12 +01:00
Łukasz Magiera
7fbb868513
Debug flag to force running sealing scheduler
2020-10-30 11:07:35 +01:00
Łukasz Magiera
e1da874258
Merge remote-tracking branch 'origin/master' into feat/async-restartable-workers
2020-10-27 03:31:07 +01:00
hannahhoward
98297cef4d
feat(data-transfer): fill in utils
2020-10-22 13:40:26 -07:00
Łukasz Magiera
8d06cca073
sched: Handle workers using sessions instead of connections
2020-10-18 12:36:06 +02:00
Łukasz Magiera
0de3051821
Merge remote-tracking branch 'origin/master' into feat/async-restartable-workers
2020-10-08 13:10:41 +02:00
Łukasz Magiera
2dc9a1ee4e
lotus-miner backup command
2020-10-01 17:55:47 +02:00
Łukasz Magiera
d817dceb05
Show lost calls in sealing jobs cli
2020-09-23 19:26:35 +02:00
Łukasz Magiera
ce6b92484f
Merge remote-tracking branch 'origin/master' into feat/async-restartable-workers
2020-09-23 11:31:21 +02:00
hannahhoward
691bd9f442
feat(markets): complete markets conversion
...
complete markets conversion to using chain/actors types, also replacing DealProposal/DealState
interfaces with structs
2020-09-17 00:43:14 -07:00
Łukasz Magiera
5f08fe7ead
Merge remote-tracking branch 'origin/master' into feat/async-restartable-workers
2020-09-10 17:30:54 +02:00
Aayush Rajasekaran
39755a294a
Update to specs v0.9.6
2020-09-07 15:48:41 -04:00
Łukasz Magiera
159ce13f5e
Async worker API
2020-09-06 18:47:16 +02:00
Ingar Shu
1608cd2d53
Add watch option to "lotus-miner storage-deals list"
2020-09-03 10:14:30 -07:00
Łukasz Magiera
99ecef89b8
gofmt
2020-08-27 12:41:24 +02:00
Łukasz Magiera
e236173417
miner: Print (pre)commit message cids in sector status
2020-08-27 12:40:19 +02:00
Aayush Rajasekaran
984e52acbc
Indicate whether a sector has been marked for upgrade
2020-08-21 15:53:39 -04:00
hannahhoward
0086f76a90
feat(lotus-miner): add data transfer list cmd
...
add equivalent command to list data transfers on miner side, extract common functionality for reuse
2020-08-20 01:35:48 -07:00
Raúl Kripalani
efdc428d5d
keep storage-fsm (renamed to storage-sealing) and sector-storage in extern.
2020-08-17 14:26:18 +01:00
Raúl Kripalani
3c17cd655e
integrate extern/sector-storage into lotus proper.
2020-08-16 11:09:58 +01:00
hannahhoward
75771d10d4
fix(markets): replicate unsealing bug
2020-08-06 13:17:16 -07:00
Ingar Shu
9e07b310d1
WIP
2020-08-05 17:27:08 +02:00
Aayush Rajasekaran
c33e38eef2
Update markets
2020-07-31 15:43:34 -04:00
whyrusleeping
146e59fe56
wire through new retrieval apis
2020-07-31 01:47:37 -04:00
whyrusleeping
7fa4cd33f0
WIP: retrieval pieces inspection command
2020-07-31 01:33:30 -04:00
Łukasz Magiera
c133a37b7c
gofmt
2020-07-28 01:22:41 +02:00
Łukasz Magiera
10362ab9b4
markets: Fix offset in LocatePieceForDealWithinSector
2020-07-28 01:22:20 +02:00
Łukasz Magiera
d557c407c6
Merge pull request #2608 from filecoin-project/feat/storage-remote-improvements
...
Update sector-storage, sealing sched-diag
2020-07-27 15:17:38 +02:00
刘林欣
26998fca32
add on-chain-info to lotus-miner sectors status command
2020-07-27 13:58:59 +02:00
Łukasz Magiera
135b77dab5
Update sector-storage, sealing sched-diag
2020-07-27 13:23:43 +02:00
Łukasz Magiera
2633bdd838
miner: sealing jobs command
2020-07-21 20:08:03 +02:00
Aayush Rajasekaran
a5ef629cef
Add expected seal duration to custom deal logic, reject deals that start too early
2020-07-15 17:31:50 -04:00
Łukasz Magiera
99796220f9
Support fast-retrieval deals
2020-07-08 20:42:07 +02:00
Łukasz Magiera
8e0d33a1fd
Updates for sectors-storge next
2020-07-08 17:23:27 +02:00
Aayush Rajasekaran
411c82ae8f
Update storage-FSM, add API to set sector seal delay
2020-07-07 15:23:23 -04:00
Łukasz Magiera
82e2cd4746
Basic CC Upgrade support
2020-07-01 17:01:06 +02:00
Łukasz Magiera
cfdbc2312d
Merge branch 'master' into next
2020-07-01 11:22:57 +02:00
laser
b9180a99d4
toggle consideration of offline storage/retrieval deal proposals
2020-06-26 12:27:41 -07:00
laser
e910a045d0
big rename to allow for later introducing the "consider offline" config
2020-06-26 10:50:54 -07:00
laser
5d9a775699
replace enable/disable commands with selection commands
2020-06-26 10:33:06 -07:00
Łukasz Magiera
24f4c96fc3
apitest: auto-start sealing precoss
2020-06-26 17:28:05 +02:00
laser
176d0bb7c0
add "lotus-storage-miner retrieval-deals" subcommands
...
- enable retrieval
- disable retrieval
2020-06-24 08:08:10 -07:00
Łukasz Magiera
6f8c464393
Merge remote-tracking branch 'origin/master' into feat/sector-remove
2020-06-23 23:54:27 +02:00
Łukasz Magiera
5adc188466
miner: Command to remove sectors
2020-06-22 19:35:14 +02:00
laser
de7d6c255c
blacklist -> blocklist
2020-06-18 15:51:01 -07:00
laser
0c8d648998
specify which CID is being blacklisted (it's the piece)
2020-06-18 14:02:22 -07:00
laser
b0edf924b4
add commands for manipulating storage deal CID blacklist
2020-06-18 13:15:18 -07:00
laser
5eceed81e1
add "get-ask" command
2020-06-16 17:23:03 -07:00
laser
6253c39100
replace "set-price" with "set-ask"
...
Fixes #2027
2020-06-16 16:13:21 -07:00
laser
36b327b57b
various symbol renames
2020-06-11 13:18:18 -07:00
laser
7587e6c08b
get and set storage deal acceptance through CLI
2020-06-11 12:59:50 -07:00
Łukasz Magiera
b753cd4503
Run window post test on circle
2020-06-01 15:06:10 +02:00
Łukasz Magiera
ee29a92021
Add a test for Window Post
2020-06-01 14:49:48 +02:00
Jeromy
f4948dcba0
remove api dependency on sealing fsm package
2020-04-23 15:33:59 -07:00
Łukasz Magiera
309f54aa0c
Update sector-storage
2020-04-23 15:29:31 -07:00
Łukasz Magiera
86e7f5914b
testing: test 2-miner mining
2020-04-23 23:20:02 +02:00
laser
110c869dd3
cut over to storage-fsm, deleting local sealing package
2020-04-07 09:34:09 -07:00
laser
f53250ee90
reorder imports
2020-04-06 13:27:14 -07:00
laser
dcd9e7da27
miscellaneous fixes post-rebase
2020-04-06 13:23:37 -07:00
Łukasz Magiera
6284fad33e
fsm: Implement handlers for Commit errors
2020-04-03 19:45:48 +02:00
Łukasz Magiera
a63a0b3077
sealing fsm: Separate precommit 1/2
2020-04-03 18:54:15 +02:00
Łukasz Magiera
a1b35aa9d5
Change api.SectorState to a string
2020-04-03 18:29:31 +02:00
Łukasz Magiera
95ee1c1cde
Extract sector-storage
2020-03-28 01:32:39 +01:00
Łukasz Magiera
c66d3dfad7
sectorstorage: Untangle from lotus deps
2020-03-27 22:35:33 +01:00
Łukasz Magiera
726c9c1fe7
workers: Address review
2020-03-24 19:01:04 +01:00
Łukasz Magiera
8559c89560
storageminer: More storage stats in storage list
2020-03-23 23:43:38 +01:00
Łukasz Magiera
a3ba8eb0d7
workers: Basic monitoring tools
2020-03-23 15:56:22 +01:00
Łukasz Magiera
5e4a7e54df
Rename agvmgr+sealmgr to sectorstorage
2020-03-23 12:47:10 +01:00
Łukasz Magiera
978a718159
storage: storage find command
2020-03-19 20:51:33 +01:00
Łukasz Magiera
d87b7c264d
stores: Use index in local store
2020-03-19 16:11:04 +01:00
Łukasz Magiera
7e997e40f3
workers: Simple storage diagnostics
2020-03-16 18:50:07 +01:00
Łukasz Magiera
2c7f579838
workers: Implement SectorIndex
2020-03-13 12:59:19 +01:00
Łukasz Magiera
a75ad492f1
workers: Declare sectors after fetching in remote store
2020-03-13 11:40:24 +01:00
Łukasz Magiera
bc7fede68b
workers: Wire up most pieces
2020-03-13 02:37:38 +01:00
Łukasz Magiera
7e2e30f94b
workers: Transfer logic refactoring
2020-03-11 06:49:17 +01:00
Łukasz Magiera
eb61a36fd7
workers: RPC scaffolding
2020-03-11 02:58:02 +01:00
Łukasz Magiera
1461e475da
storage: Support adding paths at runtime
2020-03-05 23:02:01 +01:00
Łukasz Magiera
a5e5918fc5
mod tidy; gofmt
2020-03-05 20:21:06 +01:00
Łukasz Magiera
799ff17c7c
Merge remote-tracking branch 'origin/testnet/3' into feat/4stage-seal
2020-03-04 06:37:11 +01:00
whyrusleeping
9169a073b6
add miner side commands and a few other goodies
2020-03-03 18:49:00 -08:00
whyrusleeping
99c842e027
integrate client interface to allow for offline deals
2020-03-03 16:18:08 -08:00
Łukasz Magiera
a0dbb6bdd6
Storage Manager refactor
2020-03-03 23:19:22 +01:00
Łukasz Magiera
3abb59a550
sealmgr: Interfaces; simple initial impl
2020-03-03 01:46:58 +01:00
Łukasz Magiera
5a4f917c60
4-stage v23 lotus-bench
2020-02-28 19:06:59 +01:00
whyrusleeping
df6e3e83bf
make it all build finally
2020-02-27 13:45:31 -08:00
whyrusleeping
6c12068fb7
more fixes for random garbage
2020-02-26 16:42:39 -08:00
Łukasz Magiera
c72727b4fd
specs-actors: Fix most compilation errors
2020-02-09 07:06:32 +01:00
Łukasz Magiera
13435aebdc
Spec Actors integration
2020-02-08 03:18:32 +01:00
Łukasz Magiera
03f07042ff
fpost: print message apply result
2020-01-29 23:47:28 +01:00
Łukasz Magiera
4b8b79dbe0
sealing: FinalizeSector step
2020-01-29 22:25:06 +01:00
Łukasz Magiera
94f2948020
sealing: implement handler for sealFailed
2020-01-23 16:38:10 +01:00
Łukasz Magiera
c3a5da8586
storageminer: log flag for sector status
2020-01-23 15:18:05 +01:00
Łukasz Magiera
ba5a5d1248
sealing: wire up checkPieces and checkSeal
2020-01-22 20:47:29 +01:00
Łukasz Magiera
e4de5c55ac
sealing: Some state renaming
2020-01-20 23:04:46 +01:00
Łukasz Magiera
2ed89f496f
Revesve some sector states
2020-01-13 21:54:28 +01:00
acruikshank
7873213b11
switch sectorbuilder from lib to external module
...
point to correct version of sectorbuilder + ensure go-datastore stays at 0.1.1
replace local address type with go-address
consume paramfetch.GetParams instead of local paramfetch.go
remove constants now defined in sectorbuilder
2020-01-07 07:48:43 -08:00
hannahhoward
8418464d91
refactor(address): use extracted address library
...
Switch to using extracted address library
2020-01-07 14:53:27 +01:00
Łukasz Magiera
d750723405
Merge remote-tracking branch 'origin/testnet-staging' into feat/cleanup-sectorstate-structs
2019-12-09 21:27:20 +01:00
whyrusleeping
d2448912a6
Implement basic fault handling
...
WIP: miner actor tests
working miner actor test
rebase and fix tests
2019-12-09 20:53:43 +01:00
Łukasz Magiera
94df2c656e
Use map encoders for some structs
2019-12-09 17:40:15 +01:00
Łukasz Magiera
7d68d9a029
storage: print sector retries in sector info
2019-12-08 23:35:46 +01:00
Jakub Sztandera
7f537dce2d
More renames
...
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-08 22:48:20 +01:00
Łukasz Magiera
83924e6b97
sectorbuilder: Allow to restrict task types
...
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-07 19:05:15 +01:00
whyrusleeping
d92ba5fbba
Add separate state for waiting for commit message
2019-12-05 18:40:57 -08:00
whyrusleeping
40be53c9f9
add command for power users to manually update sector state
2019-12-04 20:43:54 -08:00
Łukasz Magiera
edd30c7aa1
Merge branch 'master' into feat/remote-workers
2019-12-04 14:10:15 +01:00
Łukasz Magiera
d112fd18b1
Persist sector sealing errors
2019-12-04 01:44:29 +01:00
Łukasz Magiera
13c39452c1
storageminer: States for common failure modes
2019-12-04 00:59:40 +01:00
Łukasz Magiera
dbcb839b6f
Make sector state transitions more explicit
2019-12-04 00:42:22 +01:00
Łukasz Magiera
160e11ce8c
Merge branch 'master' into feat/remote-workers
2019-12-03 03:24:00 +01:00
Łukasz Magiera
a59d0f0f8c
Fix unsealing, sector based data refs
2019-12-01 18:58:31 +01:00
Łukasz Magiera
98b1de33b6
Stats for remote workers
2019-11-21 17:23:42 +01:00
Łukasz Magiera
ba3ad75670
remote-worker: wire up storage miner endpoints
2019-11-21 15:10:51 +01:00
Łukasz Magiera
9725eb78bf
wip remote sectorbuilder workers
2019-11-21 01:53:06 +01:00
Łukasz Magiera
071f05fa95
Storage miner API improvements
2019-11-08 19:23:58 +01:00
Łukasz Magiera
40b1f91843
fix sector block ref serialization
2019-11-06 13:22:08 +01:00
Łukasz Magiera
82344649d3
Use state store for sectors
2019-11-01 15:06:49 +01:00
Łukasz Magiera
080a84970c
api: Split api files
2019-11-01 13:01:16 +01:00
