Commit Graph

702 Commits

Author SHA1 Message Date
laser
67110ce739 stub enable/disable storage deal commands 2020-06-11 12:20:11 -07:00
Łukasz Magiera
3b13397165 gofmt 2020-06-06 00:59:01 +02:00
Łukasz Magiera
163c2b2544 Merge remote-tracking branch 'origin/master' into next 2020-06-06 00:58:24 +02:00
Łukasz Magiera
d27750590a
Merge pull request #1928 from filecoin-project/fix/lsm-prov-deadlines
Make lotus-storage-miner deadlines correct
2020-06-06 00:37:09 +02:00
Łukasz Magiera
f765fe36d7 Make lotus-storage-miner deadlines correct 2020-06-06 00:28:32 +02:00
Łukasz Magiera
3f81ff3507 Update specs-actors 2020-06-05 22:06:11 +02:00
laser
4855045ea2 pass context to paramfetch.GetParams
Fixes #1209
2020-06-05 10:28:00 -07:00
Łukasz Magiera
7ae9d26cd1 Merge remote-tracking branch 'origin/next' into fix/sealing-betterering 2020-06-05 14:00:47 +02:00
Łukasz Magiera
9e5cc7c910 Update fsm, sector-storage 2020-06-05 10:46:45 +02:00
Jakub Sztandera
7bee5b3abc
Merge remote-tracking branch 'origin/master' into next
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-06-05 00:33:43 +02:00
Łukasz Magiera
5aafa91e22
Merge pull request #1898 from filecoin-project/deps/update
Update CLI lib
2020-06-04 23:45:39 +02:00
Łukasz Magiera
f9f0d86ddf
Merge pull request #1913 from acruikshank/feat/1853-confirmations-in-StateWaitMsg2
Add confidence and timeout to message wait
2020-06-04 23:23:15 +02:00
Łukasz Magiera
8bbe63bd9d Add expected win rate to miner-info 2020-06-04 21:26:29 +02:00
Jakub Sztandera
29dbc26dbd
Update cli
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-06-04 01:01:41 +02:00
acruikshank
04f0130530 remove timeout 2020-06-03 17:42:06 -04:00
acruikshank
5574e4f11b add confidence and timeout to message wait 2020-06-03 15:38:37 -04:00
Łukasz Magiera
35740895ed
Merge pull request #1899 from filecoin-project/feat/1827-lotus-daemon-stop-cmd
add (sub)commands which shut down lotus daemon and storage miner
2020-06-03 19:15:20 +02:00
Jakub Sztandera
673a972fe9
Merge remote-tracking branch 'origin/master' into next
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-06-02 22:49:27 +02:00
Jeromy
9b867a221a add subcall timing to compute state output 2020-06-02 12:53:24 -07:00
laser
bea9cd2fe2 rename to better convey intent + document 2020-06-02 12:35:11 -07:00
laser
ee9d9a52a9 first take at a "lotus-storage-miner stop" command
Fixes #1827
2020-06-02 12:31:21 -07:00
laser
38d714a28a first take at "daemon stop" command
Fixes #1827

TODO: plumb the daemon-stopping into lotus-storage-miner, too
2020-06-02 12:29:58 -07:00
Łukasz Magiera
64f4e80446 Include build type in version 2020-06-01 20:49:39 +02:00
Łukasz Magiera
f7a71f4be7
Merge pull request #1837 from filecoin-project/feat/secstor-unseal
Update sector-storage with ReadPiece impl
2020-05-29 20:36:40 +02:00
Łukasz Magiera
e5c24ff32b Update sector-storage with ReadPiece impl 2020-05-29 19:53:35 +02:00
Łukasz Magiera
785eeb1eee
Merge pull request #1850 from filecoin-project/chore/lint
Cleanup many lint warnings
2020-05-29 18:06:06 +02:00
Jakub Sztandera
b372881e91
Fix more lint warnings
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-05-28 01:15:19 +02:00
Jakub Sztandera
d6615b6286
Cleanup many lint warnings
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-05-27 22:53:20 +02:00
Jakub Sztandera
4604b60fb1
Remove drand on miner side, MinerGetBaseInfo provides the same info
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-05-27 20:24:26 +02:00
shannonwells
e68ab286f6 upgrade lotus to go-fil-markets v0.2.5 2020-05-20 15:56:58 -07:00
Łukasz Magiera
f7325a69c1 Extract auth utils to go-jsonrpc 2020-05-20 20:37:45 +02:00
Łukasz Magiera
eeca031525 extract lib/jsonrpc to go-jsonrpc 2020-05-20 19:49:09 +02:00
Łukasz Magiera
ae60001dcc post: Handle Recovering sectors 2020-05-20 18:41:20 +02:00
shannon
cc5875c6bd Pset represents the proving sectors, and Sset repensents all sectors 2020-05-20 12:12:13 +08:00
Jeromy
cf9e576028 avoid dividing by zero if pset is empty 2020-05-16 11:35:24 -07:00
Jeromy
363f575e6c properly handle parsing of miner init sector sizes 2020-05-13 13:12:13 -07:00
Łukasz Magiera
e12e2b4e4e cli: fix proving info with no sectors 2020-05-13 19:58:49 +02:00
Łukasz Magiera
4c64f0ca11 sync: enforce message gas limits 2020-05-13 03:36:56 +02:00
Łukasz Magiera
ba389598ee Cleanup build package 2020-05-12 19:59:28 +02:00
Jeromy
8b58f22c2e block producers should have only one address 2020-05-05 12:01:44 -07:00
Łukasz Magiera
35b1963eeb gofmt 2020-05-01 21:51:31 +02:00
Łukasz Magiera
f9be73c73e storageminer: Fix 'storage list' with disconnected storage 2020-05-01 20:43:39 +02:00
Łukasz Magiera
d9acd484c0 storageminer: Improve CLI UX 2020-05-01 14:06:19 +02:00
Łukasz Magiera
5026091623 Merge remote-tracking branch 'origin/testnet/3' into feat/storage-better-fetch 2020-04-30 20:56:52 +02:00
Łukasz Magiera
89b19af43f specs-actors v0.3 2020-04-29 20:06:05 +02:00
Łukasz Magiera
068e9a29d2 Merge remote-tracking branch 'origin/testnet/3' into feat/storage-better-fetch 2020-04-29 13:27:49 +02:00
Łukasz Magiera
9dcb42328e gofmt 2020-04-28 19:27:13 +02:00
Łukasz Magiera
8d35aacd31 Update sector-storage with better fetch logic 2020-04-28 14:57:53 +02:00
Łukasz Magiera
af794a6281 storageminer: Print some balances in info 2020-04-24 23:02:27 +02:00
Łukasz Magiera
55f7c81aaf specs-actors: Fix miner cron on null blocks 2020-04-24 19:12:30 +02:00
Jeromy
f4948dcba0 remove api dependency on sealing fsm package 2020-04-23 15:33:59 -07:00
Łukasz Magiera
309f54aa0c Update sector-storage 2020-04-23 15:29:31 -07:00
Yu Da
9b598e5ec3 fix #1574 (#1583)
* fix #1566

* fix #1566

Co-authored-by: Da Yu <dayu26@dadeMacBook-Pro.local>
2020-04-23 09:44:25 -07:00
Whyrusleeping
f960cccc51 Merge pull request #1568 from filecoin-project/feat/fix-reward-redeem
fix reward redeem command to work again
2020-04-21 15:23:49 -07:00
Jeromy
e3f2dfaec0 fix reward redeem command to work again 2020-04-21 14:45:33 -07:00
Łukasz Magiera
24c764c91e Don't print QAPower as bytes 2020-04-21 21:46:50 +02:00
Łukasz Magiera
c406b875fa gofmt, mod tidy 2020-04-21 19:23:49 +02:00
Łukasz Magiera
8be9494672 windowed post: Get correct sector set 2020-04-21 19:22:53 +02:00
Łukasz Magiera
a86595bc88 Use nicer DeadlineInfo struct 2020-04-20 19:34:08 +02:00
Łukasz Magiera
3b7ae0d6d9 mod tidy, gofmt 2020-04-18 00:02:43 +02:00
Łukasz Magiera
712e2683d6 miner: proving info commands 2020-04-18 00:02:18 +02:00
Łukasz Magiera
93b2b6d65d Merge branch 'testnet/3' into feat/windowed-post 2020-04-17 18:38:20 +02:00
Łukasz Magiera
bab352fb44 Wireup WinningPost validation 2020-04-17 16:47:19 +02:00
Łukasz Magiera
afdfc8807d api: Single method for static miner info 2020-04-16 19:36:36 +02:00
Łukasz Magiera
f88e400d74 make things build 2020-04-16 00:17:39 +02:00
Jeromy
674be39af1 real drand network integration 2020-04-13 20:06:10 -07:00
Łukasz Magiera
5bf80a60f1 Get proof type in NewWinningPoStProver constructor 2020-04-13 23:25:46 +02:00
Łukasz Magiera
349b2890bf Drop 'rewards list' for now 2020-04-13 22:43:27 +02:00
Łukasz Magiera
a2554952d1 Some electionPoSt -> winningPoSt renaming 2020-04-11 00:22:45 +02:00
Łukasz Magiera
d3ffe48fcb Get things to mostly build 2020-04-10 23:29:05 +02:00
Łukasz Magiera
e053cd6b9c Merge remote-tracking branch 'origin/testnet/3' into feat/windowed-post 2020-04-10 23:09:01 +02:00
Łukasz Magiera
613e61222b mostly wire up WindowedPoSt 2020-04-10 23:07:18 +02:00
laser
6dffe9377f provide deal scheduling info to FSM so that it can set pre-commit expiry 2020-04-10 08:22:28 -07:00
Łukasz Magiera
70d654e4a6 Merge pull request #1527 from filecoin-project/feat/drand
Initial randomness beacon implementation
2020-04-09 19:48:09 +02:00
Łukasz Magiera
2b0bf372a7 Merge pull request #1507 from filecoin-project/feat/completions
Shell completions
2020-04-08 16:29:18 +02:00
Jakub Sztandera
c16806eb78 gofmt
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-04-08 14:54:06 +02:00
Jeromy
7075eaba26 WIP: random beacon interface
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-04-07 15:32:23 -07:00
laser
110c869dd3 cut over to storage-fsm, deleting local sealing package 2020-04-07 09:34:09 -07:00
laser
43f4db2308 SectorID -> SectorNumber 2020-04-06 15:31:33 -07:00
laser
f53250ee90 reorder imports 2020-04-06 13:27:14 -07:00
laser
dcd9e7da27 miscellaneous fixes post-rebase 2020-04-06 13:23:37 -07:00
laser
650a31b050 remove all lotus types from sealing package in preparation for extraction
events adapter

implement StateWaitMsg and StateComputeDataCommitment

implement StateGetSectorPreCommitOnChainInfo

implement ChainHead and SendMsg

implement remaining methods
2020-04-06 12:57:55 -07:00
Łukasz Magiera
a1b35aa9d5 Change api.SectorState to a string 2020-04-03 18:29:31 +02:00
Łukasz Magiera
dd6adcd240 rewards cli: Print amount in list as Fil 2020-04-03 06:31:59 +02:00
Łukasz Magiera
2bdedefa05 Shell completions 2020-04-03 04:03:53 +02:00
Łukasz Magiera
fa86359549 storageminer: Parse pretty sector sizes in init 2020-04-01 23:56:49 +02:00
Jeromy
417d434973 several fixes and improvements while debugging interop 2020-03-31 18:35:23 -07:00
Whyrusleeping
ea135991e3 Merge pull request #1480 from filecoin-project/feat/better-deal-info
Better deal info at the command line
2020-03-31 13:29:07 -07:00
hannahhoward
ae3f7522f0 feat(cli): use MarketListIncompleteDeals for miner deals cmd
Switch from DealsList to MarketListIncompleteDeals which (while poorly named) provides much more
information about what's happening with a miners deals
2020-03-31 11:54:37 -07:00
Pedro Costa
5e2a94e22f Fix offline deal import command arguments check
Why:

* It is failing if the number of arguments is the expected one.
2020-03-31 19:18:13 +01:00
Łukasz Magiera
95ee1c1cde Extract sector-storage 2020-03-28 01:32:39 +01:00
Łukasz Magiera
c66d3dfad7 sectorstorage: Untangle from lotus deps 2020-03-27 22:35:33 +01:00
Łukasz Magiera
de1f2be505 Merge pull request #1458 from filecoin-project/feat/merge-sectorbuilder
Merge sectorbuilder into sectorstorage
2020-03-27 18:53:58 +01:00
Jeromy
3470ed7847 re add storage miner api flag 2020-03-26 22:19:29 -07:00
Łukasz Magiera
e050e0307e Cleanup after dropping sectorbuilder 2020-03-26 20:35:16 +01:00
Łukasz Magiera
4be54a976c Merge sectorbuilder into sectorstorage 2020-03-26 03:51:06 +01:00
Łukasz Magiera
cfc65f525a sectorstorage: wire up closing logic 2020-03-25 00:52:55 +01:00
Łukasz Magiera
5de17e903c storageminer: Config for local worker task types 2020-03-24 20:38:00 +01:00
Łukasz Magiera
726c9c1fe7 workers: Address review 2020-03-24 19:01:04 +01:00
Łukasz Magiera
8559c89560 storageminer: More storage stats in storage list 2020-03-23 23:43:38 +01:00
Łukasz Magiera
a3ba8eb0d7 workers: Basic monitoring tools 2020-03-23 15:56:22 +01:00
Łukasz Magiera
80d0f1f2c1 storageminer: Cleanup CLI 2020-03-23 13:29:24 +01:00
Łukasz Magiera
5e4a7e54df Rename agvmgr+sealmgr to sectorstorage 2020-03-23 12:47:10 +01:00
Łukasz Magiera
d43f2a2e3b workers: Address review 2020-03-22 22:39:06 +01:00
Łukasz Magiera
df9aa0e357 storagemitner: manage ulimit on start 2020-03-22 22:08:22 +01:00
Łukasz Magiera
c6f67911de storageminer: Improve storage find cmd 2020-03-20 23:39:07 +01:00
Łukasz Magiera
076cc428af workers: Fix moving storage around in later steps 2020-03-20 01:55:49 +01:00
Łukasz Magiera
e0c15b24fc storageminer: Fix preseal meta import for genesis miners 2020-03-20 01:20:01 +01:00
Łukasz Magiera
978a718159 storage: storage find command 2020-03-19 20:51:33 +01:00
Łukasz Magiera
d87b7c264d stores: Use index in local store 2020-03-19 16:11:04 +01:00
Łukasz Magiera
1ed7779701 Merge remote-tracking branch 'origin/testnet/3' into feat/new-workers 2020-03-19 03:28:55 +01:00
Łukasz Magiera
2d1e30ae3b workers: Call find* on remote 2020-03-19 03:23:21 +01:00
whyrusleeping
ddf1beac6c change gas limit to be a normal int64 2020-03-18 13:45:37 -07:00
whyrusleeping
66a950942e add a usage text to import-data command 2020-03-17 22:08:14 -07:00
Łukasz Magiera
5f2caffb51 Fix tests after specs-storage changes 2020-03-18 02:08:11 +01:00
Łukasz Magiera
d8ce5078d9 Use new specs-storage interface 2020-03-17 21:19:52 +01:00
Łukasz Magiera
7e997e40f3 workers: Simple storage diagnostics 2020-03-16 18:50:07 +01:00
Łukasz Magiera
e6ec20b4ca Merge branch 'testnet/3' into feat/new-workers 2020-03-13 17:58:13 +01:00
Łukasz Magiera
2c7f579838 workers: Implement SectorIndex 2020-03-13 12:59:19 +01:00
whyrusleeping
16d087cce4 get fallback post running successfully! 2020-03-10 23:30:48 -07:00
Łukasz Magiera
0c3f4eb7dd storageminer: Create dir with --init 2020-03-09 23:00:29 +01:00
Łukasz Magiera
01087e01d2 storage: Improve thread safety 2020-03-09 20:22:30 +01:00
Łukasz Magiera
1647798396 build: Remove unused vars, fix debug build 2020-03-09 07:54:29 +01:00
Łukasz Magiera
2ff4a2846b Merge pull request #1366 from filecoin-project/fix/set-price-units
Add units to set price command
2020-03-09 07:28:42 +01:00
Łukasz Magiera
6981cfb8bc Merge pull request #1365 from filecoin-project/feat/miner-storage-add
storageminer: 'storage attach' command
2020-03-09 07:28:11 +01:00
whyrusleeping
33aa9bd03f Add units to set price command 2020-03-08 23:22:11 -07:00
Whyrusleeping
f9c38ac35e Merge pull request #1362 from filecoin-project/fix/no-storage-init
storageminer: Correctly initialize storage.json with --no-local-storage
2020-03-08 23:16:20 -07:00
Łukasz Magiera
33fcf8eb44 gofmt, mod tidy 2020-03-09 07:13:45 +01:00
Łukasz Magiera
c87ebe8590 storageminer: storage attach cmd 2020-03-09 07:13:22 +01:00
Łukasz Magiera
7c94f2f3be storageminer: Correctly initialize storage.json with --no-local-storage 2020-03-09 06:45:12 +01:00
whyrusleeping
ab51c7e2d2 Fix fallback post scheduling to hopefully do the right thing 2020-03-08 00:19:38 -08:00
whyrusleeping
4101147a5b one more miner init issue 2020-03-06 14:23:21 -08:00
Łukasz Magiera
38241d66cb Merge branch 'testnet/3' into feat/miner-rewards-cmd 2020-03-06 19:04:36 +01:00
whyrusleeping
09c543c526 fix storage miner init logic 2020-03-06 00:06:59 -08:00
whyrusleeping
1183e082af add command to inspect and redeem block rewards 2020-03-05 21:32:52 -08:00
Łukasz Magiera
a5e5918fc5 mod tidy; gofmt 2020-03-05 20:21:06 +01:00
Łukasz Magiera
7d95e134eb storageminer: Print what we can in info cmd 2020-03-05 19:26:05 +01:00
Łukasz Magiera
c91d970c41 storageminer: Init with default local storage 2020-03-05 02:12:52 +01:00
Łukasz Magiera
7db1dd52bd storagemgr: Wire up most of AddPiece logic 2020-03-05 01:38:07 +01:00
Łukasz Magiera
799ff17c7c Merge remote-tracking branch 'origin/testnet/3' into feat/4stage-seal 2020-03-04 06:37:11 +01:00
whyrusleeping
9169a073b6 add miner side commands and a few other goodies 2020-03-03 18:49:00 -08:00
Łukasz Magiera
12d870e274 sealmgr: Read only multi-path file manager 2020-03-04 03:24:08 +01:00
whyrusleeping
99c842e027 integrate client interface to allow for offline deals 2020-03-03 16:18:08 -08:00
Łukasz Magiera
a0dbb6bdd6 Storage Manager refactor 2020-03-03 23:19:22 +01:00
whyrusleeping
df6e3e83bf make it all build finally 2020-02-27 13:45:31 -08:00
Łukasz Magiera
ae634ef7df actors: Remove addrass aliases 2020-02-25 21:54:58 +01:00
Łukasz Magiera
cd10a3126b actors: drop a bunch of type aliases 2020-02-25 21:35:15 +01:00
Łukasz Magiera
d787aa5007 Merge branch 'testnet/3' into feat/specs-actors 2020-02-24 18:32:02 +01:00
Łukasz Magiera
226685dc1c Implement committed capacity sectors 2020-02-23 01:47:47 +01:00
Łukasz Magiera
b12482df89 move peermgr, tracing into lib 2020-02-22 12:36:22 +01:00
Łukasz Magiera
18627e77ff gofmt; mod tidy 2020-02-21 20:28:20 +01:00
Łukasz Magiera
49ece5fddf storageminer: Fix build 2020-02-21 19:20:22 +01:00
Łukasz Magiera
69ec3c205a Merge remote-tracking branch 'origin/master' into testnet/3 2020-02-19 22:10:14 +01:00
Aayush Rajasekaran
60970008c8 Re: #1250: API methods should receive TipSetKeys, not TipSets, as input 2020-02-17 19:53:43 -05:00
Łukasz Magiera
7e70536bf1 specs-actors: Finish type cleanup 2020-02-10 19:21:10 +01:00
Łukasz Magiera
c72727b4fd specs-actors: Fix most compilation errors 2020-02-09 07:06:32 +01:00
hannahhoward
97b645cd55 fix(go-fil-markets): fix integration
remove broken aspects of go-fil-markets integration and update versins
2020-02-04 20:08:08 -08:00
Travis Person
cf8e90fa3e Load sectorbuilder config during storage miner init 2020-02-05 00:07:44 +00:00
Travis Person
62146b7bb3 Add pre-sealed-metadata flag to miner init
Metadata for presealed sectors now must be specified
2020-02-04 23:16:10 +00:00
Łukasz Magiera
0e81c1cf7e Merge branch 'testnet/3' into feat/update-markets 2020-02-04 07:17:22 +01:00
Łukasz Magiera
a62572bb76 Merge remote-tracking branch 'origin/master' into feat/new-sb-fs 2020-01-31 08:36:47 +01:00
Łukasz Magiera
95f344540e Fix tests 2020-01-31 02:27:38 +01:00
Łukasz Magiera
aefc463586 build: Lazy ParametersJson 2020-01-30 23:50:24 +01:00
Łukasz Magiera
316b11445e storageminer: Print fault data in info 2020-01-30 19:38:03 +01:00
Yang
e5a48800ab fix:a bug of the power percentage in lotus-storage-miner info 2020-01-30 15:02:50 +08:00
Łukasz Magiera
3f58ffe572 storageminer: New storage config 2020-01-29 20:53:45 +01:00
Łukasz Magiera
5af64c53b6 initial sectorbuilder FS refactor integration 2020-01-29 00:08:02 +01:00
hannahhoward
b8077fadaa fix(dealstate): update deal states to match current 2020-01-28 14:08:13 -08:00
Łukasz Magiera
de52d3cadd sealing: Handlef for PreCommitFailed 2020-01-23 18:34:04 +01:00
Łukasz Magiera
7e43c40529 storageminer: Use tabwriter in sectors list 2020-01-23 17:15:45 +01:00
Łukasz Magiera
c3a5da8586 storageminer: log flag for sector status 2020-01-23 15:18:05 +01:00
Łukasz Magiera
0aebec6697 Merge branch 'master' into feat/event-states 2020-01-16 03:59:14 +01:00
Łukasz Magiera
604bf64ef6 Move miner sealing logic into a separate package 2020-01-15 21:49:11 +01:00
Jiarui.Huang
6354a8ce03 So we should pass a bit more than the minimum collateral at the time of miner creation
Even 0.1% more would be enough# Please enter the commit message for your changes. Lines starting
2020-01-16 01:30:01 +08:00
Łukasz Magiera
50bac00329 Merge branch 'master' into feat/testnet2 2020-01-10 20:55:40 +01:00
hannahhoward
0ce1bf706b refactor(markets): reorg file structure 2020-01-10 10:33:26 -08:00
hannahhoward
65ecb33630 feat(storagemarket): extract storage market
remove all shared components, point at go-fil-components repo
2020-01-10 09:49:07 -08:00
Łukasz Magiera
fac47bfc54 Pass correct datastore into sectorbuilder 2020-01-09 14:23:44 +01:00
Łukasz Magiera
8cbcbbd7a4 Merge branch 'feat/testnet2' of github.com:filecoin-project/go-lotus into feat/testnet2 2020-01-08 22:44:54 +01:00
Łukasz Magiera
da38822dfd paramfetch: bring parameters.json back to this repo 2020-01-08 21:31:35 +01:00
Jakub Sztandera
1ed62628a7
Update go-log to v2
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-01-08 20:22:31 +01:00
Jakub Sztandera
886898b137
Update to badger v2
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-01-08 19:56:45 +01:00
Łukasz Magiera
31173ff4b4 Set logging levels in a single place 2020-01-08 14:49:34 +01:00
laser
20321bb476 handle rebase 2020-01-07 08:18:35 -08:00
Łukasz Magiera
1e7f10e387 gofmt 2020-01-07 15:00:10 +01:00
hannahhoward
718acb0a86 refactor(cborutil): extract cborutil library
Use extracted cborutil library
2020-01-07 14:59:35 +01:00
hannahhoward
8418464d91 refactor(address): use extracted address library
Switch to using extracted address library
2020-01-07 14:53:27 +01:00
laser
6a740a6d67 consume newly-extracted paramfetch 2020-01-02 11:08:49 -08:00
Jakub Sztandera
9bd0072d5c
Nicer error print
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-17 16:27:41 +01:00
Jakub Sztandera
0eb7991bbd
Fix version check
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-17 16:26:16 +01:00
Łukasz Magiera
11d11c88ae
Revert "Refactor versions" 2019-12-17 16:16:57 +01:00
Jakub Sztandera
867cba610b
Refactor versions
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-17 00:43:43 +01:00
Łukasz Magiera
825e3a0774 sectorbuilder: check free space before creating sectors 2019-12-16 17:16:08 +01:00
Łukasz Magiera
cf9edae000
Merge pull request #878 from filecoin-project/feat/cw-sset-counts
chainwatch: Collect sector set sizes
2019-12-12 17:32:12 +01:00
Łukasz Magiera
ee979a20f8 Show sectorset info in storageminer info 2019-12-12 13:02:20 +01:00
Jakub Sztandera
9589fc0762
Add version commit string
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-11 23:00:39 +01:00
Łukasz Magiera
7d5709f4e2
Merge pull request #840 from filecoin-project/feat/bench-bps
bench: print bps speeds
2019-12-10 21:21:13 +01:00
Łukasz Magiera
0fa20f6074 bench: print bps speeds 2019-12-10 20:02:42 +01:00
whyrusleeping
08cc689293 add option to symlink to presealed sectors 2019-12-10 18:11:59 +01:00
whyrusleeping
8fdece1b3f make badger readonly when initializing storage miner from sector set 2019-12-09 14:05:09 -08:00
Łukasz Magiera
0de9991dcd
Merge pull request #816 from filecoin-project/feat/api-cleanup
Move api struct to a seprate pkg
2019-12-09 18:33:13 +01:00
Łukasz Magiera
ff963dfea5
Merge pull request #780 from filecoin-project/feat/storage-deal-cleanup
Clean up storage deal structures
2019-12-09 18:31:18 +01:00
Łukasz Magiera
c49dc28a04 Move api struct to a seprate pkg 2019-12-09 18:22:11 +01:00
Łukasz Magiera
d18179d347
Merge pull request #792 from filecoin-project/fix/precommit-cancel-commit
Handle reverts in precommit more correctly
2019-12-09 15:53:25 +01:00
Łukasz Magiera
464d06ac44
Merge pull request #806 from filecoin-project/feat/api-env
Add env var for API token and location
2019-12-09 14:56:22 +01:00
Jakub Sztandera
fb7850803e
Add env var for API token and location
Usage: FULLNODE_API_INFO or STORAGE_API_INFO
Content of env var: `<token>:<api multiaddr>`
Example: `FULLNODE_API_INFO="$(cat ~/.lotus/token)dsds:$(cat ~/.lotus/api)"`

License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-09 13:36:56 +01:00
Łukasz Magiera
7d68d9a029 storage: print sector retries in sector info 2019-12-08 23:35:46 +01:00
Jakub Sztandera
7f537dce2d
More renames
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-08 22:48:20 +01:00
Jakub Sztandera
e2bd4b658b
Rename pledge-sector
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-08 15:28:27 +01:00
whyrusleeping
f0653decf3 Clean up storage deal structures 2019-12-07 21:29:37 +01:00
Łukasz Magiera
83924e6b97
sectorbuilder: Allow to restrict task types
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-07 19:05:15 +01:00
Łukasz Magiera
6f024bee58
Merge pull request #736 from filecoin-project/feat/params-v20
Params v20
2019-12-05 14:03:37 +01:00
Łukasz Magiera
310b07cc9c
Fix typo 2019-12-05 12:15:39 +01:00
whyrusleeping
40be53c9f9 add command for power users to manually update sector state 2019-12-04 20:43:54 -08:00
Łukasz Magiera
3daf9103a8 paramfetch: Only pull necessary params 2019-12-04 20:44:15 +01:00
Łukasz Magiera
b2001db9d5 worker: Fix rebaining bugs 2019-12-04 17:53:32 +01:00
Łukasz Magiera
edd30c7aa1 Merge branch 'master' into feat/remote-workers 2019-12-04 14:10:15 +01:00
Łukasz Magiera
42b59342ab
Merge pull request #717 from filecoin-project/feat/sminer-sync-wait
storageminer: Wait for sync
2019-12-04 02:26:30 +01:00
Łukasz Magiera
d112fd18b1 Persist sector sealing errors 2019-12-04 01:44:29 +01:00
Łukasz Magiera
6467a982bc storageminer: Wait for sync 2019-12-04 01:25:18 +01:00
Łukasz Magiera
13c39452c1 storageminer: States for common failure modes 2019-12-04 00:59:40 +01:00
Łukasz Magiera
a7239d7f01 allow setting api host in storageminer 2019-12-03 11:05:35 +01:00
Łukasz Magiera
160e11ce8c Merge branch 'master' into feat/remote-workers 2019-12-03 03:24:00 +01:00
Łukasz Magiera
dab80b30f6 storageminer: print fallback start in info 2019-12-03 02:46:29 +01:00
Łukasz Magiera
5ba4dfdf14 Devnet 9 2019-12-03 01:44:52 +01:00
Łukasz Magiera
923748e551 Expand paths in node init 2019-12-02 23:10:22 +01:00
Łukasz Magiera
24be85e8ec Fix storage miner info for ePoSt 2019-12-02 17:47:09 +01:00
Łukasz Magiera
d5b94884c8 Buch of lint fixes 2019-12-02 13:51:16 +01:00
Łukasz Magiera
a59d0f0f8c Fix unsealing, sector based data refs 2019-12-01 18:58:31 +01:00
whyrusleeping
c92b9d5a0d fix storage miner sectorbuilder construction 2019-11-30 23:55:20 -06:00
whyrusleeping
59d9c681ad Rework miner test setups to fix tests 2019-11-30 17:21:11 -06:00
Łukasz Magiera
ed9279cf0c Some fixes and dev utils 2019-11-30 10:25:31 +01:00
Łukasz Magiera
8767d8c16b Merge branch 'feat/election-post' into feat/remote-workers 2019-11-30 09:42:28 +01:00
Łukasz Magiera
ad978949db import sector/deal into state machines on init 2019-11-29 20:11:42 +01:00
Łukasz Magiera
920fd3ba9b storageminer: New fallback post scheduler 2019-11-28 18:44:57 +01:00
Łukasz Magiera
23e0008b81 Merge remote-tracking branch 'origin/master' into feat/election-post 2019-11-27 13:31:44 +01:00
Łukasz Magiera
03b1d2329f seed: Call AcquireID for sectorIDs 2019-11-27 12:58:16 +01:00
whyrusleeping
249bd8389f Copy over last sector ID key when migrating sectorbuilder 2019-11-26 19:39:07 -06:00
whyrusleeping
a0588d513d Add lotus-gen, rewire genesis mining 2019-11-24 22:45:13 -06:00
Łukasz Magiera
d4197bbadc Working remote PreCommit 2019-11-21 19:38:50 +01:00
Łukasz Magiera
98b1de33b6 Stats for remote workers 2019-11-21 17:23:42 +01:00
Łukasz Magiera
ba3ad75670 remote-worker: wire up storage miner endpoints 2019-11-21 15:10:51 +01:00
Łukasz Magiera
37792b149f sync: fix some issues 2019-11-20 20:49:29 +01:00
wanghui
ba889391b5 update imports and path 2019-11-16 14:47:04 +08:00
Frank
c9714b1708
Update cmd/lotus-storage-miner/init.go
Co-Authored-By: Łukasz Magiera <magik6k@users.noreply.github.com>
2019-11-16 14:16:18 +08:00
wanghui
b28ce76e8a clean up repo if miner init fail and use log 2019-11-15 19:54:12 +08:00
whyrusleeping
797d92b463 persist blocks as they come in 2019-11-14 19:19:16 -08:00
Jakub Sztandera
bc3dac0426
Add --tests-also for fetch-params
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-11-14 02:15:33 +01:00
Łukasz Magiera
37c0967fa8
Merge pull request #595 from filecoin-project/feat/small-fixes
Bunch of small fixes / improvements, gofmt
2019-11-13 19:15:50 +01:00
Jakub Sztandera
a58e165339
Restore api flags
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-11-13 16:37:40 +01:00
Łukasz Magiera
8f0e3ede24 Bunch of small fixes / improvements, gofmt 2019-11-13 15:48:57 +01:00
whyrusleeping
e1cb19da0a Exit 1 on error 2019-11-12 15:36:49 -08:00
Łukasz Magiera
73ab6c0c66 WorkerCount on storageminer config 2019-11-12 18:59:38 +01:00
Łukasz Magiera
b8f46bff26 storageminer: Drop sortedSectorInfo log 2019-11-11 18:32:46 +01:00
Łukasz Magiera
b8e18ed773 storageminer: Don't print PP in info cmd if not proving 2019-11-11 12:10:48 +01:00
Łukasz Magiera
81bd0bc517 Test to reproduce post error after restart 2019-11-09 11:42:36 +01:00
Łukasz Magiera
3f4d454f6e storageminer: Print proving period in info cmd 2019-11-09 10:49:43 +01:00
Łukasz Magiera
59fbc976d0 storageminer: Missing new line in info cmd 2019-11-09 10:02:55 +01:00
Łukasz Magiera
ed64e52e3a sectorbuilder: apply some review suggestions 2019-11-09 00:21:04 +01:00
Łukasz Magiera
27485777f0 Merge remote-tracking branch 'origin/master' into feat/interactive-porep 2019-11-08 21:45:06 +01:00
Łukasz Magiera
8c39486736 some import fixes 2019-11-08 21:11:56 +01:00
Łukasz Magiera
071f05fa95 Storage miner API improvements 2019-11-08 19:23:58 +01:00
whyrusleeping
e226071c20 disable GPU by default 2019-11-08 08:43:23 -08:00
wanghui
66f8e348a2 update size and unit 2019-11-07 20:05:03 +08:00
Frank
08ff772cf4
Update cmd/lotus-storage-miner/info.go
update sector size format

Co-Authored-By: Łukasz Magiera <magik6k@users.noreply.github.com>
2019-11-07 19:33:44 +08:00
wanghui
f221c05a33 add sector size info 2019-11-07 18:46:11 +08:00
whyrusleeping
9863942fe2 WIP: trying to write a test to reproduce the storage deal error 2019-11-07 00:39:34 +01:00
Łukasz Magiera
ed5ccfd750 Merge remote-tracking branch 'origin/devnet/7' into feat/interactive-porep 2019-11-05 18:53:19 +01:00
Łukasz Magiera
c76ce2a2eb rate-limit some sectorbuilder ops 2019-11-04 18:36:29 +01:00
Łukasz Magiera
13da5a5966 Put WorkerThreads on sectorbuilder.Config 2019-11-04 17:47:08 +01:00
whyrusleeping
fc9091cc89 Get interactive porep sector sealing mostly working 2019-10-31 20:57:10 -07:00
Łukasz Magiera
46d782b30b storageminer: Drop commitment tracker 2019-10-30 18:37:38 +01:00
Jakub Sztandera
3ea0997c93
Add support for different configs
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-10-30 17:38:39 +01:00
Łukasz Magiera
413314b44b
Merge pull request #494 from filecoin-project/feat/handle-uncommited
storageminer: Handle uncommited sectors on start
2019-10-30 15:32:34 +01:00
Łukasz Magiera
44f4ee0de1 storageminer: cmd to list sector commitments 2019-10-29 21:41:30 +01:00
Łukasz Magiera
391c73774d Set swarm log level to WARN 2019-10-29 20:51:44 +01:00
Łukasz Magiera
8e1a9a71e6 Run store-garbage in background 2019-10-29 18:52:07 +01:00
Łukasz Magiera
874be79958 very basic sector seal scheduling 2019-10-27 09:56:53 +01:00
whyrusleeping
874ab1456c WIP: updating to new proofs code 2019-10-25 18:07:34 +02:00
whyrusleeping
4890f577f5 give miners the ability to select different sector sizes 2019-10-25 17:26:15 +02:00
Łukasz Magiera
c41dd4efeb actora: register storagemarket 2019-10-23 12:44:00 +02:00
Łukasz Magiera
aab3bd617a REST file import endpoint 2019-10-23 11:39:44 +02:00
Whyrusleeping
d891589cef
Merge pull request #412 from filecoin-project/feat/init-fail-cleanup
Clean up after failed storage miner init
2019-10-18 16:08:18 +09:00
whyrusleeping
098e05c4d7 Clean up after failed storage miner init 2019-10-18 14:13:36 +09:00
Jakub Sztandera
1bf713cb0a
Cleanup imports after rename
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-10-18 13:47:41 +09:00
Łukasz Magiera
f620ecea5e Devnet 6 2019-10-17 03:09:17 +02:00
whyrusleeping
2ac4ce122f check return code of create storage miner call 2019-10-16 16:45:48 +09:00
Łukasz Magiera
71182f69cc
Merge pull request #378 from filecoin-project/fix/miner-info-format
Fix percentage display
2019-10-15 17:30:31 +02:00
Jakub Sztandera
b582620e77
Fix percentage display
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-10-15 16:51:47 +02:00
Łukasz Magiera
a576b72364 actors: Sync with the new spec, storage actors 2019-10-15 14:31:34 +02:00
whyrusleeping
e8a1b54740 Add more info to storage-miner info command output 2019-10-14 11:32:32 +09:00
Łukasz Magiera
5861332f40 sminer: info command 2019-10-12 01:47:29 +02:00
whyrusleeping
14c4a8bee6 implement looking in the past for messages 2019-10-09 09:33:18 +02:00
whyrusleeping
e17fc950b3 Add pprof server to storage miner 2019-10-05 10:08:55 -06:00
whyrusleeping
697bed27a6 fix websocket closing 2019-10-04 10:06:05 -06:00
Łukasz Magiera
1534536590 Store libp2p key in keystore 2019-10-03 02:11:31 +02:00
Łukasz Magiera
713f08e9bf move genesis loading to build pkg 2019-10-02 22:40:14 +02:00
Łukasz Magiera
05878f4320 Built in paramfetch 2019-10-02 19:20:30 +02:00
Łukasz Magiera
1024812559 storageminer: Update post scheduling 2019-09-26 23:32:47 +02:00
Łukasz Magiera
18211b7bee storageminer: Fix PledgeCollateral calc on init 2019-09-26 12:13:43 -07:00
Łukasz Magiera
ad1265cad0 storageminer: Flags to allow specyfying keys to use 2019-09-26 16:31:13 +02:00
Łukasz Magiera
78e1ea14ad storageminer: Make worker key creation optional 2019-09-26 02:47:53 +02:00
Łukasz Magiera
9a990dbd8a use new sectorbuilder file interfaces 2019-09-23 12:50:28 +02:00
Łukasz Magiera
5e2c100f4d storageminer: Better context handling 2019-09-17 20:36:06 +02:00
Łukasz Magiera
037fa84e68 storageminer: Remove node shutdown hack 2019-09-17 20:28:21 +02:00
Łukasz Magiera
83f1a336a6 node: Basic graceful shutdown 2019-09-17 16:23:08 +02:00
Łukasz Magiera
5ea1459275 Use atomic moppl API in more places 2019-09-17 10:15:26 +02:00
whyrusleeping
a47969c76b finish up making the new serializations work 2019-09-10 16:03:17 -07:00
whyrusleeping
ed45d1c2b4 refactor state utilities into StateManager package, implement proper election proofs 2019-09-09 19:14:00 -07:00
Łukasz Magiera
6a4af984af storageminer: Fix init 2019-09-06 19:42:03 +02:00
Łukasz Magiera
c0566399c6 retrieval: Way to get the data 2019-08-29 17:50:19 +02:00
Łukasz Magiera
cad3efb9ba Command to list sealed blocks 2019-08-29 17:48:19 +02:00
Łukasz Magiera
28409a60b1 Use BLS in more places 2019-08-22 00:47:44 +02:00
Łukasz Magiera
f43757f9f2 storageminer: Unregister genesis miner in init 2019-08-20 20:17:59 +02:00
Łukasz Magiera
eda26faf21 Register miner address from storageminer process 2019-08-20 19:19:24 +02:00
whyrusleeping
5920537bc5 fix gas limit in create storage miner call 2019-08-19 11:06:39 -07:00
whyrusleeping
4f91550851 fix waiting for bls signed message 2019-08-16 15:10:34 -07:00
whyrusleeping
b271e5231a set up lotus-storage-miner to be able to use an existing miner actor 2019-08-16 14:50:00 -07:00
whyrusleeping
959fe371b0 move storage miner keys to full node 2019-08-08 10:56:14 -07:00
Łukasz Magiera
cdc535394d deals: fix statestore 2019-08-07 20:01:51 -07:00
Łukasz Magiera
5811f18b5e Address some review comments 2019-08-07 20:01:22 -07:00
Łukasz Magiera
37a7ee08ec Bootstrap storageminer with full node 2019-08-07 20:01:22 -07:00
Łukasz Magiera
322031d8e4 Fix storageminer cli 2019-08-07 20:01:22 -07:00
Łukasz Magiera
282654bf7b pond: storage miner init 2019-08-02 16:15:14 +02:00
Whyrusleeping
eb854467c8
Update cmd/lotus-storage-miner/run.go
Co-Authored-By: Łukasz Magiera <magik6k@users.noreply.github.com>
2019-07-30 10:18:01 -07:00
whyrusleeping
ee224e5b21 Implement 'storage miner' module, wire up a few bits it needs to start 2019-07-29 17:46:56 -07:00
whyrusleeping
8e840139bd appease go's format checker 2019-07-29 12:08:47 -07:00
whyrusleeping
b83ff6b9dc Wire up sector builder commands through the api 2019-07-29 12:08:47 -07:00
Łukasz Magiera
26232f0b9a storageminer: GetStorageMinerAPI for cli 2019-07-29 12:08:47 -07:00
whyrusleeping
4fb4835b35 can we store it? YES WE CAN 2019-07-29 12:08:47 -07:00
whyrusleeping
0c67d66198 Make message wait work and use it for the storage-miner init 2019-07-29 11:58:30 -07:00
Whyrusleeping
508e19f52f
Merge pull request #89 from filecoin-project/feat/chain-gen
Implement a chain generator
2019-07-29 09:57:40 -07:00
whyrusleeping
9ccd06b060 start method IDs at 1, to allow 0 for basic transfers 2019-07-26 14:42:38 -07:00
Łukasz Magiera
9ea5dbf902 chain: Benchmark chain gen 2019-07-26 13:47:29 -07:00
Jakub Sztandera
0e35240fe9 Wire in context to VMContext
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2019-07-26 21:01:02 +02:00
whyrusleeping
a0c1afff57 clean up which addresses get used where 2019-07-26 10:33:54 -07:00
Łukasz Magiera
a825b3b550 storageminer: Post-rebase update 2019-07-26 15:26:01 +02:00
Łukasz Magiera
283c4e4194 storageminer: Setup actor on init 2019-07-26 15:26:01 +02:00
Łukasz Magiera
7ec9d45915 gofmt 2019-07-25 14:54:19 +02:00
Łukasz Magiera
93a8ee11db jsonrpc: Work with browsers 2019-07-24 19:09:00 +02:00
Łukasz Magiera
4fa9e45eb7 repo: check for config in exists 2019-07-24 13:20:00 +02:00
Łukasz Magiera
c6b4fadba1 Fix permissions after split and rebase 2019-07-24 03:10:26 +02:00
Łukasz Magiera
772dd6c549 Implement storage miner API in node 2019-07-24 02:58:31 +02:00
Łukasz Magiera
f0e807dabb Fix jsonrpc client after splitting apis 2019-07-24 02:40:19 +02:00
Łukasz Magiera
d0cbf02d36 Don't build full API in storage miner 2019-07-24 01:48:59 +02:00
Łukasz Magiera
8d529d1ae7 gofmt 2019-07-24 01:47:36 +02:00
Łukasz Magiera
4c8b028887 Return error form Repo.Exists 2019-07-24 01:47:36 +02:00
Łukasz Magiera
4f1946d5a2 Address review 2019-07-24 01:47:36 +02:00
Łukasz Magiera
677f5c3e30 Check full node version in storageminer init 2019-07-24 01:47:36 +02:00
Łukasz Magiera
0e570c0b19 StorageMiner init code 2019-07-24 01:47:36 +02:00
Łukasz Magiera
486598ef53 storageminer: separate env var for storage repo 2019-07-24 01:47:36 +02:00
Łukasz Magiera
b73f29286b Begin implementing storage miner 2019-07-24 01:47:36 +02:00