Commit Graph

330 Commits

Author SHA1 Message Date
Łukasz Magiera
cfdbc2312d Merge branch 'master' into next 2020-07-01 11:22:57 +02:00
Łukasz Magiera
8f0e04027e
Merge pull request from laser/feat/1920-selection-commands
implement toggling of online/offline storage/retrieval deals
2020-07-01 11:06:32 +02:00
Łukasz Magiera
24529bf35d Merge branch 'next' into feat/specs-actors-v0.7.0 2020-06-29 22:45:50 +02:00
laser
5052a87a82 bugfix: accessors should be read and writers should be admin 2020-06-26 12:33:39 -07:00
laser
b9180a99d4 toggle consideration of offline storage/retrieval deal proposals 2020-06-26 12:27:41 -07:00
laser
e910a045d0 big rename to allow for later introducing the "consider offline" config 2020-06-26 10:50:54 -07:00
laser
5d9a775699 replace enable/disable commands with selection commands 2020-06-26 10:33:06 -07:00
Łukasz Magiera
5d6fcbeccf Change initial pledge calc to PrecommitInfo 2020-06-26 18:00:50 +02:00
Łukasz Magiera
24f4c96fc3 apitest: auto-start sealing precoss 2020-06-26 17:28:05 +02:00
Łukasz Magiera
6893dbb657 api: MsigCrate required param is now uint64 2020-06-26 15:52:22 +02:00
Aayush Rajasekaran
e3c897fb68 Change StateReadState to take an address, not an actor 2020-06-25 13:49:15 -04:00
laser
176d0bb7c0 add "lotus-storage-miner retrieval-deals" subcommands
- enable retrieval
- disable retrieval
2020-06-24 08:08:10 -07:00
Łukasz Magiera
6f8c464393 Merge remote-tracking branch 'origin/master' into feat/sector-remove 2020-06-23 23:54:27 +02:00
Łukasz Magiera
f8e7901b89 Address review 2020-06-23 14:44:34 +02:00
Łukasz Magiera
5adc188466 miner: Command to remove sectors 2020-06-22 19:35:14 +02:00
Łukasz Magiera
101ba0b796 Update deps to support removing sectors 2020-06-22 19:03:35 +02:00
laser
de7d6c255c blacklist -> blocklist 2020-06-18 15:51:01 -07:00
laser
0c8d648998 specify which CID is being blacklisted (it's the piece) 2020-06-18 14:02:22 -07:00
laser
b0edf924b4 add commands for manipulating storage deal CID blacklist 2020-06-18 13:15:18 -07:00
Łukasz Magiera
02234d00b7 Merge remote-tracking branch 'origin/master' into next 2020-06-17 20:50:42 +02:00
Łukasz Magiera
d4644a28c1
Merge pull request from laser/feat/2027-manipulate-ask
add ask-manipulating (and printing) deal subcommands
2020-06-17 20:03:51 +02:00
Łukasz Magiera
8b8bb5e833 rpc: add Closing method 2020-06-17 17:47:18 +02:00
laser
5eceed81e1 add "get-ask" command 2020-06-16 17:23:03 -07:00
laser
6253c39100 replace "set-price" with "set-ask"
Fixes 
2020-06-16 16:13:21 -07:00
Ignacio Hagopian
9d17e0be9d
ClientMinerQueryOfer API & CLI support
Signed-off-by: Ignacio Hagopian <jsign.uy@gmail.com>
2020-06-16 11:14:49 -03:00
Łukasz Magiera
0230362d33
Merge pull request from filecoin-project/deps/specs-actors-v0.6
specs-actors v0.6
2020-06-15 21:30:37 +02:00
Łukasz Magiera
907364ce67 Update deps, fix more tests 2020-06-15 18:30:49 +02:00
laser
36b327b57b various symbol renames 2020-06-11 13:18:18 -07:00
laser
7587e6c08b get and set storage deal acceptance through CLI 2020-06-11 12:59:50 -07:00
Aayush Rajasekaran
5cf76ba8b3 Create an api.MinerInfo that has peerID as a Peer ID 2020-06-09 19:07:53 -04:00
Łukasz Magiera
28f895cec2 Update sector-storage with better post faults 2020-06-08 23:20:19 +02:00
Łukasz Magiera
3b56288a5e Merge remote-tracking branch 'origin/master' into next 2020-06-08 18:29:36 +02:00
Aayush Rajasekaran
49b27da426 Add delete functionality to the wallet 2020-06-07 19:36:01 -04:00
Łukasz Magiera
3b13397165 gofmt 2020-06-06 00:59:01 +02:00
Łukasz Magiera
7ae9d26cd1 Merge remote-tracking branch 'origin/next' into fix/sealing-betterering 2020-06-05 14:00:47 +02:00
Łukasz Magiera
9e5cc7c910 Update fsm, sector-storage 2020-06-05 10:46:45 +02:00
Jakub Sztandera
7bee5b3abc
Merge remote-tracking branch 'origin/master' into next
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-06-05 00:33:43 +02:00
Łukasz Magiera
f9f0d86ddf
Merge pull request from acruikshank/feat/1853-confirmations-in-StateWaitMsg2
Add confidence and timeout to message wait
2020-06-04 23:23:15 +02:00
Łukasz Magiera
fa3b1552cf Update sector-storage intefraces 2020-06-04 21:26:29 +02:00
acruikshank
04f0130530 remove timeout 2020-06-03 17:42:06 -04:00
acruikshank
5574e4f11b add confidence and timeout to message wait 2020-06-03 15:38:37 -04:00
Jakub Sztandera
186fd4da74
Add lotus net scores for pubsub score visibility
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-06-03 03:13:49 +02:00
laser
38d714a28a first take at "daemon stop" command
Fixes 

TODO: plumb the daemon-stopping into lotus-storage-miner, too
2020-06-02 12:29:58 -07:00
Łukasz Magiera
7003960fdd Merge remote-tracking branch 'origin/master' into next 2020-06-01 18:52:06 +02:00
Aayush Rajasekaran
ec0baefc48 Add an API method to list all faults occuring in a certain range 2020-05-31 00:57:52 -04:00
Łukasz Magiera
f7a71f4be7
Merge pull request from filecoin-project/feat/secstor-unseal
Update sector-storage with ReadPiece impl
2020-05-29 20:36:40 +02:00
Łukasz Magiera
e5c24ff32b Update sector-storage with ReadPiece impl 2020-05-29 19:53:35 +02:00
Łukasz Magiera
785eeb1eee
Merge pull request from filecoin-project/chore/lint
Cleanup many lint warnings
2020-05-29 18:06:06 +02:00
Jeromy
e2a554c2e6 update specs actors to version with batch porep verification 2020-05-28 13:19:18 -07:00
Ignacio Hagopian
10753f14d0 retrieve: make fileref optional
Signed-off-by: Ignacio Hagopian <jsign.uy@gmail.com>
2020-05-28 22:11:49 +02:00
Jakub Sztandera
d6615b6286
Cleanup many lint warnings
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-05-27 22:53:20 +02:00
Ignacio Hagopian
bcd84cbe9d
retrieve: make fileref optional
Signed-off-by: Ignacio Hagopian <jsign.uy@gmail.com>
2020-05-26 14:52:52 -03:00
Łukasz Magiera
f7325a69c1 Extract auth utils to go-jsonrpc 2020-05-20 20:37:45 +02:00
Łukasz Magiera
ae60001dcc post: Handle Recovering sectors 2020-05-20 18:41:20 +02:00
Aris
e7065df2d4 Added RPC calls for MsigCreate, MsigPropose, MsigApprove, and MsigCancel 2020-05-11 10:27:48 -04:00
Łukasz Magiera
7747c3eb40 Update sector-storage 2020-05-08 21:28:14 +02:00
hannahhoward
a9866c757e feat(deps): update go-fil-markets
Update to latest 0.2.0 release of go-fil-markets with less-blocking node io
2020-05-04 18:36:51 -07:00
Łukasz Magiera
9f2df68906 workers: handle disconnecting workers more gracefully 2020-05-01 20:15:06 +02:00
Łukasz Magiera
068e9a29d2 Merge remote-tracking branch 'origin/testnet/3' into feat/storage-better-fetch 2020-04-29 13:27:49 +02:00
Łukasz Magiera
9dcb42328e gofmt 2020-04-28 19:27:13 +02:00
Łukasz Magiera
8d35aacd31 Update sector-storage with better fetch logic 2020-04-28 14:57:53 +02:00
Łukasz Magiera
55f7c81aaf specs-actors: Fix miner cron on null blocks 2020-04-24 19:12:30 +02:00
Łukasz Magiera
a28e64227b apistruct: Check tags in tests 2020-04-24 02:41:18 +02:00
Łukasz Magiera
da7db5fa98 Merge remote-tracking branch 'origin/testnet/3' into feat/check-deps 2020-04-24 00:59:15 +02:00
Łukasz Magiera
96f9d58066 Merge pull request from filecoin-project/feat/estimate-gas-price-api
add an api for estimating gas prices
2020-04-24 00:47:27 +02:00
Jeromy
f4948dcba0 remove api dependency on sealing fsm package 2020-04-23 15:33:59 -07:00
Łukasz Magiera
309f54aa0c Update sector-storage 2020-04-23 15:29:31 -07:00
Jeromy
ef1d485c6e move head change type out of chainstore package 2020-04-23 15:28:59 -07:00
Łukasz Magiera
c137b0cf73 Merge remote-tracking branch 'origin/testnet/3' into feat/newminer 2020-04-23 23:53:23 +02:00
Łukasz Magiera
86e7f5914b testing: test 2-miner mining 2020-04-23 23:20:02 +02:00
Whyrusleeping
faa9002cce working on sector pledge requirements after specs-actors 1.0.0 ()
* WIP: working on sector pledge requirements after specs-actors 1.0.0

* update storage-fsm with pledge collateral logic

* Set bigger balances for miners

* Return only additional required pledge

* split collateral methods into two methods

Co-authored-by: Łukasz Magiera <magik6k@gmail.com>
2020-04-23 12:39:34 -07:00
Jeromy
1d5059c281 add tipsetkey to estimate gas api 2020-04-22 15:37:59 -07:00
Jeromy
7e7caa8859 more expressive estimate gas api 2020-04-22 15:28:51 -07:00
Jeromy
2a97045317 add an api for estimating gas prices 2020-04-22 09:37:38 -07:00
Łukasz Magiera
c406b875fa gofmt, mod tidy 2020-04-21 19:23:49 +02:00
Łukasz Magiera
8be9494672 windowed post: Get correct sector set 2020-04-21 19:22:53 +02:00
Jeromy
91f56742c4 Use lookback to get sector set and power for miners 2020-04-17 16:44:18 -07:00
Łukasz Magiera
3b7ae0d6d9 mod tidy, gofmt 2020-04-18 00:02:43 +02:00
Łukasz Magiera
93b2b6d65d Merge branch 'testnet/3' into feat/windowed-post 2020-04-17 18:38:20 +02:00
Łukasz Magiera
dc2a67f13f Fix worker key resolving 2020-04-16 22:38:42 +02:00
Łukasz Magiera
afdfc8807d api: Single method for static miner info 2020-04-16 19:36:36 +02:00
Łukasz Magiera
246a9f0e45 gofmt 2020-04-15 22:41:20 +02:00
Łukasz Magiera
85993848be bring back api.StateMinerProvingSet 2020-04-15 22:40:46 +02:00
Łukasz Magiera
0336b32fcd windowpost: Wire up challenge generation 2020-04-15 22:22:58 +02:00
Łukasz Magiera
149bb56b8e wip updates to sector set handling 2020-04-15 21:59:11 +02:00
Aayush Rajasekaran
fc933858e1 Add an API method to calculate piece CIDs 2020-04-15 14:00:42 -04:00
Łukasz Magiera
349b2890bf Drop 'rewards list' for now 2020-04-13 22:43:27 +02:00
Jeromy
c5c18659a4 address some review 2020-04-08 17:24:10 -07:00
Jakub Sztandera
ce4978d8c3 Reintroduce correct ticket randomness alongside ElectionProof
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-04-08 21:06:41 +02:00
Jakub Sztandera
afdb1db529 drand wip
,
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-04-07 15:32:23 -07:00
Jeromy
7075eaba26 WIP: random beacon interface
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-04-07 15:32:23 -07:00
laser
110c869dd3 cut over to storage-fsm, deleting local sealing package 2020-04-07 09:34:09 -07:00
laser
f53250ee90 reorder imports 2020-04-06 13:27:14 -07:00
laser
dcd9e7da27 miscellaneous fixes post-rebase 2020-04-06 13:23:37 -07:00
Łukasz Magiera
f05be81275 fsm: Get correct interactive randomness if it lands on a nullblock 2020-04-04 04:57:05 +02:00
Jeromy
5b9ee1dea9 Add GetMiningBaseInfo api and use it for mining 2020-04-01 18:15:25 -07:00
Łukasz Magiera
13f2c21e1d Get network name from genesis 2020-04-01 01:15:49 +02:00
Łukasz Magiera
95ee1c1cde Extract sector-storage 2020-03-28 01:32:39 +01:00
Łukasz Magiera
c66d3dfad7 sectorstorage: Untangle from lotus deps 2020-03-27 22:35:33 +01:00
Łukasz Magiera
4be54a976c Merge sectorbuilder into sectorstorage 2020-03-26 03:51:06 +01:00
Łukasz Magiera
201d0a4b19 Merge remote-tracking branch 'origin/testnet/3' into feat/new-workers 2020-03-25 01:02:23 +01:00
Łukasz Magiera
726c9c1fe7 workers: Address review 2020-03-24 19:01:04 +01:00
Aayush Rajasekaran
d350a9d415 Re: : Add a non-blocking version of StateWaitMsg
- This commit adds a new method called StateSearchMsg
- We can probably overhaul StateWaitMsg onto this new method at a later point in time
2020-03-24 06:43:15 -04:00
Łukasz Magiera
8559c89560 storageminer: More storage stats in storage list 2020-03-23 23:43:38 +01:00
Łukasz Magiera
a3ba8eb0d7 workers: Basic monitoring tools 2020-03-23 15:56:22 +01:00
Łukasz Magiera
5e4a7e54df Rename agvmgr+sealmgr to sectorstorage 2020-03-23 12:47:10 +01:00
Łukasz Magiera
971fe6fdfd workers: Drop sectors from origin after transfers 2020-03-22 05:27:28 +01:00
Łukasz Magiera
c57c0e7f55 workers: Memory based scheduling 2020-03-20 23:30:17 +01:00
Łukasz Magiera
076cc428af workers: Fix moving storage around in later steps 2020-03-20 01:55:49 +01:00
Łukasz Magiera
978a718159 storage: storage find command 2020-03-19 20:51:33 +01:00
Łukasz Magiera
d87b7c264d stores: Use index in local store 2020-03-19 16:11:04 +01:00
Łukasz Magiera
5f2caffb51 Fix tests after specs-storage changes 2020-03-18 02:08:11 +01:00
Łukasz Magiera
d8ce5078d9 Use new specs-storage interface 2020-03-17 21:19:52 +01:00
Łukasz Magiera
de1c984b48 workers: Handle init on first run 2020-03-16 19:46:02 +01:00
Łukasz Magiera
7e997e40f3 workers: Simple storage diagnostics 2020-03-16 18:50:07 +01:00
Łukasz Magiera
2c7f579838 workers: Implement SectorIndex 2020-03-13 12:59:19 +01:00
Łukasz Magiera
a75ad492f1 workers: Declare sectors after fetching in remote store 2020-03-13 11:40:24 +01:00
Łukasz Magiera
bc7fede68b workers: Wire up most pieces 2020-03-13 02:37:38 +01:00
Łukasz Magiera
7e2e30f94b workers: Transfer logic refactoring 2020-03-11 06:49:17 +01:00
Łukasz Magiera
eb61a36fd7 workers: RPC scaffolding 2020-03-11 02:58:02 +01:00
whyrusleeping
26ca72e252 make state power a pointer so it marshals properly 2020-03-09 14:41:57 -07:00
Whyrusleeping
3a94d9d176 Merge pull request from filecoin-project/feat/state-compute-trace
implement compute state trace output
2020-03-08 21:22:40 -07:00
whyrusleeping
4260cc38c9 implement compute state trace output 2020-03-08 20:07:25 -07:00
Łukasz Magiera
cb1e797d72 Merge pull request from filecoin-project/feat/merge-master
Merge master back into testnet/3
2020-03-08 09:05:46 +01:00
whyrusleeping
24bf720a9a Merge branch 'master' into testnet/3 2020-03-07 16:46:12 -08:00
Whyrusleeping
c553a6f458 Merge pull request from filecoin-project/feat/chain-get-types
add some type info to chain get
2020-03-07 16:10:00 -08:00
Whyrusleeping
0b5991850c Merge pull request from filecoin-project/feat/stat-cmd
Add stat-obj to API and a few extras
2020-03-06 18:55:48 -08:00
whyrusleeping
cdd37bda1c add some type info to chain get 2020-03-06 18:47:19 -08:00
Travis Person
7628a64a55 cmd: add stat-obj 2020-03-07 00:43:44 +00:00
hannahhoward
9f5f70a93f feat(client): add car import/export option
adds option on client file import and client retrieval to read/write to CAR file
2020-03-06 13:14:02 -08:00
Aayush Rajasekaran
2d63b007f2 Unify MethodCall and ReplayResults into SimulationResult
- Call and Replay now return the same type, which includes both Message and MessageReceipt
2020-03-06 11:10:40 -08:00
whyrusleeping
1183e082af add command to inspect and redeem block rewards 2020-03-05 21:32:52 -08:00
Łukasz Magiera
1461e475da storage: Support adding paths at runtime 2020-03-05 23:02:01 +01:00
Łukasz Magiera
a5e5918fc5 mod tidy; gofmt 2020-03-05 20:21:06 +01:00
Łukasz Magiera
799ff17c7c Merge remote-tracking branch 'origin/testnet/3' into feat/4stage-seal 2020-03-04 06:37:11 +01:00
whyrusleeping
9169a073b6 add miner side commands and a few other goodies 2020-03-03 18:49:00 -08:00
whyrusleeping
2be2891647 wire up lotus side of make deal for manual commP 2020-03-03 16:18:08 -08:00
whyrusleeping
99c842e027 integrate client interface to allow for offline deals 2020-03-03 16:18:08 -08:00
Łukasz Magiera
3abb59a550 sealmgr: Interfaces; simple initial impl 2020-03-03 01:46:58 +01:00
Aayush Rajasekaran
fe8db295e7 Re: : Add a lotus wallet verify API and CLI command
- The command takes an address, message, and signature, and returns true if the sig is valid
2020-02-28 15:56:15 -08:00
whyrusleeping
0945d8725e fixing miner logic to make more tests pass 2020-02-28 11:31:28 -08:00
Łukasz Magiera
0a9e0acc6f types: Drop some redundant alias types 2020-02-25 22:09:22 +01:00
Łukasz Magiera
5d9b869d93 gofmt; mod tidy 2020-02-24 18:45:42 +01:00
Łukasz Magiera
d787aa5007 Merge branch 'testnet/3' into feat/specs-actors 2020-02-24 18:32:02 +01:00
Łukasz Magiera
917df9a5b8 More unified randomness handling 2020-02-23 21:00:47 +01:00
Łukasz Magiera
18627e77ff gofmt; mod tidy 2020-02-21 20:28:20 +01:00
Łukasz Magiera
104871d6c9 paych: Lanes are back to u64 2020-02-21 18:26:44 +01:00
whyrusleeping
00d7bd1a77 chain/gen tests now pass! 2020-02-20 00:37:10 -08:00
Aayush Rajasekaran
c742d45b19 Re: : Add a FindPeer RPC method
- Given a Peer ID, this method looks into the DHT to find that peer's addresses
- This commit also adds a CLI command to use this new RPC endpoint
2020-02-18 16:31:42 -05:00
Aayush Rajasekaran
60970008c8 Re: : API methods should receive TipSetKeys, not TipSets, as input 2020-02-17 19:53:43 -05:00
Whyrusleeping
4750f32ab6
Merge pull request from filecoin-project/feat/bad-ts-cache-reasons
mark down reason for block inclusion in bad tipset cache
2020-02-17 12:20:20 -08:00
Travis Person
d6cf76a91a cmd: add log command
Add a log command to the common api which allows for listing all
initialized golog subsystems, and setting their log level during
runtime.

Command description also adds golog environment variable documentation.
2020-02-15 06:04:55 +00:00
Łukasz Magiera
e5ab64a3ab Fix client market impl, gofmt 2020-02-13 01:15:33 +01:00
Łukasz Magiera
0d6cfc879d Use specs-actors ignatures 2020-02-13 00:52:36 +01:00
whyrusleeping
243b295559 expose bad block cache reasons through api/cli 2020-02-11 23:44:55 -08:00
Łukasz Magiera
c72727b4fd specs-actors: Fix most compilation errors 2020-02-09 07:06:32 +01:00
Łukasz Magiera
41daf5ad28 gofmt 2020-02-08 03:18:37 +01:00
Łukasz Magiera
13435aebdc Spec Actors integration 2020-02-08 03:18:32 +01:00
Łukasz Magiera
90ecfbe0e4 Merge branch 'master' into feat/new-sb-fs 2020-02-04 04:15:25 +01:00
Łukasz Magiera
a8d18c8ac9 api-backed blockstore 2020-02-04 03:47:59 +01:00
whyrusleeping
b5f9a385ae add a method to query available multisig balance 2020-01-29 17:23:16 -08:00
Łukasz Magiera
4aaa758543 fpost: better fault checks 2020-01-30 01:50:58 +01:00
Łukasz Magiera
fd0bfc8777
Merge pull request from filecoin-project/feat/state-call-cmd
implement state call command for easy method calling
2020-01-21 17:16:54 +01:00
whyrusleeping
57812fc61d chain export should work now 2020-01-20 15:51:28 -08:00
whyrusleeping
0a45e97699 implement state call command for easy method calling 2020-01-17 18:27:29 -08:00
whyrusleeping
fb173c058e WIP: blizzard fork changes and test utilities 2020-01-16 18:33:43 -08:00
jsign
08b99ff413 new api to calculate arbitrary forks revert and applys
Signed-off-by: jsign <jsign.uy@gmail.com>
2020-01-14 21:24:08 -03:00
Łukasz Magiera
117bea4e4e
Merge pull request from filecoin-project/feat/chain-list-messages
implement list-messages command
2020-01-08 13:50:55 +01:00
Łukasz Magiera
86a22a3896
Merge pull request from filecoin-project/feat/mpoolpush-cid
mpool: Return CID in MpoolPush
2020-01-08 13:43:03 +01:00
whyrusleeping
95a89ad192 implement list-messages command 2020-01-08 13:41:23 +01:00
Łukasz Magiera
4de01190a1
api: Require admin perm for SyncMarkBad 2020-01-08 13:34:53 +01:00
whyrusleeping
897cf72933 Add command to mark given blocks as bad 2020-01-07 21:42:15 -08:00
Łukasz Magiera
a11e8093e5 mpool: Return CID in MpoolPush 2020-01-07 21:10:30 -08:00
acruikshank
7873213b11 switch sectorbuilder from lib to external module
point to correct version of sectorbuilder + ensure go-datastore stays at 0.1.1

replace local address type with go-address

consume paramfetch.GetParams instead of local paramfetch.go

remove constants now defined in sectorbuilder
2020-01-07 07:48:43 -08:00
hannahhoward
8418464d91 refactor(address): use extracted address library
Switch to using extracted address library
2020-01-07 14:53:27 +01:00
Łukasz Magiera
81233b894d Implement 'chain get' for easier ipld digging 2019-12-19 17:58:02 +01:00
jsign
40289848c6
client: make wallet addr be a param in ClientStartDeal
Signed-off-by: jsign <jsign.uy@gmail.com>
2019-12-13 16:15:56 -03:00
Łukasz Magiera
fc6073d13b chainwatch: Collect sector set sizes 2019-12-12 00:32:09 +01:00
Łukasz Magiera
5b90121577 Set devnet params 2019-12-10 00:02:35 +01:00
Łukasz Magiera
c49dc28a04 Move api struct to a seprate pkg 2019-12-09 18:22:11 +01:00