cerc-io/lotus
16
0
Fork 0
Code Issues Pull Requests Packages Projects Releases 27 Wiki Activity
4,333 Commits 24 Branches 342 Tags 314 MiB
0cc8446a79
Commit Graph

885 Commits

Author SHA1 Message Date
Łukasz Magiera
0336b32fcd windowpost: Wire up challenge generation 2020-04-15 22:22:58 +02:00
Łukasz Magiera
149bb56b8e wip updates to sector set handling 2020-04-15 21:59:11 +02:00
Whyrusleeping
8a83415596 Merge pull request #1541 from filecoin-project/feat/drand-2 
real drand network integration
 2020-04-15 11:22:00 -07:00
Aayush Rajasekaran
fc933858e1 Add an API method to calculate piece CIDs 2020-04-15 14:00:42 -04:00
Jakub Sztandera
08e74a90f9 Add missing files 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-04-15 16:13:20 +02:00
Jeromy
4e6839b5ef some small cleanup 2020-04-14 15:13:52 -07:00
Jakub Sztandera
0c5e3e2533 Make tests use mock beacon 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-04-14 20:41:05 +02:00
Jeromy
674be39af1 real drand network integration 2020-04-13 20:06:10 -07:00
Łukasz Magiera
5bf80a60f1 Get proof type in NewWinningPoStProver constructor 2020-04-13 23:25:46 +02:00
Łukasz Magiera
bb3789b130 Fix ADT uses 2020-04-13 23:06:11 +02:00
Łukasz Magiera
a2554952d1 Some electionPoSt -> winningPoSt renaming 2020-04-11 00:22:45 +02:00
Łukasz Magiera
d3ffe48fcb Get things to mostly build 2020-04-10 23:29:05 +02:00
Łukasz Magiera
e053cd6b9c Merge remote-tracking branch 'origin/testnet/3' into feat/windowed-post 2020-04-10 23:09:01 +02:00
Łukasz Magiera
613e61222b mostly wire up WindowedPoSt 2020-04-10 23:07:18 +02:00
Łukasz Magiera
3426611340 Merge pull request #1526 from filecoin-project/feat/pass-deal-schedule-for-pre-commit-expiry-scheduling 
provide deal scheduling info to FSM so that it can set pre-commit expiry
 2020-04-10 23:05:50 +02:00
Łukasz Magiera
072dd8b744 Merge remote-tracking branch 'origin/testnet/3' into feat/windowed-post 2020-04-10 20:38:25 +02:00
Łukasz Magiera
0f0015f45c Merge pull request #1520 from filecoin-project/feat/graphsync-chainsync-extension 
Update to latest go-fil-markets w/ enhanced Graphsync
 2020-04-10 20:27:05 +02:00
laser
6dffe9377f provide deal scheduling info to FSM so that it can set pre-commit expiry 2020-04-10 08:22:28 -07:00
Jeromy
c5c18659a4 address some review 2020-04-08 17:24:10 -07:00
Jeromy
ef6fb1b756 rename beacon to randombeacon 2020-04-08 16:10:08 -07:00
Jakub Sztandera
ce4978d8c3 Reintroduce correct ticket randomness alongside ElectionProof 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-04-08 21:06:41 +02:00
Jakub Sztandera
f1c890ca54 Tests pass 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-04-08 18:31:16 +02:00
hannahhoward
00cd89750d feat(deps): update fil-markets, graphsync 
Updates dependencies for graphsync, fil-markets, data-transfer. Moves to new graphsync blockstore
swapping capabilities, and also locks down graphsync impl so it does not accept arbitrary requests
 2020-04-07 23:25:29 -07:00
Jakub Sztandera
afdb1db529 drand wip 
,
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-04-07 15:32:23 -07:00
Jeromy
7075eaba26 WIP: random beacon interface 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-04-07 15:32:23 -07:00
Łukasz Magiera
e36f356908 wip changes for windowed post 2020-04-07 21:55:34 +02:00
Łukasz Magiera
5524241645 fpost -> windowPost renaming 2020-04-07 19:41:41 +02:00
laser
110c869dd3 cut over to storage-fsm, deleting local sealing package 2020-04-07 09:34:09 -07:00
Łukasz Magiera
086a66efc9 Merge pull request #1517 from filecoin-project/feat/lotus-agnostic-node-interface 
remove lotus types from sealing package in preparation for extraction
 2020-04-07 00:42:30 +02:00
laser
43f4db2308 SectorID -> SectorNumber 2020-04-06 15:31:33 -07:00
Łukasz Magiera
4ee8254133 Merge pull request #1510 from filecoin-project/feat/fsm-updates 
FSM Updates
 2020-04-06 23:11:46 +02:00
laser
2f4732760a update CBOR encoders/decoders 2020-04-06 13:35:29 -07:00
laser
dcd9e7da27 miscellaneous fixes post-rebase 2020-04-06 13:23:37 -07:00
laser
650a31b050 remove all lotus types from sealing package in preparation for extraction 
events adapter

implement StateWaitMsg and StateComputeDataCommitment

implement StateGetSectorPreCommitOnChainInfo

implement ChainHead and SendMsg

implement remaining methods
 2020-04-06 12:57:55 -07:00
Łukasz Magiera
f05be81275 fsm: Get correct interactive randomness if it lands on a nullblock 2020-04-04 04:57:05 +02:00
Łukasz Magiera
9a7aa3fc87 chain get: @Hu: for uvaring hamt keys 2020-04-04 03:49:42 +02:00
lanzafame
209e8b3041 only add RemoteListenAddress to StorageMinerNode config 2020-04-04 09:56:52 +10:00
Łukasz Magiera
a1b35aa9d5 Change api.SectorState to a string 2020-04-03 18:29:31 +02:00
lanzafame
27e81f37f3 fix todo comment 2020-04-03 15:01:39 +10:00
lanzafame
3ba2b0e365 instead of guessing the address, just use a config value 2020-04-03 14:54:07 +10:00
Jeromy
beaa3dffab add a command to lotus-bench to benchmark importing and validating a chain 2020-04-02 16:18:38 -07:00
Jeromy
5b9ee1dea9 Add GetMiningBaseInfo api and use it for mining 2020-04-01 18:15:25 -07:00
Łukasz Magiera
f6c260c49f Merge pull request #1484 from filecoin-project/fix/interop-improvements 
several fixes and improvements while debugging interop
 2020-04-01 17:51:42 +02:00
Jeromy
417d434973 several fixes and improvements while debugging interop 2020-03-31 18:35:23 -07:00
Łukasz Magiera
13f2c21e1d Get network name from genesis 2020-04-01 01:15:49 +02:00
Whyrusleeping
ea135991e3 Merge pull request #1480 from filecoin-project/feat/better-deal-info 
Better deal info at the command line
 2020-03-31 13:29:07 -07:00
hannahhoward
0c69e99b7c feat(cli): add message to deal output 
Add the message field to deal output for client deals -- message will often contain additional
useful info about what happened with the deal, especially for errors
 2020-03-31 11:53:30 -07:00
Ignacio Hagopian
8f89501118 fix ClientRetrieve with CAR exporting & add test coverage 
Signed-off-by: Ignacio Hagopian <jsign.uy@gmail.com>
 2020-03-30 11:08:20 -03:00
Łukasz Magiera
95ee1c1cde Extract sector-storage 2020-03-28 01:32:39 +01:00
Łukasz Magiera
c66d3dfad7 sectorstorage: Untangle from lotus deps 2020-03-27 22:35:33 +01:00
Łukasz Magiera
de1f2be505 Merge pull request #1458 from filecoin-project/feat/merge-sectorbuilder 
Merge sectorbuilder into sectorstorage
 2020-03-27 18:53:58 +01:00
Travis Person
838a50be39 Increase low gas limits everywhere to 10000 2020-03-27 03:24:35 +00:00
Łukasz Magiera
e050e0307e Cleanup after dropping sectorbuilder 2020-03-26 20:35:16 +01:00
Łukasz Magiera
4be54a976c Merge sectorbuilder into sectorstorage 2020-03-26 03:51:06 +01:00
Jakub Sztandera
300c89f541 Update to new sepcs actors, more debug 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-03-26 01:02:13 +01:00
Łukasz Magiera
02e5148720 Merge pull request #1451 from filecoin-project/feat/secstor-move-sealed 
sectorstorage: Move sealed sectors to storage in FinalizeSector
 2020-03-25 21:22:44 +01:00
Łukasz Magiera
42c9d53ae1 workers: gofmt 2020-03-25 21:20:24 +01:00
Ignacio Hagopian
3896902d49 include DealID in DealInfo 
Signed-off-by: Ignacio Hagopian <jsign.uy@gmail.com>
 2020-03-25 16:30:59 -03:00
Łukasz Magiera
00cfb3bdcf sectorstorage: Move sealed sectors to storage in FinalizeSector 2020-03-25 19:21:53 +01:00
Łukasz Magiera
201d0a4b19 Merge remote-tracking branch 'origin/testnet/3' into feat/new-workers 2020-03-25 01:02:23 +01:00
Łukasz Magiera
cfc65f525a sectorstorage: wire up closing logic 2020-03-25 00:52:55 +01:00
Łukasz Magiera
5de17e903c storageminer: Config for local worker task types 2020-03-24 20:38:00 +01:00
Łukasz Magiera
66a682b55d Merge remote-tracking branch 'origin/testnet/3' into feat/new-workers 2020-03-24 19:09:02 +01:00
Łukasz Magiera
726c9c1fe7 workers: Address review 2020-03-24 19:01:04 +01:00
Aayush Rajasekaran
d350a9d415 Re: #1412: Add a non-blocking version of StateWaitMsg 
- This commit adds a new method called StateSearchMsg
- We can probably overhaul StateWaitMsg onto this new method at a later point in time
 2020-03-24 06:43:15 -04:00
Whyrusleeping
d74ede5a79 Merge pull request #1428 from filecoin-project/feat/graphsync-fetching 
WIP: integrate graphsync for chainsync requests
 2020-03-23 18:47:17 -07:00
Łukasz Magiera
8559c89560 storageminer: More storage stats in storage list 2020-03-23 23:43:38 +01:00
Łukasz Magiera
a3ba8eb0d7 workers: Basic monitoring tools 2020-03-23 15:56:22 +01:00
Łukasz Magiera
5e4a7e54df Rename agvmgr+sealmgr to sectorstorage 2020-03-23 12:47:10 +01:00
Łukasz Magiera
d43f2a2e3b workers: Address review 2020-03-22 22:39:06 +01:00
Jeromy
f1dbd35407 change genesis fields to match interop 2020-03-21 15:25:00 -07:00
Jeromy
f3781e8329 update and rerun cbor gen 2020-03-21 14:17:01 -07:00
hannahhoward
34f755b2b9 feat(chainsync): fixes to make graphsync work for chain fetching 
- store to chain blockstore (ok for now, since storage provider is a seperate process)
- simplify request fetching and processing
 2020-03-20 21:30:24 -07:00
whyrusleeping
1076a1a89d WIP: integrate graphsync for chainsync requests 2020-03-20 21:30:24 -07:00
Jeromy
921f11db34 Rewrite chain export walker function to actually do the right thing 2020-03-20 17:18:57 -07:00
Łukasz Magiera
c57c0e7f55 workers: Memory based scheduling 2020-03-20 23:30:17 +01:00
Łukasz Magiera
978a718159 storage: storage find command 2020-03-19 20:51:33 +01:00
Łukasz Magiera
80cca91584 workers: get to executing tasks remotely! 2020-03-19 18:11:45 +01:00
Łukasz Magiera
d87b7c264d stores: Use index in local store 2020-03-19 16:11:04 +01:00
Łukasz Magiera
2fa3f2578f impl: Move CommonAPI into a separate pkg 2020-03-19 03:31:53 +01:00
Łukasz Magiera
1ed7779701 Merge remote-tracking branch 'origin/testnet/3' into feat/new-workers 2020-03-19 03:28:55 +01:00
Łukasz Magiera
94ebbd9d90 workers: Actually register in miner 2020-03-19 00:23:32 +01:00
Łukasz Magiera
3676daf7dc Merge pull request #1421 from filecoin-project/fix/gas-limit-type 
change gas limit to be a normal int64
 2020-03-18 22:41:16 +01:00
whyrusleeping
ddf1beac6c change gas limit to be a normal int64 2020-03-18 13:45:37 -07:00
laser
366db2f38c adjust import order as per PR feedback 2020-03-18 12:43:06 -07:00
laser
f59bf6fab1 wire up dtypes.ClientDatastore 2020-03-18 11:57:22 -07:00
Łukasz Magiera
5f2caffb51 Fix tests after specs-storage changes 2020-03-18 02:08:11 +01:00
hannahhoward
f259bc6a09 feat(graphsync): unified graphsync instance 
setup a single graphsync that loads from both the chainstore & client blockstore
 2020-03-17 17:25:12 -07:00
Łukasz Magiera
d8ce5078d9 Use new specs-storage interface 2020-03-17 21:19:52 +01:00
Łukasz Magiera
7e997e40f3 workers: Simple storage diagnostics 2020-03-16 18:50:07 +01:00
Łukasz Magiera
e6ec20b4ca Merge branch 'testnet/3' into feat/new-workers 2020-03-13 17:58:13 +01:00
Łukasz Magiera
96730bae75 workers: Report sectors paths after worker creates them 2020-03-13 17:54:55 +01:00
Łukasz Magiera
2c7f579838 workers: Implement SectorIndex 2020-03-13 12:59:19 +01:00
Łukasz Magiera
bc7fede68b workers: Wire up most pieces 2020-03-13 02:37:38 +01:00
Łukasz Magiera
71afcb0333 workrs: refactor sector store for more composability 2020-03-11 08:22:21 +01:00
Łukasz Magiera
7e2e30f94b workers: Transfer logic refactoring 2020-03-11 06:49:17 +01:00
Łukasz Magiera
eb61a36fd7 workers: RPC scaffolding 2020-03-11 02:58:02 +01:00
whyrusleeping
14f9724bc9 Don't double account for miner power when setting up genesis blocks 2020-03-10 15:42:41 -07:00
Łukasz Magiera
5d6d75f546 Merge pull request #1373 from filecoin-project/fix/amgr-races 
storage: Improve thread safety
 2020-03-09 23:11:17 +01:00
Łukasz Magiera
0c2af7a8ee repo: Fix fsrepo.SetStorage on init 2020-03-09 22:46:17 +01:00
whyrusleeping
26ca72e252 make state power a pointer so it marshals properly 2020-03-09 14:41:57 -07:00
Łukasz Magiera
01087e01d2 storage: Improve thread safety 2020-03-09 20:22:30 +01:00
Łukasz Magiera
6981cfb8bc Merge pull request #1365 from filecoin-project/feat/miner-storage-add 
storageminer: 'storage attach' command
 2020-03-09 07:28:11 +01:00
Łukasz Magiera
1cf26fc652 repo: Implement memrepo.SetStorage 2020-03-09 07:21:42 +01:00
Whyrusleeping
3a94d9d176 Merge pull request #1354 from filecoin-project/feat/state-compute-trace 
implement compute state trace output
 2020-03-08 21:22:40 -07:00
Travis Person
9216a1eb07 Add more chain get types 2020-03-09 03:16:43 +00:00
whyrusleeping
4260cc38c9 implement compute state trace output 2020-03-08 20:07:25 -07:00
whyrusleeping
ab51c7e2d2 Fix fallback post scheduling to hopefully do the right thing 2020-03-08 00:19:38 -08:00
Łukasz Magiera
cb1e797d72 Merge pull request #1353 from filecoin-project/feat/merge-master 
Merge master back into testnet/3
 2020-03-08 09:05:46 +01:00
whyrusleeping
24bf720a9a Merge branch 'master' into testnet/3 2020-03-07 16:46:12 -08:00
Whyrusleeping
c553a6f458 Merge pull request #1349 from filecoin-project/feat/chain-get-types 
add some type info to chain get
 2020-03-07 16:10:00 -08:00
Whyrusleeping
0b5991850c Merge pull request #1346 from filecoin-project/feat/stat-cmd 
Add stat-obj to API and a few extras
 2020-03-06 18:55:48 -08:00
whyrusleeping
cdd37bda1c add some type info to chain get 2020-03-06 18:47:19 -08:00
Travis Person
7628a64a55 cmd: add stat-obj 2020-03-07 00:43:44 +00:00
hannahhoward
eef48c4be3 feat(client): support car to filestore 
Store filestore reference for CAR files
 2020-03-06 13:14:02 -08:00
hannahhoward
9f5f70a93f feat(client): add car import/export option 
adds option on client file import and client retrieval to read/write to CAR file
 2020-03-06 13:14:02 -08:00
Aayush Rajasekaran
340afc3503 Add information about internal message executions to SimulationResult 
- The VM now tracks a list of ExecutionResults to keep track of internal messages
 2020-03-06 11:11:06 -08:00
Aayush Rajasekaran
2d63b007f2 Unify MethodCall and ReplayResults into SimulationResult 
- Call and Replay now return the same type, which includes both Message and MessageReceipt
 2020-03-06 11:10:40 -08:00
Łukasz Magiera
38241d66cb Merge branch 'testnet/3' into feat/miner-rewards-cmd 2020-03-06 19:04:36 +01:00
Whyrusleeping
05a95cace5 Merge pull request #1336 from filecoin-project/vet/some-go-vet-fixes 
some go vet fixes
 2020-03-06 00:11:13 -08:00
Łukasz Magiera
b15c476698 node_test: set sector counters in repo 2020-03-06 08:47:03 +01:00
whyrusleeping
16096e2c71 some go vet fixes 2020-03-05 22:46:07 -08:00
Łukasz Magiera
7d3e16986c sectorbuilder type updates 2020-03-06 06:38:59 +01:00
whyrusleeping
1183e082af add command to inspect and redeem block rewards 2020-03-05 21:32:52 -08:00
Steven Allen
6992fd4dba chore(dep): update dependencies 
Updates:

* cid, multihash, and multiaddr to ensure that minimal varints are used.
* log to deduplicate some code between version 2 and version 1.
* multistream to avoid writing from multiple threads.
* badger/datastore to harden prefix handling in queries.
* libp2p to 0.5.2

BREAKING:

The new libp2p version now formats addresses with /p2p instead of /ipfs. /ipfs
multiaddrs are still supported.
 2020-03-05 16:28:42 -08:00
Łukasz Magiera
16cb27b5f9 Get node_test to pass 2020-03-05 23:27:30 +01:00
Łukasz Magiera
1461e475da storage: Support adding paths at runtime 2020-03-05 23:02:01 +01:00
Łukasz Magiera
a5e5918fc5 mod tidy; gofmt 2020-03-05 20:21:06 +01:00
Łukasz Magiera
7db1dd52bd storagemgr: Wire up most of AddPiece logic 2020-03-05 01:38:07 +01:00
Łukasz Magiera
e483383a44 node: wire up new storage manager 2020-03-04 20:42:49 +01:00
Łukasz Magiera
799ff17c7c Merge remote-tracking branch 'origin/testnet/3' into feat/4stage-seal 2020-03-04 06:37:11 +01:00
whyrusleeping
37d5baf0b2 fix blocks topic 2020-03-03 21:03:35 -08:00
Łukasz Magiera
4e46d00eb6 Merge remote-tracking branch 'origin/testnet/3' into feat/4stage-seal 2020-03-04 04:01:13 +01:00
whyrusleeping
9169a073b6 add miner side commands and a few other goodies 2020-03-03 18:49:00 -08:00
Łukasz Magiera
12d870e274 sealmgr: Read only multi-path file manager 2020-03-04 03:24:08 +01:00
whyrusleeping
52acfb88ee use proper manual piece and size setting 2020-03-03 18:19:28 -08:00
whyrusleeping
2be2891647 wire up lotus side of make deal for manual commP 2020-03-03 16:18:08 -08:00
whyrusleeping
99c842e027 integrate client interface to allow for offline deals 2020-03-03 16:18:08 -08:00
whyrusleeping
d6723935b9 fixup to match spec, move constants to common location 2020-03-03 15:48:25 -08:00
Łukasz Magiera
a0dbb6bdd6 Storage Manager refactor 2020-03-03 23:19:22 +01:00
whyrusleeping
c51a83b404 fix a few libp2p related problems 2020-03-02 20:55:25 -08:00
lanzafame
4f2baa8953 conform protocol ids to spec 
Signed-off-by: lanzafame <adrianlanzafame92@gmail.com>
 2020-03-03 11:34:43 +10:00
Travis Person
c362d75a38 Reduce default storage miner worker count 
The current default worker count of 5 can result in high memory usage of
the lotus-storage-miner process when a user starts multiple sector
pledges within a short time of each other and can result in the process
being killed for OOM.

Reducing the worker count to 2 will provide a safer default.
 2020-03-02 23:28:05 +00:00
whyrusleeping
60b19c51ef more misc fixes 2020-03-01 17:09:38 -08:00
hannahhoward
bda5315866 fix(paychmr): decode address correctly, pass wallet 2020-02-28 19:26:33 -08:00
hannahhoward
0d7afef0c5 fix(paychmgr): add to paych serialziation 2020-02-28 19:26:33 -08:00
Aayush Rajasekaran
fe8db295e7 Re: #1290: Add a lotus wallet verify API and CLI command 
- The command takes an address, message, and signature, and returns true if the sig is valid
 2020-02-28 15:56:15 -08:00
whyrusleeping
0945d8725e fixing miner logic to make more tests pass 2020-02-28 11:31:28 -08:00
whyrusleeping
00efd097c7 implement basic message filtering 2020-02-27 17:40:16 -08:00
Łukasz Magiera
f83bbc2cbe Regen cbor marshalers 2020-02-28 00:34:48 +01:00