Łukasz Magiera
149bb56b8e
wip updates to sector set handling
2020-04-15 21:59:11 +02:00
Whyrusleeping
8a83415596
Merge pull request #1541 from filecoin-project/feat/drand-2
...
real drand network integration
2020-04-15 11:22:00 -07:00
Aayush Rajasekaran
fc933858e1
Add an API method to calculate piece CIDs
2020-04-15 14:00:42 -04:00
Jakub Sztandera
08e74a90f9
Add missing files
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-04-15 16:13:20 +02:00
Jeromy
4e6839b5ef
some small cleanup
2020-04-14 15:13:52 -07:00
Jakub Sztandera
0c5e3e2533
Make tests use mock beacon
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-04-14 20:41:05 +02:00
Jeromy
674be39af1
real drand network integration
2020-04-13 20:06:10 -07:00
Łukasz Magiera
5bf80a60f1
Get proof type in NewWinningPoStProver constructor
2020-04-13 23:25:46 +02:00
Łukasz Magiera
bb3789b130
Fix ADT uses
2020-04-13 23:06:11 +02:00
Łukasz Magiera
a2554952d1
Some electionPoSt -> winningPoSt renaming
2020-04-11 00:22:45 +02:00
Łukasz Magiera
d3ffe48fcb
Get things to mostly build
2020-04-10 23:29:05 +02:00
Łukasz Magiera
e053cd6b9c
Merge remote-tracking branch 'origin/testnet/3' into feat/windowed-post
2020-04-10 23:09:01 +02:00
Łukasz Magiera
613e61222b
mostly wire up WindowedPoSt
2020-04-10 23:07:18 +02:00
Łukasz Magiera
3426611340
Merge pull request #1526 from filecoin-project/feat/pass-deal-schedule-for-pre-commit-expiry-scheduling
...
provide deal scheduling info to FSM so that it can set pre-commit expiry
2020-04-10 23:05:50 +02:00
Łukasz Magiera
072dd8b744
Merge remote-tracking branch 'origin/testnet/3' into feat/windowed-post
2020-04-10 20:38:25 +02:00
Łukasz Magiera
0f0015f45c
Merge pull request #1520 from filecoin-project/feat/graphsync-chainsync-extension
...
Update to latest go-fil-markets w/ enhanced Graphsync
2020-04-10 20:27:05 +02:00
laser
6dffe9377f
provide deal scheduling info to FSM so that it can set pre-commit expiry
2020-04-10 08:22:28 -07:00
Jeromy
c5c18659a4
address some review
2020-04-08 17:24:10 -07:00
Jeromy
ef6fb1b756
rename beacon to randombeacon
2020-04-08 16:10:08 -07:00
Jakub Sztandera
ce4978d8c3
Reintroduce correct ticket randomness alongside ElectionProof
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-04-08 21:06:41 +02:00
Jakub Sztandera
f1c890ca54
Tests pass
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-04-08 18:31:16 +02:00
hannahhoward
00cd89750d
feat(deps): update fil-markets, graphsync
...
Updates dependencies for graphsync, fil-markets, data-transfer. Moves to new graphsync blockstore
swapping capabilities, and also locks down graphsync impl so it does not accept arbitrary requests
2020-04-07 23:25:29 -07:00
Jakub Sztandera
afdb1db529
drand wip
...
,
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-04-07 15:32:23 -07:00
Jeromy
7075eaba26
WIP: random beacon interface
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-04-07 15:32:23 -07:00
Łukasz Magiera
e36f356908
wip changes for windowed post
2020-04-07 21:55:34 +02:00
Łukasz Magiera
5524241645
fpost -> windowPost renaming
2020-04-07 19:41:41 +02:00
laser
110c869dd3
cut over to storage-fsm, deleting local sealing package
2020-04-07 09:34:09 -07:00
Łukasz Magiera
086a66efc9
Merge pull request #1517 from filecoin-project/feat/lotus-agnostic-node-interface
...
remove lotus types from sealing package in preparation for extraction
2020-04-07 00:42:30 +02:00
laser
43f4db2308
SectorID -> SectorNumber
2020-04-06 15:31:33 -07:00
Łukasz Magiera
4ee8254133
Merge pull request #1510 from filecoin-project/feat/fsm-updates
...
FSM Updates
2020-04-06 23:11:46 +02:00
laser
2f4732760a
update CBOR encoders/decoders
2020-04-06 13:35:29 -07:00
laser
dcd9e7da27
miscellaneous fixes post-rebase
2020-04-06 13:23:37 -07:00
laser
650a31b050
remove all lotus types from sealing package in preparation for extraction
...
events adapter
implement StateWaitMsg and StateComputeDataCommitment
implement StateGetSectorPreCommitOnChainInfo
implement ChainHead and SendMsg
implement remaining methods
2020-04-06 12:57:55 -07:00
Łukasz Magiera
f05be81275
fsm: Get correct interactive randomness if it lands on a nullblock
2020-04-04 04:57:05 +02:00
Łukasz Magiera
9a7aa3fc87
chain get: @Hu: for uvaring hamt keys
2020-04-04 03:49:42 +02:00
lanzafame
209e8b3041
only add RemoteListenAddress to StorageMinerNode config
2020-04-04 09:56:52 +10:00
Łukasz Magiera
a1b35aa9d5
Change api.SectorState to a string
2020-04-03 18:29:31 +02:00
lanzafame
27e81f37f3
fix todo comment
2020-04-03 15:01:39 +10:00
lanzafame
3ba2b0e365
instead of guessing the address, just use a config value
2020-04-03 14:54:07 +10:00
Jeromy
beaa3dffab
add a command to lotus-bench to benchmark importing and validating a chain
2020-04-02 16:18:38 -07:00
Jeromy
5b9ee1dea9
Add GetMiningBaseInfo api and use it for mining
2020-04-01 18:15:25 -07:00
Łukasz Magiera
f6c260c49f
Merge pull request #1484 from filecoin-project/fix/interop-improvements
...
several fixes and improvements while debugging interop
2020-04-01 17:51:42 +02:00
Jeromy
417d434973
several fixes and improvements while debugging interop
2020-03-31 18:35:23 -07:00
Łukasz Magiera
13f2c21e1d
Get network name from genesis
2020-04-01 01:15:49 +02:00
Whyrusleeping
ea135991e3
Merge pull request #1480 from filecoin-project/feat/better-deal-info
...
Better deal info at the command line
2020-03-31 13:29:07 -07:00
hannahhoward
0c69e99b7c
feat(cli): add message to deal output
...
Add the message field to deal output for client deals -- message will often contain additional
useful info about what happened with the deal, especially for errors
2020-03-31 11:53:30 -07:00
Ignacio Hagopian
8f89501118
fix ClientRetrieve with CAR exporting & add test coverage
...
Signed-off-by: Ignacio Hagopian <jsign.uy@gmail.com>
2020-03-30 11:08:20 -03:00
Łukasz Magiera
95ee1c1cde
Extract sector-storage
2020-03-28 01:32:39 +01:00
Łukasz Magiera
c66d3dfad7
sectorstorage: Untangle from lotus deps
2020-03-27 22:35:33 +01:00
Łukasz Magiera
de1f2be505
Merge pull request #1458 from filecoin-project/feat/merge-sectorbuilder
...
Merge sectorbuilder into sectorstorage
2020-03-27 18:53:58 +01:00
Travis Person
838a50be39
Increase low gas limits everywhere to 10000
2020-03-27 03:24:35 +00:00
Łukasz Magiera
e050e0307e
Cleanup after dropping sectorbuilder
2020-03-26 20:35:16 +01:00
Łukasz Magiera
4be54a976c
Merge sectorbuilder into sectorstorage
2020-03-26 03:51:06 +01:00
Jakub Sztandera
300c89f541
Update to new sepcs actors, more debug
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-03-26 01:02:13 +01:00
Łukasz Magiera
02e5148720
Merge pull request #1451 from filecoin-project/feat/secstor-move-sealed
...
sectorstorage: Move sealed sectors to storage in FinalizeSector
2020-03-25 21:22:44 +01:00
Łukasz Magiera
42c9d53ae1
workers: gofmt
2020-03-25 21:20:24 +01:00
Ignacio Hagopian
3896902d49
include DealID in DealInfo
...
Signed-off-by: Ignacio Hagopian <jsign.uy@gmail.com>
2020-03-25 16:30:59 -03:00
Łukasz Magiera
00cfb3bdcf
sectorstorage: Move sealed sectors to storage in FinalizeSector
2020-03-25 19:21:53 +01:00
Łukasz Magiera
201d0a4b19
Merge remote-tracking branch 'origin/testnet/3' into feat/new-workers
2020-03-25 01:02:23 +01:00
Łukasz Magiera
cfc65f525a
sectorstorage: wire up closing logic
2020-03-25 00:52:55 +01:00
Łukasz Magiera
5de17e903c
storageminer: Config for local worker task types
2020-03-24 20:38:00 +01:00
Łukasz Magiera
66a682b55d
Merge remote-tracking branch 'origin/testnet/3' into feat/new-workers
2020-03-24 19:09:02 +01:00
Łukasz Magiera
726c9c1fe7
workers: Address review
2020-03-24 19:01:04 +01:00
Aayush Rajasekaran
d350a9d415
Re: #1412 : Add a non-blocking version of StateWaitMsg
...
- This commit adds a new method called StateSearchMsg
- We can probably overhaul StateWaitMsg onto this new method at a later point in time
2020-03-24 06:43:15 -04:00
Whyrusleeping
d74ede5a79
Merge pull request #1428 from filecoin-project/feat/graphsync-fetching
...
WIP: integrate graphsync for chainsync requests
2020-03-23 18:47:17 -07:00
Łukasz Magiera
8559c89560
storageminer: More storage stats in storage list
2020-03-23 23:43:38 +01:00
Łukasz Magiera
a3ba8eb0d7
workers: Basic monitoring tools
2020-03-23 15:56:22 +01:00
Łukasz Magiera
5e4a7e54df
Rename agvmgr+sealmgr to sectorstorage
2020-03-23 12:47:10 +01:00
Łukasz Magiera
d43f2a2e3b
workers: Address review
2020-03-22 22:39:06 +01:00
Jeromy
f1dbd35407
change genesis fields to match interop
2020-03-21 15:25:00 -07:00
Jeromy
f3781e8329
update and rerun cbor gen
2020-03-21 14:17:01 -07:00
hannahhoward
34f755b2b9
feat(chainsync): fixes to make graphsync work for chain fetching
...
- store to chain blockstore (ok for now, since storage provider is a seperate process)
- simplify request fetching and processing
2020-03-20 21:30:24 -07:00
whyrusleeping
1076a1a89d
WIP: integrate graphsync for chainsync requests
2020-03-20 21:30:24 -07:00
Jeromy
921f11db34
Rewrite chain export walker function to actually do the right thing
2020-03-20 17:18:57 -07:00
Łukasz Magiera
c57c0e7f55
workers: Memory based scheduling
2020-03-20 23:30:17 +01:00
Łukasz Magiera
978a718159
storage: storage find command
2020-03-19 20:51:33 +01:00
Łukasz Magiera
80cca91584
workers: get to executing tasks remotely!
2020-03-19 18:11:45 +01:00
Łukasz Magiera
d87b7c264d
stores: Use index in local store
2020-03-19 16:11:04 +01:00
Łukasz Magiera
2fa3f2578f
impl: Move CommonAPI into a separate pkg
2020-03-19 03:31:53 +01:00
Łukasz Magiera
1ed7779701
Merge remote-tracking branch 'origin/testnet/3' into feat/new-workers
2020-03-19 03:28:55 +01:00
Łukasz Magiera
94ebbd9d90
workers: Actually register in miner
2020-03-19 00:23:32 +01:00
Łukasz Magiera
3676daf7dc
Merge pull request #1421 from filecoin-project/fix/gas-limit-type
...
change gas limit to be a normal int64
2020-03-18 22:41:16 +01:00
whyrusleeping
ddf1beac6c
change gas limit to be a normal int64
2020-03-18 13:45:37 -07:00
laser
366db2f38c
adjust import order as per PR feedback
2020-03-18 12:43:06 -07:00
laser
f59bf6fab1
wire up dtypes.ClientDatastore
2020-03-18 11:57:22 -07:00
Łukasz Magiera
5f2caffb51
Fix tests after specs-storage changes
2020-03-18 02:08:11 +01:00
hannahhoward
f259bc6a09
feat(graphsync): unified graphsync instance
...
setup a single graphsync that loads from both the chainstore & client blockstore
2020-03-17 17:25:12 -07:00
Łukasz Magiera
d8ce5078d9
Use new specs-storage interface
2020-03-17 21:19:52 +01:00
Łukasz Magiera
7e997e40f3
workers: Simple storage diagnostics
2020-03-16 18:50:07 +01:00
Łukasz Magiera
e6ec20b4ca
Merge branch 'testnet/3' into feat/new-workers
2020-03-13 17:58:13 +01:00
Łukasz Magiera
96730bae75
workers: Report sectors paths after worker creates them
2020-03-13 17:54:55 +01:00
Łukasz Magiera
2c7f579838
workers: Implement SectorIndex
2020-03-13 12:59:19 +01:00
Łukasz Magiera
bc7fede68b
workers: Wire up most pieces
2020-03-13 02:37:38 +01:00
Łukasz Magiera
71afcb0333
workrs: refactor sector store for more composability
2020-03-11 08:22:21 +01:00
Łukasz Magiera
7e2e30f94b
workers: Transfer logic refactoring
2020-03-11 06:49:17 +01:00
Łukasz Magiera
eb61a36fd7
workers: RPC scaffolding
2020-03-11 02:58:02 +01:00
whyrusleeping
14f9724bc9
Don't double account for miner power when setting up genesis blocks
2020-03-10 15:42:41 -07:00
Łukasz Magiera
5d6d75f546
Merge pull request #1373 from filecoin-project/fix/amgr-races
...
storage: Improve thread safety
2020-03-09 23:11:17 +01:00
Łukasz Magiera
0c2af7a8ee
repo: Fix fsrepo.SetStorage on init
2020-03-09 22:46:17 +01:00
whyrusleeping
26ca72e252
make state power a pointer so it marshals properly
2020-03-09 14:41:57 -07:00
Łukasz Magiera
01087e01d2
storage: Improve thread safety
2020-03-09 20:22:30 +01:00
Łukasz Magiera
6981cfb8bc
Merge pull request #1365 from filecoin-project/feat/miner-storage-add
...
storageminer: 'storage attach' command
2020-03-09 07:28:11 +01:00
Łukasz Magiera
1cf26fc652
repo: Implement memrepo.SetStorage
2020-03-09 07:21:42 +01:00
Whyrusleeping
3a94d9d176
Merge pull request #1354 from filecoin-project/feat/state-compute-trace
...
implement compute state trace output
2020-03-08 21:22:40 -07:00
Travis Person
9216a1eb07
Add more chain get types
2020-03-09 03:16:43 +00:00
whyrusleeping
4260cc38c9
implement compute state trace output
2020-03-08 20:07:25 -07:00
whyrusleeping
ab51c7e2d2
Fix fallback post scheduling to hopefully do the right thing
2020-03-08 00:19:38 -08:00
Łukasz Magiera
cb1e797d72
Merge pull request #1353 from filecoin-project/feat/merge-master
...
Merge master back into testnet/3
2020-03-08 09:05:46 +01:00
whyrusleeping
24bf720a9a
Merge branch 'master' into testnet/3
2020-03-07 16:46:12 -08:00
Whyrusleeping
c553a6f458
Merge pull request #1349 from filecoin-project/feat/chain-get-types
...
add some type info to chain get
2020-03-07 16:10:00 -08:00
Whyrusleeping
0b5991850c
Merge pull request #1346 from filecoin-project/feat/stat-cmd
...
Add stat-obj to API and a few extras
2020-03-06 18:55:48 -08:00
whyrusleeping
cdd37bda1c
add some type info to chain get
2020-03-06 18:47:19 -08:00
Travis Person
7628a64a55
cmd: add stat-obj
2020-03-07 00:43:44 +00:00
hannahhoward
eef48c4be3
feat(client): support car to filestore
...
Store filestore reference for CAR files
2020-03-06 13:14:02 -08:00
hannahhoward
9f5f70a93f
feat(client): add car import/export option
...
adds option on client file import and client retrieval to read/write to CAR file
2020-03-06 13:14:02 -08:00
Aayush Rajasekaran
340afc3503
Add information about internal message executions to SimulationResult
...
- The VM now tracks a list of ExecutionResults to keep track of internal messages
2020-03-06 11:11:06 -08:00
Aayush Rajasekaran
2d63b007f2
Unify MethodCall and ReplayResults into SimulationResult
...
- Call and Replay now return the same type, which includes both Message and MessageReceipt
2020-03-06 11:10:40 -08:00
Łukasz Magiera
38241d66cb
Merge branch 'testnet/3' into feat/miner-rewards-cmd
2020-03-06 19:04:36 +01:00
Whyrusleeping
05a95cace5
Merge pull request #1336 from filecoin-project/vet/some-go-vet-fixes
...
some go vet fixes
2020-03-06 00:11:13 -08:00
Łukasz Magiera
b15c476698
node_test: set sector counters in repo
2020-03-06 08:47:03 +01:00
whyrusleeping
16096e2c71
some go vet fixes
2020-03-05 22:46:07 -08:00
Łukasz Magiera
7d3e16986c
sectorbuilder type updates
2020-03-06 06:38:59 +01:00
whyrusleeping
1183e082af
add command to inspect and redeem block rewards
2020-03-05 21:32:52 -08:00
Steven Allen
6992fd4dba
chore(dep): update dependencies
...
Updates:
* cid, multihash, and multiaddr to ensure that minimal varints are used.
* log to deduplicate some code between version 2 and version 1.
* multistream to avoid writing from multiple threads.
* badger/datastore to harden prefix handling in queries.
* libp2p to 0.5.2
BREAKING:
The new libp2p version now formats addresses with /p2p instead of /ipfs. /ipfs
multiaddrs are still supported.
2020-03-05 16:28:42 -08:00
Łukasz Magiera
16cb27b5f9
Get node_test to pass
2020-03-05 23:27:30 +01:00
Łukasz Magiera
1461e475da
storage: Support adding paths at runtime
2020-03-05 23:02:01 +01:00
Łukasz Magiera
a5e5918fc5
mod tidy; gofmt
2020-03-05 20:21:06 +01:00
Łukasz Magiera
7db1dd52bd
storagemgr: Wire up most of AddPiece logic
2020-03-05 01:38:07 +01:00
Łukasz Magiera
e483383a44
node: wire up new storage manager
2020-03-04 20:42:49 +01:00
Łukasz Magiera
799ff17c7c
Merge remote-tracking branch 'origin/testnet/3' into feat/4stage-seal
2020-03-04 06:37:11 +01:00
whyrusleeping
37d5baf0b2
fix blocks topic
2020-03-03 21:03:35 -08:00
Łukasz Magiera
4e46d00eb6
Merge remote-tracking branch 'origin/testnet/3' into feat/4stage-seal
2020-03-04 04:01:13 +01:00
whyrusleeping
9169a073b6
add miner side commands and a few other goodies
2020-03-03 18:49:00 -08:00
Łukasz Magiera
12d870e274
sealmgr: Read only multi-path file manager
2020-03-04 03:24:08 +01:00
whyrusleeping
52acfb88ee
use proper manual piece and size setting
2020-03-03 18:19:28 -08:00
whyrusleeping
2be2891647
wire up lotus side of make deal for manual commP
2020-03-03 16:18:08 -08:00
whyrusleeping
99c842e027
integrate client interface to allow for offline deals
2020-03-03 16:18:08 -08:00
whyrusleeping
d6723935b9
fixup to match spec, move constants to common location
2020-03-03 15:48:25 -08:00
Łukasz Magiera
a0dbb6bdd6
Storage Manager refactor
2020-03-03 23:19:22 +01:00
whyrusleeping
c51a83b404
fix a few libp2p related problems
2020-03-02 20:55:25 -08:00
lanzafame
4f2baa8953
conform protocol ids to spec
...
Signed-off-by: lanzafame <adrianlanzafame92@gmail.com>
2020-03-03 11:34:43 +10:00
Travis Person
c362d75a38
Reduce default storage miner worker count
...
The current default worker count of 5 can result in high memory usage of
the lotus-storage-miner process when a user starts multiple sector
pledges within a short time of each other and can result in the process
being killed for OOM.
Reducing the worker count to 2 will provide a safer default.
2020-03-02 23:28:05 +00:00
whyrusleeping
60b19c51ef
more misc fixes
2020-03-01 17:09:38 -08:00
hannahhoward
bda5315866
fix(paychmr): decode address correctly, pass wallet
2020-02-28 19:26:33 -08:00
hannahhoward
0d7afef0c5
fix(paychmgr): add to paych serialziation
2020-02-28 19:26:33 -08:00
Aayush Rajasekaran
fe8db295e7
Re: #1290 : Add a lotus wallet verify API and CLI command
...
- The command takes an address, message, and signature, and returns true if the sig is valid
2020-02-28 15:56:15 -08:00
whyrusleeping
0945d8725e
fixing miner logic to make more tests pass
2020-02-28 11:31:28 -08:00
whyrusleeping
00efd097c7
implement basic message filtering
2020-02-27 17:40:16 -08:00
Łukasz Magiera
f83bbc2cbe
Regen cbor marshalers
2020-02-28 00:34:48 +01:00
whyrusleeping
d8dda1ee66
debugging test failure
2020-02-27 15:14:15 -08:00