Łukasz Magiera
5932f28519
Merge remote-tracking branch 'origin/master' into feat/async-restartable-workers
2020-10-01 02:39:48 +02:00
hannahhoward
be884e27be
feat(markets): update markets 0.7.0
2020-09-30 10:26:50 -07:00
Łukasz Magiera
cf71f034dc
Merge remote-tracking branch 'origin/dev' into feat/async-restartable-workers
2020-09-26 12:35:32 +02:00
Łukasz Magiera
ef28ebb14a
Ignition upgrades, much excite.
2020-09-25 23:55:37 -07:00
Łukasz Magiera
03c3d8bdb3
workers: Return unfinished tasks on restart
2020-09-22 00:52:33 +02:00
Łukasz Magiera
5e09581256
sectorstorage: get new work tracker to run
2020-09-16 22:33:58 +02:00
Łukasz Magiera
03cf6cca40
Merge remote-tracking branch 'origin/master' into feat/async-restartable-workers
2020-09-15 17:47:03 +02:00
Raúl Kripalani
954ff32503
fix transitive api dependency on ffi.
2020-09-14 19:01:35 +01:00
Łukasz Magiera
1ebca8f732
more working code
2020-09-14 19:09:01 +02:00
Raúl Kripalani
09e9d6d778
deal journal events: wire into markets subscriptions.
2020-09-14 16:20:01 +01:00
Raúl Kripalani
6d29d75724
Merge branch 'master' into inmem-journal
2020-09-14 12:17:45 +01:00
Aayush Rajasekaran
39755a294a
Update to specs v0.9.6
2020-09-07 15:48:41 -04:00
Raúl Kripalani
3206f92063
Merge branch 'master' into inmem-journal
2020-09-02 19:50:52 +01:00
Jakub Sztandera
625c6951bb
Don't use context to close bitswap
...
Use just the Close
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-08-31 19:24:04 +02:00
hannahhoward
0a36db06ed
feat(markets): update to markets v0.5.8
2020-08-28 18:03:27 -07:00
Raúl Kripalani
efdfd3ee3e
Merge branch 'master' into inmem-journal
2020-08-26 16:38:23 +01:00
Raúl Kripalani
4e1ef09751
make journal a global var.
2020-08-26 16:09:37 +01:00
Łukasz Magiera
a03192a39b
Separate concurrent sealing sector limit for deals
2020-08-18 21:48:18 +02:00
Łukasz Magiera
baf91f08a1
Unbreak tests
2020-08-18 18:27:18 +02:00
Łukasz Magiera
65ffde9e4b
fsm: Config for max WaitDeals sectors
2020-08-18 16:20:31 +02:00
Raúl Kripalani
862bafc63a
fix lint errors.
2020-08-17 14:39:33 +01:00
Raúl Kripalani
efdc428d5d
keep storage-fsm (renamed to storage-sealing) and sector-storage in extern.
2020-08-17 14:26:18 +01:00
Raúl Kripalani
3c17cd655e
integrate extern/sector-storage into lotus proper.
2020-08-16 11:09:58 +01:00
Raúl Kripalani
fb0ccc9260
integrate extern/storage-fsm into lotus proper.
2020-08-16 10:42:13 +01:00
hannahhoward
6b5525b8d2
feat(markets): update markets 0.5.6
...
update markets to 0.5.6, removing use of validators that moved inside markets
2020-08-14 11:14:03 -07:00
Łukasz Magiera
6f890a3edd
Miner fee config
2020-08-12 19:47:09 +02:00
Raúl Kripalani
2ea5abdfb5
wire journal into miner.
2020-08-11 13:48:32 +01:00
Raúl Kripalani
92598237c3
Merge branch 'next' into inmem-journal
2020-08-11 12:41:11 +01:00
Łukasz Magiera
73b8868046
gofmt
2020-08-06 03:32:59 +02:00
Łukasz Magiera
f8b8ecc0c3
Consensus filter
2020-08-06 03:16:39 +02:00
Łukasz Magiera
3ae55d1da3
Merge pull request #2714 from filecoin-project/feat/user-dealfiter
...
Support external deal decision logic
2020-07-31 21:56:44 +02:00
Aayush Rajasekaran
c33e38eef2
Update markets
2020-07-31 15:43:34 -04:00
Łukasz Magiera
fc3c91b738
Support external deal decision logic
2020-07-31 20:29:16 +02:00
hannahhoward
e201408d61
feat(markets): better event logging
2020-07-31 12:55:45 +02:00
Łukasz Magiera
4d328cad54
Get things to mostly work
2020-07-30 14:31:50 +02:00
Aayush Rajasekaran
5df0ee7935
Merge pull request #2647 from filecoin-project/feat/better-seal-duration-ui
...
Feat/better seal duration ui
2020-07-28 21:32:54 -04:00
whyrusleeping
dd8c88b418
improve some seal duration things
2020-07-28 17:40:42 -07:00
Łukasz Magiera
09b90773d8
Merge remote-tracking branch 'origin/next' into feat/cid-builder
2020-07-28 16:06:06 +02:00
hannahhoward
5a623cccb5
feat(markets): update markets mulitple deal stores
2020-07-27 23:13:28 -07:00
Steven Allen
b7a4dbb07f
Support inline CIDs
...
And use the new CidBuilder from the spec actors.
This patch does not switch over to inline CIDs by default, but paves the way.
2020-07-23 23:12:32 -07:00
Raúl Kripalani
d6e6eedd58
pipe sealing events to the journal.
2020-07-21 13:02:51 +01:00
Raúl Kripalani
226786c1da
wip
2020-07-20 14:45:17 +01:00
Łukasz Magiera
d266c665b0
Update sector-storage with windowed scheduler
2020-07-18 00:38:02 +02:00
Aayush Rajasekaran
a5ef629cef
Add expected seal duration to custom deal logic, reject deals that start too early
2020-07-15 17:31:50 -04:00
hannahhoward
61f120222f
feat(markets): update markets with new retrieval
2020-07-15 14:04:31 -07:00
Frank
14ec9a2068
update storage miner and seal worker document
2020-07-11 16:55:13 +08:00
hannahhoward
24e3a4218b
feat(markets): upgrade to latest
...
upgrade to latest markets with fast retrieval, underlying data transfer upgrade
2020-07-08 01:35:50 -07:00
Aayush Rajasekaran
411c82ae8f
Update storage-FSM, add API to set sector seal delay
2020-07-07 15:23:23 -04:00
laser
b9180a99d4
toggle consideration of offline storage/retrieval deal proposals
2020-06-26 12:27:41 -07:00
laser
e910a045d0
big rename to allow for later introducing the "consider offline" config
2020-06-26 10:50:54 -07:00
laser
ef0abf2b98
disable/enable retrieval deal consideration via config
2020-06-24 08:07:12 -07:00
Raúl Kripalani
d20255b1b4
provide an option to disable loading of built-in assets.
2020-06-22 19:42:04 +01:00
laser
de7d6c255c
blacklist -> blocklist
2020-06-18 15:51:01 -07:00
laser
0c8d648998
specify which CID is being blacklisted (it's the piece)
2020-06-18 14:02:22 -07:00
laser
aa18d1985e
reject storage deal proposals containing blacklisted piece CIDs
2020-06-18 13:32:20 -07:00
laser
b0edf924b4
add commands for manipulating storage deal CID blacklist
2020-06-18 13:15:18 -07:00
hannahhoward
9262661135
chore(deps): update to fil-markets 0.3.0
...
Updates to latest fil markets with resumability and other fixes
2020-06-15 15:43:47 -07:00
laser
36b327b57b
various symbol renames
2020-06-11 13:18:18 -07:00
laser
7587e6c08b
get and set storage deal acceptance through CLI
2020-06-11 12:59:50 -07:00
laser
5421d0d1c5
better field and struct names + set default appropriately
...
Storage miners, by default, should be configured to accept storage deals.
2020-06-11 12:15:28 -07:00
laser
c458b4712a
better rejection messages
2020-06-11 12:06:38 -07:00
laser
d6b2519843
config-driven IsAcceptingStorageDeals flag
...
Makes incremental progress towards #1920 .
2020-06-11 11:29:59 -07:00
Łukasz Magiera
163c2b2544
Merge remote-tracking branch 'origin/master' into next
2020-06-06 00:58:24 +02:00
laser
4855045ea2
pass context to paramfetch.GetParams
...
Fixes #1209
2020-06-05 10:28:00 -07:00
Łukasz Magiera
7003960fdd
Merge remote-tracking branch 'origin/master' into next
2020-06-01 18:52:06 +02:00
Jakub Sztandera
241c3fa673
Merge pull request #1869 from filecoin-project/feat/drand-pubsub
...
Add pubsub support to drand beacon
2020-05-29 18:06:38 +02:00
Łukasz Magiera
785eeb1eee
Merge pull request #1850 from filecoin-project/chore/lint
...
Cleanup many lint warnings
2020-05-29 18:06:06 +02:00
Jakub Sztandera
71eb41b9aa
Add pubsub support to drand beacon
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-05-29 17:55:17 +02:00
hannahhoward
0c4db8cf6b
fix(storageminer): add missing err check
...
Missing an err check in storage miner initialization in the stored ask
2020-05-28 17:05:17 -07:00
Jakub Sztandera
d6615b6286
Cleanup many lint warnings
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-05-27 22:53:20 +02:00
Jakub Sztandera
4604b60fb1
Remove drand on miner side, MinerGetBaseInfo provides the same info
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-05-27 20:24:26 +02:00
hannahhoward
3264a9faad
feat(deps): update to latest go-fil-markets
...
update to go-fil-markets v0.2.7 with latest changes, modify constructors as needed to accomodate new
DS Prefix customization
2020-05-20 16:01:03 -07:00
shannonwells
652c257763
passing w/ new namespace wraps
2020-05-20 15:58:59 -07:00
shannonwells
e68ab286f6
upgrade lotus to go-fil-markets v0.2.5
2020-05-20 15:56:58 -07:00
Łukasz Magiera
f7325a69c1
Extract auth utils to go-jsonrpc
2020-05-20 20:37:45 +02:00
Łukasz Magiera
ae60001dcc
post: Handle Recovering sectors
2020-05-20 18:41:20 +02:00
hannahhoward
581e7e6fde
chore(deps): update to fil-markets 0.2.1
...
Update fil-markets to 0.2.1 that no longer keeps streams open
2020-05-08 14:11:40 -07:00
Łukasz Magiera
523a7a9d8d
Merge pull request #1670 from filecoin-project/feat/update-markets-0.2.0
...
Update go-fil-markets
2020-05-06 01:45:33 +02:00
Jeromy
8b58f22c2e
block producers should have only one address
2020-05-05 12:01:44 -07:00
hannahhoward
a9866c757e
feat(deps): update go-fil-markets
...
Update to latest 0.2.0 release of go-fil-markets with less-blocking node io
2020-05-04 18:36:51 -07:00
Jeromy
6a27c65201
updating to specs actors v0.2.0
2020-04-28 13:52:07 -07:00
Travis Person
c807469a5a
bitswap: disable provider ( #1620 )
...
Co-authored-by: Travis Person <travisperson@users.noreply.github.com>
2020-04-27 15:54:16 -07:00
Aayush Rajasekaran
7c22dabb63
default to setting max piece size to sector size
2020-04-24 01:01:22 -04:00
Whyrusleeping
faa9002cce
working on sector pledge requirements after specs-actors 1.0.0 ( #1584 )
...
* WIP: working on sector pledge requirements after specs-actors 1.0.0
* update storage-fsm with pledge collateral logic
* Set bigger balances for miners
* Return only additional required pledge
* split collateral methods into two methods
Co-authored-by: Łukasz Magiera <magik6k@gmail.com>
2020-04-23 12:39:34 -07:00
Łukasz Magiera
b941b29fe5
miner: Use correct randomness for sealing
2020-04-20 20:33:53 +02:00
Łukasz Magiera
93b2b6d65d
Merge branch 'testnet/3' into feat/windowed-post
2020-04-17 18:38:20 +02:00
Łukasz Magiera
dc2a67f13f
Fix worker key resolving
2020-04-16 22:38:42 +02:00
Łukasz Magiera
afdfc8807d
api: Single method for static miner info
2020-04-16 19:36:36 +02:00
Jeromy
4e6839b5ef
some small cleanup
2020-04-14 15:13:52 -07:00
Jeromy
674be39af1
real drand network integration
2020-04-13 20:06:10 -07:00
Łukasz Magiera
5bf80a60f1
Get proof type in NewWinningPoStProver constructor
2020-04-13 23:25:46 +02:00
Łukasz Magiera
d3ffe48fcb
Get things to mostly build
2020-04-10 23:29:05 +02:00
Łukasz Magiera
e053cd6b9c
Merge remote-tracking branch 'origin/testnet/3' into feat/windowed-post
2020-04-10 23:09:01 +02:00
Łukasz Magiera
613e61222b
mostly wire up WindowedPoSt
2020-04-10 23:07:18 +02:00
Łukasz Magiera
3426611340
Merge pull request #1526 from filecoin-project/feat/pass-deal-schedule-for-pre-commit-expiry-scheduling
...
provide deal scheduling info to FSM so that it can set pre-commit expiry
2020-04-10 23:05:50 +02:00
Łukasz Magiera
072dd8b744
Merge remote-tracking branch 'origin/testnet/3' into feat/windowed-post
2020-04-10 20:38:25 +02:00
Łukasz Magiera
0f0015f45c
Merge pull request #1520 from filecoin-project/feat/graphsync-chainsync-extension
...
Update to latest go-fil-markets w/ enhanced Graphsync
2020-04-10 20:27:05 +02:00
laser
6dffe9377f
provide deal scheduling info to FSM so that it can set pre-commit expiry
2020-04-10 08:22:28 -07:00
Jeromy
ef6fb1b756
rename beacon to randombeacon
2020-04-08 16:10:08 -07:00
hannahhoward
00cd89750d
feat(deps): update fil-markets, graphsync
...
Updates dependencies for graphsync, fil-markets, data-transfer. Moves to new graphsync blockstore
swapping capabilities, and also locks down graphsync impl so it does not accept arbitrary requests
2020-04-07 23:25:29 -07:00
Jeromy
7075eaba26
WIP: random beacon interface
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-04-07 15:32:23 -07:00
Łukasz Magiera
e36f356908
wip changes for windowed post
2020-04-07 21:55:34 +02:00
Łukasz Magiera
5524241645
fpost -> windowPost renaming
2020-04-07 19:41:41 +02:00
laser
110c869dd3
cut over to storage-fsm, deleting local sealing package
2020-04-07 09:34:09 -07:00
laser
650a31b050
remove all lotus types from sealing package in preparation for extraction
...
events adapter
implement StateWaitMsg and StateComputeDataCommitment
implement StateGetSectorPreCommitOnChainInfo
implement ChainHead and SendMsg
implement remaining methods
2020-04-06 12:57:55 -07:00
Łukasz Magiera
f05be81275
fsm: Get correct interactive randomness if it lands on a nullblock
2020-04-04 04:57:05 +02:00
Łukasz Magiera
13f2c21e1d
Get network name from genesis
2020-04-01 01:15:49 +02:00
Łukasz Magiera
95ee1c1cde
Extract sector-storage
2020-03-28 01:32:39 +01:00
Łukasz Magiera
c66d3dfad7
sectorstorage: Untangle from lotus deps
2020-03-27 22:35:33 +01:00
Łukasz Magiera
e050e0307e
Cleanup after dropping sectorbuilder
2020-03-26 20:35:16 +01:00
Łukasz Magiera
4be54a976c
Merge sectorbuilder into sectorstorage
2020-03-26 03:51:06 +01:00
Łukasz Magiera
cfc65f525a
sectorstorage: wire up closing logic
2020-03-25 00:52:55 +01:00
Łukasz Magiera
5de17e903c
storageminer: Config for local worker task types
2020-03-24 20:38:00 +01:00
Łukasz Magiera
726c9c1fe7
workers: Address review
2020-03-24 19:01:04 +01:00
Łukasz Magiera
5e4a7e54df
Rename agvmgr+sealmgr to sectorstorage
2020-03-23 12:47:10 +01:00
Łukasz Magiera
1ed7779701
Merge remote-tracking branch 'origin/testnet/3' into feat/new-workers
2020-03-19 03:28:55 +01:00
laser
366db2f38c
adjust import order as per PR feedback
2020-03-18 12:43:06 -07:00
laser
f59bf6fab1
wire up dtypes.ClientDatastore
2020-03-18 11:57:22 -07:00
Łukasz Magiera
5f2caffb51
Fix tests after specs-storage changes
2020-03-18 02:08:11 +01:00
Łukasz Magiera
d8ce5078d9
Use new specs-storage interface
2020-03-17 21:19:52 +01:00
whyrusleeping
ab51c7e2d2
Fix fallback post scheduling to hopefully do the right thing
2020-03-08 00:19:38 -08:00
Łukasz Magiera
7db1dd52bd
storagemgr: Wire up most of AddPiece logic
2020-03-05 01:38:07 +01:00
Łukasz Magiera
a0dbb6bdd6
Storage Manager refactor
2020-03-03 23:19:22 +01:00
whyrusleeping
df6e3e83bf
make it all build finally
2020-02-27 13:45:31 -08:00
Łukasz Magiera
d787aa5007
Merge branch 'testnet/3' into feat/specs-actors
2020-02-24 18:32:02 +01:00
Łukasz Magiera
917df9a5b8
More unified randomness handling
2020-02-23 21:00:47 +01:00
Łukasz Magiera
69ec3c205a
Merge remote-tracking branch 'origin/master' into testnet/3
2020-02-19 22:10:14 +01:00
Aayush Rajasekaran
60970008c8
Re: #1250 : API methods should receive TipSetKeys, not TipSets, as input
2020-02-17 19:53:43 -05:00
Łukasz Magiera
c72727b4fd
specs-actors: Fix most compilation errors
2020-02-09 07:06:32 +01:00
hannahhoward
d2c5d81e59
fix(deps): update go-fil-markets
...
update go-fil-markets to latest to solve an issue with retrieval
2020-02-05 18:48:47 -08:00
Łukasz Magiera
0e81c1cf7e
Merge branch 'testnet/3' into feat/update-markets
2020-02-04 07:17:22 +01:00
Łukasz Magiera
90ecfbe0e4
Merge branch 'master' into feat/new-sb-fs
2020-02-04 04:15:25 +01:00
laser
d8f5330c29
don't consume short-lived context
2020-02-03 15:48:11 -08:00
laser
ea2f53745e
split FPoStScheduler from Miner
...
Rationale: Nodes want to handle scheduling of PoSts. Splitting the
FPoStScheduler from the Miner allows nodes to reuse the Miner w/out
having to reuse the PoSt scheduler.
2020-02-03 15:48:11 -08:00
Łukasz Magiera
a62572bb76
Merge remote-tracking branch 'origin/master' into feat/new-sb-fs
2020-01-31 08:36:47 +01:00
Łukasz Magiera
aefc463586
build: Lazy ParametersJson
2020-01-30 23:50:24 +01:00
Łukasz Magiera
3f58ffe572
storageminer: New storage config
2020-01-29 20:53:45 +01:00
Łukasz Magiera
5af64c53b6
initial sectorbuilder FS refactor integration
2020-01-29 00:08:02 +01:00
hannahhoward
71289b58ff
feat(markets): update to support car files
...
Upgrades lotus version of go-fil-markets to its head, which supports car files and handles tracking
of pieces, reducing the size of sectorBlocks
2020-01-28 14:08:13 -08:00
Łukasz Magiera
d4c50b8ea0
sealing: gofmt
2020-01-16 03:54:57 +01:00
Łukasz Magiera
604bf64ef6
Move miner sealing logic into a separate package
2020-01-15 21:49:11 +01:00
Łukasz Magiera
a2bcc1fec2
Mostly functional mock sectorbuilder
2020-01-14 03:05:35 +01:00
Łukasz Magiera
a896b30039
gofmt
2020-01-10 20:55:58 +01:00
Łukasz Magiera
50bac00329
Merge branch 'master' into feat/testnet2
2020-01-10 20:55:40 +01:00
hannahhoward
0ce1bf706b
refactor(markets): reorg file structure
2020-01-10 10:33:26 -08:00
hannahhoward
56653eeca6
fix(storagemarket): fix compile errors
2020-01-10 10:01:48 -08:00
hannahhoward
65ecb33630
feat(storagemarket): extract storage market
...
remove all shared components, point at go-fil-components repo
2020-01-10 09:49:07 -08:00
hannahhoward
0a4eeb7cb1
refactor(retrievalmarket): switch to go-fil-markets repo
...
Switch go-fil-components to go-fil-markets
2020-01-10 09:13:12 -08:00
hannahhoward
ccf359d057
feat(retrieval): extract retrievalmarket
...
Extract retrieval market and modify shared types
2020-01-09 19:46:07 -08:00
hannahhoward
da4528932a
feat(storagemarket): initial extraction
...
Types for storage market
Modify deals.Provider to implement storagemarket.StorageProvider
Inject storagemarket.StorageProvider
Storage Provider interfaces
Storage Client interfaces
Add ValidatePublishedDeal to ClientNodeAdapter
Remove FundManager from client
Remove Wallet from client
Remove StateManager, Events, Wallet from client
Rebasing
- Copy types.BigInt, use TokenAmount/BigInt for token amounts
- Remove auto-imported log package
- Move `checkAskSignature` to a client file.
- Plumb contexts through
fix(storagemarket): use publish cids
Switch back to publish message cids to reduce the dependency surface area
2020-01-10 03:29:46 +01:00
