Aayush Rajasekaran
616e5688fc
Remove MinPreCommitBatch
2021-06-23 12:30:32 -04:00
Anton Evangelatov
21b51328f9
adding TestDealWithMarketAndMinerNode
2021-06-23 12:44:52 +02:00
Anton Evangelatov
6720463799
resolve merge conflicts
2021-06-22 11:28:23 +02:00
Łukasz Magiera
44de67cf7d
Merge pull request #6175 from filecoin-project/feat/dynamic-retreival-pricing
...
Dynamic Retrieval pricing
2021-06-17 10:25:48 +02:00
Anton Evangelatov
d45bb14015
Merge branch 'master' into nonsense/split-market-miner-processes
2021-06-16 18:49:15 +02:00
Aayush Rajasekaran
520a0091f5
Merge branch 'releases' into release/v1.10.0
2021-06-15 17:40:36 -04:00
Łukasz Magiera
0514f38dc4
Merge remote-tracking branch 'origin/master' into chore/merge-1.10
2021-06-14 13:27:53 +02:00
aarshkshah1992
4419205b0e
fix compilation
2021-06-14 10:10:29 +05:30
Łukasz Magiera
ec06f086ef
sealing: Early finalization option
2021-06-11 11:41:28 +02:00
Anton Evangelatov
9f3ec82cc1
initial resolution of conflicts
2021-06-08 13:01:22 +02:00
aarshkshah1992
16166504f4
merged master
2021-06-08 09:17:40 +05:30
aarshkshah1992
4efaa8d688
unit tests for the remote store Reader
2021-06-07 15:02:52 +05:30
aarshkshah1992
65eb610ec3
docs, logs and green ci
2021-06-07 15:02:49 +05:30
aarshkshah1992
670835fca0
bypass task scheduler for reading unsealed pieces
2021-06-07 15:02:04 +05:30
Anton Evangelatov
8bd09e39ca
resolve merge conflicts
2021-06-04 16:17:00 +02:00
Anton Evangelatov
e4136b0d42
add modules.StorageAuthWithURL to set correct token
2021-06-01 11:42:28 +02:00
Łukasz Magiera
1e4456138e
Merge master into feat/nv13
2021-05-27 12:28:20 +02:00
aarshkshah1992
dc6dbc9a11
dpr changes and test based on new unsealing PR
2021-05-22 22:40:21 +05:30
aarshkshah1992
bd9959070e
unit tests for the remote store Reader
2021-05-20 15:25:46 -06:00
aarshkshah1992
73613ee883
docs, logs and green ci
2021-05-20 15:25:46 -06:00
aarshkshah1992
2a40c802ea
bypass task scheduler for reading unsealed pieces
2021-05-20 15:25:46 -06:00
Anton Evangelatov
cb603c62d9
update retrievaladapter ; add piece_provider
2021-05-20 12:49:53 +02:00
Anton Evangelatov
2aad7b6979
update sectorstorage.New (Manager) interface
2021-05-20 12:32:29 +02:00
Łukasz Magiera
a5677d1b7a
ffiwrapper: Separate Prover interface
2021-05-19 15:20:23 +02:00
Łukasz Magiera
81b5d8c671
Make things build with both batchers
2021-05-18 16:53:49 +02:00
Łukasz Magiera
c7ba083fa4
Import precommit batcher
2021-05-18 16:51:06 +02:00
vyzo
7512748b56
wire in sealing config values
2021-05-18 15:31:52 +03:00
Łukasz Magiera
506f39b294
WIP: Integrate FIP0013
2021-05-11 22:10:29 -04:00
Łukasz Magiera
81bd27911f
Propagate StateMsg api changes
2021-04-05 19:56:53 +02:00
Łukasz Magiera
deb2b90b6a
Fix lotus/miner build
2021-04-05 13:23:46 +02:00
Dirk McCormick
aee9890ee7
feat: update go-data-transfer and go-fil-markets
2021-03-23 13:28:30 +01:00
Łukasz Magiera
305c2ec77d
miner: Config to disable owner/worker addcess fallback
2021-03-08 21:33:46 +01:00
Raúl Kripalani
7f0f7d0b36
Merge branch 'master' into refactor/lib/blockstore
2021-02-28 19:55:23 +00:00
Łukasz Magiera
0c6aef221d
Fix error logging format strings
2021-02-11 12:00:26 +01:00
Łukasz Magiera
9b65793509
Merge pull request #5404 from filecoin-project/feat/test-window-post
...
Retry proofs if we generate an incorrect one
2021-02-03 13:04:33 +01:00
Łukasz Magiera
1e7a107484
Merge pull request #5433 from filecoin-project/feat/keep-unsealed-cfg
...
Add miner config to always keep ensealed deal copies
2021-02-03 12:40:02 +01:00
Raúl Kripalani
af429dba0f
Merge branch 'master' into chore/snake_context_through_blockstore_init
2021-01-29 21:21:46 +00:00
Raúl Kripalani
b0cbc932bd
consolidate all blockstores in blockstore package.
2021-01-29 20:01:00 +00:00
Łukasz Magiera
d4c7b63aac
Add miner config to always keep ensealed deal copies
2021-01-26 17:50:31 +01:00
Raúl Kripalani
a1da1dab85
add context to LockedRepo#Datastore().
2021-01-26 11:01:43 +00:00
Steven Allen
8de4e5e005
retry proofs if we generate an incorrect one
2021-01-22 13:31:47 -08:00
Steven Allen
03cd3760bb
correctly pick the seal type based on the network version
...
Of course, we should really just run all of our tests post actors v2.
2021-01-21 15:21:20 -08:00
Aayush Rajasekaran
ab90a3b2bc
Actors update: MinerInfo.SealProofType has been removed
2021-01-21 15:21:19 -08:00
Łukasz Magiera
0cb2f51549
Merge pull request #5094 from filecoin-project/asr/verified-only
...
Allow miners to filter (un)verified deals
2020-12-10 19:48:22 +01:00
Łukasz Magiera
2fd93a55ac
plumb AddressSelector to stoage fsm
2020-12-02 21:47:54 +01:00
Łukasz Magiera
7246ef273f
miner: Control address config for (pre)commits
2020-12-02 19:58:00 +01:00
Aayush Rajasekaran
370817eb60
Allow miners to filter (un)verified deals
2020-12-02 01:32:34 -05:00
hannahhoward
afec58f780
feat(markets): add logging on data-transfer to miner
2020-11-23 12:43:30 -08:00
Łukasz Magiera
4483d94db3
Merge pull request #4902 from GFZRZK/GFZRZK/patch/remove_unuseful_code_in_newstorageask
...
just return storedask.NewStoredAsk to reduce unuseful code
2020-11-20 16:28:03 +01:00
wangchao
49f8590578
just return storedask.NewStoredAsk to reduce unuseful code
2020-11-18 13:53:48 +08:00
Aayush Rajasekaran
68a16afeda
Merge branch 'master' into release/v1.2.0
2020-11-17 19:40:05 -05:00
Łukasz Magiera
3536ec9f85
Merge pull request #4879 from filecoin-project/fix/4833
...
Fix MaxSealingSectrosForDeals getting reset to 0
2020-11-17 23:41:22 +01:00
hannahhoward
a2abeef727
feat(markets): upgrade to fix cid recording issue
2020-11-16 17:57:57 -08:00
Łukasz Magiera
dd9682f2be
Fix MaxSealingSectrosForDeals getting reset to 0
2020-11-17 00:28:49 +01:00
Steven Allen
638900f97f
Remove static proof type configuration from market subsystem
...
Instead, use proof type from miner actor. This will, in turn, use the upgraded
proof type if/when it's switched at runtime.
TODO: Consider making this some form of config option instead?
2020-11-16 19:04:17 +01:00
Steven Allen
931979809f
get lotus building
2020-11-16 19:03:30 +01:00
Łukasz Magiera
6bea9dd178
Making sealing logic work with multiple seal proof types
2020-11-16 19:03:30 +01:00
Dirk McCormick
26e12e6f6a
fix: dont crash on startup if funds migration fails
2020-11-12 17:15:05 +01:00
hannahhoward
9f7204ee26
feat(builder): finish new FundManager setup
...
Finish setup of new FundManager and provide a migration for previously reserved funds
2020-11-10 21:11:05 -08:00
Dirk McCormick
0d243bb824
refactor: integrate new FundManager
2020-11-10 21:11:05 -08:00
Łukasz Magiera
e1da874258
Merge remote-tracking branch 'origin/master' into feat/async-restartable-workers
2020-10-27 03:31:07 +01:00
Steven Allen
0d06f8fa2b
Add commands to change the worker key
2020-10-26 18:16:24 -07:00
Łukasz Magiera
660236b224
Merge remote-tracking branch 'origin/master' into feat/async-restartable-workers
2020-10-23 23:25:35 +02:00
Steven Allen
4e730b5ec8
port to v2 imports
2020-10-21 12:16:23 -07:00
Ingar Shu
1974490ab0
Don't overwrite previously-configured maxPieceSize for a persisted ask
2020-10-19 13:12:28 -07:00
Łukasz Magiera
7ac5dc55d0
Merge remote-tracking branch 'origin/master' into feat/async-restartable-workers
2020-10-17 13:45:11 +02:00
Łukasz Magiera
111942b50b
Merge pull request #4424 from filecoin-project/feat/retrieval-cli-deal-filter
...
Custom filters for retrieval deals
2020-10-16 18:41:40 +02:00
Ingar Shu
0b7dc6971d
Rebasing
2020-10-15 09:33:01 -07:00
hannahhoward
b29e3b5242
feat(markets): use build.BlockDelaySecs for start buffer
...
instead of constant from spec-actors which uses hardcoded start epoch, use one that factors in
possibility of different block time
2020-10-14 21:28:36 -07:00
Aarsh Shah
30dd5d9644
use updated stored ask api
2020-10-14 11:39:57 +02:00
Łukasz Magiera
71b3b9075d
Merge remote-tracking branch 'origin/master' into feat/async-restartable-workers
2020-10-13 21:33:21 +02:00
hannahhoward
4edebcec2b
feat(markets): update markets 0.9.0 and add data transfer restart command
2020-10-13 03:41:08 -07:00
Ingar Shu
49155ace62
Use seal-duration in calculating the earliest StartEpoch that we will consider ( #4337 )
2020-10-12 17:45:37 -03:00
Steven Allen
748d2e82a7
unshare the journal
...
Motivation:
* Run lotus with the race detector enabled (primary motivation).
* Allow multiple lotus nodes in a process (not a high priority).
Previously, the journal was shared between all lotus instances, but it was
initialized for every new node. This caused safety problems in tests (at a
minimum).
This patch explicitly passes the journal to all services that need it.
2020-10-09 13:23:07 -07:00
Łukasz Magiera
0de3051821
Merge remote-tracking branch 'origin/master' into feat/async-restartable-workers
2020-10-08 13:10:41 +02:00
Ingar Shu
1227bf2893
Change max time in future for StartEpoch to 7 days
2020-10-05 12:35:58 -07:00
Ingar Shu
550f3771ea
Reject deals that are > 90 days in the future in the BasicDealFilter
2020-10-05 11:39:02 -07:00
Łukasz Magiera
5932f28519
Merge remote-tracking branch 'origin/master' into feat/async-restartable-workers
2020-10-01 02:39:48 +02:00
hannahhoward
be884e27be
feat(markets): update markets 0.7.0
2020-09-30 10:26:50 -07:00
Łukasz Magiera
cf71f034dc
Merge remote-tracking branch 'origin/dev' into feat/async-restartable-workers
2020-09-26 12:35:32 +02:00
Łukasz Magiera
ef28ebb14a
Ignition upgrades, much excite.
2020-09-25 23:55:37 -07:00
Łukasz Magiera
03c3d8bdb3
workers: Return unfinished tasks on restart
2020-09-22 00:52:33 +02:00
Łukasz Magiera
5e09581256
sectorstorage: get new work tracker to run
2020-09-16 22:33:58 +02:00
Łukasz Magiera
03cf6cca40
Merge remote-tracking branch 'origin/master' into feat/async-restartable-workers
2020-09-15 17:47:03 +02:00
Raúl Kripalani
954ff32503
fix transitive api dependency on ffi.
2020-09-14 19:01:35 +01:00
Łukasz Magiera
1ebca8f732
more working code
2020-09-14 19:09:01 +02:00
Raúl Kripalani
09e9d6d778
deal journal events: wire into markets subscriptions.
2020-09-14 16:20:01 +01:00
Raúl Kripalani
6d29d75724
Merge branch 'master' into inmem-journal
2020-09-14 12:17:45 +01:00
Aayush Rajasekaran
39755a294a
Update to specs v0.9.6
2020-09-07 15:48:41 -04:00
Raúl Kripalani
3206f92063
Merge branch 'master' into inmem-journal
2020-09-02 19:50:52 +01:00
Jakub Sztandera
625c6951bb
Don't use context to close bitswap
...
Use just the Close
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-08-31 19:24:04 +02:00
hannahhoward
0a36db06ed
feat(markets): update to markets v0.5.8
2020-08-28 18:03:27 -07:00
Raúl Kripalani
efdfd3ee3e
Merge branch 'master' into inmem-journal
2020-08-26 16:38:23 +01:00
Raúl Kripalani
4e1ef09751
make journal a global var.
2020-08-26 16:09:37 +01:00
Łukasz Magiera
a03192a39b
Separate concurrent sealing sector limit for deals
2020-08-18 21:48:18 +02:00
Łukasz Magiera
baf91f08a1
Unbreak tests
2020-08-18 18:27:18 +02:00
Łukasz Magiera
65ffde9e4b
fsm: Config for max WaitDeals sectors
2020-08-18 16:20:31 +02:00
Raúl Kripalani
862bafc63a
fix lint errors.
2020-08-17 14:39:33 +01:00
Raúl Kripalani
efdc428d5d
keep storage-fsm (renamed to storage-sealing) and sector-storage in extern.
2020-08-17 14:26:18 +01:00
Raúl Kripalani
3c17cd655e
integrate extern/sector-storage into lotus proper.
2020-08-16 11:09:58 +01:00
Raúl Kripalani
fb0ccc9260
integrate extern/storage-fsm into lotus proper.
2020-08-16 10:42:13 +01:00
hannahhoward
6b5525b8d2
feat(markets): update markets 0.5.6
...
update markets to 0.5.6, removing use of validators that moved inside markets
2020-08-14 11:14:03 -07:00
Łukasz Magiera
6f890a3edd
Miner fee config
2020-08-12 19:47:09 +02:00
Raúl Kripalani
2ea5abdfb5
wire journal into miner.
2020-08-11 13:48:32 +01:00
Raúl Kripalani
92598237c3
Merge branch 'next' into inmem-journal
2020-08-11 12:41:11 +01:00
Łukasz Magiera
73b8868046
gofmt
2020-08-06 03:32:59 +02:00
Łukasz Magiera
f8b8ecc0c3
Consensus filter
2020-08-06 03:16:39 +02:00
Łukasz Magiera
3ae55d1da3
Merge pull request #2714 from filecoin-project/feat/user-dealfiter
...
Support external deal decision logic
2020-07-31 21:56:44 +02:00
Aayush Rajasekaran
c33e38eef2
Update markets
2020-07-31 15:43:34 -04:00
Łukasz Magiera
fc3c91b738
Support external deal decision logic
2020-07-31 20:29:16 +02:00
hannahhoward
e201408d61
feat(markets): better event logging
2020-07-31 12:55:45 +02:00
Łukasz Magiera
4d328cad54
Get things to mostly work
2020-07-30 14:31:50 +02:00
Aayush Rajasekaran
5df0ee7935
Merge pull request #2647 from filecoin-project/feat/better-seal-duration-ui
...
Feat/better seal duration ui
2020-07-28 21:32:54 -04:00
whyrusleeping
dd8c88b418
improve some seal duration things
2020-07-28 17:40:42 -07:00
Łukasz Magiera
09b90773d8
Merge remote-tracking branch 'origin/next' into feat/cid-builder
2020-07-28 16:06:06 +02:00
hannahhoward
5a623cccb5
feat(markets): update markets mulitple deal stores
2020-07-27 23:13:28 -07:00
Steven Allen
b7a4dbb07f
Support inline CIDs
...
And use the new CidBuilder from the spec actors.
This patch does not switch over to inline CIDs by default, but paves the way.
2020-07-23 23:12:32 -07:00
Raúl Kripalani
d6e6eedd58
pipe sealing events to the journal.
2020-07-21 13:02:51 +01:00
Raúl Kripalani
226786c1da
wip
2020-07-20 14:45:17 +01:00
Łukasz Magiera
d266c665b0
Update sector-storage with windowed scheduler
2020-07-18 00:38:02 +02:00
Aayush Rajasekaran
a5ef629cef
Add expected seal duration to custom deal logic, reject deals that start too early
2020-07-15 17:31:50 -04:00
hannahhoward
61f120222f
feat(markets): update markets with new retrieval
2020-07-15 14:04:31 -07:00
Frank
14ec9a2068
update storage miner and seal worker document
2020-07-11 16:55:13 +08:00
hannahhoward
24e3a4218b
feat(markets): upgrade to latest
...
upgrade to latest markets with fast retrieval, underlying data transfer upgrade
2020-07-08 01:35:50 -07:00
Aayush Rajasekaran
411c82ae8f
Update storage-FSM, add API to set sector seal delay
2020-07-07 15:23:23 -04:00
laser
b9180a99d4
toggle consideration of offline storage/retrieval deal proposals
2020-06-26 12:27:41 -07:00
laser
e910a045d0
big rename to allow for later introducing the "consider offline" config
2020-06-26 10:50:54 -07:00
laser
ef0abf2b98
disable/enable retrieval deal consideration via config
2020-06-24 08:07:12 -07:00
Raúl Kripalani
d20255b1b4
provide an option to disable loading of built-in assets.
2020-06-22 19:42:04 +01:00
laser
de7d6c255c
blacklist -> blocklist
2020-06-18 15:51:01 -07:00
laser
0c8d648998
specify which CID is being blacklisted (it's the piece)
2020-06-18 14:02:22 -07:00
laser
aa18d1985e
reject storage deal proposals containing blacklisted piece CIDs
2020-06-18 13:32:20 -07:00
laser
b0edf924b4
add commands for manipulating storage deal CID blacklist
2020-06-18 13:15:18 -07:00
hannahhoward
9262661135
chore(deps): update to fil-markets 0.3.0
...
Updates to latest fil markets with resumability and other fixes
2020-06-15 15:43:47 -07:00
laser
36b327b57b
various symbol renames
2020-06-11 13:18:18 -07:00
laser
7587e6c08b
get and set storage deal acceptance through CLI
2020-06-11 12:59:50 -07:00
laser
5421d0d1c5
better field and struct names + set default appropriately
...
Storage miners, by default, should be configured to accept storage deals.
2020-06-11 12:15:28 -07:00
laser
c458b4712a
better rejection messages
2020-06-11 12:06:38 -07:00
laser
d6b2519843
config-driven IsAcceptingStorageDeals flag
...
Makes incremental progress towards #1920 .
2020-06-11 11:29:59 -07:00
Łukasz Magiera
163c2b2544
Merge remote-tracking branch 'origin/master' into next
2020-06-06 00:58:24 +02:00
laser
4855045ea2
pass context to paramfetch.GetParams
...
Fixes #1209
2020-06-05 10:28:00 -07:00
Łukasz Magiera
7003960fdd
Merge remote-tracking branch 'origin/master' into next
2020-06-01 18:52:06 +02:00
Jakub Sztandera
241c3fa673
Merge pull request #1869 from filecoin-project/feat/drand-pubsub
...
Add pubsub support to drand beacon
2020-05-29 18:06:38 +02:00
Łukasz Magiera
785eeb1eee
Merge pull request #1850 from filecoin-project/chore/lint
...
Cleanup many lint warnings
2020-05-29 18:06:06 +02:00
Jakub Sztandera
71eb41b9aa
Add pubsub support to drand beacon
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-05-29 17:55:17 +02:00
hannahhoward
0c4db8cf6b
fix(storageminer): add missing err check
...
Missing an err check in storage miner initialization in the stored ask
2020-05-28 17:05:17 -07:00
Jakub Sztandera
d6615b6286
Cleanup many lint warnings
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-05-27 22:53:20 +02:00
Jakub Sztandera
4604b60fb1
Remove drand on miner side, MinerGetBaseInfo provides the same info
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-05-27 20:24:26 +02:00
hannahhoward
3264a9faad
feat(deps): update to latest go-fil-markets
...
update to go-fil-markets v0.2.7 with latest changes, modify constructors as needed to accomodate new
DS Prefix customization
2020-05-20 16:01:03 -07:00
shannonwells
652c257763
passing w/ new namespace wraps
2020-05-20 15:58:59 -07:00
