Raúl Kripalani
b3c951c924
add RepoType#String; adjust repo parsing logic.
2021-07-29 12:22:27 -04:00
Raúl Kripalani
8442bac5b2
support MARKETS_API_INFO env var; support markets-repo, markets-api-url flags.
2021-07-29 12:20:05 -04:00
Raúl Kripalani
3144da86f3
add RepoType#String; adjust repo parsing logic.
2021-07-29 13:49:51 +01:00
Raúl Kripalani
4e19d8d562
support MARKETS_API_INFO env var; support markets-repo, markets-api-url flags.
2021-07-29 10:55:37 +01:00
Raúl Kripalani
d8c90b91be
address nits.
2021-07-29 04:41:27 -04:00
Raúl Kripalani
c119ab6ed9
fix docs and nits.
2021-07-29 04:39:28 -04:00
Anton Evangelatov
0dd83c6755
fixup
2021-07-29 04:38:25 -04:00
Anton Evangelatov
9b7a7713a7
add RuntimeSubsystems API method; use it in lotus-miner info
2021-07-29 04:38:19 -04:00
Raúl Kripalani
d3742048f9
address nits.
2021-07-28 23:56:18 +01:00
Raúl Kripalani
a61ba7b09c
Merge branch 'master' into nonsense/get-enabled-subsystems-api
2021-07-28 23:55:59 +01:00
Aayush Rajasekaran
21244704fc
Merge branch 'master' into mg/feat/configurable-sector-expirations
2021-07-28 16:45:27 -04:00
raulk
80aedcd276
Merge branch 'master' into nonsense/get-enabled-subsystems-api
2021-07-28 20:09:43 +01:00
Raúl Kripalani
07f40b9488
fix docs and nits.
2021-07-28 20:03:25 +01:00
Łukasz Magiera
389f71251c
Remove townhall
2021-07-28 17:58:46 +02:00
Anton Evangelatov
4cf5c8f656
fixup
2021-07-28 16:23:04 +03:00
Anton Evangelatov
de4a847078
add RuntimeSubsystems API method; use it in lotus-miner info
2021-07-28 16:02:05 +03:00
Jiaying Wang
d45b4a7a1f
Merge branch 'master' into chore/cleanup-chain
2021-07-27 17:11:36 -04:00
Łukasz Magiera
9bd312881d
VMSys doesn't belong in chainstore
2021-07-27 15:30:23 +02:00
vyzo
7c195245a1
make cfgdoc-gen
2021-07-27 12:13:26 +03:00
vyzo
9d25464703
use functional options for hotstore gc, rename MovingGC to FullGC
2021-07-27 09:53:22 +03:00
vyzo
aa0bd51b2c
thread GCFrequency option into the splitstore config
2021-07-26 15:05:57 +03:00
vyzo
20f93a520f
make cfgdoc-gen
2021-07-26 15:05:57 +03:00
vyzo
4cdb34e448
add docstrings for splitstore config
2021-07-26 15:05:57 +03:00
vyzo
5acae50e07
add config option for splitstore moving gc frequency
2021-07-26 15:05:57 +03:00
vyzo
a0d6fdba33
add ChainBlockstoreInfo APIv1 endpoint
2021-07-26 08:30:07 +03:00
vyzo
2dc72d5849
satisfy linter who wants to be a spell checker in comments
2021-07-25 11:47:21 +03:00
vyzo
3d2ae433ee
add ChainCheckBlockstore API
2021-07-25 11:14:48 +03:00
Mike Greenberg
e68c59f984
fix: Update node config docs
2021-07-23 21:05:50 -04:00
Mike Greenberg
64d2b7a122
Merge branch 'origin/master' into mg/feat/configurable-sector-expirations
...
* origin/master: (47 commits)
Fix links in issue templates
Update issue templates and add templates for M1
config: Add newlines consistently
config: Add note on codegen to types.go
fix lint
cli docsgen
config: Bring some docs from filecoin-docs
add comment about the necessity of FileIO
improve README
config doc gen: generate formatted code
config: Fix doc finding logic
Nicer lotus-miner config commands
Move doc-comment logic to the config pkg
config: doc struct codegen
lotus daemon config utils
adjust compaction test with badger to hit the db
add splitstore compaction test with badger markset
update README with configuration options
tweak badger options
some tweaks in badger markset
...
Conflicts:
node/config/def.go
2021-07-23 20:36:54 -04:00
Łukasz Magiera
91c6aca7e7
config: Add newlines consistently
2021-07-23 16:59:55 +02:00
Łukasz Magiera
80af6de316
config: Add note on codegen to types.go
2021-07-23 16:02:45 +02:00
Łukasz Magiera
ac2a1bfeab
fix lint
2021-07-23 15:53:31 +02:00
Łukasz Magiera
a26712ebc4
config: Bring some docs from filecoin-docs
2021-07-23 15:40:40 +02:00
Łukasz Magiera
ed7f70e68e
config doc gen: generate formatted code
2021-07-23 15:18:20 +02:00
Łukasz Magiera
3f4973cb41
config: Fix doc finding logic
2021-07-23 15:17:22 +02:00
Łukasz Magiera
8b1f19e94c
Move doc-comment logic to the config pkg
2021-07-23 14:55:19 +02:00
Łukasz Magiera
97f5bb66c7
config: doc struct codegen
2021-07-23 13:55:50 +02:00
Mike Greenberg
adb62a3fff
chore: Move cfg getter into PCPolicy; Clamp values on get
2021-07-22 15:07:03 -04:00
Mike Greenberg
9e34cce1f2
feat(config): support configurable CC sector expiration
2021-07-22 15:07:03 -04:00
Łukasz Magiera
660829703a
Merge remote-tracking branch 'origin/master' into feat/split-net-api
2021-07-22 15:38:06 +02:00
Łukasz Magiera
da5aeda197
Merge branch 'master' into feat/splitstore-hot-messages
2021-07-22 12:58:06 +02:00
Peter Rabbitson
4830a3406b
Introduce the LOTUS_CHAIN_BADGERSTORE_DISABLE_FSYNC envvar
...
Allows the user to control the opts.SyncWrites option of BadgerDs
2021-07-21 22:38:14 +02:00
Anton Evangelatov
fe31956713
fetch peer id from chain
2021-07-21 11:43:19 +02:00
vyzo
839b00ab40
rename messagepool ProtectMessages to ForEachPendingMessage
2021-07-20 09:23:36 +03:00
vyzo
ebbaf23af8
support out-of-chain reference protection
2021-07-20 09:02:40 +03:00
vyzo
1b77361301
add option for hotstore message retention
2021-07-17 08:35:35 +03:00
vyzo
e003203bea
implement exposed splitstore
2021-07-15 13:12:10 +03:00
Łukasz Magiera
812dc266cf
builder: Don't require specific NetAPI impl in StorageMinerAPI
2021-07-15 12:01:13 +02:00
Łukasz Magiera
49e26cce7d
api: Separate the Net interface from Common
2021-07-15 11:41:30 +02:00
hunjixin
bdaa73a413
add ChainGetMessagesInTipset api
2021-07-15 14:52:09 +08:00
Łukasz Magiera
583a8a13d9
Merge pull request #6629 from filecoin-project/feat/pledge-from-miner-balance
...
Config for collateral from miner available balance
2021-07-13 17:22:00 +02:00
Łukasz Magiera
837322ea59
Merge pull request #6356 from filecoin-project/nonsense/split-market-miner-processes
...
Support standalone miner-market process
2021-07-13 17:16:07 +02:00
Łukasz Magiera
7526a074d9
sealing: collateral buffer / falback config
2021-07-13 17:04:58 +02:00
Łukasz Magiera
c37401a1a3
Merge pull request #6474 from filecoin-project/feat/splitstore-redux
...
Splitstore Enhanchements
2021-07-13 12:43:57 +02:00
hannahhoward
92ec239202
fix(node): ClientRetrieve stops on cancel
...
When a deal is cancelled, any in progress calls to ClientRetrieve or ClientRetrieveWithEvents should
return
2021-07-12 14:46:18 -07:00
Łukasz Magiera
83f2368507
Add CollateralFromMinerBalance config
2021-07-12 14:11:58 +02:00
Anton Evangelatov
4bc9fa04ba
rename cfg.Subsystems.EnableStorageMarket to EnableMarkets
2021-07-12 12:12:29 +02:00
Anton Evangelatov
056136ef5a
rename argument from url to apiInfo
2021-07-12 11:36:22 +02:00
Anton Evangelatov
a423c46f2a
rename mock.go to net.go
2021-07-12 11:35:03 +02:00
Anton Evangelatov
d89ddb9315
resolve conflicts
2021-07-12 11:34:37 +02:00
Anton Evangelatov
16784aa2cc
remove pieceProvider from DI; small refactors
2021-07-12 11:30:26 +02:00
vyzo
c0a1cfffa1
rename noopstore to discardstore
2021-07-09 19:19:37 +03:00
vyzo
abdf4a161a
explicitly switch marksets for concurrent marking
...
this has very noticeable impact in initial marking time; it also allows us
to get rid of the confusing ts monikers.
2021-07-09 04:26:36 +03:00
Łukasz Magiera
ed0cc0b56d
Handle bad peerIDs in MarketListRetrievalDeals
2021-07-08 19:27:03 +02:00
Łukasz Magiera
8f5c0c60f5
Config for deal publishing control addresses
2021-07-07 18:00:54 +02:00
Anton Evangelatov
82efe01c70
fixup
2021-07-07 18:00:28 +02:00
Anton Evangelatov
6b014f57e5
pass Subsystems to StorageMiner option; add enableLibp2p bool in Settings
2021-07-07 13:56:37 +02:00
Anton Evangelatov
42ae876711
remove ApplyIfEnableLibP2P
2021-07-07 13:31:56 +02:00
Anton Evangelatov
7a78527fde
remove not used sa; cleanup
2021-07-06 17:46:21 +02:00
Anton Evangelatov
10dc90f7fe
addressing comments
2021-07-06 17:33:47 +02:00
Anton Evangelatov
898687ea2e
Update node/modules/storageminer.go
...
Co-authored-by: Łukasz Magiera <magik6k@users.noreply.github.com>
2021-07-06 17:28:52 +02:00
Anton Evangelatov
ff2772a58c
resolved conflicts
2021-07-06 16:00:41 +02:00
Łukasz Magiera
97207df705
Merge pull request #6639 from filecoin-project/frrist/context-in-statetree-diff
...
polish(statetree): accept a context in statetree diff for timeouts
2021-07-05 17:30:31 +02:00
Anton Evangelatov
4be0a7a215
resolve conflicts with master
2021-07-05 13:13:32 +02:00
vyzo
190cb18ab0
housekeeping
...
- remove defunct tracking store implementations
- update splitstore node config
- use mark set type config option (defaulting to mapts); a memory constrained node
may want to use an on-disk one
2021-07-04 18:38:28 +03:00
vyzo
5f7ae1f489
update splistore DI constructor
2021-07-04 18:38:28 +03:00
vyzo
68bc5d2291
skip moving cold blocks when running with a noop coldstore
...
it is a noop but it still takes (a lot of) time because it has to read all the cold blocks.
2021-07-04 18:38:28 +03:00
vyzo
649b7dd162
add config option for hot headers
2021-07-04 18:38:28 +03:00
vyzo
997f2c098b
keep headers hot when running with a noop splitstore
2021-07-04 18:38:28 +03:00
vyzo
04f2e102a1
kill full splitstore compaction, simplify splitstore configuration
2021-07-04 18:38:28 +03:00
vyzo
5cca29d1db
hook noop blockstore for splitstore in DI
2021-07-04 18:38:28 +03:00
Łukasz Magiera
8a94ab676e
storage: Fix FinalizeSector with sectors in stoage paths
2021-07-02 19:54:45 +02:00
Anton Evangelatov
9e85492b85
fix test
2021-07-02 12:24:07 +02:00
Anton Evangelatov
96245c3cfa
lint
2021-07-02 12:02:36 +02:00
Anton Evangelatov
4194c7fa24
revert back optional for Miner; remove ActorAddress call in node.MinerHandler
2021-07-02 11:58:31 +02:00
Raúl Kripalani
1869de7662
unwire host from storage.Miner.
2021-07-01 13:53:20 +01:00
Łukasz Magiera
c094aa82ec
commit batch: AggregateAboveBaseFee config
2021-07-01 13:33:54 +02:00
frrist
d02a2a2cfa
polish(statetree): accept a context in statetree diff for timeouts
...
- this operation can take a while, this changes gives users the option
to abort if it takes "too long".
2021-06-30 16:40:43 -07:00
Anton Evangelatov
3aa6d03cc1
connect miner to full node , only when running markets
2021-06-30 16:45:11 +02:00
Anton Evangelatov
4f0a96c9c7
resolved conflicts
2021-06-30 13:16:52 +02:00
Anton Evangelatov
9ec7cd7239
enable libp2p options
2021-06-30 12:55:43 +02:00
Łukasz Magiera
e9dd3e8650
Test Miner SimultaneousTransfers
2021-06-28 18:17:29 +02:00
Łukasz Magiera
37c5dd5afc
Miner SimultaneousTransfers config
2021-06-28 14:24:14 +02:00
Łukasz Magiera
3f3336340f
Fix wallet error messages
2021-06-25 10:48:47 +02:00
Łukasz Magiera
c3480dc0e8
Merge remote-tracking branch 'origin/releases' into chore/merge-release
2021-06-24 09:39:11 +02:00
Łukasz Magiera
9521c0b773
Add miner-side MaxDealStartDelay config
2021-06-23 19:45:13 +02:00
Łukasz Magiera
0e4cd3c599
Merge pull request #6563 from filecoin-project/asr/batch-starter
...
Always flush when timer goes off
2021-06-23 19:19:30 +02:00
Aayush Rajasekaran
616e5688fc
Remove MinPreCommitBatch
2021-06-23 12:30:32 -04:00
Łukasz Magiera
fa2be42eb0
Merge remote-tracking branch 'origin/release/v1.10.0' into chore/merge-1.10
2021-06-23 15:51:00 +02:00
Anton Evangelatov
4217ec5308
make auth on remote rpc server optional
2021-06-23 13:27:03 +02:00
Anton Evangelatov
21b51328f9
adding TestDealWithMarketAndMinerNode
2021-06-23 12:44:52 +02:00
Jakub Sztandera
bf82b96fd8
Update default fees for aggregates
...
Resolves #6422
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2021-06-22 20:20:01 +02:00
Anton Evangelatov
6720463799
resolve merge conflicts
2021-06-22 11:28:23 +02:00
Raúl Kripalani
b6147fb27f
extern/storage: retype resource filtering strategy to enum.
2021-06-21 20:28:15 +01:00
Anton Evangelatov
577b730415
wip
2021-06-18 18:42:34 +02:00
Łukasz Magiera
097baeb9b0
Make batch deal input test less flaky
2021-06-17 20:52:09 -04:00
Łukasz Magiera
5c8498b603
storagefsm: Fix batch deal packing behavior
2021-06-17 20:50:14 -04:00
Łukasz Magiera
44de67cf7d
Merge pull request #6175 from filecoin-project/feat/dynamic-retreival-pricing
...
Dynamic Retrieval pricing
2021-06-17 10:25:48 +02:00
Anton Evangelatov
d45bb14015
Merge branch 'master' into nonsense/split-market-miner-processes
2021-06-16 18:49:15 +02:00
Aayush Rajasekaran
520a0091f5
Merge branch 'releases' into release/v1.10.0
2021-06-15 17:40:36 -04:00
Łukasz Magiera
0514f38dc4
Merge remote-tracking branch 'origin/master' into chore/merge-1.10
2021-06-14 13:27:53 +02:00
Anton Evangelatov
31e6fb154e
resolve conflicts
2021-06-14 11:27:54 +02:00
aarshkshah1992
4419205b0e
fix compilation
2021-06-14 10:10:29 +05:30
Aarsh Shah
bed2bc73a3
Update node/config/def.go
...
Co-authored-by: raulk <raul@protocol.ai>
2021-06-14 09:42:22 +05:30
Łukasz Magiera
94be3a973a
Don't enable early finalization by default
2021-06-11 11:45:20 +02:00
Łukasz Magiera
ec06f086ef
sealing: Early finalization option
2021-06-11 11:41:28 +02:00
aarshkshah1992
fed5afa704
merge master
2021-06-11 09:35:20 +05:30
Łukasz Magiera
6f80d9f3c2
Merge pull request #6311 from filecoin-project/raulk/itests
...
consolidate integration tests into `itests` package; create test kit; cleanup
2021-06-10 12:33:29 +02:00
Jennifer Wang
8f426b49ec
updated configuration comments for docs
2021-06-09 23:36:44 -04:00
Jennifer
3a1ad50da5
Merge pull request #6440 from filecoin-project/jen/miner-config-doc
...
updated configuration comments for docs
2021-06-09 23:35:04 -04:00
Jennifer Wang
95ad74a156
updated configuration comments for docs
2021-06-09 20:44:20 -04:00
Raúl Kripalani
6d46be53bd
make tests no longer create auth tokens.
2021-06-10 00:15:29 +01:00
Łukasz Magiera
f0a2e97cb5
fee config for sector batching
2021-06-09 14:23:06 -04:00
Raúl Kripalani
81b3c6e2ab
Merge branch 'master' into raulk/itests
2021-06-09 17:34:46 +01:00
Anton Evangelatov
beb5bffaf6
fix log.Error; rename RemoteStore
2021-06-09 13:05:54 +02:00
Łukasz Magiera
78171055e7
fee config for sector batching
2021-06-08 15:45:32 +02:00
Anton Evangelatov
9f3ec82cc1
initial resolution of conflicts
2021-06-08 13:01:22 +02:00
aarshkshah1992
4e9bb16532
changes as per review
2021-06-08 10:09:27 +05:30
aarshkshah1992
16166504f4
merged master
2021-06-08 09:17:40 +05:30
Raúl Kripalani
a274fcc533
Merge branch 'master' into raulk/itests
2021-06-07 23:44:22 +01:00
Raúl Kripalani
db1a61852d
Merge branch 'master' into raulk/itests
2021-06-07 23:17:44 +01:00
Jakub Sztandera
f9acd07987
Update libp2p to 0.14.1
...
This does not resolve the CI issue but prepares us for it after https://github.com/libp2p/go-libp2p/pull/1116
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2021-06-07 18:51:48 +02:00
Łukasz Magiera
fadc79a487
Merge pull request #6280 from filecoin-project/feat/pieceread-outside-scheduler
...
Bypass task scheduler for reading unsealed pieces
2021-06-07 18:11:44 +02:00
Łukasz Magiera
8625da3479
Bump miner/worker api versions
2021-06-07 16:57:24 +02:00
aarshkshah1992
21e6b50294
finished rebasing PR
2021-06-07 16:02:15 +05:30
Anton Evangelatov
de646a5b93
fix node builder
2021-06-07 12:16:10 +02:00
aarshkshah1992
4efaa8d688
unit tests for the remote store Reader
2021-06-07 15:02:52 +05:30
aarshkshah1992
65eb610ec3
docs, logs and green ci
2021-06-07 15:02:49 +05:30
aarshkshah1992
670835fca0
bypass task scheduler for reading unsealed pieces
2021-06-07 15:02:04 +05:30
Lion
e4588aed5c
Fix the doc errors of the sealing config funcs
2021-06-07 12:35:43 +08:00
Dirk McCormick
52b90e4c9d
test: offline deals
2021-06-04 22:42:07 +02:00
Łukasz Magiera
a7746961fb
Merge remote-tracking branch 'origin/master' into feat/list-retrievals
2021-06-04 20:49:01 +02:00
Anton Evangelatov
ded5341da0
fixup test node builder
2021-06-04 17:22:36 +02:00
Anton Evangelatov
ed634bc3a4
rebuild docs
2021-06-04 17:06:55 +02:00
Anton Evangelatov
c4d10bc44e
apply messagepool.NewProviderLite to lite nodes
2021-06-04 16:51:07 +02:00
Anton Evangelatov
6f125cc129
add prover to fullnode and miner builders
2021-06-04 16:26:32 +02:00
Anton Evangelatov
d9a7348ae1
use masters filecoin-ffi
2021-06-04 16:20:40 +02:00
Anton Evangelatov
8bd09e39ca
resolve merge conflicts
2021-06-04 16:17:00 +02:00
Anton Evangelatov
c877166b4a
add messagepool to test node constructor
2021-06-04 15:53:33 +02:00
Anton Evangelatov
88756f3ebf
fix TestAPIDeal tests
2021-06-04 15:41:38 +02:00