cerc-io/lotus
16
0
Fork 0
Code Issues Pull Requests Packages Projects Releases 27 Wiki Activity
13,273 Commits 24 Branches 342 Tags 314 MiB
a0f1696f36
Commit Graph

2276 Commits

Author SHA1 Message Date
Raúl Kripalani
a0f1696f36 remove MaxConcurrentReadyFetches=2 default value. 
This was there to deal with migration IO workload. This is no
longer a problem with the new migration logic. The initialize-all
operation/command deals with concurrency.

For ongoing operation, miners can set the value they wish, but
we do not make a decision for them by default, because each
deployment can handle different IO loads.
 2021-08-06 12:27:50 +01:00
raulk
b418f82cf5
Merge pull request #6995 from filecoin-project/feat/miner-tmp 2021-08-06 12:07:58 +01:00
Dirk McCormick
d6ad8517b7 feat: store temporary files in tmp folder under repo root 2021-08-06 10:44:21 +02:00
Raúl Kripalani
221d1a0e3c fix minor issues in migration. 
- aborting the initialization cancels the AcquireShard context, but
  the DAG store would not release the shard (fixed in
  filecoin-project/dagstore)
- off by one error in console output.
 2021-08-05 19:40:02 +01:00
Raúl Kripalani
dd0eec3994 DagstoreInitializeAll: richer output. 2021-08-05 17:32:52 +01:00
Raúl Kripalani
4974dc65d5 DagstoreInitializeAll: handle zero concurrency case well. 2021-08-05 14:56:52 +01:00
Raúl Kripalani
21d078e7e1 fix bugs from testing. 2021-08-05 14:43:01 +01:00
Raúl Kripalani
7c858ece76 implement DagstoreInitializeAll. 2021-08-05 13:27:43 +01:00
Raúl Kripalani
1cc59ade98 improve docs; add DagstoreRecoverShard. 2021-08-05 11:38:39 +01:00
Raúl Kripalani
edcd2f34d4 get rid of unserializable error type. 2021-08-04 19:36:56 +01:00
Raúl Kripalani
5f49101566 add JSON-RPC operations and cli for dagstore. 2021-08-04 19:20:52 +01:00
Raúl Kripalani
12d1f8e636 run gen. 2021-08-04 17:34:47 +01:00
Raúl Kripalani
270bad8144 pull dagstore migration into Lotus and simplify. 
Migration registers all shards with lazy init.

Shards are then initialized as they are retrieved for the
first time, or in bulk through a lotus-shed tool that will
be provided separately.
 2021-08-04 16:59:27 +01:00
Raúl Kripalani
07ffbf85e4 fix lint; run gen. 2021-08-04 12:48:53 +01:00
Raúl Kripalani
6a244ee8f0 clarify comment. 2021-08-04 12:45:49 +01:00
Raúl Kripalani
583a3c6277 switch DAGStoreConfig#GCInterval to Duration type. 2021-08-04 12:45:49 +01:00
Raúl Kripalani
970f3eff69 fix gen. 2021-08-03 23:46:48 +01:00
Raúl Kripalani
da28416598 add docs to config parameters. 2021-08-03 23:41:59 +01:00
Raúl Kripalani
c06c8541f9 refactor dagstore + carv2 integration (+). 
- Integrate with config.toml.
- Export DAGStore to DI context in preparation for JSON-RPC
  and cli commands.
- Renames.
 2021-08-03 23:09:28 +01:00
Raúl Kripalani
4076746141 minor renaming. 2021-08-03 12:22:40 +01:00
Raúl Kripalani
f1d98361a6 small DAGStoreWrapper code reorg. 2021-08-03 12:17:50 +01:00
Raúl Kripalani
b63858f210 upgrade to dagstore v0.4.0. 2021-07-30 15:33:01 +01:00
Raúl Kripalani
72391cca20 LOTUS_DAGSTORE_COPY_CONCURRENCY for controlling copy concurrency. 2021-07-29 21:36:43 +01:00
Aarsh Shah
fcd630e529 call dagstore start 2021-07-30 01:43:34 +05:30
Raúl Kripalani
073150a306 Merge branch 'release/v1.11.1' into feat/replace-multistore-carv2 2021-07-29 18:42:09 +01:00
Raúl Kripalani
b3c951c924 add RepoType#String; adjust repo parsing logic. 2021-07-29 12:22:27 -04:00
Raúl Kripalani
8442bac5b2 support MARKETS_API_INFO env var; support markets-repo, markets-api-url flags. 2021-07-29 12:20:05 -04:00
Raúl Kripalani
d8c90b91be address nits. 2021-07-29 04:41:27 -04:00
Raúl Kripalani
c119ab6ed9 fix docs and nits. 2021-07-29 04:39:28 -04:00
Anton Evangelatov
0dd83c6755 fixup 2021-07-29 04:38:25 -04:00
Anton Evangelatov
9b7a7713a7 add RuntimeSubsystems API method; use it in lotus-miner info 2021-07-29 04:38:19 -04:00
Raúl Kripalani
9ba6a41ef4 fix dagstore/piecestore lifecycle. 2021-07-28 17:08:04 +01:00
Raúl Kripalani
b6112c6fc9 wire in copy throttling. 2021-07-28 16:28:27 +01:00
Raúl Kripalani
19182999dd Merge branch 'master' into feat/replace-multistore-carv2 2021-07-27 22:06:07 +01:00
aarshkshah1992
944aeed13e remove dead code 2021-07-27 22:16:45 +05:30
Raúl Kripalani
18f5997d02 add throttling to dagstore; increase GC frequency to 1min. 2021-07-27 15:11:49 +01:00
vyzo
7c195245a1 make cfgdoc-gen 2021-07-27 12:13:26 +03:00
vyzo
9d25464703 use functional options for hotstore gc, rename MovingGC to FullGC 2021-07-27 09:53:22 +03:00
Raúl Kripalani
160fab08aa fix lint and gen errors. 2021-07-26 23:32:51 +01:00
Raúl Kripalani
9bdbbf33cb Merge branch 'master' into feat/replace-multistore-carv2 2021-07-26 22:15:36 +01:00
vyzo
aa0bd51b2c thread GCFrequency option into the splitstore config 2021-07-26 15:05:57 +03:00
vyzo
20f93a520f make cfgdoc-gen 2021-07-26 15:05:57 +03:00
vyzo
4cdb34e448 add docstrings for splitstore config 2021-07-26 15:05:57 +03:00
vyzo
5acae50e07 add config option for splitstore moving gc frequency 2021-07-26 15:05:57 +03:00
vyzo
a0d6fdba33 add ChainBlockstoreInfo APIv1 endpoint 2021-07-26 08:30:07 +03:00
vyzo
2dc72d5849 satisfy linter who wants to be a spell checker in comments 2021-07-25 11:47:21 +03:00
vyzo
3d2ae433ee add ChainCheckBlockstore API 2021-07-25 11:14:48 +03:00
Łukasz Magiera
91c6aca7e7 config: Add newlines consistently 2021-07-23 16:59:55 +02:00
Łukasz Magiera
80af6de316 config: Add note on codegen to types.go 2021-07-23 16:02:45 +02:00
Łukasz Magiera
ac2a1bfeab fix lint 2021-07-23 15:53:31 +02:00