cerc-io/lotus
16
0
Fork 0
Code Issues Pull Requests Packages Projects Releases 27 Wiki Activity
13,273 Commits 24 Branches 342 Tags 314 MiB
a0f1696f36
Commit Graph

13273 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Raúl Kripalani
a0f1696f36 remove MaxConcurrentReadyFetches=2 default value. 
This was there to deal with migration IO workload. This is no
longer a problem with the new migration logic. The initialize-all
operation/command deals with concurrency.

For ongoing operation, miners can set the value they wish, but
we do not make a decision for them by default, because each
deployment can handle different IO loads.
 2021-08-06 12:27:50 +01:00
raulk
b418f82cf5
Merge pull request #6995 from filecoin-project/feat/miner-tmp 2021-08-06 12:07:58 +01:00
Dirk McCormick
d6ad8517b7 feat: store temporary files in tmp folder under repo root 2021-08-06 10:44:21 +02:00
Raúl Kripalani
221d1a0e3c fix minor issues in migration. 
- aborting the initialization cancels the AcquireShard context, but
  the DAG store would not release the shard (fixed in
  filecoin-project/dagstore)
- off by one error in console output.
 2021-08-05 19:40:02 +01:00
Raúl Kripalani
dd0eec3994 DagstoreInitializeAll: richer output. 2021-08-05 17:32:52 +01:00
Raúl Kripalani
4974dc65d5 DagstoreInitializeAll: handle zero concurrency case well. 2021-08-05 14:56:52 +01:00
Raúl Kripalani
21d078e7e1 fix bugs from testing. 2021-08-05 14:43:01 +01:00
Raúl Kripalani
f19f5269df upgrade deps. 2021-08-05 14:32:47 +01:00
raulk
a670359d78
Merge pull request #6983 from filecoin-project/raulk/dagstore-api-cli 
dagstore: add JSON-RPC operations and cli.
 2021-08-05 14:26:12 +01:00
Raúl Kripalani
28c550bbae add lotus-miner dagstore initialize-all command. 2021-08-05 14:23:06 +01:00
Raúl Kripalani
7c858ece76 implement DagstoreInitializeAll. 2021-08-05 13:27:43 +01:00
Raúl Kripalani
1cc59ade98 improve docs; add DagstoreRecoverShard. 2021-08-05 11:38:39 +01:00
Raúl Kripalani
edcd2f34d4 get rid of unserializable error type. 2021-08-04 19:36:56 +01:00
Raúl Kripalani
5f49101566 add JSON-RPC operations and cli for dagstore. 2021-08-04 19:20:52 +01:00
raulk
25f61c8a5d
Merge pull request #6982 from filecoin-project/raulk/dagstore-migration 2021-08-04 19:20:26 +01:00
Raúl Kripalani
12d1f8e636 run gen. 2021-08-04 17:34:47 +01:00
Raúl Kripalani
270bad8144 pull dagstore migration into Lotus and simplify. 
Migration registers all shards with lazy init.

Shards are then initialized as they are retrieved for the
first time, or in bulk through a lotus-shed tool that will
be provided separately.
 2021-08-04 16:59:27 +01:00
raulk
e8e73e5374
Merge pull request #6979 from filecoin-project/raulk/review-dagstore 2021-08-04 13:22:39 +01:00
Raúl Kripalani
8f5e6a864f upgrade go-fil-markets. 2021-08-04 13:22:24 +01:00
Raúl Kripalani
07ffbf85e4 fix lint; run gen. 2021-08-04 12:48:53 +01:00
Raúl Kripalani
6a244ee8f0 clarify comment. 2021-08-04 12:45:49 +01:00
Raúl Kripalani
583a3c6277 switch DAGStoreConfig#GCInterval to Duration type. 2021-08-04 12:45:49 +01:00
Raúl Kripalani
35895e897a fix test. 2021-08-03 23:52:11 +01:00
Raúl Kripalani
970f3eff69 fix gen. 2021-08-03 23:46:48 +01:00
Raúl Kripalani
be24acbfbe go mod tidy. 2021-08-03 23:43:37 +01:00
Raúl Kripalani
da28416598 add docs to config parameters. 2021-08-03 23:41:59 +01:00
Raúl Kripalani
c06c8541f9 refactor dagstore + carv2 integration (+). 
- Integrate with config.toml.
- Export DAGStore to DI context in preparation for JSON-RPC
  and cli commands.
- Renames.
 2021-08-03 23:09:28 +01:00
Dirk McCormick
b3d02ea1f7 fix: use Version instead of API in wait-api cmd so it works for miner and markets nodes 2021-08-03 14:07:45 +02:00
Raúl Kripalani
691da14996 minor renaming. 2021-08-03 12:23:36 +01:00
Raúl Kripalani
bd3811e652 minor renaming. 2021-08-03 12:23:04 +01:00
Raúl Kripalani
4076746141 minor renaming. 2021-08-03 12:22:40 +01:00
Raúl Kripalani
f1d98361a6 small DAGStoreWrapper code reorg. 2021-08-03 12:17:50 +01:00
Raúl Kripalani
7e02868ce2 consolidate blockstore utils. 2021-08-03 12:10:12 +01:00
Dirk McCormick
0800de176e fix: lotus-miner pieces commands to use markets API instead of storage miner API 2021-08-03 11:52:38 +02:00
Dirk McCormick
d1dc30b14d fix: lotus-miner storage-deals set-deal-duration to use markets API instead of storage miner API 2021-08-03 11:48:48 +02:00
Dirk McCormick
ae0680a5de fix: lotus-miner sectors refs to use markets API instead of storage miner API 2021-08-03 11:16:34 +02:00
raulk
3be2681824
Merge pull request #6948 from filecoin-project/feat/dagst-throttle0-fetch-copy 
Dagstore throttle fetch and copy
 2021-07-30 15:46:50 +01:00
Raúl Kripalani
b63858f210 upgrade to dagstore v0.4.0. 2021-07-30 15:33:01 +01:00
Raúl Kripalani
932767d014 fix lint errors. 2021-07-30 15:25:18 +01:00
Aarsh Shah
2e30891005 update dagstore deps 2021-07-30 13:31:34 +05:30
Aarsh Shah
ab888c3a07 test the isunsealed api 2021-07-30 13:14:47 +05:30
Aarsh Shah
8cd305338a dagstore throttle fetch and copy 2021-07-30 13:02:42 +05:30
Raúl Kripalani
72391cca20 LOTUS_DAGSTORE_COPY_CONCURRENCY for controlling copy concurrency. 2021-07-29 21:36:43 +01:00
Aarsh Shah
88efbfa6ff go fmt 2021-07-30 01:44:47 +05:30
Aarsh Shah
fcd630e529 call dagstore start 2021-07-30 01:43:34 +05:30
Raúl Kripalani
073150a306 Merge branch 'release/v1.11.1' into feat/replace-multistore-carv2 2021-07-29 18:42:09 +01:00
raulk
7d70ef79af
Merge pull request #6933 from filecoin-project/jen/bp-to-release 
Fixes in master -> release
 2021-07-29 18:30:46 +01:00
Raúl Kripalani
bb040abb2c fix compilation error. 2021-07-29 12:23:04 -04:00
Raúl Kripalani
00c3432e5a use fallback api infos last; init service with markets-path. 2021-07-29 12:22:53 -04:00
Raúl Kripalani
4b6fa79ea2 bugfix. 2021-07-29 12:22:49 -04:00