Commit Graph

13285 Commits

Author SHA1 Message Date
Raúl Kripalani
39a0010c75 update go-car/v2 to error instead of panic on misuse; make gen. 2021-08-06 16:54:29 +01:00
Raúl Kripalani
0bca36c126 build/version: update to 1.11.1-m1.3.4. 2021-08-06 16:35:55 +01:00
Raúl Kripalani
f0df21b925 Merge branch 'release/v1.11.1' into feat/replace-multistore-carv2 2021-08-06 16:35:16 +01:00
Raúl Kripalani
6ad8d72f2f upgrade dependencies. 2021-08-06 16:21:00 +01:00
Raúl Kripalani
6e6b1ec89d fix typos in log statements. 2021-08-06 15:10:35 +01:00
Raúl Kripalani
7b94399f9e fix lint. 2021-08-06 15:05:02 +01:00
Raúl Kripalani
cd7e9477b5 rename default directory to 'dagstore', avoiding unnecessary capitalization 2021-08-06 12:27:50 +01:00
Raúl Kripalani
a0f1696f36 remove MaxConcurrentReadyFetches=2 default value.
This was there to deal with migration IO workload. This is no
longer a problem with the new migration logic. The initialize-all
operation/command deals with concurrency.

For ongoing operation, miners can set the value they wish, but
we do not make a decision for them by default, because each
deployment can handle different IO loads.
2021-08-06 12:27:50 +01:00
raulk
b418f82cf5
Merge pull request #6995 from filecoin-project/feat/miner-tmp 2021-08-06 12:07:58 +01:00
Dirk McCormick
d6ad8517b7 feat: store temporary files in tmp folder under repo root 2021-08-06 10:44:21 +02:00
Raúl Kripalani
221d1a0e3c fix minor issues in migration.
- aborting the initialization cancels the AcquireShard context, but
  the DAG store would not release the shard (fixed in
  filecoin-project/dagstore)
- off by one error in console output.
2021-08-05 19:40:02 +01:00
Raúl Kripalani
dd0eec3994 DagstoreInitializeAll: richer output. 2021-08-05 17:32:52 +01:00
Raúl Kripalani
4974dc65d5 DagstoreInitializeAll: handle zero concurrency case well. 2021-08-05 14:56:52 +01:00
Raúl Kripalani
21d078e7e1 fix bugs from testing. 2021-08-05 14:43:01 +01:00
Raúl Kripalani
f19f5269df upgrade deps. 2021-08-05 14:32:47 +01:00
raulk
a670359d78
Merge pull request #6983 from filecoin-project/raulk/dagstore-api-cli
dagstore: add JSON-RPC operations and cli.
2021-08-05 14:26:12 +01:00
Raúl Kripalani
28c550bbae add lotus-miner dagstore initialize-all command. 2021-08-05 14:23:06 +01:00
Raúl Kripalani
7c858ece76 implement DagstoreInitializeAll. 2021-08-05 13:27:43 +01:00
Raúl Kripalani
1cc59ade98 improve docs; add DagstoreRecoverShard. 2021-08-05 11:38:39 +01:00
Raúl Kripalani
edcd2f34d4 get rid of unserializable error type. 2021-08-04 19:36:56 +01:00
Raúl Kripalani
5f49101566 add JSON-RPC operations and cli for dagstore. 2021-08-04 19:20:52 +01:00
raulk
25f61c8a5d
Merge pull request #6982 from filecoin-project/raulk/dagstore-migration 2021-08-04 19:20:26 +01:00
Raúl Kripalani
12d1f8e636 run gen. 2021-08-04 17:34:47 +01:00
Raúl Kripalani
270bad8144 pull dagstore migration into Lotus and simplify.
Migration registers all shards with lazy init.

Shards are then initialized as they are retrieved for the
first time, or in bulk through a lotus-shed tool that will
be provided separately.
2021-08-04 16:59:27 +01:00
raulk
e8e73e5374
Merge pull request #6979 from filecoin-project/raulk/review-dagstore 2021-08-04 13:22:39 +01:00
Raúl Kripalani
8f5e6a864f upgrade go-fil-markets. 2021-08-04 13:22:24 +01:00
Raúl Kripalani
07ffbf85e4 fix lint; run gen. 2021-08-04 12:48:53 +01:00
Raúl Kripalani
6a244ee8f0 clarify comment. 2021-08-04 12:45:49 +01:00
Raúl Kripalani
583a3c6277 switch DAGStoreConfig#GCInterval to Duration type. 2021-08-04 12:45:49 +01:00
Raúl Kripalani
35895e897a fix test. 2021-08-03 23:52:11 +01:00
Raúl Kripalani
970f3eff69 fix gen. 2021-08-03 23:46:48 +01:00
Raúl Kripalani
be24acbfbe go mod tidy. 2021-08-03 23:43:37 +01:00
Raúl Kripalani
da28416598 add docs to config parameters. 2021-08-03 23:41:59 +01:00
Raúl Kripalani
c06c8541f9 refactor dagstore + carv2 integration (+).
- Integrate with config.toml.
- Export DAGStore to DI context in preparation for JSON-RPC
  and cli commands.
- Renames.
2021-08-03 23:09:28 +01:00
Dirk McCormick
b3d02ea1f7 fix: use Version instead of API in wait-api cmd so it works for miner and markets nodes 2021-08-03 14:07:45 +02:00
Raúl Kripalani
691da14996 minor renaming. 2021-08-03 12:23:36 +01:00
Raúl Kripalani
bd3811e652 minor renaming. 2021-08-03 12:23:04 +01:00
Raúl Kripalani
4076746141 minor renaming. 2021-08-03 12:22:40 +01:00
Raúl Kripalani
f1d98361a6 small DAGStoreWrapper code reorg. 2021-08-03 12:17:50 +01:00
Raúl Kripalani
7e02868ce2 consolidate blockstore utils. 2021-08-03 12:10:12 +01:00
Dirk McCormick
0800de176e fix: lotus-miner pieces commands to use markets API instead of storage miner API 2021-08-03 11:52:38 +02:00
Dirk McCormick
d1dc30b14d fix: lotus-miner storage-deals set-deal-duration to use markets API instead of storage miner API 2021-08-03 11:48:48 +02:00
Dirk McCormick
ae0680a5de fix: lotus-miner sectors refs to use markets API instead of storage miner API 2021-08-03 11:16:34 +02:00
Jiaying Wang
40449f1ccb
Merge pull request #6966 from filecoin-project/jen/v1.11.1-rc2
v1.11.1-rc2
2021-08-01 04:02:40 -04:00
Jennifer Wang
020cc5e64f docsgen 2021-08-01 03:46:36 -04:00
Jennifer Wang
52b76c9d5c Prepare for v1.11.1-rc2:
- bump the version
- update the changelog
2021-08-01 03:32:03 -04:00
Jiaying Wang
5939623f26
Merge pull request #6965 from filecoin-project/jen/backport
Backport master -> v1.11.1
2021-08-01 03:24:38 -04:00
Anton Evangelatov
783fa6b7c0 add explicit error msg if repo dir does not exist 2021-08-01 00:26:52 -04:00
raulk
3be2681824
Merge pull request #6948 from filecoin-project/feat/dagst-throttle0-fetch-copy
Dagstore throttle fetch and copy
2021-07-30 15:46:50 +01:00
Raúl Kripalani
b63858f210 upgrade to dagstore v0.4.0. 2021-07-30 15:33:01 +01:00