Commit Graph
13285 Commits
Author SHA1 Message Date
Raúl Kripalani 39a0010c75 update go-car/v2 to error instead of panic on misuse; make gen. 1.11.2-beta1 m1.3.4 2021-08-06 16:54:29 +01:00
Raúl Kripalani 0bca36c126 build/version: update to 1.11.1-m1.3.4. 2021-08-06 16:35:55 +01:00
Raúl Kripalani f0df21b925 Merge branch 'release/v1.11.1' into feat/replace-multistore-carv2 2021-08-06 16:35:16 +01:00
Raúl Kripalani 6ad8d72f2f upgrade dependencies. 2021-08-06 16:21:00 +01:00
Raúl Kripalani 6e6b1ec89d fix typos in log statements. 2021-08-06 15:10:35 +01:00
Raúl Kripalani 7b94399f9e fix lint. 2021-08-06 15:05:02 +01:00
Raúl Kripalani cd7e9477b5 rename default directory to 'dagstore', avoiding unnecessary capitalization 2021-08-06 12:27:50 +01:00
Raúl Kripalani a0f1696f36 remove MaxConcurrentReadyFetches=2 default value.
This was there to deal with migration IO workload. This is no
longer a problem with the new migration logic. The initialize-all
operation/command deals with concurrency.

For ongoing operation, miners can set the value they wish, but
we do not make a decision for them by default, because each
deployment can handle different IO loads.
2021-08-06 12:27:50 +01:00
raulk b418f82cf5 Merge pull request #6995 from filecoin-project/feat/miner-tmp 2021-08-06 12:07:58 +01:00
Dirk McCormick d6ad8517b7 feat: store temporary files in tmp folder under repo root 2021-08-06 10:44:21 +02:00
Raúl Kripalani 221d1a0e3c fix minor issues in migration.
- aborting the initialization cancels the AcquireShard context, but
  the DAG store would not release the shard (fixed in
  filecoin-project/dagstore)
- off by one error in console output.
2021-08-05 19:40:02 +01:00
Raúl Kripalani dd0eec3994 DagstoreInitializeAll: richer output. 2021-08-05 17:32:52 +01:00
Raúl Kripalani 4974dc65d5 DagstoreInitializeAll: handle zero concurrency case well. 2021-08-05 14:56:52 +01:00
Raúl Kripalani 21d078e7e1 fix bugs from testing. 2021-08-05 14:43:01 +01:00
Raúl Kripalani f19f5269df upgrade deps. 2021-08-05 14:32:47 +01:00
raulk a670359d78 Merge pull request #6983 from filecoin-project/raulk/dagstore-api-cli
dagstore: add JSON-RPC operations and cli.
2021-08-05 14:26:12 +01:00
Raúl Kripalani 28c550bbae add lotus-miner dagstore initialize-all command. 2021-08-05 14:23:06 +01:00
Raúl Kripalani 7c858ece76 implement DagstoreInitializeAll. 2021-08-05 13:27:43 +01:00
Raúl Kripalani 1cc59ade98 improve docs; add DagstoreRecoverShard. 2021-08-05 11:38:39 +01:00
Raúl Kripalani edcd2f34d4 get rid of unserializable error type. 2021-08-04 19:36:56 +01:00
Raúl Kripalani 5f49101566 add JSON-RPC operations and cli for dagstore. 2021-08-04 19:20:52 +01:00
raulk 25f61c8a5d Merge pull request #6982 from filecoin-project/raulk/dagstore-migration 2021-08-04 19:20:26 +01:00
Raúl Kripalani 12d1f8e636 run gen. 2021-08-04 17:34:47 +01:00
Raúl Kripalani 270bad8144 pull dagstore migration into Lotus and simplify.
Migration registers all shards with lazy init.

Shards are then initialized as they are retrieved for the
first time, or in bulk through a lotus-shed tool that will
be provided separately.
2021-08-04 16:59:27 +01:00
raulk e8e73e5374 Merge pull request #6979 from filecoin-project/raulk/review-dagstore 2021-08-04 13:22:39 +01:00
Raúl Kripalani 8f5e6a864f upgrade go-fil-markets. 2021-08-04 13:22:24 +01:00
Raúl Kripalani 07ffbf85e4 fix lint; run gen. 2021-08-04 12:48:53 +01:00
Raúl Kripalani 6a244ee8f0 clarify comment. 2021-08-04 12:45:49 +01:00
Raúl Kripalani 583a3c6277 switch DAGStoreConfig#GCInterval to Duration type. 2021-08-04 12:45:49 +01:00
Raúl Kripalani 35895e897a fix test. 2021-08-03 23:52:11 +01:00
Raúl Kripalani 970f3eff69 fix gen. 2021-08-03 23:46:48 +01:00
Raúl Kripalani be24acbfbe go mod tidy. 2021-08-03 23:43:37 +01:00
Raúl Kripalani da28416598 add docs to config parameters. 2021-08-03 23:41:59 +01:00
Raúl Kripalani c06c8541f9 refactor dagstore + carv2 integration (+).
- Integrate with config.toml.
- Export DAGStore to DI context in preparation for JSON-RPC
  and cli commands.
- Renames.
2021-08-03 23:09:28 +01:00
Dirk McCormick b3d02ea1f7 fix: use Version instead of API in wait-api cmd so it works for miner and markets nodes 2021-08-03 14:07:45 +02:00
Raúl Kripalani 691da14996 minor renaming. 2021-08-03 12:23:36 +01:00
Raúl Kripalani bd3811e652 minor renaming. 2021-08-03 12:23:04 +01:00
Raúl Kripalani 4076746141 minor renaming. 2021-08-03 12:22:40 +01:00
Raúl Kripalani f1d98361a6 small DAGStoreWrapper code reorg. 2021-08-03 12:17:50 +01:00
Raúl Kripalani 7e02868ce2 consolidate blockstore utils. 2021-08-03 12:10:12 +01:00
Dirk McCormick 0800de176e fix: lotus-miner pieces commands to use markets API instead of storage miner API 2021-08-03 11:52:38 +02:00
Dirk McCormick d1dc30b14d fix: lotus-miner storage-deals set-deal-duration to use markets API instead of storage miner API 2021-08-03 11:48:48 +02:00
Dirk McCormick ae0680a5de fix: lotus-miner sectors refs to use markets API instead of storage miner API 2021-08-03 11:16:34 +02:00
Jiaying Wang 40449f1ccb Merge pull request #6966 from filecoin-project/jen/v1.11.1-rc2
v1.11.1-rc2
v1.11.1-rc2
2021-08-01 04:02:40 -04:00
Jennifer Wang 020cc5e64f docsgen 2021-08-01 03:46:36 -04:00
Jennifer Wang 52b76c9d5c Prepare for v1.11.1-rc2:
- bump the version
- update the changelog
2021-08-01 03:32:03 -04:00
Jiaying Wang 5939623f26 Merge pull request #6965 from filecoin-project/jen/backport
Backport master -> v1.11.1
2021-08-01 03:24:38 -04:00
Anton Evangelatov 783fa6b7c0 add explicit error msg if repo dir does not exist 2021-08-01 00:26:52 -04:00
raulk 3be2681824 Merge pull request #6948 from filecoin-project/feat/dagst-throttle0-fetch-copy
Dagstore throttle fetch and copy
1.11.2-alpha7 m1.3.3
2021-07-30 15:46:50 +01:00
Raúl Kripalani b63858f210 upgrade to dagstore v0.4.0. 2021-07-30 15:33:01 +01:00