Łukasz Magiera
853f9da457
Merge pull request #4583 from filecoin-project/fix/tvx-msg-cid
...
tvx extract: make it work with secp messages.
2020-11-20 15:13:06 +01:00
Raúl Kripalani
bb9d2b5af4
finish comment.
2020-11-20 14:05:50 +00:00
Łukasz Magiera
b10b6fdd11
Merge pull request #4355 from filecoin-project/shed/post-find
...
Shed/post find
2020-11-20 14:52:42 +01:00
Łukasz Magiera
2d9123a618
Merge pull request #4140 from filecoin-project/feat/mutex-fraction
...
Add options to set BlockProfileRate and MutexProfileFraction
2020-11-20 14:22:58 +01:00
Łukasz Magiera
16dbbadddf
Set lower feecap on PoSt messages with low balance
2020-11-19 18:02:20 +01:00
Aayush Rajasekaran
62d20f2191
Use version0 when pre-sealing
2020-11-18 23:10:05 -05:00
Aayush Rajasekaran
68a16afeda
Merge branch 'master' into release/v1.2.0
2020-11-17 19:40:05 -05:00
Raúl Kripalani
27c0ce4a3a
fix lint.
2020-11-16 22:39:08 +00:00
Raúl Kripalani
0c6072a1a0
chainstore lifecycle: close via Close() instead of context.
2020-11-16 22:28:59 +00:00
Steven Allen
c8ff58aae1
add basic calico test
2020-11-16 19:04:17 +01:00
Łukasz Magiera
915c5e0fdd
Get most tests to pass
2020-11-16 19:03:30 +01:00
Łukasz Magiera
2a7e4af5ee
Fix lotus-miner/lotus-worker build
2020-11-16 19:03:30 +01:00
Steven Allen
4544d2118e
fix lotus seed for proof api changes
2020-11-16 19:03:30 +01:00
Łukasz Magiera
6bea9dd178
Making sealing logic work with multiple seal proof types
2020-11-16 19:03:30 +01:00
Raúl Kripalani
bac51dd4e3
daemon --import-snapshot: force head silently, without triggering reorg.
2020-11-16 16:03:47 +00:00
Raúl Kripalani
d7b4f92f1f
add context to ChainStore.
2020-11-16 15:52:19 +00:00
Raúl Kripalani
87d6daf745
fix blockstore double open issue on --import-snapshot.
...
Fixes https://github.com/filecoin-project/lotus/issues/4850 .
2020-11-16 15:21:47 +00:00
Łukasz Magiera
c5c0185943
miner: Basic storage cleanup command
2020-11-12 21:27:16 +01:00
Łukasz Magiera
bf547112de
miner: Storage list sectors command
2020-11-12 19:11:58 +01:00
Łukasz Magiera
28ffa8ca06
Merge pull request #4819 from liyue201/master
...
Delete the duplicate output
2020-11-12 18:13:51 +01:00
Dirk McCormick
0e3e449bf8
test: stop mining at the end of tests
2020-11-12 16:23:46 +01:00
stirlingx
8246149544
Delete unnecessary output
2020-11-12 18:59:36 +08:00
Aayush Rajasekaran
3a3986320c
Merge pull request #4804 from filecoin-project/feat/storage-retwait-cleanup
...
Expand sched-diag; Command to abort sealing calls
2020-11-12 02:11:15 -05:00
Aayush Rajasekaran
498477da04
Nit: ArgsUsage param rename
2020-11-12 02:04:55 -05:00
Travis Person
f4df58ed0f
Merge pull request #4810 from filecoin-project/fix/lotus-stats-flags
...
lotus-stats: fix influx flags
2020-11-11 14:36:37 -08:00
Travis Person
ff7bdb5140
lotus-stats: fix influx flags
2020-11-11 21:17:36 +00:00
Łukasz Magiera
8ac495723e
gofmt
2020-11-11 17:42:23 +01:00
Łukasz Magiera
09f9f871a3
Create a command to abort sealing calls
2020-11-11 17:39:12 +01:00
Łukasz Magiera
2a3d930933
Hide ret-done tasks in sealing jobs by default
2020-11-11 16:48:04 +01:00
stirlingx
8b889139e9
Modify printf format
2020-11-11 10:39:13 +08:00
Aayush Rajasekaran
735c04f999
Merge pull request #4681 from filecoin-project/badger-viewable
...
move to native badger blockstore; leverage zero-copy View() to deserialize in-place
2020-11-10 18:08:12 -05:00
Łukasz Magiera
18aa97f962
Merge pull request #4779 from filecoin-project/feat/work-track-hostname
...
storage: Track worker hostnames with work
2020-11-10 20:38:44 +01:00
zgfzgf
f5401317c9
cmd sectors commitIDs len
2020-11-10 17:37:36 +08:00
Łukasz Magiera
5caa277261
storage: Track abandoned work more correctly
2020-11-09 23:38:20 +01:00
Łukasz Magiera
f819e71d12
storage: Separate returned jobs in jobs cli
2020-11-09 23:13:29 +01:00
Łukasz Magiera
27a9dd3bbb
storage: Track worker hostnames with work
2020-11-09 23:09:04 +01:00
Raúl Kripalani
3577300aee
Merge branch 'master' into badger-viewable
2020-11-06 19:34:25 +00:00
Łukasz Magiera
426c2e8c2b
Merge pull request #4717 from filecoin-project/feat/optional-chain-bitswap
...
Optional chain Bitswap
2020-11-06 16:49:39 +01:00
Łukasz Magiera
3c9e438a68
Merge pull request #4617 from filecoin-project/termination-penalty
...
Add `termination-estimate` to get an estimation for how much a termination penalty will be
2020-11-06 16:44:44 +01:00
Łukasz Magiera
2f9d19c42c
Merge pull request #4726 from filecoin-project/feat/shed-id-cid
...
shed: Util for creating ID CIDs
2020-11-06 16:03:45 +01:00
Łukasz Magiera
ee9df63221
shed: Util for creating ID CIDs
2020-11-06 15:42:09 +01:00
Raúl Kripalani
8befc0c1f5
export metrics from bench.
2020-11-05 19:09:47 +00:00
Travis Person
bd4322f56f
Update lotus-stats with a richer cli
...
This updates lotus stats to use urfave instead of the golang flags
package. This brings with it some common features from other lotus tools
such as the use of the `FULLNODE_API_INFO` env and other parts of the
lotus cli package.
This also includes the latest dashboard.
2020-11-04 18:06:17 +00:00
Raúl Kripalani
a411342f0c
export more metrics.
2020-11-04 17:09:01 +00:00
Raúl Kripalani
370ef93db6
chainstore: new ForceHeadSilent to support benchmarks.
2020-11-04 14:39:01 +00:00
Raúl Kripalani
fd1439f284
fix lint.
2020-11-03 22:49:55 +00:00
Łukasz Magiera
a1e1b03ca4
Optionally allow bitswap for chainstore
2020-11-03 23:44:44 +01:00
Raúl Kripalani
87ce2f774d
lotus-bench: write separate profiles for import and validation.
2020-11-03 22:40:21 +00:00
Raúl Kripalani
5487356370
fix lint errors.
2020-11-03 21:23:41 +00:00
Raúl Kripalani
809111336a
Merge branch 'master' into badger-viewable
2020-11-03 18:29:10 +00:00
Raúl Kripalani
18418128c3
lotus-bench: make start tipset walkback start from end tipset.
2020-11-03 18:15:59 +00:00
Raúl Kripalani
581ac5b019
lotus-bench: add ability to specify tipsets.
2020-11-03 18:11:43 +00:00
Raúl Kripalani
842c8ca056
improve lotus-bench; support running validation on a store without a CAR.
2020-11-03 17:35:31 +00:00
zgfzgf
3e7efad0fd
modify lint error
2020-11-03 21:28:01 +08:00
zgfzgf
3c2cd506ec
modify merge lotus-bench
2020-11-03 19:56:04 +08:00
Łukasz Magiera
1df02d5a93
Merge pull request #4691 from filecoin-project/fix/metrics
...
fix metrics wiring.
2020-11-03 11:50:43 +01:00
Łukasz Magiera
a4cf6fa715
sched: Interactive RPC Shell
2020-11-02 20:38:15 +01:00
Raúl Kripalani
656ece06e5
fix metrics wiring.
...
Some components like go-ds-measure, go-ipfs-blockstore and go-bitswap
expose metrics via ipfs/go-metrics-interface, but Lotus never injects
the Prometheus exporter (ipfs/go-metrics-prometheus). Therefore, those
metrics never surface in instrumentation.
Instead, Lotus uses OpenCensus directly.
This commit injects the Prometheus exporter for go-metrics-interface, and
instructs the OpenCensus Prometheus exporter to use the DefaultRegistry.
This has the effect of exposing blending the metrics of both metrics
libraries.
With this patch, the datastore, cache utilisation, and bitswap metrics
are now exported via the /debug/metrics endpoint.
This commit also fixes an issue where the metrics scope was empty, making
go-metrics-interface default to "<no-scope>". Angle brackets are inadmissible
characters for Prometheus, so it was refusing to export the affected metrics.
(These were the ARC cache metrics.)
2020-11-02 17:56:49 +00:00
Raúl Kripalani
d1ebf3c769
introduce non-pooled StorageKey method.
2020-11-02 13:32:07 +00:00
Raúl Kripalani
f4e13ffd80
actually register prometheus gauge.
2020-11-01 20:01:57 +00:00
Raúl Kripalani
44e34d9606
lotus-bench: native badger SyncWrites=false.
2020-11-01 19:54:47 +00:00
Raúl Kripalani
35ccd73a86
lotus-bench: improve for observability.
2020-11-01 19:52:53 +00:00
Raúl Kripalani
aece624d1c
lotus-bench: add support for native badger blockstore.
2020-11-01 18:54:35 +00:00
Raúl Kripalani
c2355b18f9
write heap and allocs profile in lotus-bench.
2020-11-01 18:00:08 +00:00
Raúl Kripalani
d8d85373f5
fix lotus-shed datastore commands.
2020-11-01 13:50:41 +00:00
Raúl Kripalani
a16d7f221e
Merge branch 'master' into badger-viewable
2020-11-01 13:10:56 +00:00
Raúl Kripalani
099c4b5e1d
migrate repo.Datastore(/chain) to repo.Blockstore().
2020-11-01 13:03:21 +00:00
Łukasz Magiera
978192233d
Merge pull request #4498 from filecoin-project/feat/try-election
...
Add election run-dummy command
2020-10-31 01:02:25 +01:00
Łukasz Magiera
6fcdf3c7ed
Merge pull request #4615 from filecoin-project/feat/worker-pause
...
worker: Commands to pause/resume task processing
2020-10-31 00:26:37 +01:00
Łukasz Magiera
094ea3fe97
Merge pull request #4666 from filecoin-project/fix/sched-issues
...
Fix worker reenabling, handle multiple restarts in worker
2020-10-30 21:34:07 +01:00
Łukasz Magiera
6cdbf5216e
Merge pull request #4629 from filecoin-project/fix/badger-lsm-trsh
...
Reduce badger ValueTreshold to 128
2020-10-30 21:10:18 +01:00
Łukasz Magiera
fb492d9acb
Merge pull request #4662 from filecoin-project/feat/force-sched-cli
...
Debug flag to force running sealing scheduler
2020-10-30 20:15:49 +01:00
Łukasz Magiera
885c6c94d3
Add sync status to miner info command
2020-10-30 19:39:31 +01:00
jennijuju
2f4582147a
Add termination-estimate
to get an estimation for how much a termination penalty will be:
...
- Usage example: `./lotus-shed sectors termation-estimate 5 8 10`.
2020-10-30 13:34:03 -04:00
Łukasz Magiera
af1d45d969
worker: Handle multiple manager restarts while waiting for tasks
2020-10-30 18:00:48 +01:00
Łukasz Magiera
7fbb868513
Debug flag to force running sealing scheduler
2020-10-30 11:07:35 +01:00
Łukasz Magiera
ad9a5acb7f
miner sectors list: flags for events/seal time
2020-10-29 19:10:20 +01:00
Jakub Sztandera
ae905bd056
Fix closing
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-10-29 01:05:31 +01:00
Jakub Sztandera
a2c66dd102
make linter happy
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-10-28 23:30:28 +01:00
Jakub Sztandera
0297be4b9a
Add lotus-shed datastore rewrite
command
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-10-28 23:24:45 +01:00
Łukasz Magiera
553408d573
worker: Commands to pause/resume task processing
2020-10-28 22:10:17 +01:00
Łukasz Magiera
e1da874258
Merge remote-tracking branch 'origin/master' into feat/async-restartable-workers
2020-10-27 03:31:07 +01:00
Steven Allen
832c0998e4
validate that block propagation works after a worker key change
2020-10-26 18:16:25 -07:00
Steven Allen
0d06f8fa2b
Add commands to change the worker key
2020-10-26 18:16:24 -07:00
Jakub Sztandera
cced3bf9ee
Randomize seed
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-10-26 17:44:55 +01:00
Jakub Sztandera
ea6afe84db
Add election run-dummy command
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-10-26 17:44:51 +01:00
Łukasz Magiera
8923524f6a
Make EarlyExpiration in sectors list less scary
2020-10-26 15:33:15 +01:00
Łukasz Magiera
a37c372d06
Merge pull request #4572 from filecoin-project/feat/data-transfer-utils
...
Flesh out data transfer features
2020-10-26 13:29:26 +01:00
Raúl Kripalani
cdfa869ea6
tvx extract: make it work with secp messages.
...
Unfortunately ChainGetMessage returns a *types.Message, which in
the case of secp messages is lacking the signature. The signature
is part of the input to calculate the CID on secp messages. Therefore,
calling `.Cid()` on the result of ChainGetMessage for this kind of
message will lead to an incorrect CID.
tvx was relying on that call to return the correct CID. Since this is
not the case (and this is a footgun that needs to be corrected, ideally
together with the *types.{,Signed}Message duality mess), I'm replacing
the comparison.
2020-10-24 20:16:14 +01:00
Łukasz Magiera
660236b224
Merge remote-tracking branch 'origin/master' into feat/async-restartable-workers
2020-10-23 23:25:35 +02:00
Łukasz Magiera
067de4508b
shed: Commad to decode messages
2020-10-23 22:17:46 +02:00
Łukasz Magiera
dbcba6477e
Merge pull request #4263 from filecoin-project/feat/lite-market-client
...
lite-mode - market storage and retrieval clients
2020-10-23 17:23:06 +02:00
Dirk McCormick
906286fdbe
feat: lite-mode - CLI tests for lotus client
commands
2020-10-23 15:02:49 +02:00
Dirk McCormick
92942d44d1
feat: lite-mode - market storage and retrieval clients
2020-10-23 15:02:26 +02:00
Raúl Kripalani
39d9150175
fix tvx init.
2020-10-23 13:30:04 +01:00
Raúl Kripalani
5301c416bc
tvx extract: --ignore-sanity-checks flag.
2020-10-23 10:47:22 +01:00
Raúl Kripalani
92395745d3
tvx simulate: execute raw message against height.
2020-10-23 10:46:32 +01:00
hannahhoward
98297cef4d
feat(data-transfer): fill in utils
2020-10-22 13:40:26 -07:00
Łukasz Magiera
0289c39850
Merge pull request #4516 from filecoin-project/feat/api-request-metrics-wrapper
...
Feat/api request metrics wrapper
2020-10-22 21:40:47 +02:00
Łukasz Magiera
f9723ca3c1
Merge pull request #4521 from filecoin-project/feat/fix-shed-ledger-list
...
Fix lotus-shed ledger list
2020-10-22 19:59:18 +02:00