cerc-io/lotus
16
0
Fork 0
Code Issues Pull Requests Packages Projects Releases 27 Wiki Activity
9,444 Commits 24 Branches 342 Tags 314 MiB
b4fa099257
Commit Graph

1746 Commits

Author SHA1 Message Date
Raúl Kripalani
656ece06e5 fix metrics wiring. 
Some components like go-ds-measure, go-ipfs-blockstore and go-bitswap
expose metrics via ipfs/go-metrics-interface, but Lotus never injects
the Prometheus exporter (ipfs/go-metrics-prometheus). Therefore, those
metrics never surface in instrumentation.

Instead, Lotus uses OpenCensus directly.

This commit injects the Prometheus exporter for go-metrics-interface, and
instructs the OpenCensus Prometheus exporter to use the DefaultRegistry.

This has the effect of exposing blending the metrics of both metrics
libraries.

With this patch, the datastore, cache utilisation, and bitswap metrics
are now exported via the /debug/metrics endpoint.

This commit also fixes an issue where the metrics scope was empty, making
go-metrics-interface default to "<no-scope>". Angle brackets are inadmissible
characters for Prometheus, so it was refusing to export the affected metrics.
(These were the ARC cache metrics.)
 2020-11-02 17:56:49 +00:00
Raúl Kripalani
d1ebf3c769 introduce non-pooled StorageKey method. 2020-11-02 13:32:07 +00:00
Raúl Kripalani
f4e13ffd80 actually register prometheus gauge. 2020-11-01 20:01:57 +00:00
Raúl Kripalani
44e34d9606 lotus-bench: native badger SyncWrites=false. 2020-11-01 19:54:47 +00:00
Raúl Kripalani
35ccd73a86 lotus-bench: improve for observability. 2020-11-01 19:52:53 +00:00
Raúl Kripalani
aece624d1c lotus-bench: add support for native badger blockstore. 2020-11-01 18:54:35 +00:00
Raúl Kripalani
c2355b18f9 write heap and allocs profile in lotus-bench. 2020-11-01 18:00:08 +00:00
Raúl Kripalani
d8d85373f5 fix lotus-shed datastore commands. 2020-11-01 13:50:41 +00:00
Raúl Kripalani
a16d7f221e Merge branch 'master' into badger-viewable 2020-11-01 13:10:56 +00:00
Raúl Kripalani
099c4b5e1d migrate repo.Datastore(/chain) to repo.Blockstore(). 2020-11-01 13:03:21 +00:00
Łukasz Magiera
978192233d
Merge pull request #4498 from filecoin-project/feat/try-election 
Add election run-dummy command
 2020-10-31 01:02:25 +01:00
Łukasz Magiera
6fcdf3c7ed
Merge pull request #4615 from filecoin-project/feat/worker-pause 
worker: Commands to pause/resume task processing
 2020-10-31 00:26:37 +01:00
Łukasz Magiera
094ea3fe97
Merge pull request #4666 from filecoin-project/fix/sched-issues 
Fix worker reenabling, handle multiple restarts in worker
 2020-10-30 21:34:07 +01:00
Łukasz Magiera
6cdbf5216e
Merge pull request #4629 from filecoin-project/fix/badger-lsm-trsh 
Reduce badger ValueTreshold to 128
 2020-10-30 21:10:18 +01:00
Łukasz Magiera
fb492d9acb
Merge pull request #4662 from filecoin-project/feat/force-sched-cli 
Debug flag to force running sealing scheduler
 2020-10-30 20:15:49 +01:00
Łukasz Magiera
885c6c94d3 Add sync status to miner info command 2020-10-30 19:39:31 +01:00
jennijuju
2f4582147a Add termination-estimate to get an estimation for how much a termination penalty will be: 
- Usage example: `./lotus-shed sectors termation-estimate 5 8 10`.
 2020-10-30 13:34:03 -04:00
Łukasz Magiera
af1d45d969 worker: Handle multiple manager restarts while waiting for tasks 2020-10-30 18:00:48 +01:00
Łukasz Magiera
7fbb868513 Debug flag to force running sealing scheduler 2020-10-30 11:07:35 +01:00
Łukasz Magiera
ad9a5acb7f miner sectors list: flags for events/seal time 2020-10-29 19:10:20 +01:00
Jakub Sztandera
ae905bd056
Fix closing 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-10-29 01:05:31 +01:00
Jakub Sztandera
a2c66dd102
make linter happy 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-10-28 23:30:28 +01:00
Jakub Sztandera
0297be4b9a
Add lotus-shed datastore rewrite command 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-10-28 23:24:45 +01:00
Łukasz Magiera
553408d573 worker: Commands to pause/resume task processing 2020-10-28 22:10:17 +01:00
Łukasz Magiera
e1da874258 Merge remote-tracking branch 'origin/master' into feat/async-restartable-workers 2020-10-27 03:31:07 +01:00
Steven Allen
832c0998e4 validate that block propagation works after a worker key change 2020-10-26 18:16:25 -07:00
Steven Allen
0d06f8fa2b Add commands to change the worker key 2020-10-26 18:16:24 -07:00
Jakub Sztandera
cced3bf9ee
Randomize seed 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-10-26 17:44:55 +01:00
Jakub Sztandera
ea6afe84db
Add election run-dummy command 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-10-26 17:44:51 +01:00
Łukasz Magiera
8923524f6a Make EarlyExpiration in sectors list less scary 2020-10-26 15:33:15 +01:00
Łukasz Magiera
a37c372d06
Merge pull request #4572 from filecoin-project/feat/data-transfer-utils 
Flesh out data transfer features
 2020-10-26 13:29:26 +01:00
Łukasz Magiera
660236b224 Merge remote-tracking branch 'origin/master' into feat/async-restartable-workers 2020-10-23 23:25:35 +02:00
Łukasz Magiera
067de4508b shed: Commad to decode messages 2020-10-23 22:17:46 +02:00
Łukasz Magiera
dbcba6477e
Merge pull request #4263 from filecoin-project/feat/lite-market-client 
lite-mode - market storage and retrieval clients
 2020-10-23 17:23:06 +02:00
Dirk McCormick
906286fdbe feat: lite-mode - CLI tests for lotus client commands 2020-10-23 15:02:49 +02:00
Dirk McCormick
92942d44d1 feat: lite-mode - market storage and retrieval clients 2020-10-23 15:02:26 +02:00
Raúl Kripalani
39d9150175 fix tvx init. 2020-10-23 13:30:04 +01:00
Raúl Kripalani
5301c416bc tvx extract: --ignore-sanity-checks flag. 2020-10-23 10:47:22 +01:00
Raúl Kripalani
92395745d3 tvx simulate: execute raw message against height. 2020-10-23 10:46:32 +01:00
hannahhoward
98297cef4d feat(data-transfer): fill in utils 2020-10-22 13:40:26 -07:00
Łukasz Magiera
0289c39850
Merge pull request #4516 from filecoin-project/feat/api-request-metrics-wrapper 
Feat/api request metrics wrapper
 2020-10-22 21:40:47 +02:00
Łukasz Magiera
f9723ca3c1
Merge pull request #4521 from filecoin-project/feat/fix-shed-ledger-list 
Fix lotus-shed ledger list
 2020-10-22 19:59:18 +02:00
Łukasz Magiera
6c800bd0e3
Merge pull request #4501 from filecoin-project/feat/gateway-oni-needs 
add some methods that oni needs
 2020-10-22 19:44:47 +02:00
Łukasz Magiera
6bdf9935bf
Merge pull request #4475 from filecoin-project/fix/miner-init-createworker 
miner: fix init --create-worker-key
 2020-10-22 18:55:25 +02:00
Łukasz Magiera
6fc8550c19
Merge pull request #4314 from filecoin-project/feat/lotus-pcr-block-list 
Add block list to pcr
 2020-10-22 17:59:23 +02:00
Łukasz Magiera
041762a34f
Merge pull request #4383 from filecoin-project/steb/actor-v2-imports 
Remove most v0 actor imports
 2020-10-22 17:17:56 +02:00
Łukasz Magiera
9a58763a4e shed: Rename the command to frozen-miners 2020-10-22 16:07:42 +02:00
ZenGround0
f9707ba344 add borked inspection command 
hook up new command

Fix head call

Debug internal error

Debug moa

Debug 0

Fix 0

Fix 1

Better print

Don't ignore error
 2020-10-22 16:03:11 +02:00
Łukasz Magiera
ee8d8bf5e5 pcr: Fix lint 2020-10-22 15:42:46 +02:00
Łukasz Magiera
b85bf82d00
Merge pull request #4318 from filecoin-project/asr/shed-won-power 
Add a shed util to determine % of power that has won a block
 2020-10-22 15:40:55 +02:00
Travis Person
6fb3dafa95 lotus-pcr: add blocklist 2020-10-22 15:35:01 +02:00
Łukasz Magiera
f5960df544
Merge pull request #4313 from filecoin-project/fix/pcr-basefee 
Look at block base fee for PCR
 2020-10-22 15:32:01 +02:00
Łukasz Magiera
0832d5a7d5 bench: Fix lint warnings 2020-10-22 15:00:31 +02:00
whyrusleeping
602d2b8ad5 record datastore metrics after successful run 2020-10-22 14:57:06 +02:00
Jakub Sztandera
0341944350 Inject prometheus 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-10-22 14:57:05 +02:00
whyrusleeping
00d1e6b549 add measure datastore wrapper around bench chain datastore 2020-10-22 14:57:04 +02:00
Steven Allen
bcabe7b3b5 migrate methods to abstracted methods 
Method numbers never change anyways. At worst, we'll deprecate old methods and
have to explicitly import them from the correct actors version to use them.
 2020-10-21 12:18:37 -07:00
Steven Allen
4e730b5ec8 port to v2 imports 2020-10-21 12:16:23 -07:00
Jakub Sztandera
f0d966a595
Fix lotus-shed ledger list 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-10-21 19:40:51 +02:00
lanzafame
7a33d5bb34 register all apis with metric wrapper 2020-10-21 18:37:50 +10:00
lanzafame
3e767ca5c8 wrap api in metrics proxy 2020-10-21 18:27:13 +10:00
Aayush Rajasekaran
547c01f5ff
Merge pull request #4506 from filecoin-project/release/1.1.0 
Introduce Network version 6
 2020-10-20 18:29:49 -04:00
Aayush Rajasekaran
75eb644108
Merge pull request #4507 from filecoin-project/lotus-shed-terminate-1475 
Add a terminate sectors command to lotus-shed
 2020-10-20 18:28:09 -04:00
jennijuju
ee5dcbc1d8 Add wait message 2020-10-20 18:26:17 -04:00
Steven Allen
ed1645109a Add lotus storage miner API support to lotus-shed 2020-10-20 17:38:15 -04:00
jennijuju
277d3e9ab4 Add terminate sectors based on 1475's #4433 implementation in lotus-shed: 
-  Moving the cmd to lotus-shed so that miners can use this right away without waiting for fsm changes.- Note: this should only be used when the miner is 100% sure that they want to terminate the sector on chain and they will be lose the power and pay a big one-time termination penalty for the sectors.
- Only live sectors can be terminated.
- To use, run `./lotus-shed sectors terminate --really-do-it=true sectorNum1 sectorNum2`.
- A message will be sent and after the message is landed on chain, miner can run `lotus-miner sectors status --on-chain-info <terminated sector number>`, and check Expiration Info at the bottom. Both `OnTime` and `Early` are 0 indicates the sector is terminated.
 2020-10-20 17:38:09 -04:00
Aayush Rajasekaran
556f92a823 Update to actors v2.2.0 at PostLiftoff epoch 2020-10-20 17:23:35 -04:00
whyrusleeping
abc3e783ff bump lookback cap to 24 hours 2020-10-20 10:09:21 -07:00
whyrusleeping
6bc56c549a add some methods that oni needs 2020-10-20 10:04:51 -07:00
Łukasz Magiera
869d71446d miner: fix init --create-worker-key 2020-10-19 16:08:46 +02:00
Łukasz Magiera
1a10f95973 worker: Better miner connectivity check on startup 2020-10-18 19:53:23 +02:00
Łukasz Magiera
879aa9512d worker: Use miner session for connectivity check 2020-10-18 17:56:29 +02:00
Łukasz Magiera
cf4dfa3a05 worker: Use http rpc for miner API 2020-10-18 13:59:38 +02:00
Łukasz Magiera
f933e1d2b7 miner cli: Update to uuid worker IDs 2020-10-18 13:03:17 +02:00
Łukasz Magiera
8d06cca073 sched: Handle workers using sessions instead of connections 2020-10-18 12:36:06 +02:00
Łukasz Magiera
7ac5dc55d0 Merge remote-tracking branch 'origin/master' into feat/async-restartable-workers 2020-10-17 13:45:11 +02:00
Łukasz Magiera
40e34b334a
Merge pull request #4423 from filecoin-project/asr/shed-robust 
Make audit balances capable of printing robust addresses
 2020-10-16 17:52:10 +02:00
whyrusleeping
a71fbee2d1 bump lookback limit to 12 hours 2020-10-15 16:49:25 -07:00
whyrusleeping
af1a422ddd statevminternal circ supply 2020-10-15 16:36:45 -07:00
whyrusleeping
8351420404 Add more endpoints for spacegap 2020-10-15 16:27:49 -07:00
whyrusleeping
726eacbe03 add endpoints needed by spacegap 2020-10-15 13:54:58 -07:00
Whyrusleeping
17fcf30edd
Merge pull request #4373 from filecoin-project/feat/gateway-wallet-verify 
add WalletVerify to lotus-gateway
 2020-10-15 15:42:38 -05:00
Aayush Rajasekaran
8c7d2efe72 Make audit balances capable of printing robust addresses 2020-10-15 12:17:54 -04:00
Łukasz Magiera
c56ef260d5
Merge pull request #4421 from filecoin-project/fix/lite-msig-inspect 
Ensure msig inspect cli works with lotus-lite
 2020-10-15 15:11:34 +02:00
Łukasz Magiera
955d7f9c54
Merge pull request #4393 from filecoin-project/vectors/support-multiple-versions 
conformance: support multiple protocol versions.
 2020-10-15 14:29:23 +02:00
Raúl Kripalani
1fb9ed1c9a remove TODO. 2020-10-15 12:58:43 +01:00
Raúl Kripalani
4e659e30c5 fix lint errors. 2020-10-15 12:14:16 +01:00
Dirk McCormick
f5d48b0e86 fix: lotus-gateway api tests 2020-10-15 12:47:24 +02:00
Dirk McCormick
9c99171cb8 fix: ensure msig inspect cli works with lotus-lite 2020-10-15 12:15:21 +02:00
Łukasz Magiera
ab4f051b83 sync wait --watch 2020-10-14 18:17:18 +02:00
Whyrusleeping
12f36c5bda
Update cmd/lotus-gateway/api.go 
Co-authored-by: dirkmc <dirkmdev@gmail.com>
 2020-10-14 09:22:25 -05:00
Raúl Kripalani
45cd510da1 conformance: support multiple protocol versions. 
This PR introduces support for running multiple variants of a vector,
each of which targets a unique protocol version.

tvx tooling has been adapted to produce and parse the new version
of the schema.
 2020-10-14 14:39:43 +01:00
Łukasz Magiera
4ad8d85b13
Merge pull request #4278 from filecoin-project/tvx/trace-puts 
tvx: trace puts to blockstore for inclusion in CAR.
 2020-10-14 12:08:06 +02:00
whyrusleeping
3d80c38064 support stateReadState in gateway 2020-10-13 14:23:08 -07:00
whyrusleeping
98c1aa7988 add WalletVerify to lotus-gateway 2020-10-13 13:31:20 -07:00
Łukasz Magiera
71b3b9075d Merge remote-tracking branch 'origin/master' into feat/async-restartable-workers 2020-10-13 21:33:21 +02:00
Travis Person
be74a13736 lotus-pcr: ignore all other market messages 2020-10-12 21:41:48 +00:00
Aayush Rajasekaran
83624a8858 Rename StateVMCirculatingSupply to StateVMCirculatingSupplyInternal 2020-10-12 16:41:27 -04:00
Aayush Rajasekaran
96e1dfd8d7 Add an endpoint for precise circulating supply 2020-10-12 16:38:29 -04:00
Łukasz Magiera
224a96431f
Merge pull request #4319 from filecoin-project/asr/repay-debt-cli 
Add a CLI tool for miner's to repay debt
 2020-10-12 19:24:40 +02:00