cerc-io/lotus
16
0
Fork 0
Code Issues Pull Requests Packages Projects Releases 27 Wiki Activity
12,024 Commits 24 Branches 342 Tags 314 MiB
0ccf716989
Commit Graph

2118 Commits

Author SHA1 Message Date
Łukasz Magiera
06d3892e38 lotus-wallet: Add interactive mode 2021-02-05 12:44:01 +01:00
Łukasz Magiera
ebfde330dd shed: Support miner nodes in rpc util 2021-02-04 20:06:05 +01:00
whyrusleeping
0efb4ca3a7 add an api endpoint to get pending transactions for multisigs 2021-02-03 20:46:10 -08:00
Łukasz Magiera
6e7fcb7ee6 Merge remote-tracking branch 'origin/master' into feat/refactor-fsm-input 2021-02-03 14:01:56 +01:00
whyrusleeping
ed6ccef5cf export metrics for lotus-gateway 2021-02-01 13:13:20 -08:00
Łukasz Magiera
fed3e82ff8
Merge pull request #5047 from zgfzgf/feat-shed-bitfield 
shed bitfield: Cleanup, add merge command
 2021-01-30 12:54:39 +01:00
Łukasz Magiera
b1dfd41c19
Merge pull request #4950 from zgfzgf/feat-bench-policy 
delete bench policy
 2021-01-30 12:34:40 +01:00
Łukasz Magiera
a541a2500a
Merge pull request #5282 from filecoin-project/chore/snake_context_through_blockstore_init 
Snake a context through the Chain-blockstore creation
 2021-01-30 11:55:17 +01:00
Raúl Kripalani
af429dba0f Merge branch 'master' into chore/snake_context_through_blockstore_init 2021-01-29 21:21:46 +00:00
Raúl Kripalani
b0cbc932bd consolidate all blockstores in blockstore package. 2021-01-29 20:01:00 +00:00
Jakub Sztandera
0a0fc47655
Make lint happy 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2021-01-28 19:58:28 +01:00
Jakub Sztandera
608793314f
Fix url Values 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2021-01-28 19:58:12 +01:00
Jakub Sztandera
ba94f271db
Add spam protection to fountain 
Uses reCAPTCHAv3, `RECAPTCHA_SITE_KEY` and `RECAPTCHA_SECRET_KEY` need to be
set in env.

Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2021-01-28 19:58:09 +01:00
Łukasz Magiera
94009f247f
Merge pull request #5411 from filecoin-project/feat/sealing-handle-batch-publish 
Handle batch publish storage deals message in sealing recovery
 2021-01-28 19:33:49 +01:00
Łukasz Magiera
3634bdcfa5
Merge pull request #5220 from filecoin-project/feat/verifpower-sector-list 
Show verified power in miner sector list
 2021-01-28 19:09:19 +01:00
Raúl Kripalani
a1da1dab85 add context to LockedRepo#Datastore(). 2021-01-26 11:01:43 +00:00
Raúl Kripalani
ce3af308ed Merge branch 'master' into chore/snake_context_through_blockstore_init 2021-01-25 19:31:41 +00:00
Dirk McCormick
1b494acc9e feat: handle batch publish storage deals message in sealing recovery 2021-01-25 14:10:05 +01:00
Steven Allen
a1e6781f0c fix tests 2021-01-21 15:21:20 -08:00
Steven Allen
ab4f135208 test actors v3 2021-01-21 15:21:20 -08:00
Steven Allen
026d236252 more reliably close in tests 2021-01-21 15:21:20 -08:00
Steven Allen
126a5c1cf8 chore: fix nolint comment 2021-01-21 15:21:19 -08:00
Aayush Rajasekaran
ab90a3b2bc Actors update: MinerInfo.SealProofType has been removed 2021-01-21 15:21:19 -08:00
Łukasz Magiera
b9a9f23204 storagefsm: Add stub AddPieceFailed state 2021-01-21 17:40:50 +01:00
Łukasz Magiera
239d6f8f4d storagefsm: Rewrite input handling 2021-01-21 17:40:50 +01:00
Aayush Rajasekaran
23ce0645ed
Merge pull request #5342 from filecoin-project/asr/change-owner 
Allow multisigs to be set as miner owner address
 2021-01-20 21:30:37 -05:00
Frank
e0209c74ad add verified indicator for storage-deals list 2021-01-20 15:14:51 +08:00
Łukasz Magiera
388c53e637
Merge pull request #5352 from filcloud/color-amount 
add color for token amount
 2021-01-19 11:47:22 +01:00
Dirk McCormick
827a473391 feat: expose StateSearchMessage on gateway 2021-01-19 11:27:43 +01:00
Łukasz Magiera
38f9559080 Implement full-node restore option 2021-01-15 20:57:32 +01:00
Frank
7747bcd859 remove some colorTokenAmount 2021-01-15 11:48:07 +08:00
Łukasz Magiera
1e53ed6a82 Print proving window info in pending termination list 2021-01-14 17:27:28 +01:00
Łukasz Magiera
9632a3836a Print msg cid in terminate flush 2021-01-14 16:47:30 +01:00
Łukasz Magiera
4a114150f0 fix miner terminate cli arg checks 2021-01-14 16:14:24 +01:00
Łukasz Magiera
7ddf1d1feb Add terminating states to state lists 2021-01-14 12:44:27 +01:00
Łukasz Magiera
785b660724 perning termination CLI 2021-01-14 12:37:31 +01:00
Frank
3224c84fb1 add color for token amount 2021-01-14 16:39:39 +08:00
Aayush Rajasekaran
b6bcd978e7 Fix lotus msig approve 2021-01-13 03:21:50 -05:00
Aayush Rajasekaran
b33bf16f70 Add a command to encode JSON params 2021-01-13 02:40:06 -05:00
Aayush Rajasekaran
02f33e2b8e Simplify the miner actor set owner command 2021-01-13 01:34:14 -05:00
Łukasz Magiera
52cc2cd3eb Initial sector termination support 2021-01-13 00:42:01 +01:00
Łukasz Magiera
8ac71f6d0a
Merge pull request #5222 from filcloud/bench-env 
add bench env print
 2021-01-06 20:17:42 +01:00
Łukasz Magiera
cbbe01eeb5
Merge pull request #5223 from filcloud/noise-limit 
add limit and rate for chain noise
 2021-01-06 20:17:29 +01:00
Łukasz Magiera
cf299b39b0
Merge pull request #5259 from filcloud/verbose-transfer 
add verbose for list transfers
 2021-01-06 17:24:13 +01:00
Frank
fdc46ad5df update json format 2021-01-06 12:20:33 +08:00
Frank
25f3384939 go fmt 2021-01-06 11:30:51 +08:00
Łukasz Magiera
9b70fdbe9d
Merge pull request #5289 from filecoin-project/asr/remove-env-var 
Remove LOTUS_DISABLE_V2_ACTOR_MIGRATION envvar
 2021-01-05 20:10:26 +01:00
Łukasz Magiera
4f9fcd2b01
Merge pull request #5258 from filecoin-project/raulk/tvx-batch-tipset-diff 
tvx extract: more tipset extraction goodness.
 2021-01-05 18:57:21 +01:00
Aayush Rajasekaran
11d1e3cd5f Remove LOTUS_DISABLE_V2_ACTOR_MIGRATION envvar 2021-01-05 00:46:57 -05:00
Peter Rabbitson
9334e73396 Snake a context through the Chain-blockstore creation 2021-01-04 15:27:52 +01:00
Frank
7583c4399a add verbose for list transfers 2020-12-28 16:36:19 +08:00
Raúl Kripalani
cd032d5418 tvx extract: more tipset extraction goodness. 
- ability to extract a tipset range into individual vectors.
- ability to extract a tipset range and squash into a single multi-tipset vector.
- mark statediff output deterministically, so it can be extracted by tooling.
- ability to execute callbacks between tipsets in the driver.
- implement save-balances callback.
 2020-12-27 18:58:35 +00:00
Frank
984e4e9963 add limit and rate for chain noise 2020-12-18 19:35:11 +08:00
Frank
f24d401b61 add bench env print 2020-12-18 17:57:32 +08:00
Łukasz Magiera
9892c60ed0 Show verified power in miner sector list 2020-12-17 17:17:07 +01:00
Dan Shao
fda3b152bd Skip checking terminated sectors provable 2020-12-17 20:05:43 +08:00
Łukasz Magiera
0d72d742b4
Merge pull request #5194 from filecoin-project/raulk/tvx-extract-tipset 
tvx command to extract tipset vectors.
 2020-12-15 19:53:10 +01:00
vyzo
210216a94f lotus-shed blockmsgid command 2020-12-15 20:20:16 +02:00
Raúl Kripalani
2af1283c65 tvx exec: flag to fallback to API blockstore. 2020-12-15 17:44:56 +00:00
Raúl Kripalani
3fa51f08e1 fix lint error; stamp metadata on vector. 2020-12-15 17:08:49 +00:00
Raúl Kripalani
446b1cc883 tvx command to extract tipset vectors. 2020-12-15 16:56:01 +00:00
Łukasz Magiera
2e154ef6d0
Merge pull request #5176 from filecoin-project/shaodan-miner-sectors-info 
Shaodan miner sectors info
 2020-12-10 20:09:15 +01:00
Łukasz Magiera
0cb2f51549
Merge pull request #5094 from filecoin-project/asr/verified-only 
Allow miners to filter (un)verified deals
 2020-12-10 19:48:22 +01:00
Łukasz Magiera
d347e7ab8f Merge branch 'miner-sectors-info' of github.com:shaodan/lotus into shaodan-miner-sectors-info 2020-12-10 19:32:26 +01:00
Dirk McCormick
72cb130e17 feat: show data transfer ID in list-deals 2020-12-08 15:23:26 +01:00
Łukasz Magiera
a999e41677
Merge pull request #5072 from zgfzgf/feat-shed-cid 
Feat shed cid
 2020-12-08 10:23:04 +01:00
Łukasz Magiera
5c37c9d8e9
Merge pull request #5118 from filcloud/keygen-outfile 
add keygen outfile
 2020-12-07 13:11:11 +01:00
Łukasz Magiera
b7975dcd9a
Merge pull request #5114 from filecoin-project/chore/update_sr2_stat_aggregation 
Chore/update sr2 stat aggregation
 2020-12-07 13:09:23 +01:00
Dan Shao
d56170d70e Optimize sectors info loading 2020-12-07 13:42:37 +08:00
Peter Rabbitson
d9e3cc0374 Add an extra filplus counter 2020-12-04 19:00:13 +01:00
Peter Rabbitson
2514c96cff Count deals from sealed sectors only 2020-12-04 15:45:25 +01:00
Peter Rabbitson
88bd757024 Only count the first 10 copies of the same piece per project 2020-12-04 15:45:25 +01:00
Peter Rabbitson
1e6aa4b129 Only count phase2 deals ( start epoch 166560 ) 2020-12-04 15:45:25 +01:00
Frank
daca99687c add keygen outfile 2020-12-04 18:39:35 +08:00
Łukasz Magiera
90a31fde9f
Merge pull request #5103 from filecoin-project/feat/miner-control-config 
miner: Control address config for (pre)commits
 2020-12-03 15:33:12 +01:00
Łukasz Magiera
da5e1b319f
Merge pull request #5098 from filecoin-project/feat/shed-ledger-show 
shed: ledger show command
 2020-12-03 13:22:06 +01:00
Łukasz Magiera
f74a1b70ab miner: Fix actor control list cli 2020-12-02 20:46:07 +01:00
Łukasz Magiera
9707c82285 shed: ledger show command 2020-12-02 10:37:17 +01:00
Aayush Rajasekaran
370817eb60 Allow miners to filter (un)verified deals 2020-12-02 01:32:34 -05:00
zgfzgf
7c8ab6977a add estimate command 2020-12-02 12:57:57 +08:00
zgfzgf
7d3e4c5d01 feat election error miner-power to network-power 2020-12-02 12:36:05 +08:00
zgfzgf
97dd082585 change flag codec value raw to id and default value is id 2020-12-02 08:41:58 +08:00
Łukasz Magiera
c6f85886bf miner: Add slow mode to proving check 2020-12-02 00:32:14 +01:00
Łukasz Magiera
64e30808f8 miner info: Print control and spendable balances 2020-12-01 19:56:47 +01:00
Łukasz Magiera
28420b9eb0 miner info: Make balances line up better 2020-12-01 19:43:22 +01:00
Łukasz Magiera
827ec75f5f miner info: Don't print random config values 2020-12-01 19:23:29 +01:00
Łukasz Magiera
c31774b08e miner info: Cleanup balance printing 2020-12-01 19:22:57 +01:00
Łukasz Magiera
15c4793fe0 miner info: More cleanup 2020-12-01 19:15:20 +01:00
Łukasz Magiera
42cecbd879 miner info: Collapse sector size line 2020-12-01 19:01:08 +01:00
Łukasz Magiera
00e5ace818 Print basefee in miner info 2020-12-01 18:56:43 +01:00
Łukasz Magiera
82b5cb89cd
Merge pull request #5061 from filecoin-project/fix/err-late-deals 
Error out deals that are not activated by proposed deal start epoch
 2020-12-01 17:02:06 +01:00
zgfzgf
715c32ff77 add flag codec 2020-12-01 22:53:24 +08:00
Łukasz Magiera
4b1d6bfcca
Merge pull request #5079 from zgfzgf/feat-shed-commp 
add commp-to-cid base64 decode
 2020-12-01 15:11:23 +01:00
Łukasz Magiera
614f45dcfb
Merge pull request #5041 from filecoin-project/feat/5013 
Sector check command
 2020-12-01 14:59:01 +01:00
Łukasz Magiera
354b5af55a
Merge pull request #5032 from filecoin-project/fix/cancel-transfer 
Cancel transfer cancels storage deal
 2020-12-01 14:57:58 +01:00
Łukasz Magiera
c4a6b94b9c
Merge pull request #5023 from filecoin-project/feat/worker-set-task-types 
worker: Support setting task types at runtime
 2020-12-01 14:51:07 +01:00
Dirk McCormick
cb044f83a7 fix: ensure deal start is far enough in future for tests 2020-12-01 14:25:48 +01:00
zgfzgf
ec08e27af2 add base64 decode 2020-12-01 19:36:01 +08:00
zgfzgf
a8cdb8adc7 add abi Cid 2020-12-01 17:16:41 +08:00
zgfzgf
0439e95aa3 add encoding flag 2020-12-01 16:50:53 +08:00
ZenGround0
2e5843a0ee Filecoin signature serialization 2020-11-30 23:14:21 -05:00
ZenGround0
751568a4dd Print hex 2020-11-30 22:50:41 -05:00
Łukasz Magiera
6dea0a6281 worker: fix math-related issue 2020-11-30 23:19:16 +01:00
Łukasz Magiera
a4f3758f4c worker api: better grouping 2020-11-30 23:16:30 +01:00
Łukasz Magiera
d15ef9ac9b
Merge pull request #5036 from filecoin-project/feat/shed-rpc-args 
shed rpc: Allow calling with args
 2020-11-30 14:33:52 +01:00
Łukasz Magiera
70732ac423 Fix lint 2020-11-30 14:26:42 +01:00
zgfzgf
253e22d6ea add bitfield merge func 2020-11-28 21:54:30 +08:00
zgfzgf
a7ed639c21 optimize bitfield use func 2020-11-28 21:44:12 +08:00
zgfzgf
f4adf03ce5 optimize bitfield intersect 2020-11-28 21:07:14 +08:00
zgfzgf
c016e34dbc bitfield add encode 2020-11-28 20:56:16 +08:00
zgfzgf
21835c785b optimize bitfield runs 2020-11-28 20:17:56 +08:00
zgfzgf
8007c1f9ae feat bitfield stat 2020-11-28 20:03:26 +08:00
zgfzgf
055795c4cc optimize bitfield decode 2020-11-28 19:14:48 +08:00
zgfzgf
b03c4bc26b add bitfield hex encode 2020-11-28 17:29:15 +08:00
Łukasz Magiera
e8d2560581 Fix tests 2020-11-27 16:47:48 +01:00
Łukasz Magiera
0c1592f2d3
Merge pull request #5025 from filecoin-project/feat/accounting-tool 
add a tooling to make filecoin accounting a little easier
 2020-11-27 16:11:25 +01:00
Łukasz Magiera
61485beb22 fix lint 2020-11-27 16:02:01 +01:00
Łukasz Magiera
01ad4c0514 shed rpc: Allow calling with args 2020-11-27 15:57:00 +01:00
Dirk McCormick
c66e594046 fix: cancel transfer cancels storage deal 2020-11-27 15:37:22 +01:00
whyrusleeping
4f675b76ad add a tooling to make filecoin accounting a little easier 2020-11-26 13:46:19 -08:00
Łukasz Magiera
bfb5bad124 docsgen 2020-11-26 17:34:58 +01:00
Łukasz Magiera
3672053ae9 worker: Support setting task types at runtime 2020-11-26 17:33:34 +01:00
Łukasz Magiera
4dfec7b232 worker: Sort tasks in info 2020-11-26 16:37:11 +01:00
Łukasz Magiera
23c7728edb worker: Print task types in info 2020-11-26 16:34:51 +01:00
Łukasz Magiera
aa278443d3
Merge pull request #5008 from filecoin-project/fix/worker-remote 
worker: More robust remote checks
 2020-11-26 16:29:51 +01:00
Łukasz Magiera
2304ea0077
Merge pull request #5016 from filecoin-project/fix/fsm-rm-unceroverable 
storagefsm: Add missing planners
 2020-11-26 12:22:48 +01:00
Łukasz Magiera
65653a1747 storagefsm: Add GetTicket to some maps 2020-11-26 10:53:31 +01:00
s1m0n21
663b3f4f21 add a sector check command 2020-11-26 15:02:43 +08:00
Łukasz Magiera
23bf3349d7 worker: More robust remote checks 2020-11-25 17:05:45 +01:00
Dirk McCormick
239e180683 feat: markets - separate watching for pre-commit from prove-commit 2020-11-24 13:24:41 -08:00
Łukasz Magiera
a63ef1dcd5
Merge pull request #4984 from yaohcn/fix-log-warn 
fix log format
 2020-11-24 18:01:56 +01:00
Łukasz Magiera
9cef300535
Merge pull request #4971 from filecoin-project/chore/new_sr2_deal_rollup_cmd 
New SR-specific lotus-shed cmd
 2020-11-24 17:50:10 +01:00
Lucas Molas
8b8449faee update jsonrpc with max req size 2020-11-24 16:46:35 +01:00
yaohcn
7c0b6f41d8 fix log format 2020-11-24 19:09:48 +08:00
Peter Rabbitson
a145819004 More linter... 2020-11-23 18:46:59 +01:00
Peter Rabbitson
e7f3554c62 The linter is *so* dumb: 
- There is no way for me to check the error on defer ...Close(), why even ask?
- A sort function does not suffer arbitrary aliasing

Everything is terrible...
 2020-11-23 06:51:52 +01:00
Peter Rabbitson
2609342356 New SR-specific lotus-shed cmd 2020-11-23 05:41:14 +00:00
zgfzgf
e197038b9f delete policy useless code 2020-11-21 10:14:13 +08:00
zgfzgf
549afbaa5f add policy 8m and 512m 2020-11-21 10:04:07 +08:00
hannahhoward
218f7c2c5d feat(markets): update markets, extract commp 2020-11-20 13:29:14 -08:00
Łukasz Magiera
375b7a1c4c
Merge pull request #4305 from zgfzgf/fix-lotus-bench 
Fix lotus bench error
 2020-11-20 19:22:22 +01:00
Łukasz Magiera
4b507f5be1
Merge pull request #4911 from filecoin-project/asr/seed-old 
Use version0 when pre-sealing
 2020-11-20 16:41:14 +01:00
zgfzgf
d033042d6b update code 2020-11-20 23:20:26 +08:00
zgfzgf
7d4bc90d42 solve merge conflicts 2020-11-20 22:34:15 +08:00
Łukasz Magiera
853f9da457
Merge pull request #4583 from filecoin-project/fix/tvx-msg-cid 
tvx extract: make it work with secp messages.
 2020-11-20 15:13:06 +01:00
Raúl Kripalani
bb9d2b5af4
finish comment. 2020-11-20 14:05:50 +00:00
Łukasz Magiera
b10b6fdd11
Merge pull request #4355 from filecoin-project/shed/post-find 
Shed/post find
 2020-11-20 14:52:42 +01:00
Łukasz Magiera
2d9123a618
Merge pull request #4140 from filecoin-project/feat/mutex-fraction 
Add options to set BlockProfileRate and MutexProfileFraction
 2020-11-20 14:22:58 +01:00
Łukasz Magiera
16dbbadddf Set lower feecap on PoSt messages with low balance 2020-11-19 18:02:20 +01:00
Aayush Rajasekaran
62d20f2191 Use version0 when pre-sealing 2020-11-18 23:10:05 -05:00
Aayush Rajasekaran
68a16afeda Merge branch 'master' into release/v1.2.0 2020-11-17 19:40:05 -05:00
Raúl Kripalani
27c0ce4a3a fix lint. 2020-11-16 22:39:08 +00:00
Raúl Kripalani
0c6072a1a0 chainstore lifecycle: close via Close() instead of context. 2020-11-16 22:28:59 +00:00
Steven Allen
c8ff58aae1 add basic calico test 2020-11-16 19:04:17 +01:00
Łukasz Magiera
915c5e0fdd Get most tests to pass 2020-11-16 19:03:30 +01:00
Łukasz Magiera
2a7e4af5ee Fix lotus-miner/lotus-worker build 2020-11-16 19:03:30 +01:00
Steven Allen
4544d2118e fix lotus seed for proof api changes 2020-11-16 19:03:30 +01:00
Łukasz Magiera
6bea9dd178 Making sealing logic work with multiple seal proof types 2020-11-16 19:03:30 +01:00
Raúl Kripalani
bac51dd4e3 daemon --import-snapshot: force head silently, without triggering reorg. 2020-11-16 16:03:47 +00:00
Raúl Kripalani
d7b4f92f1f add context to ChainStore. 2020-11-16 15:52:19 +00:00
Raúl Kripalani
87d6daf745 fix blockstore double open issue on --import-snapshot. 
Fixes https://github.com/filecoin-project/lotus/issues/4850.
 2020-11-16 15:21:47 +00:00
Łukasz Magiera
c5c0185943 miner: Basic storage cleanup command 2020-11-12 21:27:16 +01:00
Łukasz Magiera
bf547112de miner: Storage list sectors command 2020-11-12 19:11:58 +01:00
Łukasz Magiera
28ffa8ca06
Merge pull request #4819 from liyue201/master 
Delete the duplicate output
 2020-11-12 18:13:51 +01:00
Dirk McCormick
0e3e449bf8 test: stop mining at the end of tests 2020-11-12 16:23:46 +01:00
stirlingx
8246149544
Delete unnecessary output 2020-11-12 18:59:36 +08:00
Aayush Rajasekaran
3a3986320c
Merge pull request #4804 from filecoin-project/feat/storage-retwait-cleanup 
Expand sched-diag; Command to abort sealing calls
 2020-11-12 02:11:15 -05:00
Aayush Rajasekaran
498477da04 Nit: ArgsUsage param rename 2020-11-12 02:04:55 -05:00
Travis Person
f4df58ed0f
Merge pull request #4810 from filecoin-project/fix/lotus-stats-flags 
lotus-stats: fix influx flags
 2020-11-11 14:36:37 -08:00
Travis Person
ff7bdb5140 lotus-stats: fix influx flags 2020-11-11 21:17:36 +00:00
Łukasz Magiera
8ac495723e gofmt 2020-11-11 17:42:23 +01:00
Łukasz Magiera
09f9f871a3 Create a command to abort sealing calls 2020-11-11 17:39:12 +01:00
Łukasz Magiera
2a3d930933 Hide ret-done tasks in sealing jobs by default 2020-11-11 16:48:04 +01:00
stirlingx
8b889139e9
Modify printf format 2020-11-11 10:39:13 +08:00
Aayush Rajasekaran
735c04f999
Merge pull request #4681 from filecoin-project/badger-viewable 
move to native badger blockstore; leverage zero-copy View() to deserialize in-place
 2020-11-10 18:08:12 -05:00
Łukasz Magiera
18aa97f962
Merge pull request #4779 from filecoin-project/feat/work-track-hostname 
storage: Track worker hostnames with work
 2020-11-10 20:38:44 +01:00
zgfzgf
f5401317c9 cmd sectors commitIDs len 2020-11-10 17:37:36 +08:00
Łukasz Magiera
5caa277261 storage: Track abandoned work more correctly 2020-11-09 23:38:20 +01:00
Łukasz Magiera
f819e71d12 storage: Separate returned jobs in jobs cli 2020-11-09 23:13:29 +01:00
Łukasz Magiera
27a9dd3bbb storage: Track worker hostnames with work 2020-11-09 23:09:04 +01:00
Raúl Kripalani
3577300aee Merge branch 'master' into badger-viewable 2020-11-06 19:34:25 +00:00
Łukasz Magiera
426c2e8c2b
Merge pull request #4717 from filecoin-project/feat/optional-chain-bitswap 
Optional chain Bitswap
 2020-11-06 16:49:39 +01:00
Łukasz Magiera
3c9e438a68
Merge pull request #4617 from filecoin-project/termination-penalty 
Add `termination-estimate` to get an estimation for how much a termination penalty will be
 2020-11-06 16:44:44 +01:00
Łukasz Magiera
2f9d19c42c
Merge pull request #4726 from filecoin-project/feat/shed-id-cid 
shed: Util for creating ID CIDs
 2020-11-06 16:03:45 +01:00
Łukasz Magiera
ee9df63221 shed: Util for creating ID CIDs 2020-11-06 15:42:09 +01:00
Raúl Kripalani
8befc0c1f5 export metrics from bench. 2020-11-05 19:09:47 +00:00
Travis Person
bd4322f56f Update lotus-stats with a richer cli 
This updates lotus stats to use urfave instead of the golang flags
package. This brings with it some common features from other lotus tools
such as the use of the `FULLNODE_API_INFO` env and other parts of the
lotus cli package.

This also includes the latest dashboard.
 2020-11-04 18:06:17 +00:00
Raúl Kripalani
a411342f0c export more metrics. 2020-11-04 17:09:01 +00:00
Raúl Kripalani
370ef93db6 chainstore: new ForceHeadSilent to support benchmarks. 2020-11-04 14:39:01 +00:00
Raúl Kripalani
fd1439f284 fix lint. 2020-11-03 22:49:55 +00:00
Łukasz Magiera
a1e1b03ca4 Optionally allow bitswap for chainstore 2020-11-03 23:44:44 +01:00
Raúl Kripalani
87ce2f774d lotus-bench: write separate profiles for import and validation. 2020-11-03 22:40:21 +00:00
Raúl Kripalani
5487356370 fix lint errors. 2020-11-03 21:23:41 +00:00
Raúl Kripalani
809111336a Merge branch 'master' into badger-viewable 2020-11-03 18:29:10 +00:00
Raúl Kripalani
18418128c3 lotus-bench: make start tipset walkback start from end tipset. 2020-11-03 18:15:59 +00:00
Raúl Kripalani
581ac5b019 lotus-bench: add ability to specify tipsets. 2020-11-03 18:11:43 +00:00
Raúl Kripalani
842c8ca056 improve lotus-bench; support running validation on a store without a CAR. 2020-11-03 17:35:31 +00:00
zgfzgf
3e7efad0fd modify lint error 2020-11-03 21:28:01 +08:00
zgfzgf
3c2cd506ec modify merge lotus-bench 2020-11-03 19:56:04 +08:00
Łukasz Magiera
1df02d5a93
Merge pull request #4691 from filecoin-project/fix/metrics 
fix metrics wiring.
 2020-11-03 11:50:43 +01:00
Łukasz Magiera
a4cf6fa715 sched: Interactive RPC Shell 2020-11-02 20:38:15 +01:00
Raúl Kripalani
656ece06e5 fix metrics wiring. 
Some components like go-ds-measure, go-ipfs-blockstore and go-bitswap
expose metrics via ipfs/go-metrics-interface, but Lotus never injects
the Prometheus exporter (ipfs/go-metrics-prometheus). Therefore, those
metrics never surface in instrumentation.

Instead, Lotus uses OpenCensus directly.

This commit injects the Prometheus exporter for go-metrics-interface, and
instructs the OpenCensus Prometheus exporter to use the DefaultRegistry.

This has the effect of exposing blending the metrics of both metrics
libraries.

With this patch, the datastore, cache utilisation, and bitswap metrics
are now exported via the /debug/metrics endpoint.

This commit also fixes an issue where the metrics scope was empty, making
go-metrics-interface default to "<no-scope>". Angle brackets are inadmissible
characters for Prometheus, so it was refusing to export the affected metrics.
(These were the ARC cache metrics.)
 2020-11-02 17:56:49 +00:00
Raúl Kripalani
d1ebf3c769 introduce non-pooled StorageKey method. 2020-11-02 13:32:07 +00:00
Raúl Kripalani
f4e13ffd80 actually register prometheus gauge. 2020-11-01 20:01:57 +00:00
Raúl Kripalani
44e34d9606 lotus-bench: native badger SyncWrites=false. 2020-11-01 19:54:47 +00:00
Raúl Kripalani
35ccd73a86 lotus-bench: improve for observability. 2020-11-01 19:52:53 +00:00
Raúl Kripalani
aece624d1c lotus-bench: add support for native badger blockstore. 2020-11-01 18:54:35 +00:00
Raúl Kripalani
c2355b18f9 write heap and allocs profile in lotus-bench. 2020-11-01 18:00:08 +00:00
Raúl Kripalani
d8d85373f5 fix lotus-shed datastore commands. 2020-11-01 13:50:41 +00:00
Raúl Kripalani
a16d7f221e Merge branch 'master' into badger-viewable 2020-11-01 13:10:56 +00:00
Raúl Kripalani
099c4b5e1d migrate repo.Datastore(/chain) to repo.Blockstore(). 2020-11-01 13:03:21 +00:00
Łukasz Magiera
978192233d
Merge pull request #4498 from filecoin-project/feat/try-election 
Add election run-dummy command
 2020-10-31 01:02:25 +01:00
Łukasz Magiera
6fcdf3c7ed
Merge pull request #4615 from filecoin-project/feat/worker-pause 
worker: Commands to pause/resume task processing
 2020-10-31 00:26:37 +01:00
Łukasz Magiera
094ea3fe97
Merge pull request #4666 from filecoin-project/fix/sched-issues 
Fix worker reenabling, handle multiple restarts in worker
 2020-10-30 21:34:07 +01:00
Łukasz Magiera
6cdbf5216e
Merge pull request #4629 from filecoin-project/fix/badger-lsm-trsh 
Reduce badger ValueTreshold to 128
 2020-10-30 21:10:18 +01:00
Łukasz Magiera
fb492d9acb
Merge pull request #4662 from filecoin-project/feat/force-sched-cli 
Debug flag to force running sealing scheduler
 2020-10-30 20:15:49 +01:00
Łukasz Magiera
885c6c94d3 Add sync status to miner info command 2020-10-30 19:39:31 +01:00
jennijuju
2f4582147a Add termination-estimate to get an estimation for how much a termination penalty will be: 
- Usage example: `./lotus-shed sectors termation-estimate 5 8 10`.
 2020-10-30 13:34:03 -04:00
Łukasz Magiera
af1d45d969 worker: Handle multiple manager restarts while waiting for tasks 2020-10-30 18:00:48 +01:00
Łukasz Magiera
7fbb868513 Debug flag to force running sealing scheduler 2020-10-30 11:07:35 +01:00
Łukasz Magiera
ad9a5acb7f miner sectors list: flags for events/seal time 2020-10-29 19:10:20 +01:00
Jakub Sztandera
ae905bd056
Fix closing 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-10-29 01:05:31 +01:00
Jakub Sztandera
a2c66dd102
make linter happy 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-10-28 23:30:28 +01:00
Jakub Sztandera
0297be4b9a
Add lotus-shed datastore rewrite command 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-10-28 23:24:45 +01:00
Łukasz Magiera
553408d573 worker: Commands to pause/resume task processing 2020-10-28 22:10:17 +01:00
Łukasz Magiera
e1da874258 Merge remote-tracking branch 'origin/master' into feat/async-restartable-workers 2020-10-27 03:31:07 +01:00
Steven Allen
832c0998e4 validate that block propagation works after a worker key change 2020-10-26 18:16:25 -07:00
Steven Allen
0d06f8fa2b Add commands to change the worker key 2020-10-26 18:16:24 -07:00
Jakub Sztandera
cced3bf9ee
Randomize seed 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-10-26 17:44:55 +01:00
Jakub Sztandera
ea6afe84db
Add election run-dummy command 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-10-26 17:44:51 +01:00
Łukasz Magiera
8923524f6a Make EarlyExpiration in sectors list less scary 2020-10-26 15:33:15 +01:00
Łukasz Magiera
a37c372d06
Merge pull request #4572 from filecoin-project/feat/data-transfer-utils 
Flesh out data transfer features
 2020-10-26 13:29:26 +01:00
Raúl Kripalani
cdfa869ea6 tvx extract: make it work with secp messages. 
Unfortunately ChainGetMessage returns a *types.Message, which in
the case of secp messages is lacking the signature. The signature
is part of the input to calculate the CID on secp messages. Therefore,
calling `.Cid()` on the result of ChainGetMessage for this kind of
message will lead to an incorrect CID.

tvx was relying on that call to return the correct CID. Since this is
not the case (and this is a footgun that needs to be corrected, ideally
together with the *types.{,Signed}Message duality mess), I'm replacing
the comparison.
 2020-10-24 20:16:14 +01:00
Łukasz Magiera
660236b224 Merge remote-tracking branch 'origin/master' into feat/async-restartable-workers 2020-10-23 23:25:35 +02:00
Łukasz Magiera
067de4508b shed: Commad to decode messages 2020-10-23 22:17:46 +02:00
Łukasz Magiera
dbcba6477e
Merge pull request #4263 from filecoin-project/feat/lite-market-client 
lite-mode - market storage and retrieval clients
 2020-10-23 17:23:06 +02:00
Dirk McCormick
906286fdbe feat: lite-mode - CLI tests for lotus client commands 2020-10-23 15:02:49 +02:00
Dirk McCormick
92942d44d1 feat: lite-mode - market storage and retrieval clients 2020-10-23 15:02:26 +02:00
Raúl Kripalani
39d9150175 fix tvx init. 2020-10-23 13:30:04 +01:00
Raúl Kripalani
5301c416bc tvx extract: --ignore-sanity-checks flag. 2020-10-23 10:47:22 +01:00
Raúl Kripalani
92395745d3 tvx simulate: execute raw message against height. 2020-10-23 10:46:32 +01:00
hannahhoward
98297cef4d feat(data-transfer): fill in utils 2020-10-22 13:40:26 -07:00
Łukasz Magiera
0289c39850
Merge pull request #4516 from filecoin-project/feat/api-request-metrics-wrapper 
Feat/api request metrics wrapper
 2020-10-22 21:40:47 +02:00
Łukasz Magiera
f9723ca3c1
Merge pull request #4521 from filecoin-project/feat/fix-shed-ledger-list 
Fix lotus-shed ledger list
 2020-10-22 19:59:18 +02:00
Łukasz Magiera
6c800bd0e3
Merge pull request #4501 from filecoin-project/feat/gateway-oni-needs 
add some methods that oni needs
 2020-10-22 19:44:47 +02:00
Łukasz Magiera
6bdf9935bf
Merge pull request #4475 from filecoin-project/fix/miner-init-createworker 
miner: fix init --create-worker-key
 2020-10-22 18:55:25 +02:00
Łukasz Magiera
6fc8550c19
Merge pull request #4314 from filecoin-project/feat/lotus-pcr-block-list 
Add block list to pcr
 2020-10-22 17:59:23 +02:00
Łukasz Magiera
041762a34f
Merge pull request #4383 from filecoin-project/steb/actor-v2-imports 
Remove most v0 actor imports
 2020-10-22 17:17:56 +02:00
Łukasz Magiera
9a58763a4e shed: Rename the command to frozen-miners 2020-10-22 16:07:42 +02:00
ZenGround0
f9707ba344 add borked inspection command 
hook up new command

Fix head call

Debug internal error

Debug moa

Debug 0

Fix 0

Fix 1

Better print

Don't ignore error
 2020-10-22 16:03:11 +02:00