Łukasz Magiera
5fe37404bc
Merge remote-tracking branch 'origin/master' into next
2021-03-01 19:03:01 +01:00
Raúl Kripalani
3795cc2bd2
segregate chain and state blockstores.
...
This paves the way for better object lifetime management.
Concretely, it makes it possible to:
- have different stores backing chain and state data.
- having the same datastore library, but using different parameters.
- attach different caching layers/policies to each class of data, e.g.
sizing caches differently.
- specifying different retention policies for chain and state data.
This separation is important because:
- access patterns/frequency of chain and state data are different.
- state is derivable from chain, so one could never expunge the chain
store, and only retain state objects reachable from the last finality
in the state store.
2021-02-28 22:49:44 +00:00
Raúl Kripalani
7f0f7d0b36
Merge branch 'master' into refactor/lib/blockstore
2021-02-28 19:55:23 +00:00
Aayush Rajasekaran
191a05da48
Fixup get-cc-collateral command
2021-02-28 02:10:22 -05:00
Łukasz Magiera
29c9fa3137
Merge pull request #5612 from filecoin-project/feat/cc-fsm-cleanup
...
storagefsm: Cleanup CC sector creation
2021-02-26 11:39:28 +01:00
Łukasz Magiera
f5d819ba53
Merge pull request #5669 from ghoneycutt/import_error
...
Improve error message with importing a chain
2021-02-25 14:31:33 +01:00
Garrett Honeycutt
92b605466f
Improve error message with importing a chain
...
Without this commit the error message does not provide much value as it
lacks context.
2021-02-24 19:29:29 -05:00
Łukasz Magiera
a3a78fc705
Command to extend sector expiration
2021-02-23 09:27:14 +01:00
Łukasz Magiera
37b1fb97fb
Configurable storage path storage limit
2021-02-18 16:44:34 +01:00
Łukasz Magiera
d8c9712383
Merge remote-tracking branch 'origin/master' into feat/refactor-fsm-input
2021-02-17 21:24:48 +01:00
Łukasz Magiera
d12545af6f
Merge pull request #5469 from filecoin-project/feat/faucet-captcha
...
Add spam protection to fountain
2021-02-17 20:17:28 +01:00
Aayush Rajasekaran
f358af6f56
Fix typo
2021-02-16 19:35:35 -05:00
Łukasz Magiera
fd90c03018
Roturn SectorID from PledgeSector
2021-02-16 19:16:35 +01:00
Łukasz Magiera
7111e924cc
Merge remote-tracking branch 'origin/master' into feat/refactor-fsm-input
2021-02-11 13:30:22 +01:00
Łukasz Magiera
0c6aef221d
Fix error logging format strings
2021-02-11 12:00:26 +01:00
Cory Schwartz
039ca9f3b4
return the err
2021-02-09 17:05:56 -08:00
Cory Schwartz
6d4caa0163
lotus-seed command to generate lotus block
...
Currently devnet deployment requires spinning up a full daemon.
This would move the daemon `lotus-make-genesis` logic to lotus-seed
so it can be more easily executed in scripts, etc.
2021-02-09 16:54:32 -08:00
Łukasz Magiera
5a3b983954
Merge pull request #5529 from filecoin-project/feat/shed-rpc-miner
...
shed: Support miner nodes in rpc util
2021-02-09 17:23:08 +01:00
Łukasz Magiera
e92b8b24b1
Merge remote-tracking branch 'origin/master' into feat/refactor-fsm-input
2021-02-09 14:04:21 +01:00
Dirk McCormick
eb03422c93
feat: add ends-in to pending publish deals output
2021-02-08 18:06:50 +01:00
Dirk McCormick
614844dc94
feat: output more info in pending-publish CLI
2021-02-08 12:08:42 +01:00
Łukasz Magiera
3ff6a6f59f
address review; flush tablewriter
2021-02-05 22:33:53 +01:00
Łukasz Magiera
cfa73f34e4
market: miner CLI for managing pending deals
2021-02-05 21:55:43 +01:00
Łukasz Magiera
dc6392db49
Merge pull request #5219 from filecoin-project/feat/interactive-wallet
...
lotus-wallet: Add interactive mode
2021-02-05 13:07:25 +01:00
Łukasz Magiera
641eeb4783
lotus-wallet: Better interactive prompts
2021-02-05 12:47:55 +01:00
Łukasz Magiera
ab5345860c
gofmt
2021-02-05 12:44:07 +01:00
Łukasz Magiera
06d3892e38
lotus-wallet: Add interactive mode
2021-02-05 12:44:01 +01:00
Łukasz Magiera
ebfde330dd
shed: Support miner nodes in rpc util
2021-02-04 20:06:05 +01:00
whyrusleeping
0efb4ca3a7
add an api endpoint to get pending transactions for multisigs
2021-02-03 20:46:10 -08:00
Łukasz Magiera
6e7fcb7ee6
Merge remote-tracking branch 'origin/master' into feat/refactor-fsm-input
2021-02-03 14:01:56 +01:00
whyrusleeping
ed6ccef5cf
export metrics for lotus-gateway
2021-02-01 13:13:20 -08:00
Łukasz Magiera
fed3e82ff8
Merge pull request #5047 from zgfzgf/feat-shed-bitfield
...
shed bitfield: Cleanup, add merge command
2021-01-30 12:54:39 +01:00
Łukasz Magiera
b1dfd41c19
Merge pull request #4950 from zgfzgf/feat-bench-policy
...
delete bench policy
2021-01-30 12:34:40 +01:00
Łukasz Magiera
a541a2500a
Merge pull request #5282 from filecoin-project/chore/snake_context_through_blockstore_init
...
Snake a context through the Chain-blockstore creation
2021-01-30 11:55:17 +01:00
Raúl Kripalani
af429dba0f
Merge branch 'master' into chore/snake_context_through_blockstore_init
2021-01-29 21:21:46 +00:00
Raúl Kripalani
b0cbc932bd
consolidate all blockstores in blockstore package.
2021-01-29 20:01:00 +00:00
Jakub Sztandera
0a0fc47655
Make lint happy
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2021-01-28 19:58:28 +01:00
Jakub Sztandera
608793314f
Fix url Values
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2021-01-28 19:58:12 +01:00
Jakub Sztandera
ba94f271db
Add spam protection to fountain
...
Uses reCAPTCHAv3, `RECAPTCHA_SITE_KEY` and `RECAPTCHA_SECRET_KEY` need to be
set in env.
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2021-01-28 19:58:09 +01:00
Łukasz Magiera
94009f247f
Merge pull request #5411 from filecoin-project/feat/sealing-handle-batch-publish
...
Handle batch publish storage deals message in sealing recovery
2021-01-28 19:33:49 +01:00
Łukasz Magiera
3634bdcfa5
Merge pull request #5220 from filecoin-project/feat/verifpower-sector-list
...
Show verified power in miner sector list
2021-01-28 19:09:19 +01:00
Raúl Kripalani
a1da1dab85
add context to LockedRepo#Datastore().
2021-01-26 11:01:43 +00:00
Raúl Kripalani
ce3af308ed
Merge branch 'master' into chore/snake_context_through_blockstore_init
2021-01-25 19:31:41 +00:00
Dirk McCormick
1b494acc9e
feat: handle batch publish storage deals message in sealing recovery
2021-01-25 14:10:05 +01:00
Steven Allen
a1e6781f0c
fix tests
2021-01-21 15:21:20 -08:00
Steven Allen
ab4f135208
test actors v3
2021-01-21 15:21:20 -08:00
Steven Allen
026d236252
more reliably close in tests
2021-01-21 15:21:20 -08:00
Steven Allen
126a5c1cf8
chore: fix nolint comment
2021-01-21 15:21:19 -08:00
Aayush Rajasekaran
ab90a3b2bc
Actors update: MinerInfo.SealProofType has been removed
2021-01-21 15:21:19 -08:00
Łukasz Magiera
b9a9f23204
storagefsm: Add stub AddPieceFailed state
2021-01-21 17:40:50 +01:00
Łukasz Magiera
239d6f8f4d
storagefsm: Rewrite input handling
2021-01-21 17:40:50 +01:00
Aayush Rajasekaran
23ce0645ed
Merge pull request #5342 from filecoin-project/asr/change-owner
...
Allow multisigs to be set as miner owner address
2021-01-20 21:30:37 -05:00
Frank
e0209c74ad
add verified indicator for storage-deals list
2021-01-20 15:14:51 +08:00
Łukasz Magiera
388c53e637
Merge pull request #5352 from filcloud/color-amount
...
add color for token amount
2021-01-19 11:47:22 +01:00
Dirk McCormick
827a473391
feat: expose StateSearchMessage on gateway
2021-01-19 11:27:43 +01:00
Łukasz Magiera
38f9559080
Implement full-node restore option
2021-01-15 20:57:32 +01:00
Frank
7747bcd859
remove some colorTokenAmount
2021-01-15 11:48:07 +08:00
Łukasz Magiera
1e53ed6a82
Print proving window info in pending termination list
2021-01-14 17:27:28 +01:00
Łukasz Magiera
9632a3836a
Print msg cid in terminate flush
2021-01-14 16:47:30 +01:00
Łukasz Magiera
4a114150f0
fix miner terminate cli arg checks
2021-01-14 16:14:24 +01:00
Łukasz Magiera
7ddf1d1feb
Add terminating states to state lists
2021-01-14 12:44:27 +01:00
Łukasz Magiera
785b660724
perning termination CLI
2021-01-14 12:37:31 +01:00
Frank
3224c84fb1
add color for token amount
2021-01-14 16:39:39 +08:00
Aayush Rajasekaran
b6bcd978e7
Fix lotus msig approve
2021-01-13 03:21:50 -05:00
Aayush Rajasekaran
b33bf16f70
Add a command to encode JSON params
2021-01-13 02:40:06 -05:00
Aayush Rajasekaran
02f33e2b8e
Simplify the miner actor set owner command
2021-01-13 01:34:14 -05:00
Łukasz Magiera
52cc2cd3eb
Initial sector termination support
2021-01-13 00:42:01 +01:00
Łukasz Magiera
8ac71f6d0a
Merge pull request #5222 from filcloud/bench-env
...
add bench env print
2021-01-06 20:17:42 +01:00
Łukasz Magiera
cbbe01eeb5
Merge pull request #5223 from filcloud/noise-limit
...
add limit and rate for chain noise
2021-01-06 20:17:29 +01:00
Łukasz Magiera
cf299b39b0
Merge pull request #5259 from filcloud/verbose-transfer
...
add verbose for list transfers
2021-01-06 17:24:13 +01:00
Frank
fdc46ad5df
update json format
2021-01-06 12:20:33 +08:00
Frank
25f3384939
go fmt
2021-01-06 11:30:51 +08:00
Łukasz Magiera
9b70fdbe9d
Merge pull request #5289 from filecoin-project/asr/remove-env-var
...
Remove LOTUS_DISABLE_V2_ACTOR_MIGRATION envvar
2021-01-05 20:10:26 +01:00
Łukasz Magiera
4f9fcd2b01
Merge pull request #5258 from filecoin-project/raulk/tvx-batch-tipset-diff
...
tvx extract: more tipset extraction goodness.
2021-01-05 18:57:21 +01:00
Aayush Rajasekaran
11d1e3cd5f
Remove LOTUS_DISABLE_V2_ACTOR_MIGRATION envvar
2021-01-05 00:46:57 -05:00
Peter Rabbitson
9334e73396
Snake a context through the Chain-blockstore creation
2021-01-04 15:27:52 +01:00
Frank
7583c4399a
add verbose for list transfers
2020-12-28 16:36:19 +08:00
Raúl Kripalani
cd032d5418
tvx extract: more tipset extraction goodness.
...
- ability to extract a tipset range into individual vectors.
- ability to extract a tipset range and squash into a single multi-tipset vector.
- mark statediff output deterministically, so it can be extracted by tooling.
- ability to execute callbacks between tipsets in the driver.
- implement save-balances callback.
2020-12-27 18:58:35 +00:00
Frank
984e4e9963
add limit and rate for chain noise
2020-12-18 19:35:11 +08:00
Frank
f24d401b61
add bench env print
2020-12-18 17:57:32 +08:00
Łukasz Magiera
9892c60ed0
Show verified power in miner sector list
2020-12-17 17:17:07 +01:00
Dan Shao
fda3b152bd
Skip checking terminated sectors provable
2020-12-17 20:05:43 +08:00
Łukasz Magiera
0d72d742b4
Merge pull request #5194 from filecoin-project/raulk/tvx-extract-tipset
...
tvx command to extract tipset vectors.
2020-12-15 19:53:10 +01:00
vyzo
210216a94f
lotus-shed blockmsgid command
2020-12-15 20:20:16 +02:00
Raúl Kripalani
2af1283c65
tvx exec: flag to fallback to API blockstore.
2020-12-15 17:44:56 +00:00
Raúl Kripalani
3fa51f08e1
fix lint error; stamp metadata on vector.
2020-12-15 17:08:49 +00:00
Raúl Kripalani
446b1cc883
tvx command to extract tipset vectors.
2020-12-15 16:56:01 +00:00
Łukasz Magiera
2e154ef6d0
Merge pull request #5176 from filecoin-project/shaodan-miner-sectors-info
...
Shaodan miner sectors info
2020-12-10 20:09:15 +01:00
Łukasz Magiera
0cb2f51549
Merge pull request #5094 from filecoin-project/asr/verified-only
...
Allow miners to filter (un)verified deals
2020-12-10 19:48:22 +01:00
Łukasz Magiera
d347e7ab8f
Merge branch 'miner-sectors-info' of github.com:shaodan/lotus into shaodan-miner-sectors-info
2020-12-10 19:32:26 +01:00
Dirk McCormick
72cb130e17
feat: show data transfer ID in list-deals
2020-12-08 15:23:26 +01:00
Łukasz Magiera
a999e41677
Merge pull request #5072 from zgfzgf/feat-shed-cid
...
Feat shed cid
2020-12-08 10:23:04 +01:00
Łukasz Magiera
5c37c9d8e9
Merge pull request #5118 from filcloud/keygen-outfile
...
add keygen outfile
2020-12-07 13:11:11 +01:00
Łukasz Magiera
b7975dcd9a
Merge pull request #5114 from filecoin-project/chore/update_sr2_stat_aggregation
...
Chore/update sr2 stat aggregation
2020-12-07 13:09:23 +01:00
Dan Shao
d56170d70e
Optimize sectors info loading
2020-12-07 13:42:37 +08:00
Peter Rabbitson
d9e3cc0374
Add an extra filplus counter
2020-12-04 19:00:13 +01:00
Peter Rabbitson
2514c96cff
Count deals from sealed sectors only
2020-12-04 15:45:25 +01:00
Peter Rabbitson
88bd757024
Only count the first 10 copies of the same piece per project
2020-12-04 15:45:25 +01:00
Peter Rabbitson
1e6aa4b129
Only count phase2 deals ( start epoch 166560 )
2020-12-04 15:45:25 +01:00
Frank
daca99687c
add keygen outfile
2020-12-04 18:39:35 +08:00
Łukasz Magiera
90a31fde9f
Merge pull request #5103 from filecoin-project/feat/miner-control-config
...
miner: Control address config for (pre)commits
2020-12-03 15:33:12 +01:00
Łukasz Magiera
da5e1b319f
Merge pull request #5098 from filecoin-project/feat/shed-ledger-show
...
shed: ledger show command
2020-12-03 13:22:06 +01:00
Łukasz Magiera
f74a1b70ab
miner: Fix actor control list cli
2020-12-02 20:46:07 +01:00
Łukasz Magiera
9707c82285
shed: ledger show command
2020-12-02 10:37:17 +01:00
Aayush Rajasekaran
370817eb60
Allow miners to filter (un)verified deals
2020-12-02 01:32:34 -05:00
zgfzgf
7c8ab6977a
add estimate command
2020-12-02 12:57:57 +08:00
zgfzgf
7d3e4c5d01
feat election error miner-power to network-power
2020-12-02 12:36:05 +08:00
zgfzgf
97dd082585
change flag codec value raw to id and default value is id
2020-12-02 08:41:58 +08:00
Łukasz Magiera
c6f85886bf
miner: Add slow mode to proving check
2020-12-02 00:32:14 +01:00
Łukasz Magiera
64e30808f8
miner info: Print control and spendable balances
2020-12-01 19:56:47 +01:00
Łukasz Magiera
28420b9eb0
miner info: Make balances line up better
2020-12-01 19:43:22 +01:00
Łukasz Magiera
827ec75f5f
miner info: Don't print random config values
2020-12-01 19:23:29 +01:00
Łukasz Magiera
c31774b08e
miner info: Cleanup balance printing
2020-12-01 19:22:57 +01:00
Łukasz Magiera
15c4793fe0
miner info: More cleanup
2020-12-01 19:15:20 +01:00
Łukasz Magiera
42cecbd879
miner info: Collapse sector size line
2020-12-01 19:01:08 +01:00
Łukasz Magiera
00e5ace818
Print basefee in miner info
2020-12-01 18:56:43 +01:00
Łukasz Magiera
82b5cb89cd
Merge pull request #5061 from filecoin-project/fix/err-late-deals
...
Error out deals that are not activated by proposed deal start epoch
2020-12-01 17:02:06 +01:00
zgfzgf
715c32ff77
add flag codec
2020-12-01 22:53:24 +08:00
Łukasz Magiera
4b1d6bfcca
Merge pull request #5079 from zgfzgf/feat-shed-commp
...
add commp-to-cid base64 decode
2020-12-01 15:11:23 +01:00
Łukasz Magiera
614f45dcfb
Merge pull request #5041 from filecoin-project/feat/5013
...
Sector check command
2020-12-01 14:59:01 +01:00
Łukasz Magiera
354b5af55a
Merge pull request #5032 from filecoin-project/fix/cancel-transfer
...
Cancel transfer cancels storage deal
2020-12-01 14:57:58 +01:00
Łukasz Magiera
c4a6b94b9c
Merge pull request #5023 from filecoin-project/feat/worker-set-task-types
...
worker: Support setting task types at runtime
2020-12-01 14:51:07 +01:00
Dirk McCormick
cb044f83a7
fix: ensure deal start is far enough in future for tests
2020-12-01 14:25:48 +01:00
zgfzgf
ec08e27af2
add base64 decode
2020-12-01 19:36:01 +08:00
zgfzgf
a8cdb8adc7
add abi Cid
2020-12-01 17:16:41 +08:00
zgfzgf
0439e95aa3
add encoding flag
2020-12-01 16:50:53 +08:00
ZenGround0
2e5843a0ee
Filecoin signature serialization
2020-11-30 23:14:21 -05:00
ZenGround0
751568a4dd
Print hex
2020-11-30 22:50:41 -05:00
Łukasz Magiera
6dea0a6281
worker: fix math-related issue
2020-11-30 23:19:16 +01:00
Łukasz Magiera
a4f3758f4c
worker api: better grouping
2020-11-30 23:16:30 +01:00
Łukasz Magiera
d15ef9ac9b
Merge pull request #5036 from filecoin-project/feat/shed-rpc-args
...
shed rpc: Allow calling with args
2020-11-30 14:33:52 +01:00
Łukasz Magiera
70732ac423
Fix lint
2020-11-30 14:26:42 +01:00
zgfzgf
253e22d6ea
add bitfield merge func
2020-11-28 21:54:30 +08:00
zgfzgf
a7ed639c21
optimize bitfield use func
2020-11-28 21:44:12 +08:00
zgfzgf
f4adf03ce5
optimize bitfield intersect
2020-11-28 21:07:14 +08:00
zgfzgf
c016e34dbc
bitfield add encode
2020-11-28 20:56:16 +08:00
zgfzgf
21835c785b
optimize bitfield runs
2020-11-28 20:17:56 +08:00
zgfzgf
8007c1f9ae
feat bitfield stat
2020-11-28 20:03:26 +08:00
zgfzgf
055795c4cc
optimize bitfield decode
2020-11-28 19:14:48 +08:00
zgfzgf
b03c4bc26b
add bitfield hex encode
2020-11-28 17:29:15 +08:00
Łukasz Magiera
e8d2560581
Fix tests
2020-11-27 16:47:48 +01:00
Łukasz Magiera
0c1592f2d3
Merge pull request #5025 from filecoin-project/feat/accounting-tool
...
add a tooling to make filecoin accounting a little easier
2020-11-27 16:11:25 +01:00
Łukasz Magiera
61485beb22
fix lint
2020-11-27 16:02:01 +01:00
Łukasz Magiera
01ad4c0514
shed rpc: Allow calling with args
2020-11-27 15:57:00 +01:00
Dirk McCormick
c66e594046
fix: cancel transfer cancels storage deal
2020-11-27 15:37:22 +01:00
whyrusleeping
4f675b76ad
add a tooling to make filecoin accounting a little easier
2020-11-26 13:46:19 -08:00
Łukasz Magiera
bfb5bad124
docsgen
2020-11-26 17:34:58 +01:00
Łukasz Magiera
3672053ae9
worker: Support setting task types at runtime
2020-11-26 17:33:34 +01:00
Łukasz Magiera
4dfec7b232
worker: Sort tasks in info
2020-11-26 16:37:11 +01:00
Łukasz Magiera
23c7728edb
worker: Print task types in info
2020-11-26 16:34:51 +01:00
Łukasz Magiera
aa278443d3
Merge pull request #5008 from filecoin-project/fix/worker-remote
...
worker: More robust remote checks
2020-11-26 16:29:51 +01:00
Łukasz Magiera
2304ea0077
Merge pull request #5016 from filecoin-project/fix/fsm-rm-unceroverable
...
storagefsm: Add missing planners
2020-11-26 12:22:48 +01:00
Łukasz Magiera
65653a1747
storagefsm: Add GetTicket to some maps
2020-11-26 10:53:31 +01:00
s1m0n21
663b3f4f21
add a sector check command
2020-11-26 15:02:43 +08:00
Łukasz Magiera
23bf3349d7
worker: More robust remote checks
2020-11-25 17:05:45 +01:00
Dirk McCormick
239e180683
feat: markets - separate watching for pre-commit from prove-commit
2020-11-24 13:24:41 -08:00
Łukasz Magiera
a63ef1dcd5
Merge pull request #4984 from yaohcn/fix-log-warn
...
fix log format
2020-11-24 18:01:56 +01:00
Łukasz Magiera
9cef300535
Merge pull request #4971 from filecoin-project/chore/new_sr2_deal_rollup_cmd
...
New SR-specific lotus-shed cmd
2020-11-24 17:50:10 +01:00
Lucas Molas
8b8449faee
update jsonrpc with max req size
2020-11-24 16:46:35 +01:00
yaohcn
7c0b6f41d8
fix log format
2020-11-24 19:09:48 +08:00
Peter Rabbitson
a145819004
More linter...
2020-11-23 18:46:59 +01:00
Peter Rabbitson
e7f3554c62
The linter is *so* dumb:
...
- There is no way for me to check the error on defer ...Close(), why even ask?
- A sort function does not suffer arbitrary aliasing
Everything is terrible...
2020-11-23 06:51:52 +01:00
Peter Rabbitson
2609342356
New SR-specific lotus-shed cmd
2020-11-23 05:41:14 +00:00
zgfzgf
e197038b9f
delete policy useless code
2020-11-21 10:14:13 +08:00
zgfzgf
549afbaa5f
add policy 8m and 512m
2020-11-21 10:04:07 +08:00
hannahhoward
218f7c2c5d
feat(markets): update markets, extract commp
2020-11-20 13:29:14 -08:00
Łukasz Magiera
375b7a1c4c
Merge pull request #4305 from zgfzgf/fix-lotus-bench
...
Fix lotus bench error
2020-11-20 19:22:22 +01:00
Łukasz Magiera
4b507f5be1
Merge pull request #4911 from filecoin-project/asr/seed-old
...
Use version0 when pre-sealing
2020-11-20 16:41:14 +01:00
zgfzgf
d033042d6b
update code
2020-11-20 23:20:26 +08:00
zgfzgf
7d4bc90d42
solve merge conflicts
2020-11-20 22:34:15 +08:00
Łukasz Magiera
853f9da457
Merge pull request #4583 from filecoin-project/fix/tvx-msg-cid
...
tvx extract: make it work with secp messages.
2020-11-20 15:13:06 +01:00
Raúl Kripalani
bb9d2b5af4
finish comment.
2020-11-20 14:05:50 +00:00
Łukasz Magiera
b10b6fdd11
Merge pull request #4355 from filecoin-project/shed/post-find
...
Shed/post find
2020-11-20 14:52:42 +01:00
Łukasz Magiera
2d9123a618
Merge pull request #4140 from filecoin-project/feat/mutex-fraction
...
Add options to set BlockProfileRate and MutexProfileFraction
2020-11-20 14:22:58 +01:00
Łukasz Magiera
16dbbadddf
Set lower feecap on PoSt messages with low balance
2020-11-19 18:02:20 +01:00
Aayush Rajasekaran
62d20f2191
Use version0 when pre-sealing
2020-11-18 23:10:05 -05:00
Aayush Rajasekaran
68a16afeda
Merge branch 'master' into release/v1.2.0
2020-11-17 19:40:05 -05:00
Raúl Kripalani
27c0ce4a3a
fix lint.
2020-11-16 22:39:08 +00:00
Raúl Kripalani
0c6072a1a0
chainstore lifecycle: close via Close() instead of context.
2020-11-16 22:28:59 +00:00
Steven Allen
c8ff58aae1
add basic calico test
2020-11-16 19:04:17 +01:00
Łukasz Magiera
915c5e0fdd
Get most tests to pass
2020-11-16 19:03:30 +01:00
Łukasz Magiera
2a7e4af5ee
Fix lotus-miner/lotus-worker build
2020-11-16 19:03:30 +01:00
Steven Allen
4544d2118e
fix lotus seed for proof api changes
2020-11-16 19:03:30 +01:00
Łukasz Magiera
6bea9dd178
Making sealing logic work with multiple seal proof types
2020-11-16 19:03:30 +01:00
Raúl Kripalani
bac51dd4e3
daemon --import-snapshot: force head silently, without triggering reorg.
2020-11-16 16:03:47 +00:00
Raúl Kripalani
d7b4f92f1f
add context to ChainStore.
2020-11-16 15:52:19 +00:00
Raúl Kripalani
87d6daf745
fix blockstore double open issue on --import-snapshot.
...
Fixes https://github.com/filecoin-project/lotus/issues/4850 .
2020-11-16 15:21:47 +00:00
Łukasz Magiera
c5c0185943
miner: Basic storage cleanup command
2020-11-12 21:27:16 +01:00
Łukasz Magiera
bf547112de
miner: Storage list sectors command
2020-11-12 19:11:58 +01:00
Łukasz Magiera
28ffa8ca06
Merge pull request #4819 from liyue201/master
...
Delete the duplicate output
2020-11-12 18:13:51 +01:00
Dirk McCormick
0e3e449bf8
test: stop mining at the end of tests
2020-11-12 16:23:46 +01:00
stirlingx
8246149544
Delete unnecessary output
2020-11-12 18:59:36 +08:00
Aayush Rajasekaran
3a3986320c
Merge pull request #4804 from filecoin-project/feat/storage-retwait-cleanup
...
Expand sched-diag; Command to abort sealing calls
2020-11-12 02:11:15 -05:00
Aayush Rajasekaran
498477da04
Nit: ArgsUsage param rename
2020-11-12 02:04:55 -05:00
Travis Person
f4df58ed0f
Merge pull request #4810 from filecoin-project/fix/lotus-stats-flags
...
lotus-stats: fix influx flags
2020-11-11 14:36:37 -08:00
Travis Person
ff7bdb5140
lotus-stats: fix influx flags
2020-11-11 21:17:36 +00:00
Łukasz Magiera
8ac495723e
gofmt
2020-11-11 17:42:23 +01:00
Łukasz Magiera
09f9f871a3
Create a command to abort sealing calls
2020-11-11 17:39:12 +01:00
Łukasz Magiera
2a3d930933
Hide ret-done tasks in sealing jobs by default
2020-11-11 16:48:04 +01:00
stirlingx
8b889139e9
Modify printf format
2020-11-11 10:39:13 +08:00
Aayush Rajasekaran
735c04f999
Merge pull request #4681 from filecoin-project/badger-viewable
...
move to native badger blockstore; leverage zero-copy View() to deserialize in-place
2020-11-10 18:08:12 -05:00
Łukasz Magiera
18aa97f962
Merge pull request #4779 from filecoin-project/feat/work-track-hostname
...
storage: Track worker hostnames with work
2020-11-10 20:38:44 +01:00
zgfzgf
f5401317c9
cmd sectors commitIDs len
2020-11-10 17:37:36 +08:00
Łukasz Magiera
5caa277261
storage: Track abandoned work more correctly
2020-11-09 23:38:20 +01:00
Łukasz Magiera
f819e71d12
storage: Separate returned jobs in jobs cli
2020-11-09 23:13:29 +01:00
Łukasz Magiera
27a9dd3bbb
storage: Track worker hostnames with work
2020-11-09 23:09:04 +01:00
Raúl Kripalani
3577300aee
Merge branch 'master' into badger-viewable
2020-11-06 19:34:25 +00:00
Łukasz Magiera
426c2e8c2b
Merge pull request #4717 from filecoin-project/feat/optional-chain-bitswap
...
Optional chain Bitswap
2020-11-06 16:49:39 +01:00
Łukasz Magiera
3c9e438a68
Merge pull request #4617 from filecoin-project/termination-penalty
...
Add `termination-estimate` to get an estimation for how much a termination penalty will be
2020-11-06 16:44:44 +01:00
Łukasz Magiera
2f9d19c42c
Merge pull request #4726 from filecoin-project/feat/shed-id-cid
...
shed: Util for creating ID CIDs
2020-11-06 16:03:45 +01:00
Łukasz Magiera
ee9df63221
shed: Util for creating ID CIDs
2020-11-06 15:42:09 +01:00
Raúl Kripalani
8befc0c1f5
export metrics from bench.
2020-11-05 19:09:47 +00:00
Travis Person
bd4322f56f
Update lotus-stats with a richer cli
...
This updates lotus stats to use urfave instead of the golang flags
package. This brings with it some common features from other lotus tools
such as the use of the `FULLNODE_API_INFO` env and other parts of the
lotus cli package.
This also includes the latest dashboard.
2020-11-04 18:06:17 +00:00
Raúl Kripalani
a411342f0c
export more metrics.
2020-11-04 17:09:01 +00:00
Raúl Kripalani
370ef93db6
chainstore: new ForceHeadSilent to support benchmarks.
2020-11-04 14:39:01 +00:00
Raúl Kripalani
fd1439f284
fix lint.
2020-11-03 22:49:55 +00:00
Łukasz Magiera
a1e1b03ca4
Optionally allow bitswap for chainstore
2020-11-03 23:44:44 +01:00
Raúl Kripalani
87ce2f774d
lotus-bench: write separate profiles for import and validation.
2020-11-03 22:40:21 +00:00
Raúl Kripalani
5487356370
fix lint errors.
2020-11-03 21:23:41 +00:00
Raúl Kripalani
809111336a
Merge branch 'master' into badger-viewable
2020-11-03 18:29:10 +00:00
Raúl Kripalani
18418128c3
lotus-bench: make start tipset walkback start from end tipset.
2020-11-03 18:15:59 +00:00
Raúl Kripalani
581ac5b019
lotus-bench: add ability to specify tipsets.
2020-11-03 18:11:43 +00:00
Raúl Kripalani
842c8ca056
improve lotus-bench; support running validation on a store without a CAR.
2020-11-03 17:35:31 +00:00
zgfzgf
3e7efad0fd
modify lint error
2020-11-03 21:28:01 +08:00
zgfzgf
3c2cd506ec
modify merge lotus-bench
2020-11-03 19:56:04 +08:00
Łukasz Magiera
1df02d5a93
Merge pull request #4691 from filecoin-project/fix/metrics
...
fix metrics wiring.
2020-11-03 11:50:43 +01:00
Łukasz Magiera
a4cf6fa715
sched: Interactive RPC Shell
2020-11-02 20:38:15 +01:00
Raúl Kripalani
656ece06e5
fix metrics wiring.
...
Some components like go-ds-measure, go-ipfs-blockstore and go-bitswap
expose metrics via ipfs/go-metrics-interface, but Lotus never injects
the Prometheus exporter (ipfs/go-metrics-prometheus). Therefore, those
metrics never surface in instrumentation.
Instead, Lotus uses OpenCensus directly.
This commit injects the Prometheus exporter for go-metrics-interface, and
instructs the OpenCensus Prometheus exporter to use the DefaultRegistry.
This has the effect of exposing blending the metrics of both metrics
libraries.
With this patch, the datastore, cache utilisation, and bitswap metrics
are now exported via the /debug/metrics endpoint.
This commit also fixes an issue where the metrics scope was empty, making
go-metrics-interface default to "<no-scope>". Angle brackets are inadmissible
characters for Prometheus, so it was refusing to export the affected metrics.
(These were the ARC cache metrics.)
2020-11-02 17:56:49 +00:00
Raúl Kripalani
d1ebf3c769
introduce non-pooled StorageKey method.
2020-11-02 13:32:07 +00:00
Raúl Kripalani
f4e13ffd80
actually register prometheus gauge.
2020-11-01 20:01:57 +00:00
Raúl Kripalani
44e34d9606
lotus-bench: native badger SyncWrites=false.
2020-11-01 19:54:47 +00:00
Raúl Kripalani
35ccd73a86
lotus-bench: improve for observability.
2020-11-01 19:52:53 +00:00
Raúl Kripalani
aece624d1c
lotus-bench: add support for native badger blockstore.
2020-11-01 18:54:35 +00:00
Raúl Kripalani
c2355b18f9
write heap and allocs profile in lotus-bench.
2020-11-01 18:00:08 +00:00
Raúl Kripalani
d8d85373f5
fix lotus-shed datastore commands.
2020-11-01 13:50:41 +00:00
Raúl Kripalani
a16d7f221e
Merge branch 'master' into badger-viewable
2020-11-01 13:10:56 +00:00
Raúl Kripalani
099c4b5e1d
migrate repo.Datastore(/chain) to repo.Blockstore().
2020-11-01 13:03:21 +00:00
Łukasz Magiera
978192233d
Merge pull request #4498 from filecoin-project/feat/try-election
...
Add election run-dummy command
2020-10-31 01:02:25 +01:00
Łukasz Magiera
6fcdf3c7ed
Merge pull request #4615 from filecoin-project/feat/worker-pause
...
worker: Commands to pause/resume task processing
2020-10-31 00:26:37 +01:00
Łukasz Magiera
094ea3fe97
Merge pull request #4666 from filecoin-project/fix/sched-issues
...
Fix worker reenabling, handle multiple restarts in worker
2020-10-30 21:34:07 +01:00
Łukasz Magiera
6cdbf5216e
Merge pull request #4629 from filecoin-project/fix/badger-lsm-trsh
...
Reduce badger ValueTreshold to 128
2020-10-30 21:10:18 +01:00
Łukasz Magiera
fb492d9acb
Merge pull request #4662 from filecoin-project/feat/force-sched-cli
...
Debug flag to force running sealing scheduler
2020-10-30 20:15:49 +01:00
Łukasz Magiera
885c6c94d3
Add sync status to miner info command
2020-10-30 19:39:31 +01:00
jennijuju
2f4582147a
Add termination-estimate to get an estimation for how much a termination penalty will be:
...
- Usage example: `./lotus-shed sectors termation-estimate 5 8 10`.
2020-10-30 13:34:03 -04:00
Łukasz Magiera
af1d45d969
worker: Handle multiple manager restarts while waiting for tasks
2020-10-30 18:00:48 +01:00
Łukasz Magiera
7fbb868513
Debug flag to force running sealing scheduler
2020-10-30 11:07:35 +01:00
Łukasz Magiera
ad9a5acb7f
miner sectors list: flags for events/seal time
2020-10-29 19:10:20 +01:00
Jakub Sztandera
ae905bd056
Fix closing
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-10-29 01:05:31 +01:00
Jakub Sztandera
a2c66dd102
make linter happy
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-10-28 23:30:28 +01:00
Jakub Sztandera
0297be4b9a
Add lotus-shed datastore rewrite command
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-10-28 23:24:45 +01:00
Łukasz Magiera
553408d573
worker: Commands to pause/resume task processing
2020-10-28 22:10:17 +01:00
Łukasz Magiera
e1da874258
Merge remote-tracking branch 'origin/master' into feat/async-restartable-workers
2020-10-27 03:31:07 +01:00
Steven Allen
832c0998e4
validate that block propagation works after a worker key change
2020-10-26 18:16:25 -07:00
Steven Allen
0d06f8fa2b
Add commands to change the worker key
2020-10-26 18:16:24 -07:00
Jakub Sztandera
cced3bf9ee
Randomize seed
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-10-26 17:44:55 +01:00
Jakub Sztandera
ea6afe84db
Add election run-dummy command
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-10-26 17:44:51 +01:00
Łukasz Magiera
8923524f6a
Make EarlyExpiration in sectors list less scary
2020-10-26 15:33:15 +01:00
Łukasz Magiera
a37c372d06
Merge pull request #4572 from filecoin-project/feat/data-transfer-utils
...
Flesh out data transfer features
2020-10-26 13:29:26 +01:00
Raúl Kripalani
cdfa869ea6
tvx extract: make it work with secp messages.
...
Unfortunately ChainGetMessage returns a *types.Message, which in
the case of secp messages is lacking the signature. The signature
is part of the input to calculate the CID on secp messages. Therefore,
calling `.Cid()` on the result of ChainGetMessage for this kind of
message will lead to an incorrect CID.
tvx was relying on that call to return the correct CID. Since this is
not the case (and this is a footgun that needs to be corrected, ideally
together with the *types.{,Signed}Message duality mess), I'm replacing
the comparison.
2020-10-24 20:16:14 +01:00
Łukasz Magiera
660236b224
Merge remote-tracking branch 'origin/master' into feat/async-restartable-workers
2020-10-23 23:25:35 +02:00
Łukasz Magiera
067de4508b
shed: Commad to decode messages
2020-10-23 22:17:46 +02:00
Łukasz Magiera
dbcba6477e
Merge pull request #4263 from filecoin-project/feat/lite-market-client
...
lite-mode - market storage and retrieval clients
2020-10-23 17:23:06 +02:00
Dirk McCormick
906286fdbe
feat: lite-mode - CLI tests for lotus client commands
2020-10-23 15:02:49 +02:00
Dirk McCormick
92942d44d1
feat: lite-mode - market storage and retrieval clients
2020-10-23 15:02:26 +02:00
Raúl Kripalani
39d9150175
fix tvx init.
2020-10-23 13:30:04 +01:00
Raúl Kripalani
5301c416bc
tvx extract: --ignore-sanity-checks flag.
2020-10-23 10:47:22 +01:00
Raúl Kripalani
92395745d3
tvx simulate: execute raw message against height.
2020-10-23 10:46:32 +01:00
hannahhoward
98297cef4d
feat(data-transfer): fill in utils
2020-10-22 13:40:26 -07:00
Łukasz Magiera
0289c39850
Merge pull request #4516 from filecoin-project/feat/api-request-metrics-wrapper
...
Feat/api request metrics wrapper
2020-10-22 21:40:47 +02:00
Łukasz Magiera
f9723ca3c1
Merge pull request #4521 from filecoin-project/feat/fix-shed-ledger-list
...
Fix lotus-shed ledger list
2020-10-22 19:59:18 +02:00
Łukasz Magiera
6c800bd0e3
Merge pull request #4501 from filecoin-project/feat/gateway-oni-needs
...
add some methods that oni needs
2020-10-22 19:44:47 +02:00
Łukasz Magiera
6bdf9935bf
Merge pull request #4475 from filecoin-project/fix/miner-init-createworker
...
miner: fix init --create-worker-key
2020-10-22 18:55:25 +02:00
Łukasz Magiera
6fc8550c19
Merge pull request #4314 from filecoin-project/feat/lotus-pcr-block-list
...
Add block list to pcr
2020-10-22 17:59:23 +02:00
Łukasz Magiera
041762a34f
Merge pull request #4383 from filecoin-project/steb/actor-v2-imports
...
Remove most v0 actor imports
2020-10-22 17:17:56 +02:00
Łukasz Magiera
9a58763a4e
shed: Rename the command to frozen-miners
2020-10-22 16:07:42 +02:00
ZenGround0
f9707ba344
add borked inspection command
...
hook up new command
Fix head call
Debug internal error
Debug moa
Debug 0
Fix 0
Fix 1
Better print
Don't ignore error
2020-10-22 16:03:11 +02:00
Łukasz Magiera
ee8d8bf5e5
pcr: Fix lint
2020-10-22 15:42:46 +02:00
Łukasz Magiera
b85bf82d00
Merge pull request #4318 from filecoin-project/asr/shed-won-power
...
Add a shed util to determine % of power that has won a block
2020-10-22 15:40:55 +02:00
Travis Person
6fb3dafa95
lotus-pcr: add blocklist
2020-10-22 15:35:01 +02:00
Łukasz Magiera
f5960df544
Merge pull request #4313 from filecoin-project/fix/pcr-basefee
...
Look at block base fee for PCR
2020-10-22 15:32:01 +02:00
Łukasz Magiera
0832d5a7d5
bench: Fix lint warnings
2020-10-22 15:00:31 +02:00
whyrusleeping
602d2b8ad5
record datastore metrics after successful run
2020-10-22 14:57:06 +02:00
Jakub Sztandera
0341944350
Inject prometheus
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-10-22 14:57:05 +02:00
whyrusleeping
00d1e6b549
add measure datastore wrapper around bench chain datastore
2020-10-22 14:57:04 +02:00
Steven Allen
bcabe7b3b5
migrate methods to abstracted methods
...
Method numbers never change anyways. At worst, we'll deprecate old methods and
have to explicitly import them from the correct actors version to use them.
2020-10-21 12:18:37 -07:00
Steven Allen
4e730b5ec8
port to v2 imports
2020-10-21 12:16:23 -07:00
Jakub Sztandera
f0d966a595
Fix lotus-shed ledger list
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-10-21 19:40:51 +02:00
lanzafame
7a33d5bb34
register all apis with metric wrapper
2020-10-21 18:37:50 +10:00
lanzafame
3e767ca5c8
wrap api in metrics proxy
2020-10-21 18:27:13 +10:00
Aayush Rajasekaran
547c01f5ff
Merge pull request #4506 from filecoin-project/release/1.1.0
...
Introduce Network version 6
2020-10-20 18:29:49 -04:00
Aayush Rajasekaran
75eb644108
Merge pull request #4507 from filecoin-project/lotus-shed-terminate-1475
...
Add a terminate sectors command to lotus-shed
2020-10-20 18:28:09 -04:00
jennijuju
ee5dcbc1d8
Add wait message
2020-10-20 18:26:17 -04:00
Steven Allen
ed1645109a
Add lotus storage miner API support to lotus-shed
2020-10-20 17:38:15 -04:00
jennijuju
277d3e9ab4
Add terminate sectors based on 1475's #4433 implementation in lotus-shed:
...
- Moving the cmd to lotus-shed so that miners can use this right away without waiting for fsm changes.- Note: this should only be used when the miner is 100% sure that they want to terminate the sector on chain and they will be lose the power and pay a big one-time termination penalty for the sectors.
- Only live sectors can be terminated.
- To use, run `./lotus-shed sectors terminate --really-do-it=true sectorNum1 sectorNum2`.
- A message will be sent and after the message is landed on chain, miner can run `lotus-miner sectors status --on-chain-info <terminated sector number>`, and check Expiration Info at the bottom. Both `OnTime` and `Early` are 0 indicates the sector is terminated.
2020-10-20 17:38:09 -04:00
Aayush Rajasekaran
556f92a823
Update to actors v2.2.0 at PostLiftoff epoch
2020-10-20 17:23:35 -04:00
whyrusleeping
abc3e783ff
bump lookback cap to 24 hours
2020-10-20 10:09:21 -07:00
whyrusleeping
6bc56c549a
add some methods that oni needs
2020-10-20 10:04:51 -07:00
Łukasz Magiera
869d71446d
miner: fix init --create-worker-key
2020-10-19 16:08:46 +02:00
Łukasz Magiera
1a10f95973
worker: Better miner connectivity check on startup
2020-10-18 19:53:23 +02:00
Łukasz Magiera
879aa9512d
worker: Use miner session for connectivity check
2020-10-18 17:56:29 +02:00
