Jiaying Wang
d45b4a7a1f
Merge branch 'master' into chore/cleanup-chain
2021-07-27 17:11:36 -04:00
Jiaying Wang
4918a7c16f
Merge branch 'master' into feat/cli-super-verbose
2021-07-27 17:07:16 -04:00
raulk
e4b225f4ba
Merge branch 'master' into feat/cli-super-verbose
2021-07-27 20:49:44 +01:00
Raúl Kripalani
b04fb75a92
rename flag to very verbose.
2021-07-27 20:49:30 +01:00
vyzo
7c28ff3826
Merge branch 'master' into feat/moving-gc
2021-07-27 21:48:51 +03:00
Łukasz Magiera
e163d556fb
Merge branch 'master' into chore/cleanup-chain
2021-07-27 17:49:42 +02:00
Jiaying Wang
e46f02f59d
Merge branch 'master' into feat/vis-sector-alloc
2021-07-27 09:49:33 -04:00
Łukasz Magiera
ae63a4b33b
fix lotus-sim build
2021-07-27 15:49:01 +02:00
Łukasz Magiera
9bd312881d
VMSys doesn't belong in chainstore
2021-07-27 15:30:23 +02:00
Raúl Kripalani
48cddd3644
add a super verbose -vv flag to lotus and lotus-miner.
2021-07-27 14:25:28 +01:00
Raúl Kripalani
e0522a6b1f
rename cmd/lotus{-storage=>}-miner to match binary.
2021-07-27 11:54:46 +01:00
Jiaying Wang
790f27d6a2
Merge branch 'master' into feat/vis-sector-alloc
2021-07-26 16:15:15 -04:00
Anton Evangelatov
9d61f91cdf
Update cmd/lotus-shed/market.go
...
Co-authored-by: Aayush Rajasekaran <arajasek94@gmail.com>
2021-07-26 16:41:22 +02:00
Jakub Sztandera
7de866d881
lint = happy
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2021-07-26 16:39:12 +02:00
vyzo
4715b1f436
fix lotus-shed
2021-07-26 15:04:46 +03:00
vyzo
221dc7024f
add splitstore info command
2021-07-26 08:47:02 +03:00
vyzo
c99dc3e811
add splitstore check command
2021-07-25 11:24:06 +03:00
vyzo
e317c831a8
quiet excessive badger logs
2021-07-25 09:07:27 +03:00
vyzo
ce6f410f2a
add options to control compaction/gc of the coldstore and config rewrite during rollback
2021-07-25 09:01:34 +03:00
vyzo
254c489164
fix typo
...
Co-authored-by: raulk <raul@protocol.ai>
2021-07-25 09:01:34 +03:00
vyzo
33cdc90f13
fix typo
...
Co-authored-by: raulk <raul@protocol.ai>
2021-07-25 09:01:34 +03:00
vyzo
da66e7a878
fix typo
2021-07-25 09:01:34 +03:00
vyzo
e696a2c0cc
fix newline in progres message
2021-07-25 09:01:34 +03:00
vyzo
36b209ca5c
compact and gc coldstore after copying
2021-07-25 09:01:34 +03:00
vyzo
92b9d8c895
quiet linter
2021-07-25 09:01:34 +03:00
vyzo
0c68bccbda
add splitstore rollback lotus-shed command
2021-07-25 09:01:34 +03:00
Jakub Sztandera
e615eecbea
Skip also set sectors
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2021-07-23 19:01:50 -04:00
Jakub Sztandera
39cc536115
Add sectors vis
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2021-07-23 19:01:48 -04:00
Łukasz Magiera
ac2a1bfeab
fix lint
2021-07-23 15:53:31 +02:00
Łukasz Magiera
4757b014bc
Nicer lotus-miner config commands
2021-07-23 14:57:42 +02:00
Łukasz Magiera
8b1f19e94c
Move doc-comment logic to the config pkg
2021-07-23 14:55:19 +02:00
Łukasz Magiera
97f5bb66c7
config: doc struct codegen
2021-07-23 13:55:50 +02:00
Łukasz Magiera
cf65804883
lotus daemon config utils
2021-07-23 13:09:03 +02:00
Dirk McCormick
52498f78a1
feat: add import market datastore cmd
2021-07-23 10:30:58 +02:00
Dirk McCormick
7ef167b04f
refactor: simplify market datastore backup
2021-07-23 09:33:26 +02:00
Anton Evangelatov
adba595350
commit from @dirkmc - initial export cmd for martkers related metadata
2021-07-22 18:41:57 +02:00
Łukasz Magiera
15a6995cda
fix lint
2021-07-22 16:31:04 +02:00
Łukasz Magiera
0656b62176
Merge remote-tracking branch 'origin/master' into feat/compact-sectors-numbers-cmd
2021-07-22 16:04:25 +02:00
Steven Allen
f9c759fcb2
fix: always check if StateSearchMessage returns nil
...
It returns nil on "not found".
Fixes the cases not covered in:
https://github.com/filecoin-project/lotus/pull/6787
2021-07-20 11:28:27 -07:00
Peter Rabbitson
a37ababc20
Minor rearrange
2021-07-14 08:32:07 +02:00
Peter Rabbitson
677c193e6c
Add current power to the stats
2021-07-14 08:11:23 +02:00
Łukasz Magiera
dd09666399
Merge pull request #6743 from filecoin-project/chore/centralize_all_cli_color_handling
...
Handle the --color flag via proper global state
2021-07-13 17:34:25 +02:00
Łukasz Magiera
837322ea59
Merge pull request #6356 from filecoin-project/nonsense/split-market-miner-processes
...
Support standalone miner-market process
2021-07-13 17:16:07 +02:00
Anton Evangelatov
2af02af1c1
rename --name to --type; provide empty stores.StorageConfig when init new service
2021-07-13 12:57:43 +02:00
Peter Rabbitson
6efd2e7335
Handle the --color flag via proper global state
...
Use `color.NoColor` as a global progressively modified as one descends
down command flags. Allows non-surprising operation when --color is
accepted at multiple layers, and even makes this behave predictably:
lotus-miner --color actor control list --color=false
2021-07-13 12:22:29 +02:00
Łukasz Magiera
4433c3cd7c
Merge pull request #6708 from filecoin-project/feat/miner-info-deals
...
Add more deal details to lotus-miner info
2021-07-12 22:18:56 +02:00
Anton Evangelatov
7728d6bfc3
remove --enable-markets flag; add --name string slice flag
2021-07-12 14:38:29 +02:00
Anton Evangelatov
4bc9fa04ba
rename cfg.Subsystems.EnableStorageMarket to EnableMarkets
2021-07-12 12:12:29 +02:00
Anton Evangelatov
d89ddb9315
resolve conflicts
2021-07-12 11:34:37 +02:00
Anton Evangelatov
16784aa2cc
remove pieceProvider from DI; small refactors
2021-07-12 11:30:26 +02:00
Aayush Rajasekaran
20582037c5
Fix Lotus shed
2021-07-11 14:03:22 -04:00
Aayush Rajasekaran
e983d90a28
Merge pull request #6066 from chadwick2143/extend-v1-sectors
...
Fix bugs in sectors extend --v1-sectors
2021-07-11 13:19:35 -04:00
Aayush Rajasekaran
ea9ad8c5a8
Update cmd/lotus-storage-miner/sectors.go
2021-07-11 13:01:19 -04:00
Aayush Rajasekaran
93d929a10a
Merge pull request #5950 from zgfzgf/feat-shed-election-backtest
...
add election backtest
2021-07-11 12:08:21 -04:00
Łukasz Magiera
44e81424f2
Print completed deal stats in miner info
2021-07-08 19:40:05 +02:00
Łukasz Magiera
ed0cc0b56d
Handle bad peerIDs in MarketListRetrievalDeals
2021-07-08 19:27:03 +02:00
Łukasz Magiera
10825e3a95
Add more info about deals to miner info
2021-07-08 19:02:18 +02:00
Łukasz Magiera
8f7bf1df86
Merge pull request #6697 from filecoin-project/feat/dealpublish-ctl-config
...
Config for deal publishing control addresses
2021-07-08 19:00:29 +02:00
Peter Rabbitson
140a2e0200
Stabilize default text and make gen docsgen-cli
2021-07-08 10:44:13 +02:00
Peter Rabbitson
c7bb326c78
Enable color by default only if os.Stdout is a TTY
2021-07-07 18:12:24 +02:00
Łukasz Magiera
8f5c0c60f5
Config for deal publishing control addresses
2021-07-07 18:00:54 +02:00
Anton Evangelatov
6b014f57e5
pass Subsystems to StorageMiner option; add enableLibp2p bool in Settings
2021-07-07 13:56:37 +02:00
Anton Evangelatov
7a78527fde
remove not used sa; cleanup
2021-07-06 17:46:21 +02:00
turuslan
8697edc8b7
fix "lotus-seed car" error "merkledag: not found"
2021-07-06 12:54:09 +03:00
Anton Evangelatov
4be0a7a215
resolve conflicts with master
2021-07-05 13:13:32 +02:00
Łukasz Magiera
8a94ab676e
storage: Fix FinalizeSector with sectors in stoage paths
2021-07-02 19:54:45 +02:00
Anton Evangelatov
adba1a792a
add missing err check
2021-07-02 15:15:16 +02:00
Anton Evangelatov
ab6e01e379
remove --enable-markets flag, read from repo
2021-07-02 15:08:25 +02:00
Anton Evangelatov
3aa6d03cc1
connect miner to full node , only when running markets
2021-06-30 16:45:11 +02:00
Anton Evangelatov
4f0a96c9c7
resolved conflicts
2021-06-30 13:16:52 +02:00
Anton Evangelatov
9ec7cd7239
enable libp2p options
2021-06-30 12:55:43 +02:00
Łukasz Magiera
022d4b548a
shed tool to estimate aggregate network fees
2021-06-29 20:42:26 +02:00
Łukasz Magiera
cefd140e45
Merge pull request #6329 from filecoin-project/raulk/itests-refactor-kit
...
revamped integration test kit (aka. Operation Sparks Joy)
2021-06-28 13:20:49 +02:00
Anton Evangelatov
7fb93d4585
refactor kit.NewDealHarness to include main miner and market node
2021-06-23 11:24:55 +02:00
Steven Allen
63e2caae81
lint(lotus-sim): handle error
2021-06-22 15:06:44 -07:00
Steven Allen
87c306fd47
feat(lotus-sim): use current power instead of lookback
...
I'd _really_ like to use lookback, but don't have that when starting
from a snapshot.
2021-06-22 15:06:30 -07:00
Steven Allen
0b06de2bd3
fix(lotus-sim): unembed Node from Simulation
...
I wanted to expose the node's _fields_, but this also exposed the
methods. That got rather confusing.
(probably could have used a new type, but eh)
foo
2021-06-22 14:53:06 -07:00
Anton Evangelatov
6720463799
resolve merge conflicts
2021-06-22 11:28:23 +02:00
Steven Allen
b7c36bc02c
fix(lotus-sim): make NewNode take a repo
...
This is primarily for testing, so we can just pass an in-memory repo.
2021-06-21 11:32:19 -07:00
Steven Allen
c532b1b819
fix(lotus-sim): remove unused field and function
2021-06-21 11:25:40 -07:00
Steven Allen
80eba1069a
feat(lotus-sim): NewNode to construct a node without a repo
2021-06-21 11:25:40 -07:00
Steven Allen
ffb63a93ff
fix(lotus-sim): make 'fund' easier to understand
2021-06-21 11:25:40 -07:00
Raúl Kripalani
83ee345b1c
Merge branch 'master' into raulk/itests-refactor-kit
2021-06-21 18:19:26 +01:00
Steven Allen
d6abcff63c
fix(lotus-sim): apply code review from magik6k
...
Co-authored-by: Łukasz Magiera <magik6k@users.noreply.github.com>
2021-06-21 09:05:48 -07:00
Raúl Kripalani
7ee184e965
fix lotus-storage-miner tests.
2021-06-21 11:56:10 +01:00
Steven Allen
69a8a6bc0e
fix(lotus-sim): lint
2021-06-18 15:44:37 -07:00
Jakub Sztandera
2fdf49e7da
Add histogram and quantiles for message sizes
...
Resolves https://github.com/filecoin-project/lotus/issues/6513
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2021-06-18 15:44:37 -07:00
Steven Allen
eb2b706156
chore: fix lint errors in simulation
2021-06-18 15:44:37 -07:00
Steven Allen
2aedd82c72
fix(lotus-sim): correct window post batch sizes
2021-06-18 15:44:37 -07:00
Steven Allen
bc2698a988
fix(lotus-sim): simulate using realistic gas numbers
...
Previously, we assumed the network was "optimal". Now, we're using real
numbers.
2021-06-18 15:44:37 -07:00
Steven Allen
a26cd5a809
fix(lotus-sim): mark provecommit stage initialized
2021-06-18 15:44:37 -07:00
Steven Allen
f0d0b40bd3
fix(lotus-sim): debug log mock
2021-06-18 15:44:37 -07:00
Steven Allen
ce29a0ac17
fix(lotus-sim): initialize commit queue
2021-06-18 15:44:37 -07:00
Steven Allen
28e6fa5923
fix(lotus-sim): remove duplicate error handling
2021-06-18 15:44:37 -07:00
Steven Allen
ec5fab09a1
feat(lotus-sim): log failing proofs
2021-06-18 15:44:37 -07:00
Steven Allen
e41f0842b0
fix(lotus-sim): load prove-commits
...
(regression from refactor)
2021-06-18 15:44:37 -07:00
Steven Allen
af33d69357
fix(lotus-sim): don't close node on list
2021-06-18 15:44:37 -07:00
Steven Allen
885062f712
fix(lotus-sim): fix info state imports
2021-06-18 15:44:37 -07:00
Steven Allen
73ae1924bc
feat(lotus-sim): state size command
2021-06-18 15:44:37 -07:00
Steven Allen
22267eb45d
feat(lotus-sim): split info command file
2021-06-18 15:44:36 -07:00
Steven Allen
5d7b7ce5c1
feat(lotus-sim): allow profile info
2021-06-18 15:44:36 -07:00
Steven Allen
95cf577447
fix(lotus-sim): really cancel walk immediately
2021-06-18 15:44:36 -07:00
Steven Allen
8fffaa5c47
fix(lotus-sim): average over 2 days
...
There's too much noise per day.
2021-06-18 15:44:36 -07:00
Steven Allen
63178ce982
feat(lotus-sim): daily capacity growth
2021-06-18 15:44:36 -07:00
Steven Allen
0af7dcdedb
fix(lotus-sim): rename power to capacity
2021-06-18 15:44:36 -07:00
Steven Allen
f9d2a23132
fix(lotus-sim): correctly handle cancellation in walk
...
1. Select order is not guaranteed, always check if the context has been
canceled explicitly.
2. Never close a work channel unless we're actually done. This can yield
out-of-order results due to buffering.
2021-06-18 15:44:36 -07:00
Steven Allen
ec3f969e9a
feat(lotus-sim): allow walking back past the start
2021-06-18 15:44:36 -07:00
Steven Allen
f6043a0250
feat(lotus-sim): measure daily power growth
2021-06-18 15:44:36 -07:00
Steven Allen
52261fb814
refactor(lotus-sim): enterprise grade
...
While the previous version "worked", this version nicely separates out
the state for the separate stages. Hopefully, we'll be able to use this
to build different pipelines with different configs.
2021-06-18 15:44:36 -07:00
Jakub Sztandera
7dd58efb84
Add quantiles and histogram
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2021-06-18 15:44:36 -07:00
Steven Allen
2721279e87
fix(lotus-sim): describe info commands
2021-06-18 15:44:36 -07:00
Steven Allen
985994cc0f
feat(lotus-sim): add command for analyzing post stats over time
2021-06-18 15:44:36 -07:00
Steven Allen
707b3bf08a
fix(lotus-sim): refuse to start simulation with no miners
2021-06-18 15:44:36 -07:00
Steven Allen
d551f2b4bd
feat(lotus-sim): print duration info in days
2021-06-18 15:44:36 -07:00
Steven Allen
1df5445ed2
feat(lotus-sim): make walk parallel
2021-06-18 15:44:36 -07:00
Steven Allen
fbaffe86da
fix(lotus-sim): return error from walk
2021-06-18 15:44:36 -07:00
Steven Allen
500fae6a52
fix(lotus-sim): less indentation in info
2021-06-18 15:44:36 -07:00
Steven Allen
ab59474c4c
fix(lotus-sim): count single prove-commits when computing efficiency
2021-06-18 15:44:36 -07:00
Jakub Sztandera
3d3c26fa0c
Add lookback limit
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2021-06-18 15:44:36 -07:00
Steven Allen
68593ce995
fix(lotus-sim): obey context in walk
2021-06-18 15:44:36 -07:00
Jakub Sztandera
ca9eadd7c7
Add gas info command
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2021-06-18 15:44:36 -07:00
Steven Allen
16449007ab
fix(lotus-sim): fix funding error check
2021-06-18 15:44:35 -07:00
Steven Allen
8d734d81d9
fix(lotus-sim): log failed pre-commits and continue
2021-06-18 15:44:35 -07:00
Steven Allen
783dc5a33d
fix(lotus-sim): fund multiple times
...
Sometimes, a miner is deep in the red.
2021-06-18 15:44:35 -07:00
Steven Allen
be713ec04a
fix(lotus-sim): we always fill the block with pre-commits
2021-06-18 15:44:35 -07:00
Steven Allen
c18ca60d28
fix(lotus-sim): specify ErrWriter
...
Apparently, it defaults to nil...
2021-06-18 15:44:35 -07:00
Steven Allen
977bf1cad9
fix(lotus-sim): write pprof profiles to a directory
...
We need to know the sizes up-front for tar, and that's not happening.
2021-06-18 15:44:35 -07:00
Steven Allen
7a8bfd8725
doc(lotus-sim): document signals
2021-06-18 15:44:35 -07:00
Steven Allen
a3f64e0768
fix(lotus-sim): profile signal handling
2021-06-18 15:44:35 -07:00
Steven Allen
5766002370
fix(lotus-sim): guard info with dashes
2021-06-18 15:44:35 -07:00
Steven Allen
4a80c83533
fix(lotus-sim): fix spelling
2021-06-18 15:44:35 -07:00
Steven Allen
936659d087
feat(lotus-sim): print info on SIGUSR1
2021-06-18 15:44:35 -07:00
Steven Allen
dcdb0abe27
feat(lotus-sim): profile on SIGUSR2
2021-06-18 15:44:35 -07:00
Steven Allen
2b77c17546
chore(lotus-sim): fix import grouping
...
I got a bit lazy when developing this.
2021-06-18 15:44:35 -07:00
Steven Allen
1802ae31a6
feat(lotus-sim): record timing information for pre/prove-commit packing
2021-06-18 15:44:35 -07:00
Steven Allen
868231adc7
fix(lotus-sim): don't take from the fund account when funding
2021-06-18 15:44:35 -07:00
Steven Allen
2b4f865665
feat(lotus-sim): fund from a funding account
...
Instead of funding the simulation from the burnt-funds actor, fund from
a custom account and take a "tax" to fund that account.
Otherwise, we run out of funds...
2021-06-18 15:44:35 -07:00
Steven Allen
86e459f585
feat(lotus-sim): return receipt
...
Instead of returning a "full" boolean and an error, return a receipt and
an error. We now use the error to indicate if the block is "full".
2021-06-18 15:44:35 -07:00
Steven Allen
88af350774
fix(lotus-sim): use global base-fee value
2021-06-18 15:44:35 -07:00
Steven Allen
747b3d3e57
fix(lotus-sim): skip miners without power when loading
2021-06-18 15:44:35 -07:00
Steven Allen
ba65a1ba9b
chore(lotus-sim): rename stat to info
2021-06-18 15:44:35 -07:00
Steven Allen
e097ba8640
feat(lotus-sim): wire up signal handler
2021-06-18 15:44:35 -07:00
Steven Allen
4578e0dd8d
chore(lotus-sim): remove dead code
2021-06-18 15:44:35 -07:00
Steven Allen
77f0fee58e
chore(lotus-sim): fix comment about simulation block miner
2021-06-18 15:44:35 -07:00
Steven Allen
bb4753ffbf
feat(lotus-sim): add commands to rename and copy
2021-06-18 15:44:35 -07:00
Steven Allen
4f0b9eefc1
fix(lotus-sim): check for slash in names on copy
2021-06-18 15:44:35 -07:00
Steven Allen
8410b0f79f
feat(lotus-sim): add a feature to copy/rename simulation.
...
Useful to backup old simulations before creating a new one.
2021-06-18 15:44:35 -07:00
Steven Allen
c5dc67ccd8
feat(lotus-sim): add a walk function
...
This way, we can easily walk the chain and:
1. Inspect messages and their results.
2. Inspect tipset state.
2021-06-18 15:44:35 -07:00
Steven Allen
ccdd660f0d
feat(lotus-sim): more stats
2021-06-18 15:44:35 -07:00
Steven Allen
5f6733fe44
feat(lotus-sim): expose StateManager from Simulation
2021-06-18 15:44:35 -07:00