Dirk McCormick
7ef167b04f
refactor: simplify market datastore backup
2021-07-23 09:33:26 +02:00
Anton Evangelatov
adba595350
commit from @dirkmc - initial export cmd for martkers related metadata
2021-07-22 18:41:57 +02:00
Łukasz Magiera
15a6995cda
fix lint
2021-07-22 16:31:04 +02:00
Łukasz Magiera
0656b62176
Merge remote-tracking branch 'origin/master' into feat/compact-sectors-numbers-cmd
2021-07-22 16:04:25 +02:00
Steven Allen
f9c759fcb2
fix: always check if StateSearchMessage returns nil
...
It returns nil on "not found".
Fixes the cases not covered in:
https://github.com/filecoin-project/lotus/pull/6787
2021-07-20 11:28:27 -07:00
Peter Rabbitson
a37ababc20
Minor rearrange
2021-07-14 08:32:07 +02:00
Peter Rabbitson
677c193e6c
Add current power to the stats
2021-07-14 08:11:23 +02:00
Łukasz Magiera
dd09666399
Merge pull request #6743 from filecoin-project/chore/centralize_all_cli_color_handling
...
Handle the --color flag via proper global state
2021-07-13 17:34:25 +02:00
Łukasz Magiera
837322ea59
Merge pull request #6356 from filecoin-project/nonsense/split-market-miner-processes
...
Support standalone miner-market process
2021-07-13 17:16:07 +02:00
Anton Evangelatov
2af02af1c1
rename --name to --type; provide empty stores.StorageConfig when init new service
2021-07-13 12:57:43 +02:00
Peter Rabbitson
6efd2e7335
Handle the --color flag via proper global state
...
Use `color.NoColor` as a global progressively modified as one descends
down command flags. Allows non-surprising operation when --color is
accepted at multiple layers, and even makes this behave predictably:
lotus-miner --color actor control list --color=false
2021-07-13 12:22:29 +02:00
Łukasz Magiera
4433c3cd7c
Merge pull request #6708 from filecoin-project/feat/miner-info-deals
...
Add more deal details to lotus-miner info
2021-07-12 22:18:56 +02:00
Anton Evangelatov
7728d6bfc3
remove --enable-markets flag; add --name string slice flag
2021-07-12 14:38:29 +02:00
Anton Evangelatov
4bc9fa04ba
rename cfg.Subsystems.EnableStorageMarket to EnableMarkets
2021-07-12 12:12:29 +02:00
Anton Evangelatov
d89ddb9315
resolve conflicts
2021-07-12 11:34:37 +02:00
Anton Evangelatov
16784aa2cc
remove pieceProvider from DI; small refactors
2021-07-12 11:30:26 +02:00
Aayush Rajasekaran
20582037c5
Fix Lotus shed
2021-07-11 14:03:22 -04:00
Aayush Rajasekaran
e983d90a28
Merge pull request #6066 from chadwick2143/extend-v1-sectors
...
Fix bugs in sectors extend --v1-sectors
2021-07-11 13:19:35 -04:00
Aayush Rajasekaran
ea9ad8c5a8
Update cmd/lotus-storage-miner/sectors.go
2021-07-11 13:01:19 -04:00
Aayush Rajasekaran
93d929a10a
Merge pull request #5950 from zgfzgf/feat-shed-election-backtest
...
add election backtest
2021-07-11 12:08:21 -04:00
Łukasz Magiera
44e81424f2
Print completed deal stats in miner info
2021-07-08 19:40:05 +02:00
Łukasz Magiera
ed0cc0b56d
Handle bad peerIDs in MarketListRetrievalDeals
2021-07-08 19:27:03 +02:00
Łukasz Magiera
10825e3a95
Add more info about deals to miner info
2021-07-08 19:02:18 +02:00
Łukasz Magiera
8f7bf1df86
Merge pull request #6697 from filecoin-project/feat/dealpublish-ctl-config
...
Config for deal publishing control addresses
2021-07-08 19:00:29 +02:00
Peter Rabbitson
140a2e0200
Stabilize default text and make gen docsgen-cli
2021-07-08 10:44:13 +02:00
Peter Rabbitson
c7bb326c78
Enable color by default only if os.Stdout is a TTY
2021-07-07 18:12:24 +02:00
Łukasz Magiera
8f5c0c60f5
Config for deal publishing control addresses
2021-07-07 18:00:54 +02:00
Anton Evangelatov
6b014f57e5
pass Subsystems to StorageMiner option; add enableLibp2p bool in Settings
2021-07-07 13:56:37 +02:00
Anton Evangelatov
7a78527fde
remove not used sa; cleanup
2021-07-06 17:46:21 +02:00
turuslan
8697edc8b7
fix "lotus-seed car" error "merkledag: not found"
2021-07-06 12:54:09 +03:00
Anton Evangelatov
4be0a7a215
resolve conflicts with master
2021-07-05 13:13:32 +02:00
Łukasz Magiera
8a94ab676e
storage: Fix FinalizeSector with sectors in stoage paths
2021-07-02 19:54:45 +02:00
Anton Evangelatov
adba1a792a
add missing err check
2021-07-02 15:15:16 +02:00
Anton Evangelatov
ab6e01e379
remove --enable-markets flag, read from repo
2021-07-02 15:08:25 +02:00
Anton Evangelatov
3aa6d03cc1
connect miner to full node , only when running markets
2021-06-30 16:45:11 +02:00
Anton Evangelatov
4f0a96c9c7
resolved conflicts
2021-06-30 13:16:52 +02:00
Anton Evangelatov
9ec7cd7239
enable libp2p options
2021-06-30 12:55:43 +02:00
Łukasz Magiera
022d4b548a
shed tool to estimate aggregate network fees
2021-06-29 20:42:26 +02:00
Łukasz Magiera
cefd140e45
Merge pull request #6329 from filecoin-project/raulk/itests-refactor-kit
...
revamped integration test kit (aka. Operation Sparks Joy)
2021-06-28 13:20:49 +02:00
Anton Evangelatov
7fb93d4585
refactor kit.NewDealHarness to include main miner and market node
2021-06-23 11:24:55 +02:00
Steven Allen
63e2caae81
lint(lotus-sim): handle error
2021-06-22 15:06:44 -07:00
Steven Allen
87c306fd47
feat(lotus-sim): use current power instead of lookback
...
I'd _really_ like to use lookback, but don't have that when starting
from a snapshot.
2021-06-22 15:06:30 -07:00
Steven Allen
0b06de2bd3
fix(lotus-sim): unembed Node from Simulation
...
I wanted to expose the node's _fields_, but this also exposed the
methods. That got rather confusing.
(probably could have used a new type, but eh)
foo
2021-06-22 14:53:06 -07:00
Anton Evangelatov
6720463799
resolve merge conflicts
2021-06-22 11:28:23 +02:00
Steven Allen
b7c36bc02c
fix(lotus-sim): make NewNode take a repo
...
This is primarily for testing, so we can just pass an in-memory repo.
2021-06-21 11:32:19 -07:00
Steven Allen
c532b1b819
fix(lotus-sim): remove unused field and function
2021-06-21 11:25:40 -07:00
Steven Allen
80eba1069a
feat(lotus-sim): NewNode to construct a node without a repo
2021-06-21 11:25:40 -07:00
Steven Allen
ffb63a93ff
fix(lotus-sim): make 'fund' easier to understand
2021-06-21 11:25:40 -07:00
Raúl Kripalani
83ee345b1c
Merge branch 'master' into raulk/itests-refactor-kit
2021-06-21 18:19:26 +01:00
Steven Allen
d6abcff63c
fix(lotus-sim): apply code review from magik6k
...
Co-authored-by: Łukasz Magiera <magik6k@users.noreply.github.com>
2021-06-21 09:05:48 -07:00
Raúl Kripalani
7ee184e965
fix lotus-storage-miner tests.
2021-06-21 11:56:10 +01:00
Steven Allen
69a8a6bc0e
fix(lotus-sim): lint
2021-06-18 15:44:37 -07:00
Jakub Sztandera
2fdf49e7da
Add histogram and quantiles for message sizes
...
Resolves https://github.com/filecoin-project/lotus/issues/6513
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2021-06-18 15:44:37 -07:00
Steven Allen
eb2b706156
chore: fix lint errors in simulation
2021-06-18 15:44:37 -07:00
Steven Allen
2aedd82c72
fix(lotus-sim): correct window post batch sizes
2021-06-18 15:44:37 -07:00
Steven Allen
bc2698a988
fix(lotus-sim): simulate using realistic gas numbers
...
Previously, we assumed the network was "optimal". Now, we're using real
numbers.
2021-06-18 15:44:37 -07:00
Steven Allen
a26cd5a809
fix(lotus-sim): mark provecommit stage initialized
2021-06-18 15:44:37 -07:00
Steven Allen
f0d0b40bd3
fix(lotus-sim): debug log mock
2021-06-18 15:44:37 -07:00
Steven Allen
ce29a0ac17
fix(lotus-sim): initialize commit queue
2021-06-18 15:44:37 -07:00
Steven Allen
28e6fa5923
fix(lotus-sim): remove duplicate error handling
2021-06-18 15:44:37 -07:00
Steven Allen
ec5fab09a1
feat(lotus-sim): log failing proofs
2021-06-18 15:44:37 -07:00
Steven Allen
e41f0842b0
fix(lotus-sim): load prove-commits
...
(regression from refactor)
2021-06-18 15:44:37 -07:00
Steven Allen
af33d69357
fix(lotus-sim): don't close node on list
2021-06-18 15:44:37 -07:00
Steven Allen
885062f712
fix(lotus-sim): fix info state imports
2021-06-18 15:44:37 -07:00
Steven Allen
73ae1924bc
feat(lotus-sim): state size command
2021-06-18 15:44:37 -07:00
Steven Allen
22267eb45d
feat(lotus-sim): split info command file
2021-06-18 15:44:36 -07:00
Steven Allen
5d7b7ce5c1
feat(lotus-sim): allow profile info
2021-06-18 15:44:36 -07:00
Steven Allen
95cf577447
fix(lotus-sim): really cancel walk immediately
2021-06-18 15:44:36 -07:00
Steven Allen
8fffaa5c47
fix(lotus-sim): average over 2 days
...
There's too much noise per day.
2021-06-18 15:44:36 -07:00
Steven Allen
63178ce982
feat(lotus-sim): daily capacity growth
2021-06-18 15:44:36 -07:00
Steven Allen
0af7dcdedb
fix(lotus-sim): rename power to capacity
2021-06-18 15:44:36 -07:00
Steven Allen
f9d2a23132
fix(lotus-sim): correctly handle cancellation in walk
...
1. Select order is not guaranteed, always check if the context has been
canceled explicitly.
2. Never close a work channel unless we're actually done. This can yield
out-of-order results due to buffering.
2021-06-18 15:44:36 -07:00
Steven Allen
ec3f969e9a
feat(lotus-sim): allow walking back past the start
2021-06-18 15:44:36 -07:00
Steven Allen
f6043a0250
feat(lotus-sim): measure daily power growth
2021-06-18 15:44:36 -07:00
Steven Allen
52261fb814
refactor(lotus-sim): enterprise grade
...
While the previous version "worked", this version nicely separates out
the state for the separate stages. Hopefully, we'll be able to use this
to build different pipelines with different configs.
2021-06-18 15:44:36 -07:00
Jakub Sztandera
7dd58efb84
Add quantiles and histogram
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2021-06-18 15:44:36 -07:00
Steven Allen
2721279e87
fix(lotus-sim): describe info commands
2021-06-18 15:44:36 -07:00
Steven Allen
985994cc0f
feat(lotus-sim): add command for analyzing post stats over time
2021-06-18 15:44:36 -07:00
Steven Allen
707b3bf08a
fix(lotus-sim): refuse to start simulation with no miners
2021-06-18 15:44:36 -07:00
Steven Allen
d551f2b4bd
feat(lotus-sim): print duration info in days
2021-06-18 15:44:36 -07:00
Steven Allen
1df5445ed2
feat(lotus-sim): make walk parallel
2021-06-18 15:44:36 -07:00
Steven Allen
fbaffe86da
fix(lotus-sim): return error from walk
2021-06-18 15:44:36 -07:00
Steven Allen
500fae6a52
fix(lotus-sim): less indentation in info
2021-06-18 15:44:36 -07:00
Steven Allen
ab59474c4c
fix(lotus-sim): count single prove-commits when computing efficiency
2021-06-18 15:44:36 -07:00
Jakub Sztandera
3d3c26fa0c
Add lookback limit
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2021-06-18 15:44:36 -07:00
Steven Allen
68593ce995
fix(lotus-sim): obey context in walk
2021-06-18 15:44:36 -07:00
Jakub Sztandera
ca9eadd7c7
Add gas info command
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2021-06-18 15:44:36 -07:00
Steven Allen
16449007ab
fix(lotus-sim): fix funding error check
2021-06-18 15:44:35 -07:00
Steven Allen
8d734d81d9
fix(lotus-sim): log failed pre-commits and continue
2021-06-18 15:44:35 -07:00
Steven Allen
783dc5a33d
fix(lotus-sim): fund multiple times
...
Sometimes, a miner is deep in the red.
2021-06-18 15:44:35 -07:00
Steven Allen
be713ec04a
fix(lotus-sim): we always fill the block with pre-commits
2021-06-18 15:44:35 -07:00
Steven Allen
c18ca60d28
fix(lotus-sim): specify ErrWriter
...
Apparently, it defaults to nil...
2021-06-18 15:44:35 -07:00
Steven Allen
977bf1cad9
fix(lotus-sim): write pprof profiles to a directory
...
We need to know the sizes up-front for tar, and that's not happening.
2021-06-18 15:44:35 -07:00
Steven Allen
7a8bfd8725
doc(lotus-sim): document signals
2021-06-18 15:44:35 -07:00
Steven Allen
a3f64e0768
fix(lotus-sim): profile signal handling
2021-06-18 15:44:35 -07:00
Steven Allen
5766002370
fix(lotus-sim): guard info with dashes
2021-06-18 15:44:35 -07:00
Steven Allen
4a80c83533
fix(lotus-sim): fix spelling
2021-06-18 15:44:35 -07:00
Steven Allen
936659d087
feat(lotus-sim): print info on SIGUSR1
2021-06-18 15:44:35 -07:00
Steven Allen
dcdb0abe27
feat(lotus-sim): profile on SIGUSR2
2021-06-18 15:44:35 -07:00
Steven Allen
2b77c17546
chore(lotus-sim): fix import grouping
...
I got a bit lazy when developing this.
2021-06-18 15:44:35 -07:00