Łukasz Magiera
81a2f2f06d
Merge pull request #7329 from filecoin-project/feat/lotus-stats-update
...
Add caches to lotus-stats and splitcode
2021-11-22 12:44:00 +01:00
Łukasz Magiera
9adaa9b967
lotus-shed msg: Decode submessages/msig proposals
2021-11-17 23:10:14 +01:00
Aayush Rajasekaran
1449644c34
Integrate v7 actors
2021-11-17 15:55:14 -05:00
Aayush Rajasekaran
495f08473d
Shed: Add a util to list miner faults
2021-11-07 23:33:37 +00:00
Aayush Rajasekaran
3be0c068b9
Shed: Add a util to create miners more easily
2021-11-03 00:20:48 +00:00
Travis Person
2d4f5958e2
Add caches to lotus-stats and splitcode
2021-11-01 09:05:14 +00:00
Jennifer Wang
dc6bd2b015
use existing util
2021-10-26 20:53:16 -04:00
Jennifer Wang
18834de7d0
parse attofil to fil
2021-10-26 19:37:29 -04:00
Aayush Rajasekaran
e1deed3b1a
Merge pull request #7544 from filecoin-project/asr/shed
...
Shed: Add a util to find miner based on peerid
2021-10-20 17:55:16 -07:00
Łukasz Magiera
f7884c4f45
Merge pull request #7527 from filecoin-project/feat/show-prepared-waitres
...
Show prepared tasks in sealing jobs
2021-10-20 15:22:35 +01:00
Aayush Rajasekaran
9ba7f372cd
Shed: Add a util to find miner based on peerid
2021-10-19 18:46:09 -07:00
Łukasz Magiera
ba171954b4
Merge pull request #7479 from filecoin-project/feat/prov-check-by-storage
...
Add storage-id flag to proving check
2021-10-19 10:06:30 +01:00
Łukasz Magiera
261238e157
Show prepared tasks in sealing jobs
2021-10-18 18:44:56 +02:00
Jennifer Wang
d1e15e61d0
Merge branch 'release/v1.12.0' into jen/12-master
2021-10-11 14:37:32 -04:00
Jennifer Wang
16743a25c2
print confidence in decimal
2021-10-11 12:34:51 -04:00
dirkmc
f9433811c7
Merge pull request #7454 from filecoin-project/nonsense/retry-in-publish-deal
...
itests: retry deal when control addr is out of funds
2021-10-11 15:14:27 +02:00
Jakub Sztandera
61e1297cc7
gofmt
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2021-10-11 08:24:55 -04:00
Jakub Sztandera
e40c7b7a86
Fix withdrawn amount equiality check
...
Co-authored-by: Jiaying Wang <42981373+jennijuju@users.noreply.github.com>
2021-10-11 08:24:33 -04:00
Jakub Sztandera
177033d0f2
Fix withdrawn amount equiality check
...
Co-authored-by: Jiaying Wang <42981373+jennijuju@users.noreply.github.com>
2021-10-11 08:24:24 -04:00
Aayush Rajasekaran
cab724841a
Update cmd/lotus-miner/actor.go
...
Co-authored-by: Jiaying Wang <42981373+jennijuju@users.noreply.github.com>
2021-10-11 08:24:00 -04:00
Aayush Rajasekaran
2241f02621
Bugfix: actor withdraw CLI should depend on network version
2021-10-11 08:23:53 -04:00
Jakub Sztandera
5abba9ca9f
gofmt
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2021-10-11 14:10:06 +02:00
Anton Evangelatov
1acb6b4328
update CLI command to take arg; reduce time for itest
2021-10-11 14:03:56 +02:00
Anton Evangelatov
6e5ccc87cf
cli: add retry for deals stuck in Publish with no funds
2021-10-11 14:03:55 +02:00
Jakub Sztandera
8533ae0032
Fix withdrawn amount equiality check
...
Co-authored-by: Jiaying Wang <42981373+jennijuju@users.noreply.github.com>
2021-10-11 14:03:28 +02:00
Jakub Sztandera
90ff1d3ccf
Fix withdrawn amount equiality check
...
Co-authored-by: Jiaying Wang <42981373+jennijuju@users.noreply.github.com>
2021-10-11 14:03:21 +02:00
Aayush Rajasekaran
be774f55ce
Update cmd/lotus-miner/actor.go
...
Co-authored-by: Jiaying Wang <42981373+jennijuju@users.noreply.github.com>
2021-10-10 10:40:22 -04:00
Aayush Rajasekaran
e158b1d1e4
Bugfix: actor withdraw CLI should depend on network version
2021-10-09 20:17:03 -04:00
Łukasz Magiera
bfcfb199a0
Add storage-id flag to proving check
2021-10-08 14:56:08 +02:00
Peter Rabbitson
8b01725129
Dep upgrade pass
...
Touching just the seemingly non-controversial ones
2021-10-08 12:37:40 +02:00
Aayush Rajasekaran
89db4235ce
Shed: Add a util to find the most recent null tipset
2021-10-06 19:37:35 -04:00
Jennifer Wang
38e01cba83
Merge branch 'release/v1.12.0' into jen/12tomaster
2021-10-04 02:38:00 -04:00
Aayush Rajasekaran
a335cb3767
Update to latest actors
2021-10-01 17:11:05 -04:00
Łukasz Magiera
a8a9818043
Expose storage states on the metrics endpoint
2021-10-01 14:45:01 +02:00
Łukasz Magiera
95e8b59367
Merge pull request #7341 from filecoin-project/mg/feat/panic-reporter
...
feat: Catch panic to generate report and reraise
2021-10-01 10:50:19 +01:00
Mike Greenberg
2f8a2fc907
fix: Update lotusminer default paths
...
Co-authored-by: Łukasz Magiera <magik6k@users.noreply.github.com>
2021-09-30 09:06:55 -04:00
Aayush Rajasekaran
2bafdf7271
Modify tooling to support new WithdrawBalance return
2021-09-29 13:01:04 -04:00
Aayush Rajasekaran
c3c46e9097
Fix Drand fetching around null tipsets
2021-09-29 11:57:59 -04:00
Łukasz Magiera
83c8e981b4
lotus shed: fr32 utils
2021-09-27 18:31:36 +02:00
Łukasz Magiera
53a9dd5da4
Add more info to miner allinfo command
2021-09-24 12:02:06 +02:00
Łukasz Magiera
0e7e665e6d
Merge pull request #7312 from filecoin-project/nonsense/crossref-datatransfer-storagedeal
...
add `lotus-miner storage-deals list --format=json` with transfers
2021-09-24 10:57:59 +01:00
Aarsh Shah
a80bc34d59
fix build
2021-09-21 15:23:01 +04:00
Mike Greenberg
3508a5b664
chore: Use After hooks and proper args
2021-09-17 18:01:54 -04:00
Aayush Rajasekaran
888b2040de
Miner CLI: Allow trying to change owners of any miner actor
2021-09-14 11:50:30 +02:00
Anton Evangelatov
3e10f2e250
make gen
2021-09-10 15:18:32 +02:00
Anton Evangelatov
67dc7523d5
fixup
2021-09-10 15:09:37 +02:00
Anton Evangelatov
caaff9b7af
remove flag
2021-09-10 15:06:51 +02:00
Anton Evangelatov
fe602ab3bb
refactor
2021-09-10 15:05:51 +02:00
Łukasz Magiera
b4a3eb55e1
Show more deal states in miner info
2021-09-10 12:21:33 +02:00
Anton Evangelatov
027c1b5ab8
add lotus-miner storage-deals lwt
2021-09-10 12:21:02 +02:00
Łukasz Magiera
8612d1e824
Add --unproven flag to the sectors list command
2021-09-09 23:29:52 +02:00
Aayush Rajasekaran
16c60914eb
Seed: improve helptext
2021-09-08 15:26:37 -04:00
Łukasz Magiera
dfc039276d
address review
2021-09-07 19:42:52 +02:00
Łukasz Magiera
186c4990dd
Reduce nesting in sectors list command
2021-09-07 18:49:53 +02:00
Łukasz Magiera
e4044151f0
Show deal sizes is sealing sectors
2021-09-07 18:49:53 +02:00
Łukasz Magiera
3c2d854a9e
Merge pull request #7246 from filecoin-project/feat/sectorinfo-partition
...
Add partition info to the 'sectors status' command
2021-09-02 20:22:11 +02:00
Łukasz Magiera
fea430a553
Add partition info to the 'sectors status' command
2021-09-02 20:01:15 +02:00
Łukasz Magiera
727bb84592
stmgr: drop MethdosMap
2021-09-02 18:58:34 +02:00
Łukasz Magiera
30fccaa0bd
fix lint
2021-09-02 18:45:18 +02:00
Łukasz Magiera
95b128b7bc
chain: Cleanup consensus logic
2021-09-02 18:09:37 +02:00
Łukasz Magiera
daaa725e3b
sectors expired: Handle precomitted and unproven sectors correctly
2021-08-31 16:24:29 +02:00
Steven Allen
1cf556c3a2
feat: expose ChainGetPath on the gateway
2021-08-30 16:43:21 -07:00
Łukasz Magiera
22d75f4843
Tweak miner info --blocks output
2021-08-27 13:41:41 +02:00
Łukasz Magiera
4630216c38
Merge branch 'info-blocks' of github.com:filcloud/lotus-mirror into filcloud-info-blocks
2021-08-27 13:20:05 +02:00
Łukasz Magiera
a63f5c8bf2
Merge pull request #7025 from lanzafame/fix/need-empty-storage-json
...
fix: init restore adds empty storage.json
2021-08-27 12:29:27 +02:00
Łukasz Magiera
c19ee58f46
Merge pull request #7194 from filecoin-project/feat/big-data
...
Insert miner and network power data as gibibytes to avoid int64 overflows
2021-08-27 11:19:54 +02:00
Travis Person
0e8abc1973
Insert miner and network power data as gibibytes to avoid int64 overflows.
2021-08-27 00:01:44 +00:00
Łukasz Magiera
d6e309aa01
Show alert count in lotus-miner info
2021-08-26 15:45:19 +02:00
Łukasz Magiera
b094e0913d
untangle fsjournal dependencies
2021-08-26 15:44:45 +02:00
Anton Evangelatov
548865e8dd
simplify assignments to vmemBar and ramBar
2021-08-25 11:48:15 +03:00
Anton Evangelatov
0eacb9b9c8
call string.Repeat always with positive int
2021-08-25 11:48:15 +03:00
Aayush Rajasekaran
2495c52b05
Merge pull request #7099 from filecoin-project/asr/verifreg-nonmsig
...
Shed: Create a verifreg command for when VRK isn't a multisig
2021-08-24 21:03:38 -04:00
Łukasz Magiera
5a23c2bb90
sectors expired: Address review
2021-08-24 11:29:25 +02:00
Łukasz Magiera
a9bf24695d
Fix lint
2021-08-23 11:27:34 -07:00
Łukasz Magiera
ccf8844689
lotus-miner sectors expired --remove-expired
2021-08-23 11:27:34 -07:00
Łukasz Magiera
d1759a4335
Show more info in sectors expired cmd
2021-08-23 11:27:34 -07:00
Łukasz Magiera
927ef041f8
miner: Command to list expired sectors
2021-08-23 11:27:34 -07:00
Łukasz Magiera
69204eea04
shed: Support raw encoding in cid id
2021-08-20 17:12:26 +02:00
Frrist
518b6f1d41
fix(miner): always create miner deal staging directory ( #7098 )
...
- fixes #7097
Co-authored-by: Raúl Kripalani <raul@protocol.ai>
Co-authored-by: Raúl Kripalani <raul@protocol.ai>
2021-08-17 00:16:06 +01:00
Aarsh Shah
d7076778e2
integrate DAG store and CARv2 in deal-making ( #6671 )
...
This commit removes badger from the deal-making processes, and
moves to a new architecture with the dagstore as the cental
component on the miner-side, and CARv2s on the client-side.
Every deal that has been handed off to the sealing subsystem becomes
a shard in the dagstore. Shards are mounted via the LotusMount, which
teaches the dagstore how to load the related piece when serving
retrievals.
When the miner starts the Lotus for the first time with this patch,
we will perform a one-time migration of all active deals into the
dagstore. This is a lightweight process, and it consists simply
of registering the shards in the dagstore.
Shards are backed by the unsealed copy of the piece. This is currently
a CARv1. However, the dagstore keeps CARv2 indices for all pieces, so
when it's time to acquire a shard to serve a retrieval, the unsealed
CARv1 is joined with its index (safeguarded by the dagstore), to form
a read-only blockstore, thus taking the place of the monolithic
badger.
Data transfers have been adjusted to interface directly with CARv2 files.
On inbound transfers (client retrievals, miner storage deals), we stream
the received data into a CARv2 ReadWrite blockstore. On outbound transfers
(client storage deals, miner retrievals), we serve the data off a CARv2
ReadOnly blockstore.
Client-side imports are managed by the refactored *imports.Manager
component (when not using IPFS integration). Just like it before, we use
the go-filestore library to avoid duplicating the data from the original
file in the resulting UnixFS DAG (concretely the leaves). However, the
target of those imports are what we call "ref-CARv2s": CARv2 files placed
under the `$LOTUS_PATH/imports` directory, containing the intermediate
nodes in full, and the leaves as positional references to the original file
on disk.
Client-side retrievals are placed into CARv2 files in the location:
`$LOTUS_PATH/retrievals`.
A new set of `Dagstore*` JSON-RPC operations and `lotus-miner dagstore`
subcommands have been introduced on the miner-side to inspect and manage
the dagstore.
Despite moving to a CARv2-backed system, the IPFS integration has been
respected, and it continues to be possible to make storage deals with data
held in an IPFS node, and to perform retrievals directly into an IPFS node.
NOTE: because the "staging" and "client" Badger blockstores are no longer
used, existing imports on the client will be rendered useless. On startup,
Lotus will enumerate all imports and print WARN statements on the log for
each import that needs to be reimported. These log lines contain these
messages:
- import lacks carv2 path; import will not work; please reimport
- import has missing/broken carv2; please reimport
At the end, we will print a "sanity check completed" message indicating
the count of imports found, and how many were deemed broken.
Co-authored-by: Aarsh Shah <aarshkshah1992@gmail.com>
Co-authored-by: Dirk McCormick <dirkmdev@gmail.com>
Co-authored-by: Raúl Kripalani <raul@protocol.ai>
Co-authored-by: Dirk McCormick <dirkmdev@gmail.com>
2021-08-16 23:34:32 +01:00
raulk
473a192b85
fix build after merging #6097 . ( #7096 )
...
fix build after merging #6097 .
2021-08-16 23:18:32 +01:00
ZenGround0
10615b53ad
Merge pull request #6853 from filecoin-project/frrist/miner-temp-file-path
...
feat(miner deals): create subdir to miner repo for staged deals
2021-08-16 16:19:05 -04:00
ZenGround0
2e5b492edd
Merge pull request #6097 from filcloud/sectors-renew
...
Extending sectors: more practical and flexible tools
2021-08-16 13:50:38 -04:00
Aayush Rajasekaran
90e60f7a98
Shed: Create a verifreg command for when VRK isn't a multisig
2021-08-16 12:56:27 -04:00
He Weidong
b50b1e9ac4
Optimize for ci
2021-08-14 10:41:01 +08:00
He Weidong
c5f81d35f5
minor modification
2021-08-13 13:47:48 +08:00
Raúl Kripalani
5f6166435c
make lotus-miner net commands hit markets subsystem.
2021-08-12 11:15:00 +01:00
Steven Allen
dcff06bd91
test: genesis actors version
...
Properly handle genesis in actors tests. Fast-forward upgrading to
actors v13 doesn't work because there needs to be at least a day between
v0 genesis and v13 (due to differences in miner cron).
2021-08-11 13:30:15 -07:00
swift-mx
d6562bccfc
Merge branch 'filecoin-project:master' into master
2021-08-11 19:25:27 +08:00
mx
46a93bb78a
fix: get other actor controlList
2021-08-11 19:23:37 +08:00
lanzafame
0b8a211e70
fix: init restore adds empty storage.json
2021-08-11 13:36:01 +10:00
Steven Allen
130fc6fce1
Merge pull request #7019 from filecoin-project/asr/genesis-shed
...
Shed: Include network name in genesis-verify
2021-08-10 16:25:02 -07:00
Aayush Rajasekaran
feb9d3c557
Shed: Include network name in genesis-verify
2021-08-10 14:46:24 -04:00
ZenGround0
6da26dcefc
Remove network version panic
2021-08-10 13:07:30 -04:00
Frank
2744bb4e5a
update
2021-08-04 15:49:35 +08:00
Frank
2fec0c2440
add produced blocks info
2021-08-04 15:41:06 +08:00
vyzo
c9124bd1a9
clear splitstore dir before deleting, only warn if the latter fails
...
to address situations with symlinks
2021-08-03 15:39:48 +03:00
vyzo
db6b7b91d8
add option to only clear splistore keys
2021-08-03 15:32:53 +03:00
He Weidong
94c5076710
Make flags more intuitive
2021-08-02 16:44:22 +08:00
He Weidong
66e8418125
Enable exclude
2021-08-02 16:39:16 +08:00
He Weidong
677afbcb91
update to miner5
2021-08-02 16:26:29 +08:00
He Weidong
7f6c942b81
Use max-fee instead of gas-feecap
2021-08-02 16:09:00 +08:00
He Weidong
e09cdc45a7
Add gas-feecap flag for cmd sectors renew
2021-08-02 16:08:57 +08:00
He Weidong
9ee80fd1db
Prettify json output of extending params
2021-08-02 16:08:55 +08:00
He Weidong
77166f88ac
Optimize search of sectors location
2021-08-02 16:08:52 +08:00
He Weidong
e0777fed15
Add a more flexible cli tool: sectors renew
2021-08-02 16:08:50 +08:00
He Weidong
075bb3b314
Add a cli tool: sectors check-expire
2021-08-02 16:08:47 +08:00
vyzo
4a1655b225
add lotus-shed splitstore clear command
2021-08-01 19:18:29 +03:00
frrist
ca697c9aa2
feat(miner deals): create subdir to miner repo for staged deals
2021-07-29 21:08:38 -07:00
Aayush Rajasekaran
e5fb4a6c04
Merge pull request #6942 from filecoin-project/asr/nit
...
Improve formatting of workers CLI
2021-07-29 15:09:06 -04:00
Aayush Rajasekaran
1f7d584517
Update cmd/lotus-miner/sealing.go
2021-07-29 14:46:19 -04:00
Aayush Rajasekaran
28e3c8bd3f
Improve formatting of workers CLI
2021-07-29 11:46:42 -04:00
Raúl Kripalani
8433aae1af
use fallback api infos last; init service with markets-path.
2021-07-29 16:10:04 +01:00
Raúl Kripalani
b17fcfc4d1
bugfix.
2021-07-29 14:36:04 +01:00
Raúl Kripalani
90427bc3af
fix docs, add flag.
2021-07-29 13:39:03 +01:00
Raúl Kripalani
3b2c3a3f6b
polish.
2021-07-29 12:56:08 +01:00
Raúl Kripalani
d9c6a32b8e
refactor miner info command.
2021-07-29 12:54:08 +01:00
Raúl Kripalani
22c0884f5f
target markets API for markets commands.
2021-07-29 12:37:29 +01:00
raulk
80aedcd276
Merge branch 'master' into nonsense/get-enabled-subsystems-api
2021-07-28 20:09:43 +01:00
Raúl Kripalani
07f40b9488
fix docs and nits.
2021-07-28 20:03:25 +01:00
Łukasz Magiera
25052fe48f
Remove chainwatch (now filecoin-project/sentinel)
2021-07-28 17:59:01 +02:00
Łukasz Magiera
389f71251c
Remove townhall
2021-07-28 17:58:46 +02:00
Anton Evangelatov
6969202a03
make linter happy
2021-07-28 17:47:01 +03:00
Anton Evangelatov
54c6a3a454
extract outputs for mining node and markets node in separate functions
2021-07-28 17:31:48 +03:00
Anton Evangelatov
de4a847078
add RuntimeSubsystems API method; use it in lotus-miner info
2021-07-28 16:02:05 +03:00
Jiaying Wang
29b2d27f00
Merge branch 'master' into chore/cleanup-chain
2021-07-27 18:04:17 -04:00
raulk
35c90349ce
Merge pull request #6840 from filecoin-project/nonsense/lotus-shed-support-rollback-for-mra
...
lotus-shed: initial export cmd for markets related metadata
2021-07-27 22:13:29 +01:00
Jiaying Wang
d45b4a7a1f
Merge branch 'master' into chore/cleanup-chain
2021-07-27 17:11:36 -04:00
Jiaying Wang
4918a7c16f
Merge branch 'master' into feat/cli-super-verbose
2021-07-27 17:07:16 -04:00
raulk
e4b225f4ba
Merge branch 'master' into feat/cli-super-verbose
2021-07-27 20:49:44 +01:00
Raúl Kripalani
b04fb75a92
rename flag to very verbose.
2021-07-27 20:49:30 +01:00
vyzo
7c28ff3826
Merge branch 'master' into feat/moving-gc
2021-07-27 21:48:51 +03:00
Łukasz Magiera
e163d556fb
Merge branch 'master' into chore/cleanup-chain
2021-07-27 17:49:42 +02:00
Jiaying Wang
e46f02f59d
Merge branch 'master' into feat/vis-sector-alloc
2021-07-27 09:49:33 -04:00
Łukasz Magiera
ae63a4b33b
fix lotus-sim build
2021-07-27 15:49:01 +02:00
Łukasz Magiera
9bd312881d
VMSys doesn't belong in chainstore
2021-07-27 15:30:23 +02:00
Raúl Kripalani
48cddd3644
add a super verbose -vv flag to lotus and lotus-miner.
2021-07-27 14:25:28 +01:00
Raúl Kripalani
e0522a6b1f
rename cmd/lotus{-storage=>}-miner to match binary.
2021-07-27 11:54:46 +01:00
Jiaying Wang
790f27d6a2
Merge branch 'master' into feat/vis-sector-alloc
2021-07-26 16:15:15 -04:00
Anton Evangelatov
9d61f91cdf
Update cmd/lotus-shed/market.go
...
Co-authored-by: Aayush Rajasekaran <arajasek94@gmail.com>
2021-07-26 16:41:22 +02:00
Jakub Sztandera
7de866d881
lint = happy
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2021-07-26 16:39:12 +02:00
vyzo
4715b1f436
fix lotus-shed
2021-07-26 15:04:46 +03:00
vyzo
221dc7024f
add splitstore info command
2021-07-26 08:47:02 +03:00
vyzo
c99dc3e811
add splitstore check command
2021-07-25 11:24:06 +03:00
vyzo
e317c831a8
quiet excessive badger logs
2021-07-25 09:07:27 +03:00
vyzo
ce6f410f2a
add options to control compaction/gc of the coldstore and config rewrite during rollback
2021-07-25 09:01:34 +03:00
vyzo
254c489164
fix typo
...
Co-authored-by: raulk <raul@protocol.ai>
2021-07-25 09:01:34 +03:00
vyzo
33cdc90f13
fix typo
...
Co-authored-by: raulk <raul@protocol.ai>
2021-07-25 09:01:34 +03:00
vyzo
da66e7a878
fix typo
2021-07-25 09:01:34 +03:00
vyzo
e696a2c0cc
fix newline in progres message
2021-07-25 09:01:34 +03:00