Łukasz Magiera
e8d2560581
Fix tests
2020-11-27 16:47:48 +01:00
Dirk McCormick
c66e594046
fix: cancel transfer cancels storage deal
2020-11-27 15:37:22 +01:00
Łukasz Magiera
65653a1747
storagefsm: Add GetTicket to some maps
2020-11-26 10:53:31 +01:00
s1m0n21
663b3f4f21
add a sector check command
2020-11-26 15:02:43 +08:00
Łukasz Magiera
16dbbadddf
Set lower feecap on PoSt messages with low balance
2020-11-19 18:02:20 +01:00
Steven Allen
c8ff58aae1
add basic calico test
2020-11-16 19:04:17 +01:00
Łukasz Magiera
2a7e4af5ee
Fix lotus-miner/lotus-worker build
2020-11-16 19:03:30 +01:00
Łukasz Magiera
c5c0185943
miner: Basic storage cleanup command
2020-11-12 21:27:16 +01:00
Łukasz Magiera
bf547112de
miner: Storage list sectors command
2020-11-12 19:11:58 +01:00
Aayush Rajasekaran
498477da04
Nit: ArgsUsage param rename
2020-11-12 02:04:55 -05:00
Łukasz Magiera
8ac495723e
gofmt
2020-11-11 17:42:23 +01:00
Łukasz Magiera
09f9f871a3
Create a command to abort sealing calls
2020-11-11 17:39:12 +01:00
Łukasz Magiera
2a3d930933
Hide ret-done tasks in sealing jobs by default
2020-11-11 16:48:04 +01:00
Łukasz Magiera
18aa97f962
Merge pull request #4779 from filecoin-project/feat/work-track-hostname
...
storage: Track worker hostnames with work
2020-11-10 20:38:44 +01:00
zgfzgf
f5401317c9
cmd sectors commitIDs len
2020-11-10 17:37:36 +08:00
Łukasz Magiera
5caa277261
storage: Track abandoned work more correctly
2020-11-09 23:38:20 +01:00
Łukasz Magiera
f819e71d12
storage: Separate returned jobs in jobs cli
2020-11-09 23:13:29 +01:00
Łukasz Magiera
27a9dd3bbb
storage: Track worker hostnames with work
2020-11-09 23:09:04 +01:00
Łukasz Magiera
fb492d9acb
Merge pull request #4662 from filecoin-project/feat/force-sched-cli
...
Debug flag to force running sealing scheduler
2020-10-30 20:15:49 +01:00
Łukasz Magiera
885c6c94d3
Add sync status to miner info command
2020-10-30 19:39:31 +01:00
Łukasz Magiera
7fbb868513
Debug flag to force running sealing scheduler
2020-10-30 11:07:35 +01:00
Łukasz Magiera
ad9a5acb7f
miner sectors list: flags for events/seal time
2020-10-29 19:10:20 +01:00
Łukasz Magiera
e1da874258
Merge remote-tracking branch 'origin/master' into feat/async-restartable-workers
2020-10-27 03:31:07 +01:00
Steven Allen
832c0998e4
validate that block propagation works after a worker key change
2020-10-26 18:16:25 -07:00
Steven Allen
0d06f8fa2b
Add commands to change the worker key
2020-10-26 18:16:24 -07:00
Łukasz Magiera
8923524f6a
Make EarlyExpiration in sectors list less scary
2020-10-26 15:33:15 +01:00
Łukasz Magiera
660236b224
Merge remote-tracking branch 'origin/master' into feat/async-restartable-workers
2020-10-23 23:25:35 +02:00
hannahhoward
98297cef4d
feat(data-transfer): fill in utils
2020-10-22 13:40:26 -07:00
Łukasz Magiera
0289c39850
Merge pull request #4516 from filecoin-project/feat/api-request-metrics-wrapper
...
Feat/api request metrics wrapper
2020-10-22 21:40:47 +02:00
Łukasz Magiera
6bdf9935bf
Merge pull request #4475 from filecoin-project/fix/miner-init-createworker
...
miner: fix init --create-worker-key
2020-10-22 18:55:25 +02:00
Steven Allen
bcabe7b3b5
migrate methods to abstracted methods
...
Method numbers never change anyways. At worst, we'll deprecate old methods and
have to explicitly import them from the correct actors version to use them.
2020-10-21 12:18:37 -07:00
Steven Allen
4e730b5ec8
port to v2 imports
2020-10-21 12:16:23 -07:00
lanzafame
7a33d5bb34
register all apis with metric wrapper
2020-10-21 18:37:50 +10:00
Łukasz Magiera
869d71446d
miner: fix init --create-worker-key
2020-10-19 16:08:46 +02:00
Łukasz Magiera
f933e1d2b7
miner cli: Update to uuid worker IDs
2020-10-18 13:03:17 +02:00
Łukasz Magiera
8d06cca073
sched: Handle workers using sessions instead of connections
2020-10-18 12:36:06 +02:00
Łukasz Magiera
7ac5dc55d0
Merge remote-tracking branch 'origin/master' into feat/async-restartable-workers
2020-10-17 13:45:11 +02:00
Łukasz Magiera
ab4f051b83
sync wait --watch
2020-10-14 18:17:18 +02:00
Łukasz Magiera
71b3b9075d
Merge remote-tracking branch 'origin/master' into feat/async-restartable-workers
2020-10-13 21:33:21 +02:00
Łukasz Magiera
224a96431f
Merge pull request #4319 from filecoin-project/asr/repay-debt-cli
...
Add a CLI tool for miner's to repay debt
2020-10-12 19:24:40 +02:00
Łukasz Magiera
2855c2bc49
Merge pull request #4329 from shaodan/ux-workers-cores
...
Improve the UX for `lotus-miner sealing workers`
2020-10-12 16:45:26 +02:00
Dan Shao
c0961fb63d
Improve the UX for lotus-miner sealing workers
: add total number of cores
2020-10-12 15:07:56 +08:00
Aayush Rajasekaran
b4215e5f46
Add a CLI tool for miner's to repay debt
2020-10-11 19:57:30 -04:00
Jakub Sztandera
2b21fdef33
Refactor from crypto.SigType to types.KeyType
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-10-12 00:07:53 +02:00
Steven Allen
748d2e82a7
unshare the journal
...
Motivation:
* Run lotus with the race detector enabled (primary motivation).
* Allow multiple lotus nodes in a process (not a high priority).
Previously, the journal was shared between all lotus instances, but it was
initialized for every new node. This caused safety problems in tests (at a
minimum).
This patch explicitly passes the journal to all services that need it.
2020-10-09 13:23:07 -07:00
Dirk McCormick
200a95f824
refactor: unify test builder full node options
2020-10-09 11:56:25 +02:00
Dirk McCormick
ef73b964fb
feat: add end-to-end test for lite mode
2020-10-09 11:48:35 +02:00
Ingar Shu
c3420c0ceb
Display price, verified-price with units in lotus-miner storage-deals get-ask
2020-10-08 12:08:01 -07:00
Ingar Shu
2ad671649c
Use FIL units for miner set-ask
2020-10-08 11:31:32 -07:00
Łukasz Magiera
0de3051821
Merge remote-tracking branch 'origin/master' into feat/async-restartable-workers
2020-10-08 13:10:41 +02:00
Steven Allen
df4b068d0e
Merge branch 'master' into next
2020-10-07 11:55:00 -07:00
Łukasz Magiera
cfd126ee9f
Merge pull request #3961 from filecoin-project/docs/miner-storage
...
lotus-miner: add more help text to storage / attach
2020-10-07 14:55:42 +02:00
Łukasz Magiera
f6eb530cba
Merge pull request #4203 from filecoin-project/fix/pond-actorsv2
...
Fix pond
2020-10-07 07:55:38 +02:00
Aayush Rajasekaran
c23f1623a1
Fix test
2020-10-06 20:48:00 -04:00
Łukasz Magiera
15670942c3
Fix pond
2020-10-07 01:50:11 +02:00
Łukasz Magiera
2f70a91665
Merge remote-tracking branch 'origin/master' into next
2020-10-06 23:54:59 +02:00
Aayush Rajasekaran
7a80e356de
Add a CLI command to set a miner's owner address
2020-10-06 05:11:52 -04:00
Łukasz Magiera
0e2f697217
Merge pull request #4133 from filecoin-project/feat/backup
...
Miner backup/restore commands
2020-10-06 02:05:03 +02:00
Łukasz Magiera
ed03202c1d
Test lotus-miner info all
2020-10-05 14:15:14 +02:00
Łukasz Magiera
0fee5dab8a
Merge pull request #4077 from filecoin-project/4076-remove-ask-duration
...
Always use default 720h for setask duration and hide the duration param option
2020-10-04 13:59:41 +02:00
Łukasz Magiera
1fc23fb466
lotus-miner: Cleanup storage attach helptext a bit
2020-10-03 11:30:22 +02:00
Łukasz Magiera
ec7282ff09
miner restore: Resolve worker key for wallet check
2020-10-01 17:55:48 +02:00
Łukasz Magiera
738efe3f9a
miner restore: Add progerss bar for metadata import
2020-10-01 17:55:48 +02:00
Łukasz Magiera
e444977891
Full node metadata backup
2020-10-01 17:55:48 +02:00
Łukasz Magiera
5c33982f72
miner restore: storage config flag
2020-10-01 17:55:48 +02:00
Łukasz Magiera
44747446a9
miner restore: config flag
2020-10-01 17:55:48 +02:00
Łukasz Magiera
d7ec5e3618
lotus-miner init restore
2020-10-01 17:55:48 +02:00
Łukasz Magiera
9b5a0815fc
backup: open datastores in readonly in offline mode
2020-10-01 17:55:47 +02:00
Łukasz Magiera
deac7166b5
Support offline backups
2020-10-01 17:55:47 +02:00
Łukasz Magiera
2dc9a1ee4e
lotus-miner backup command
2020-10-01 17:55:47 +02:00
Łukasz Magiera
5932f28519
Merge remote-tracking branch 'origin/master' into feat/async-restartable-workers
2020-10-01 02:39:48 +02:00
Łukasz Magiera
2cfe22d4e5
Merge remote-tracking branch 'origin/master' into feat/async-restartable-workers
2020-09-30 20:48:16 +02:00
Łukasz Magiera
e3ee4e4718
Fix lint errors
2020-09-30 20:24:03 +02:00
Łukasz Magiera
4d4bab12eb
Improve miner sectors list UX
2020-09-30 13:34:05 +02:00
jennijuju
64f24fd276
Added an option to hide sector info for lotus-miner info
2020-09-28 15:42:50 -04:00
jennijuju
124bd0c765
Always use default 720h for setask duration and hide the duration param option.
2020-09-28 14:58:46 -04:00
Łukasz Magiera
a9d1ca4d83
Change order in miner sectors list
2020-09-28 12:08:09 +02:00
Łukasz Magiera
cf71f034dc
Merge remote-tracking branch 'origin/dev' into feat/async-restartable-workers
2020-09-26 12:35:32 +02:00
Aayush Rajasekaran
8fbbebbaf1
Correct helptext around set ask
2020-09-25 00:11:10 -04:00
Łukasz Magiera
a8fcb86c10
miner allinfo: Don't fail if sector status fails
2020-09-24 22:17:20 +02:00
Łukasz Magiera
cdda66a154
Merge pull request #3942 from filecoin-project/3941-deadline-info
...
3941: Added cmd `lotus-miner proving deadline <deadline index>`
2020-09-24 16:25:45 +02:00
jennijuju
f8f335df55
3941: Added cmd `lotus-miner proving deadline <deadline index>"
...
- To show the current proving period deadline information of given deadline index.
- It outputs the following:
- number of partitions in this deadline
- partitions numbers has submitted PoSt since the current proving period started
- if the deadline is the current proving deadline
- for each patition, shows the amount of the sectors in this partition, and their numbers. Also, shows the number of fault sectors and corresponding sector numbers.
2020-09-24 16:23:12 +02:00
Łukasz Magiera
04ee53e061
sectorstorage: Show task type of ret-wait jobs
2020-09-24 11:55:11 +02:00
Łukasz Magiera
f57652524c
Merge remote-tracking branch 'origin/master' into feat/async-restartable-workers
2020-09-23 22:31:27 +02:00
Łukasz Magiera
d817dceb05
Show lost calls in sealing jobs cli
2020-09-23 19:26:35 +02:00
jennijuju
91a43c477c
When doing sectors update-state
, show a list of existing states if user inputs an invalid one.
2020-09-23 12:34:34 -04:00
Łukasz Magiera
ce6b92484f
Merge remote-tracking branch 'origin/master' into feat/async-restartable-workers
2020-09-23 11:31:21 +02:00
Travis Person
c66f087f4c
lotus-miner: add more help text to storage / attach
2020-09-22 18:15:42 +00:00
Łukasz Magiera
aa5bd7bc17
Merge remote-tracking branch 'origin/master' into feat/async-restartable-workers
2020-09-21 22:36:16 +02:00
Steven Allen
4cf0c105eb
optimize sector loading
...
And avoid exposing "arrays" via the miner abstraction. We may change these
structures later.
2020-09-21 12:12:08 -07:00
Łukasz Magiera
f7934b083c
Merge remote-tracking branch 'origin/master' into refactor/net-upgrade
2020-09-21 19:10:18 +02:00
Łukasz Magiera
29913f4c41
Merge pull request #3903 from filecoin-project/3605-sector-list-option
...
Add an option to hide sectors in Removed from `sectors list`.
2020-09-21 19:04:11 +02:00
Łukasz Magiera
1096f8acc6
miner: Invert show-removed option in sectors list
2020-09-21 18:59:05 +02:00
Jerry
c401d2ec4e
fix storage find error
2020-09-19 15:48:02 +08:00
Steven Allen
1bf3b4989d
rename imports to match actors code
...
`sed -i 's/\bv0\(\w\)\(\w*\)/\L\1\E\20/g' **/*.go`
2020-09-18 14:59:27 -07:00
Steven Allen
c130806c37
compile fix
2020-09-18 14:59:14 -07:00
Steven Allen
f741ce6e30
fixup some more imports
2020-09-18 14:51:18 -07:00
Steven Allen
8285eda8e5
migrate storage miner info
2020-09-18 14:46:42 -07:00
Łukasz Magiera
6050401652
Merge pull request #3925 from filecoin-project/feat/log-shutdown
...
log shutdown method for lotus daemon and miner
2020-09-18 23:15:41 +02:00
Łukasz Magiera
7109e95f5e
Merge pull request #3881 from filcloud/issue-3626-SectorState
...
fix SectorState
2020-09-18 21:30:18 +02:00
Travis Person
eadc61c37a
log shutdown method for lotus daemon and miner
2020-09-18 18:07:58 +00:00
Łukasz Magiera
70faa36b7f
Merge remote-tracking branch 'origin/master' into refactor/net-upgrade
2020-09-18 19:29:06 +02:00
jennijuju
14a4acec8c
Add an option to hide sectors in Removed for sectors list
.
2020-09-17 13:19:50 -04:00
Łukasz Magiera
6eda53565f
Most tests passing
2020-09-17 17:30:24 +02:00
Aayush Rajasekaran
31ff5230bb
Get State API almost working
2020-09-17 05:05:32 -04:00
Frank
d5af25b76c
update init sector state list
2020-09-17 10:38:07 +08:00
Ingar Shu
f56602c588
Specify retrieval price in FIL/GiB
2020-09-16 14:30:04 -07:00
Ingar Shu
2aef7f7c07
Clarify help text units
2020-09-16 13:56:46 -07:00
Ingar Shu
665d23cb8e
Add set-ask, get-ask retrieval CLI
2020-09-16 13:56:46 -07:00
Łukasz Magiera
5e09581256
sectorstorage: get new work tracker to run
2020-09-16 22:33:58 +02:00
Frank
ed74091c20
add exist sector state check
2020-09-16 19:49:45 +08:00
Aayush Rajasekaran
72d19f369b
Incremental progress towards using new power state interface
2020-09-16 01:57:18 -04:00
Steven Allen
c64f983900
migrate StateMinserSectorCount
2020-09-15 12:09:39 -07:00
Łukasz Magiera
03cf6cca40
Merge remote-tracking branch 'origin/master' into feat/async-restartable-workers
2020-09-15 17:47:03 +02:00
Łukasz Magiera
84fa22110f
fix lint
2020-09-15 12:09:43 +02:00
Łukasz Magiera
7fd5c81674
cli: state sector command
2020-09-15 01:36:49 +02:00
Steven Allen
02dcb5e182
Merge branch 'master' into refactor/net-upgrade
2020-09-14 14:53:57 -07:00
Łukasz Magiera
1ebca8f732
more working code
2020-09-14 19:09:01 +02:00
Łukasz Magiera
06ec571c20
Merge remote-tracking branch 'origin/master' into refactor/net-upgrade
2020-09-14 15:09:52 +02:00
Raúl Kripalani
6d29d75724
Merge branch 'master' into inmem-journal
2020-09-14 12:17:45 +01:00
Steven Allen
d3594835c4
[WIP] Network upgrade support
...
This patch starts adding support for network upgrades.
* It adds an actors abstraction layer for loading abstract (cross-version) actors.
* It starts switching over to a shared deadline type.
* It adds an abstraction for ADTs (hamt/amt).
* It removes the callback-based API in the StateManager (difficult to abstract
across actor versions).
* It _does not_ actually add support for actors v2. We can do that in a followup
patch but that should be relatively easy.
This patch is heavily WIP and does not compile. Feel free to push changes
directly to this branch.
Notes:
* State tree access now needs a network version, because the HAMT type will change.
* I haven't figured out a nice way to abstract over changes to the _message_
types. However, many of them will be type aliased to actors v0 in actors v2 so
we can likely continue using the v0 versions (or use the v2 versions
everywhere). I've been renaming imports to `v0*` to make it clear that we're
importing types from a _specific_ actors version.
TODO:
* Consider merging incremental improvements? We'd have to get this compiling
again first but we could merge in the new abstractions, and slowly switch over.
* Finish migrating to the new abstractions.
* Remove all actor state types from the public API. See `miner.State.Info()` for
the planned approach here.
* Fix the tests. This is likely going to be a massive pain.
2020-09-11 20:16:29 -07:00
Łukasz Magiera
5f08fe7ead
Merge remote-tracking branch 'origin/master' into feat/async-restartable-workers
2020-09-10 17:30:54 +02:00
Łukasz Magiera
38863d3025
build: Separate API versions per node type
2020-09-08 21:14:53 +02:00
Aayush Rajasekaran
39755a294a
Update to specs v0.9.6
2020-09-07 15:48:41 -04:00
Łukasz Magiera
5d73943929
storage: Fix import cycle
2020-09-06 18:54:00 +02:00
Raúl Kripalani
1ec534d607
Merge branch 'master' into inmem-journal
2020-09-04 10:55:40 +01:00
Ingar Shu
1608cd2d53
Add watch option to "lotus-miner storage-deals list"
2020-09-03 10:14:30 -07:00
Raúl Kripalani
3206f92063
Merge branch 'master' into inmem-journal
2020-09-02 19:50:52 +01:00
Łukasz Magiera
11b11e416b
sectorstorage: Compact assigned windows
2020-08-28 18:26:38 +02:00
Łukasz Magiera
59f554b658
sealing sched: Show waiting tasks assigned to workers in sealing jobs cli
2020-08-27 23:14:33 +02:00
Łukasz Magiera
d8e58e67c6
storagefsm: Treat PackingFailed sectors as expired
2020-08-27 22:41:35 +02:00
Łukasz Magiera
df635579c4
storagefsm: Handle sectors with expired deals better
2020-08-27 13:51:38 +02:00
Łukasz Magiera
788c7dbf48
storagefsm: Separate satte for submitting commit message
2020-08-27 12:57:28 +02:00
Łukasz Magiera
51ca460f18
miner: Fix sorting of some sector states in miner-info
2020-08-27 12:41:12 +02:00
Łukasz Magiera
e236173417
miner: Print (pre)commit message cids in sector status
2020-08-27 12:40:19 +02:00
Raúl Kripalani
cb8e105a94
reduce diff noise.
2020-08-26 16:44:06 +01:00
Raúl Kripalani
efdfd3ee3e
Merge branch 'master' into inmem-journal
2020-08-26 16:38:23 +01:00
Raúl Kripalani
4e1ef09751
make journal a global var.
2020-08-26 16:09:37 +01:00
Whyrusleeping
0009f7c8dc
Merge pull request #3300 from filecoin-project/fix/set-peer-id
...
fix parsing of peerID in input to set-peer-id
2020-08-25 17:26:05 -07:00
whyrusleeping
9bb862d025
fix parsing of peerID in input to set-peer-id
2020-08-25 17:10:06 -07:00
Steven Allen
7fb4851eb9
update deps for bug fixes
...
* updates bitswap to include _many_ perf enhancements and bug fixes.
* updates go-fs-lock because the version here is pretty old.
* updates go-libp2p
* updates bbloom _just_ in case, because the version we were depending on had bugs (looks like we're not actually using it).
2020-08-25 17:06:07 -07:00
Łukasz Magiera
71a2dc06d7
Merge pull request #3259 from GFZRZK/master
...
Bugfix: fix some typo and correct recoveries datasource
2020-08-24 22:44:36 +02:00
Łukasz Magiera
6a7cb669ac
Merge pull request #3250 from filecoin-project/fix/miner-info-avail
...
miner info: Fix avail calc, print aggregate deal info
2020-08-24 18:10:07 +02:00
WC
119f6ff2e6
Bugfix: fix some typo and correct recoveries datasource
...
Bugfix: fix some typo and correct recoveries data source
2020-08-24 14:56:44 +08:00
Łukasz Magiera
a236957538
Merge pull request #3232 from filecoin-project/asr/marked-for-upgrade
...
Indicate whether a sector has been marked for upgrade
2020-08-22 21:48:45 +02:00
Łukasz Magiera
12af420d7e
mod tidy
2020-08-22 19:16:45 +02:00
Łukasz Magiera
88016c17e4
miner info: Fix avail calc, print aggregate deal info
2020-08-22 19:15:08 +02:00
Aayush Rajasekaran
984e52acbc
Indicate whether a sector has been marked for upgrade
2020-08-21 15:53:39 -04:00
Steven Allen
5733c71c50
Lint everything
...
We were ignoring quite a few error cases, and had one case where we weren't
actually updating state where we wanted to. Unfortunately, if the linter doesn't
pass, nobody has any reason to actually check lint failures in CI.
There are three remaining XXXs marked in the code for lint.
2020-08-20 20:46:36 -07:00
Whyrusleeping
af3fe206d6
Merge pull request #3122 from filecoin-project/feat/cmd-improvements
...
sorted deal listings
2020-08-20 13:29:01 -07:00