Travis Person
eadc61c37a
log shutdown method for lotus daemon and miner
2020-09-18 18:07:58 +00:00
Łukasz Magiera
70faa36b7f
Merge remote-tracking branch 'origin/master' into refactor/net-upgrade
2020-09-18 19:29:06 +02:00
Aayush Rajasekaran
694463ffbe
More lint fixes
2020-09-18 03:06:28 -04:00
Steven Allen
b2ee59024f
improve diff logic
...
* Make diffing work across versions.
* Start porting more chainwatch logic.
2020-09-17 21:39:34 -07:00
Travis Person
ac7007d1d0
lotus-shed: add jwt token command
2020-09-18 04:05:03 +00:00
Travis Person
db2a20da6c
lotus-shed: add keyinfo verify
2020-09-18 03:59:00 +00:00
Łukasz Magiera
26bbd9fb9d
wdpost: append is hard
2020-09-18 03:00:31 +02:00
Łukasz Magiera
57c1eac37a
gofmt
2020-09-18 02:40:01 +02:00
Łukasz Magiera
dcc5643473
shed: Even more bitfield utils
2020-09-18 02:38:30 +02:00
Łukasz Magiera
b85b50afbc
shed: bitfield intersect command
2020-09-17 20:37:35 +02:00
jennijuju
14a4acec8c
Add an option to hide sectors in Removed for sectors list
.
2020-09-17 13:19:50 -04:00
Łukasz Magiera
6eda53565f
Most tests passing
2020-09-17 17:30:24 +02:00
Aayush Rajasekaran
31ff5230bb
Get State API almost working
2020-09-17 05:05:32 -04:00
Aayush Rajasekaran
b5ba7a0fad
Miner migration
2020-09-17 02:21:16 -04:00
Frank
d5af25b76c
update init sector state list
2020-09-17 10:38:07 +08:00
hannahhoward
80b6994fe2
feat(market): update state diffing for market actor
...
Update to abstract actor for markets state diffing. Also move the diff adt functions inside the
abstract actors
2020-09-16 19:14:07 -07:00
Ingar Shu
f56602c588
Specify retrieval price in FIL/GiB
2020-09-16 14:30:04 -07:00
Ingar Shu
2aef7f7c07
Clarify help text units
2020-09-16 13:56:46 -07:00
Ingar Shu
665d23cb8e
Add set-ask, get-ask retrieval CLI
2020-09-16 13:56:46 -07:00
Frank
ed74091c20
add exist sector state check
2020-09-16 19:49:45 +08:00
Aayush Rajasekaran
72d19f369b
Incremental progress towards using new power state interface
2020-09-16 01:57:18 -04:00
Aayush Rajasekaran
90853e24cf
Add a boolean HasMinPower to return of GetPower
2020-09-16 01:47:24 -04:00
jennijuju
5c69249ba3
Use window post
for window PoSt related log messages.
2020-09-15 21:22:29 -04:00
Jakub Sztandera
0c1c19c6ef
Merge pull request #3867 from filecoin-project/feat/lotus-bench-repo-dir
...
allow specification of repo directory in lotus-bench
2020-09-15 23:21:04 +02:00
Steven Allen
c64f983900
migrate StateMinserSectorCount
2020-09-15 12:09:39 -07:00
whyrusleeping
24756ac056
allow specification of repo directory in lotus-bench
2020-09-15 11:55:54 -07:00
Łukasz Magiera
531b7bf92d
Merge pull request #3848 from filecoin-project/feat/state-sector-cli
...
cli: state sector command
2020-09-15 15:30:04 +02:00
Łukasz Magiera
84fa22110f
fix lint
2020-09-15 12:09:43 +02:00
Łukasz Magiera
e22aa74865
Merge pull request #3780 from filecoin-project/feat/lotus-gateway
...
implement initial lotus-gateway program
2020-09-15 12:07:59 +02:00
Łukasz Magiera
285fc69f6a
gateway: address review
2020-09-15 11:50:08 +02:00
Łukasz Magiera
7fd5c81674
cli: state sector command
2020-09-15 01:36:49 +02:00
Steven Allen
cc4d5306eb
Progress
2020-09-14 15:43:12 -07:00
Steven Allen
02dcb5e182
Merge branch 'master' into refactor/net-upgrade
2020-09-14 14:53:57 -07:00
Steven Allen
9804310cc8
Update specs-actors to 0.9.10
...
Moves the Keyer type (and helpers) into go-state-types.
2020-09-14 14:32:57 -07:00
Mike Greenberg
8a21198f56
Merge pull request #3765 from ggq89/master
...
optimize definition of state_heights
2020-09-14 14:19:31 -04:00
Łukasz Magiera
06ec571c20
Merge remote-tracking branch 'origin/master' into refactor/net-upgrade
2020-09-14 15:09:52 +02:00
Raúl Kripalani
6d29d75724
Merge branch 'master' into inmem-journal
2020-09-14 12:17:45 +01:00
Albert·Gou
747b34c2c8
Update sync.go
2020-09-14 18:00:17 +08:00
Albert·Gou
e45a7749b0
Update sync.go
2020-09-14 16:20:01 +08:00
Albert·Gou
b7ea145f38
Merge remote-tracking branch 'upstream/master' into master
2020-09-14 16:17:10 +08:00
whyrusleeping
3401cb349b
add mpool push and chainHead
2020-09-11 23:07:20 -07:00
Steven Allen
d3594835c4
[WIP] Network upgrade support
...
This patch starts adding support for network upgrades.
* It adds an actors abstraction layer for loading abstract (cross-version) actors.
* It starts switching over to a shared deadline type.
* It adds an abstraction for ADTs (hamt/amt).
* It removes the callback-based API in the StateManager (difficult to abstract
across actor versions).
* It _does not_ actually add support for actors v2. We can do that in a followup
patch but that should be relatively easy.
This patch is heavily WIP and does not compile. Feel free to push changes
directly to this branch.
Notes:
* State tree access now needs a network version, because the HAMT type will change.
* I haven't figured out a nice way to abstract over changes to the _message_
types. However, many of them will be type aliased to actors v0 in actors v2 so
we can likely continue using the v0 versions (or use the v2 versions
everywhere). I've been renaming imports to `v0*` to make it clear that we're
importing types from a _specific_ actors version.
TODO:
* Consider merging incremental improvements? We'd have to get this compiling
again first but we could merge in the new abstractions, and slowly switch over.
* Finish migrating to the new abstractions.
* Remove all actor state types from the public API. See `miner.State.Info()` for
the planned approach here.
* Fix the tests. This is likely going to be a massive pain.
2020-09-11 20:16:29 -07:00
whyrusleeping
8b9a3ea6c3
implement initial lotus-gateway program
2020-09-11 20:01:37 -07:00
Łukasz Magiera
aeb3437a9f
lint, docsgen
2020-09-11 10:55:10 +02:00
Albert·Gou
6e7de3c8d9
optimize definition of state_heights
...
In the same parentstateroot, the one with the smallest height should be selected
2020-09-11 16:52:48 +08:00
whyrusleeping
0e3dd3cb3b
Add faster and slimmer option to chain export via lotus-shed
2020-09-10 17:28:25 -07:00
Steven Allen
7a46c5ff31
[WIP] Fix ticket randomness
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-09-10 17:41:55 -04:00
Łukasz Magiera
890e6280df
Merge pull request #3669 from filecoin-project/feat/independent-version-numbers
...
build: Separate API versions per node type
2020-09-10 17:00:32 +02:00
Whyrusleeping
767341b279
Merge pull request #3437 from filecoin-project/feat/mpool-stats-cmd
...
add a simple command to watch messages sitting in the mempool
2020-09-09 18:29:42 -07:00
whyrusleeping
c73916b4e7
fix the linter
2020-09-09 17:37:49 -07:00
whyrusleeping
0361ca1c39
add some bits about windowed post
2020-09-09 17:18:55 -07:00
frrist
f2b238f50a
fix(chainwatch): compare prev miner with cur miner
...
- bug was comparing cur miner with cur miner
2020-09-09 15:30:30 -07:00
whyrusleeping
09194aa613
print better error when losing connection
2020-09-09 15:19:54 -07:00
whyrusleeping
e58327d4ed
rename LE tag to quantile
2020-09-09 15:19:54 -07:00
whyrusleeping
8414aa6e4b
more metrics!
2020-09-09 15:19:54 -07:00
whyrusleeping
7d1d690eb7
lets get some metrics
2020-09-09 15:19:54 -07:00
whyrusleeping
47ad7ccb5f
some more stats
2020-09-09 15:19:54 -07:00
whyrusleeping
679c4183e7
add a simple command to watch messages sitting in the mempool
2020-09-09 15:19:53 -07:00
Łukasz Magiera
38863d3025
build: Separate API versions per node type
2020-09-08 21:14:53 +02:00
whyrusleeping
26ec0716b9
fix lint errors
2020-09-07 16:12:44 -07:00
whyrusleeping
97af576f6a
Implement faucet funds reallocation logic
...
use all committed sectors instead of power
give all miners who had at least a sector on friday a base amount
include genesis miner in redistribution
drop back to 1,000,000
2020-09-07 16:06:13 -07:00
Aayush Rajasekaran
d678fe4bfa
Fix tests
2020-09-07 15:48:42 -04:00
Aayush Rajasekaran
39755a294a
Update to specs v0.9.6
2020-09-07 15:48:41 -04:00
Łukasz Magiera
70da2b7b4d
Merge pull request #3568 from filecoin-project/feat/lotus-shed-math
...
lotus-shed: add math command
2020-09-05 21:47:06 +02:00
Travis Person
bf3466f3cb
lotus-pcr: use current tipset during refund
...
Using the tipset which is being processed might lead to incorrect gas
estimations or balance checking for the wallet.
2020-09-05 02:38:24 +00:00
Travis Person
eebd2efcbf
lotus-shed: add math command
2020-09-05 00:50:56 +00:00
Travis Person
d6691fe9d8
lotus-pcr: add tipset aggregation
2020-09-04 22:28:13 +00:00
Raúl Kripalani
1ec534d607
Merge branch 'master' into inmem-journal
2020-09-04 10:55:40 +01:00
Łukasz Magiera
d81feb05d1
Merge pull request #3527 from filecoin-project/feat/watch-option-miner-storage-deals-list
...
Add watch option to storage-deals list
2020-09-04 04:13:01 +02:00
Mike Greenberg
abaef98fd8
fix(chainwatch): Stop SyncIncomingBlocks from leaking into processing
...
The SQL query was anchoring data from the `blocks` table, which includes
all blocks seen from SyncIncomingBlocks which isn't always available in
the chainstate via the API. In order to prevent these blocks from
leaking into normal processing (which errors anyway), the join was
changed to allow `blocks_synced` to anchor the set as we originally
intended.
2020-09-03 19:15:25 -04:00
Mike Greenberg
ddc5e57d4d
fix(chainwatch): Error instead of panic during processing
2020-09-03 19:15:19 -04:00
Ingar Shu
1608cd2d53
Add watch option to "lotus-miner storage-deals list"
2020-09-03 10:14:30 -07:00
Raúl Kripalani
4554c4bda9
fix lotus-bench stale import.
2020-09-02 19:54:13 +01:00
Raúl Kripalani
3206f92063
Merge branch 'master' into inmem-journal
2020-09-02 19:50:52 +01:00
Jakub Sztandera
59f765f7be
Rename to import-snapshot, require more than finality for state export
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-09-02 17:15:36 +02:00
Łukasz Magiera
528e39fcb3
docsgen, fix snapshot flag name
2020-09-02 17:15:10 +02:00
whyrusleeping
2b16e69e90
allow snapshot importing
2020-09-02 17:15:10 +02:00
Łukasz Magiera
351313523c
Merge pull request #3470 from filecoin-project/feat/toggle-message-processing
...
lotus-pcr: add toggle for message processing
2020-09-02 14:26:40 +02:00
Aayush Rajasekaran
8417f516e5
Check error in advance-block
2020-09-02 02:41:12 -04:00
Travis Person
9532441ed4
lotus-pcr: add toggle for message processing
2020-09-02 03:50:16 +00:00
Mike Greenberg
2b83089da8
fix(chainwatch): Add important documentation
2020-08-31 22:55:11 -04:00
Mike Greenberg
7290431cb0
fix(chainwatch): Restore IncomingBlockSync listening
2020-08-31 22:46:28 -04:00
Mike Greenberg
95a75daf9f
fix(chainwatch): Remove useless logging
2020-08-31 22:32:34 -04:00
Mike Greenberg
80ed6b8c25
fix(chainwatch): Process chain waitout waiting for update via ChainNotify
2020-08-31 22:31:25 -04:00
whyrusleeping
cac848c106
add a command to import an ipld object into the chainstore
2020-08-31 14:24:23 -07:00
Łukasz Magiera
0e6ff668eb
worker: Cli to attach storage paths
2020-08-30 20:33:02 +02:00
Aayush Rajasekaran
5095e6f07b
Fix chain import
2020-08-28 22:15:43 -04:00
Łukasz Magiera
e86f90fe8d
Merge pull request #3380 from filecoin-project/fix/chainwatch/perf
...
perf(chainwatch): parallelize miner processing
2020-08-29 02:51:46 +02:00
frrist
0185090cbb
perf(chainwatch): parallelize miner processing
2020-08-28 13:26:11 -07:00
Łukasz Magiera
11b11e416b
sectorstorage: Compact assigned windows
2020-08-28 18:26:38 +02:00
Łukasz Magiera
20ffce5c0d
Merge remote-tracking branch 'origin/master' into fix/some-fsm-issues
2020-08-28 16:47:25 +02:00
Łukasz Magiera
932ab61c2d
Merge pull request #3275 from filecoin-project/fix/chainwatch/sync
...
fix(chainwatch): use height to determine unsynced blocks and fix deadlock in sector deal table
2020-08-28 12:16:00 +02:00
Mike Greenberg
ff5ac51c54
fix(chainwatch): Upsert on chain_economics
...
This table may get multiple updates depending on how many blocks get
added into a tipset. Each new block affects the tipset state, but the
parent state root will remain the same. This allows the very latest
value to be applied.
2020-08-27 23:21:20 -04:00
Mike Greenberg
9e130af9e7
feat(chainwatch): Add more complete power and reward metrics
2020-08-27 23:00:12 -04:00
Aayush Rajasekaran
bed7158212
Use beacon entries in advance-block
2020-08-27 21:38:51 -04:00
Łukasz Magiera
59f554b658
sealing sched: Show waiting tasks assigned to workers in sealing jobs cli
2020-08-27 23:14:33 +02:00
frrist
0ad38fe38f
lint
2020-08-27 14:09:03 -07:00
frrist
5c4db23da4
polish(chainwatch): accept lotus api and token
2020-08-27 14:05:39 -07:00
Łukasz Magiera
d8e58e67c6
storagefsm: Treat PackingFailed sectors as expired
2020-08-27 22:41:35 +02:00
frrist
f934ebd429
fix(chainwatch): sync based on height
2020-08-27 11:47:53 -07:00
frrist
fccdd70524
polish(chainwatch): relax scheduler refresh
2020-08-27 11:47:53 -07:00
frrist
5e40dda3bc
fix(chainwatch): fix deadlock in sector deals
2020-08-27 11:47:53 -07:00
frrist
fb8340acb2
polish(chainwatch): clean up logging
2020-08-27 11:47:53 -07:00
Łukasz Magiera
df635579c4
storagefsm: Handle sectors with expired deals better
2020-08-27 13:51:38 +02:00
Łukasz Magiera
788c7dbf48
storagefsm: Separate satte for submitting commit message
2020-08-27 12:57:28 +02:00
Łukasz Magiera
51ca460f18
miner: Fix sorting of some sector states in miner-info
2020-08-27 12:41:12 +02:00
Łukasz Magiera
e236173417
miner: Print (pre)commit message cids in sector status
2020-08-27 12:40:19 +02:00
Raúl Kripalani
cb8e105a94
reduce diff noise.
2020-08-26 16:44:06 +01:00
Raúl Kripalani
efdfd3ee3e
Merge branch 'master' into inmem-journal
2020-08-26 16:38:23 +01:00
Raúl Kripalani
4e1ef09751
make journal a global var.
2020-08-26 16:09:37 +01:00
Whyrusleeping
0009f7c8dc
Merge pull request #3300 from filecoin-project/fix/set-peer-id
...
fix parsing of peerID in input to set-peer-id
2020-08-25 17:26:05 -07:00
Whyrusleeping
cd2e794d3f
Merge pull request #3299 from filecoin-project/steb/update-deps
...
update deps for bug fixes
2020-08-25 17:18:02 -07:00
whyrusleeping
9bb862d025
fix parsing of peerID in input to set-peer-id
2020-08-25 17:10:06 -07:00
Steven Allen
7fb4851eb9
update deps for bug fixes
...
* updates bitswap to include _many_ perf enhancements and bug fixes.
* updates go-fs-lock because the version here is pretty old.
* updates go-libp2p
* updates bbloom _just_ in case, because the version we were depending on had bugs (looks like we're not actually using it).
2020-08-25 17:06:07 -07:00
frrist
0d61e0d717
refactor(ctx): update to latest go-jsonrpc
2020-08-25 15:20:41 -07:00
Steven Allen
f84bbd4520
Fix more lint warnings.
...
This way we can keep CI green.
2020-08-25 12:56:30 -07:00
Travis Person
fb033a3719
lotus-fountain: remove make miner workflow
2020-08-25 05:10:12 +00:00
whyrusleeping
90337995ff
print out genesis cid
2020-08-24 22:48:48 +02:00
whyrusleeping
aa2cad1a66
small usability tweak, fix lint
2020-08-24 22:48:47 +02:00
whyrusleeping
4f6dc0748d
print out genesis block accounts
2020-08-24 22:48:11 +02:00
whyrusleeping
6b8191121c
add lotus-shed command to verify some stuff about the genesis car
2020-08-24 22:48:11 +02:00
Łukasz Magiera
ecc3ff4a5c
Merge pull request #3254 from filecoin-project/fix/chainwatch/independent-processor-subtasks
...
fix(chainwatch): Make processor failures independent of each other
2020-08-24 22:45:02 +02:00
Łukasz Magiera
71a2dc06d7
Merge pull request #3259 from GFZRZK/master
...
Bugfix: fix some typo and correct recoveries datasource
2020-08-24 22:44:36 +02:00
Łukasz Magiera
6a7cb669ac
Merge pull request #3250 from filecoin-project/fix/miner-info-avail
...
miner info: Fix avail calc, print aggregate deal info
2020-08-24 18:10:07 +02:00
WC
119f6ff2e6
Bugfix: fix some typo and correct recoveries datasource
...
Bugfix: fix some typo and correct recoveries data source
2020-08-24 14:56:44 +08:00
Mike Greenberg
80f8f71a96
fix(lint): Cleanup unneeded error returns; go mod tidy
2020-08-23 16:51:12 -04:00
Mike Greenberg
7e0ba4aa32
fix(chainwatch): Reduce default max-batch to 50
2020-08-23 13:01:10 -04:00
Mike Greenberg
da8dbc8ffe
fix(chainwatch): Make processor failures independent of each other
2020-08-23 01:59:15 -04:00
Łukasz Magiera
a236957538
Merge pull request #3232 from filecoin-project/asr/marked-for-upgrade
...
Indicate whether a sector has been marked for upgrade
2020-08-22 21:48:45 +02:00
Łukasz Magiera
12af420d7e
mod tidy
2020-08-22 19:16:45 +02:00
Łukasz Magiera
88016c17e4
miner info: Fix avail calc, print aggregate deal info
2020-08-22 19:15:08 +02:00
Aayush Rajasekaran
984e52acbc
Indicate whether a sector has been marked for upgrade
2020-08-21 15:53:39 -04:00
Steven Allen
5733c71c50
Lint everything
...
We were ignoring quite a few error cases, and had one case where we weren't
actually updating state where we wanted to. Unfortunately, if the linter doesn't
pass, nobody has any reason to actually check lint failures in CI.
There are three remaining XXXs marked in the code for lint.
2020-08-20 20:46:36 -07:00
Whyrusleeping
af3fe206d6
Merge pull request #3122 from filecoin-project/feat/cmd-improvements
...
sorted deal listings
2020-08-20 13:29:01 -07:00
Aayush Rajasekaran
93e566d7e0
Change docs.lotu.sh links to lotu.sh
2020-08-20 12:45:41 -04:00
Łukasz Magiera
364e3229b9
Merge pull request #3178 from filecoin-project/feat/miner-init-from-flag
...
add a from flag for miner init
2020-08-20 17:09:03 +02:00
Łukasz Magiera
0acc461cb1
Merge pull request #3185 from filecoin-project/fix/chainwatch/fix-nil-smoothing-estimate
...
fix(chainwatch): Handle RewardState.EpochSmoothingEstimate == nil
2020-08-20 11:20:58 +02:00
Łukasz Magiera
cd82f79d35
Merge pull request #3191 from filecoin-project/feat/miner-data-transfers
...
Add data transfer list command to miner
2020-08-20 11:18:56 +02:00
hannahhoward
0086f76a90
feat(lotus-miner): add data transfer list cmd
...
add equivalent command to list data transfers on miner side, extract common functionality for reuse
2020-08-20 01:35:48 -07:00
Travis Person
3eeec8d438
lotus-pcr: fix refund math
2020-08-20 08:28:53 +00:00
Mike Greenberg
bf10de82df
fix(chainwatch): Handle RewardState.EpochSmoothingEstimate == nil
2020-08-20 01:55:17 -04:00
whyrusleeping
2675ffb128
add a from flag for miner init
2020-08-19 17:34:58 -07:00
Łukasz Magiera
885f357c59
Merge pull request #3175 from filecoin-project/feat/control-addersses-control
...
Wire up miner control addresses, use for PoSt
2020-08-20 02:24:33 +02:00
Łukasz Magiera
de41f63fa4
miner info: Also print locked pledge
2020-08-20 02:03:42 +02:00
Łukasz Magiera
a4807b18bc
gofmt, api docstring
2020-08-20 01:26:13 +02:00
Łukasz Magiera
5ea61abfe1
Wire up miner control addresses, use for post
2020-08-20 01:17:03 +02:00
Łukasz Magiera
f943ea7d5d
Merge pull request #3170 from filecoin-project/frrist/chainwatch-SectorOnChainInfo-ext
...
refactor(cw): add new values to sector_info table and smoothing estimate
2020-08-19 23:58:22 +02:00
Łukasz Magiera
ed098390cb
Merge pull request #3172 from filecoin-project/feat/lotus-shed-jwt
...
lotus-shed: add simple jwt creation support
2020-08-19 23:32:01 +02:00
frrist
05f1a23c94
feat(chainwatch): power actor smoothing estimate
2020-08-19 13:34:58 -07:00
frrist
fecaeda382
feat(chainwatch): reward actor smoothing estimate
2020-08-19 13:05:07 -07:00