cerc-io/lotus
16
0
Fork 0
Code Issues Pull Requests Packages Projects Releases 27 Wiki Activity
8,326 Commits 24 Branches 342 Tags 314 MiB
8292d60196
Commit Graph

1467 Commits

Author SHA1 Message Date
Łukasz Magiera
1096f8acc6 miner: Invert show-removed option in sectors list 2020-09-21 18:59:05 +02:00
Travis Person
b3d0a5fb4a lotus-shed: add consensus check command 2020-09-20 20:26:20 +00:00
Jerry
c401d2ec4e fix storage find error 2020-09-19 15:48:02 +08:00
Travis Person
e6bbc03ca8 lotus-pcr: update miner recovery 2020-09-19 02:09:05 +00:00
Travis Person
e39036dd49 lotus-pcr: find miners command 2020-09-18 23:17:04 +00:00
Travis Person
26de0db757 lotus-pcr: add recover-miners command 2020-09-18 23:17:04 +00:00
Steven Allen
1bf3b4989d rename imports to match actors code 
`sed -i 's/\bv0\(\w\)\(\w*\)/\L\1\E\20/g' **/*.go`
 2020-09-18 14:59:27 -07:00
Steven Allen
c130806c37 compile fix 2020-09-18 14:59:14 -07:00
Steven Allen
f741ce6e30 fixup some more imports 2020-09-18 14:51:18 -07:00
Steven Allen
8285eda8e5 migrate storage miner info 2020-09-18 14:46:42 -07:00
Łukasz Magiera
6050401652
Merge pull request #3925 from filecoin-project/feat/log-shutdown 
log shutdown method for lotus daemon and miner
 2020-09-18 23:15:41 +02:00
Steven Allen
298efa221c fix lint errors 2020-09-18 13:52:07 -07:00
Steven Allen
fb2b25c297 finish upgrading chainwatch 2020-09-18 13:43:30 -07:00
Łukasz Magiera
7109e95f5e
Merge pull request #3881 from filcloud/issue-3626-SectorState 
fix SectorState
 2020-09-18 21:30:18 +02:00
Aayush Rajasekaran
c3046f487c Don't use -1 as default sector number 2020-09-18 14:41:03 -04:00
Travis Person
eadc61c37a log shutdown method for lotus daemon and miner 2020-09-18 18:07:58 +00:00
Łukasz Magiera
70faa36b7f Merge remote-tracking branch 'origin/master' into refactor/net-upgrade 2020-09-18 19:29:06 +02:00
Aayush Rajasekaran
694463ffbe More lint fixes 2020-09-18 03:06:28 -04:00
vyzo
3c72461969 MpoolPushUntrusted API for gateway 2020-09-18 09:40:43 +03:00
Steven Allen
b2ee59024f improve diff logic 
* Make diffing work across versions.
* Start porting more chainwatch logic.
 2020-09-17 21:39:34 -07:00
Travis Person
ac7007d1d0 lotus-shed: add jwt token command 2020-09-18 04:05:03 +00:00
Travis Person
db2a20da6c lotus-shed: add keyinfo verify 2020-09-18 03:59:00 +00:00
Łukasz Magiera
26bbd9fb9d wdpost: append is hard 2020-09-18 03:00:31 +02:00
Łukasz Magiera
57c1eac37a gofmt 2020-09-18 02:40:01 +02:00
Łukasz Magiera
dcc5643473 shed: Even more bitfield utils 2020-09-18 02:38:30 +02:00
Łukasz Magiera
b85b50afbc shed: bitfield intersect command 2020-09-17 20:37:35 +02:00
jennijuju
14a4acec8c Add an option to hide sectors in Removed for sectors list. 2020-09-17 13:19:50 -04:00
Łukasz Magiera
6eda53565f Most tests passing 2020-09-17 17:30:24 +02:00
Aayush Rajasekaran
31ff5230bb Get State API almost working 2020-09-17 05:05:32 -04:00
Aayush Rajasekaran
b5ba7a0fad Miner migration 2020-09-17 02:21:16 -04:00
Frank
d5af25b76c update init sector state list 2020-09-17 10:38:07 +08:00
hannahhoward
80b6994fe2 feat(market): update state diffing for market actor 
Update to abstract actor for markets state diffing. Also move the diff adt functions inside the
abstract actors
 2020-09-16 19:14:07 -07:00
Ingar Shu
f56602c588
Specify retrieval price in FIL/GiB 2020-09-16 14:30:04 -07:00
Ingar Shu
2aef7f7c07
Clarify help text units 2020-09-16 13:56:46 -07:00
Ingar Shu
665d23cb8e
Add set-ask, get-ask retrieval CLI 2020-09-16 13:56:46 -07:00
Frank
ed74091c20 add exist sector state check 2020-09-16 19:49:45 +08:00
Aayush Rajasekaran
72d19f369b Incremental progress towards using new power state interface 2020-09-16 01:57:18 -04:00
Aayush Rajasekaran
90853e24cf Add a boolean HasMinPower to return of GetPower 2020-09-16 01:47:24 -04:00
whyrusleeping
6670d22fb5 add command to (slowly) prune lotus chain datastore 2020-09-15 20:20:48 -07:00
jennijuju
5c69249ba3 Use window post for window PoSt related log messages. 2020-09-15 21:22:29 -04:00
Jakub Sztandera
0c1c19c6ef
Merge pull request #3867 from filecoin-project/feat/lotus-bench-repo-dir 
allow specification of repo directory in lotus-bench
 2020-09-15 23:21:04 +02:00
Steven Allen
c64f983900 migrate StateMinserSectorCount 2020-09-15 12:09:39 -07:00
whyrusleeping
24756ac056 allow specification of repo directory in lotus-bench 2020-09-15 11:55:54 -07:00
Łukasz Magiera
531b7bf92d
Merge pull request #3848 from filecoin-project/feat/state-sector-cli 
cli: state sector command
 2020-09-15 15:30:04 +02:00
Łukasz Magiera
84fa22110f fix lint 2020-09-15 12:09:43 +02:00
Łukasz Magiera
e22aa74865
Merge pull request #3780 from filecoin-project/feat/lotus-gateway 
implement initial lotus-gateway program
 2020-09-15 12:07:59 +02:00
Łukasz Magiera
285fc69f6a gateway: address review 2020-09-15 11:50:08 +02:00
Łukasz Magiera
7fd5c81674 cli: state sector command 2020-09-15 01:36:49 +02:00
Steven Allen
cc4d5306eb Progress 2020-09-14 15:43:12 -07:00
Steven Allen
02dcb5e182 Merge branch 'master' into refactor/net-upgrade 2020-09-14 14:53:57 -07:00
Steven Allen
9804310cc8 Update specs-actors to 0.9.10 
Moves the Keyer type (and helpers) into go-state-types.
 2020-09-14 14:32:57 -07:00
Mike Greenberg
8a21198f56
Merge pull request #3765 from ggq89/master 
optimize definition of state_heights
 2020-09-14 14:19:31 -04:00
Łukasz Magiera
06ec571c20 Merge remote-tracking branch 'origin/master' into refactor/net-upgrade 2020-09-14 15:09:52 +02:00
Raúl Kripalani
6d29d75724 Merge branch 'master' into inmem-journal 2020-09-14 12:17:45 +01:00
Albert·Gou
747b34c2c8 Update sync.go 2020-09-14 18:00:17 +08:00
Albert·Gou
e45a7749b0 Update sync.go 2020-09-14 16:20:01 +08:00
Albert·Gou
b7ea145f38 Merge remote-tracking branch 'upstream/master' into master 2020-09-14 16:17:10 +08:00
whyrusleeping
3401cb349b add mpool push and chainHead 2020-09-11 23:07:20 -07:00
Steven Allen
d3594835c4 [WIP] Network upgrade support 
This patch starts adding support for network upgrades.

* It adds an actors abstraction layer for loading abstract (cross-version) actors.
* It starts switching over to a shared deadline type.
* It adds an abstraction for ADTs (hamt/amt).
* It removes the callback-based API in the StateManager (difficult to abstract
across actor versions).
* It _does not_ actually add support for actors v2. We can do that in a followup
patch but that should be relatively easy.

This patch is heavily WIP and does not compile. Feel free to push changes
directly to this branch.

Notes:

* State tree access now needs a network version, because the HAMT type will change.
* I haven't figured out a nice way to abstract over changes to the _message_
types. However, many of them will be type aliased to actors v0 in actors v2 so
we can likely continue using the v0 versions (or use the v2 versions
everywhere). I've been renaming imports to `v0*` to make it clear that we're
importing types from a _specific_ actors version.

TODO:

* Consider merging incremental improvements? We'd have to get this compiling
again first but we could merge in the new abstractions, and slowly switch over.
* Finish migrating to the new abstractions.
* Remove all actor state types from the public API. See `miner.State.Info()` for
the planned approach here.
* Fix the tests. This is likely going to be a massive pain.
 2020-09-11 20:16:29 -07:00
whyrusleeping
8b9a3ea6c3 implement initial lotus-gateway program 2020-09-11 20:01:37 -07:00
Łukasz Magiera
aeb3437a9f lint, docsgen 2020-09-11 10:55:10 +02:00
Albert·Gou
6e7de3c8d9 optimize definition of state_heights 
In the same parentstateroot, the one with the smallest height should be selected
 2020-09-11 16:52:48 +08:00
whyrusleeping
0e3dd3cb3b Add faster and slimmer option to chain export via lotus-shed 2020-09-10 17:28:25 -07:00
Steven Allen
7a46c5ff31 [WIP] Fix ticket randomness 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-09-10 17:41:55 -04:00
Łukasz Magiera
890e6280df
Merge pull request #3669 from filecoin-project/feat/independent-version-numbers 
build: Separate API versions per node type
 2020-09-10 17:00:32 +02:00
Whyrusleeping
767341b279
Merge pull request #3437 from filecoin-project/feat/mpool-stats-cmd 
add a simple command to watch messages sitting in the mempool
 2020-09-09 18:29:42 -07:00
whyrusleeping
c73916b4e7 fix the linter 2020-09-09 17:37:49 -07:00
whyrusleeping
0361ca1c39 add some bits about windowed post 2020-09-09 17:18:55 -07:00
frrist
f2b238f50a fix(chainwatch): compare prev miner with cur miner 
- bug was comparing cur miner with cur miner
 2020-09-09 15:30:30 -07:00
whyrusleeping
09194aa613 print better error when losing connection 2020-09-09 15:19:54 -07:00
whyrusleeping
e58327d4ed rename LE tag to quantile 2020-09-09 15:19:54 -07:00
whyrusleeping
8414aa6e4b more metrics! 2020-09-09 15:19:54 -07:00
whyrusleeping
7d1d690eb7 lets get some metrics 2020-09-09 15:19:54 -07:00
whyrusleeping
47ad7ccb5f some more stats 2020-09-09 15:19:54 -07:00
whyrusleeping
679c4183e7 add a simple command to watch messages sitting in the mempool 2020-09-09 15:19:53 -07:00
Łukasz Magiera
38863d3025 build: Separate API versions per node type 2020-09-08 21:14:53 +02:00
whyrusleeping
26ec0716b9 fix lint errors 2020-09-07 16:12:44 -07:00
whyrusleeping
97af576f6a Implement faucet funds reallocation logic 
use all committed sectors instead of power

give all miners who had at least a sector on friday a base amount

include genesis miner in redistribution

drop back to 1,000,000
 2020-09-07 16:06:13 -07:00
Aayush Rajasekaran
d678fe4bfa Fix tests 2020-09-07 15:48:42 -04:00
Aayush Rajasekaran
39755a294a Update to specs v0.9.6 2020-09-07 15:48:41 -04:00
Łukasz Magiera
70da2b7b4d
Merge pull request #3568 from filecoin-project/feat/lotus-shed-math 
lotus-shed: add math command
 2020-09-05 21:47:06 +02:00
Travis Person
bf3466f3cb lotus-pcr: use current tipset during refund 
Using the tipset which is being processed might lead to incorrect gas
estimations or balance checking for the wallet.
 2020-09-05 02:38:24 +00:00
Travis Person
eebd2efcbf lotus-shed: add math command 2020-09-05 00:50:56 +00:00
Travis Person
d6691fe9d8 lotus-pcr: add tipset aggregation 2020-09-04 22:28:13 +00:00
Raúl Kripalani
1ec534d607 Merge branch 'master' into inmem-journal 2020-09-04 10:55:40 +01:00
Łukasz Magiera
d81feb05d1
Merge pull request #3527 from filecoin-project/feat/watch-option-miner-storage-deals-list 
Add watch option to storage-deals list
 2020-09-04 04:13:01 +02:00
Mike Greenberg
abaef98fd8 fix(chainwatch): Stop SyncIncomingBlocks from leaking into processing 
The SQL query was anchoring data from the `blocks` table, which includes
all blocks seen from SyncIncomingBlocks which isn't always available in
the chainstate via the API. In order to prevent these blocks from
leaking into normal processing (which errors anyway), the join was
changed to allow `blocks_synced` to anchor the set as we originally
intended.
 2020-09-03 19:15:25 -04:00
Mike Greenberg
ddc5e57d4d fix(chainwatch): Error instead of panic during processing 2020-09-03 19:15:19 -04:00
Ingar Shu
1608cd2d53
Add watch option to "lotus-miner storage-deals list" 2020-09-03 10:14:30 -07:00
Raúl Kripalani
4554c4bda9 fix lotus-bench stale import. 2020-09-02 19:54:13 +01:00
Raúl Kripalani
3206f92063 Merge branch 'master' into inmem-journal 2020-09-02 19:50:52 +01:00
Jakub Sztandera
59f765f7be Rename to import-snapshot, require more than finality for state export 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-09-02 17:15:36 +02:00
Łukasz Magiera
528e39fcb3 docsgen, fix snapshot flag name 2020-09-02 17:15:10 +02:00
whyrusleeping
2b16e69e90 allow snapshot importing 2020-09-02 17:15:10 +02:00
Łukasz Magiera
351313523c
Merge pull request #3470 from filecoin-project/feat/toggle-message-processing 
lotus-pcr: add toggle for message processing
 2020-09-02 14:26:40 +02:00
Aayush Rajasekaran
8417f516e5 Check error in advance-block 2020-09-02 02:41:12 -04:00
Travis Person
9532441ed4 lotus-pcr: add toggle for message processing 2020-09-02 03:50:16 +00:00
Mike Greenberg
2b83089da8 fix(chainwatch): Add important documentation 2020-08-31 22:55:11 -04:00
Mike Greenberg
7290431cb0 fix(chainwatch): Restore IncomingBlockSync listening 2020-08-31 22:46:28 -04:00
Mike Greenberg
95a75daf9f fix(chainwatch): Remove useless logging 2020-08-31 22:32:34 -04:00
Mike Greenberg
80ed6b8c25 fix(chainwatch): Process chain waitout waiting for update via ChainNotify 2020-08-31 22:31:25 -04:00
whyrusleeping
cac848c106 add a command to import an ipld object into the chainstore 2020-08-31 14:24:23 -07:00
Łukasz Magiera
0e6ff668eb worker: Cli to attach storage paths 2020-08-30 20:33:02 +02:00
Aayush Rajasekaran
5095e6f07b Fix chain import 2020-08-28 22:15:43 -04:00
Łukasz Magiera
e86f90fe8d
Merge pull request #3380 from filecoin-project/fix/chainwatch/perf 
perf(chainwatch): parallelize miner processing
 2020-08-29 02:51:46 +02:00
frrist
0185090cbb perf(chainwatch): parallelize miner processing 2020-08-28 13:26:11 -07:00
Łukasz Magiera
11b11e416b sectorstorage: Compact assigned windows 2020-08-28 18:26:38 +02:00
Łukasz Magiera
20ffce5c0d Merge remote-tracking branch 'origin/master' into fix/some-fsm-issues 2020-08-28 16:47:25 +02:00
Łukasz Magiera
932ab61c2d
Merge pull request #3275 from filecoin-project/fix/chainwatch/sync 
fix(chainwatch): use height to determine unsynced blocks and fix deadlock in sector deal table
 2020-08-28 12:16:00 +02:00
Mike Greenberg
ff5ac51c54 fix(chainwatch): Upsert on chain_economics 
This table may get multiple updates depending on how many blocks get
added into a tipset. Each new block affects the tipset state, but the
parent state root will remain the same. This allows the very latest
value to be applied.
 2020-08-27 23:21:20 -04:00
Mike Greenberg
9e130af9e7 feat(chainwatch): Add more complete power and reward metrics 2020-08-27 23:00:12 -04:00
Aayush Rajasekaran
bed7158212 Use beacon entries in advance-block 2020-08-27 21:38:51 -04:00
Łukasz Magiera
59f554b658 sealing sched: Show waiting tasks assigned to workers in sealing jobs cli 2020-08-27 23:14:33 +02:00
frrist
0ad38fe38f lint 2020-08-27 14:09:03 -07:00
frrist
5c4db23da4 polish(chainwatch): accept lotus api and token 2020-08-27 14:05:39 -07:00
Łukasz Magiera
d8e58e67c6 storagefsm: Treat PackingFailed sectors as expired 2020-08-27 22:41:35 +02:00
frrist
f934ebd429 fix(chainwatch): sync based on height 2020-08-27 11:47:53 -07:00
frrist
fccdd70524 polish(chainwatch): relax scheduler refresh 2020-08-27 11:47:53 -07:00
frrist
5e40dda3bc fix(chainwatch): fix deadlock in sector deals 2020-08-27 11:47:53 -07:00
frrist
fb8340acb2 polish(chainwatch): clean up logging 2020-08-27 11:47:53 -07:00
Łukasz Magiera
df635579c4 storagefsm: Handle sectors with expired deals better 2020-08-27 13:51:38 +02:00
Łukasz Magiera
788c7dbf48 storagefsm: Separate satte for submitting commit message 2020-08-27 12:57:28 +02:00
Łukasz Magiera
51ca460f18 miner: Fix sorting of some sector states in miner-info 2020-08-27 12:41:12 +02:00
Łukasz Magiera
e236173417 miner: Print (pre)commit message cids in sector status 2020-08-27 12:40:19 +02:00
Raúl Kripalani
cb8e105a94 reduce diff noise. 2020-08-26 16:44:06 +01:00
Raúl Kripalani
efdfd3ee3e Merge branch 'master' into inmem-journal 2020-08-26 16:38:23 +01:00
Raúl Kripalani
4e1ef09751 make journal a global var. 2020-08-26 16:09:37 +01:00
Whyrusleeping
0009f7c8dc
Merge pull request #3300 from filecoin-project/fix/set-peer-id 
fix parsing of peerID in input to set-peer-id
 2020-08-25 17:26:05 -07:00
Whyrusleeping
cd2e794d3f
Merge pull request #3299 from filecoin-project/steb/update-deps 
update deps for bug fixes
 2020-08-25 17:18:02 -07:00
whyrusleeping
9bb862d025 fix parsing of peerID in input to set-peer-id 2020-08-25 17:10:06 -07:00
Steven Allen
7fb4851eb9 update deps for bug fixes 
* updates bitswap to include _many_ perf enhancements and bug fixes.
* updates go-fs-lock because the version here is pretty old.
* updates go-libp2p
* updates bbloom _just_ in case, because the version we were depending on had bugs (looks like we're not actually using it).
 2020-08-25 17:06:07 -07:00
frrist
0d61e0d717 refactor(ctx): update to latest go-jsonrpc 2020-08-25 15:20:41 -07:00
Steven Allen
f84bbd4520 Fix more lint warnings. 
This way we can keep CI green.
 2020-08-25 12:56:30 -07:00
Travis Person
fb033a3719 lotus-fountain: remove make miner workflow 2020-08-25 05:10:12 +00:00
whyrusleeping
90337995ff print out genesis cid 2020-08-24 22:48:48 +02:00
whyrusleeping
aa2cad1a66 small usability tweak, fix lint 2020-08-24 22:48:47 +02:00
whyrusleeping
4f6dc0748d print out genesis block accounts 2020-08-24 22:48:11 +02:00
whyrusleeping
6b8191121c add lotus-shed command to verify some stuff about the genesis car 2020-08-24 22:48:11 +02:00
Łukasz Magiera
ecc3ff4a5c
Merge pull request #3254 from filecoin-project/fix/chainwatch/independent-processor-subtasks 
fix(chainwatch): Make processor failures independent of each other
 2020-08-24 22:45:02 +02:00
Łukasz Magiera
71a2dc06d7
Merge pull request #3259 from GFZRZK/master 
Bugfix: fix some typo and correct recoveries datasource
 2020-08-24 22:44:36 +02:00
Łukasz Magiera
6a7cb669ac
Merge pull request #3250 from filecoin-project/fix/miner-info-avail 
miner info: Fix avail calc, print aggregate deal info
 2020-08-24 18:10:07 +02:00
WC
119f6ff2e6
Bugfix: fix some typo and correct recoveries datasource 
Bugfix: fix some typo and correct recoveries data source
 2020-08-24 14:56:44 +08:00
Mike Greenberg
80f8f71a96 fix(lint): Cleanup unneeded error returns; go mod tidy 2020-08-23 16:51:12 -04:00
Mike Greenberg
7e0ba4aa32 fix(chainwatch): Reduce default max-batch to 50 2020-08-23 13:01:10 -04:00
Mike Greenberg
da8dbc8ffe fix(chainwatch): Make processor failures independent of each other 2020-08-23 01:59:15 -04:00
Łukasz Magiera
a236957538
Merge pull request #3232 from filecoin-project/asr/marked-for-upgrade 
Indicate whether a sector has been marked for upgrade
 2020-08-22 21:48:45 +02:00
Łukasz Magiera
12af420d7e mod tidy 2020-08-22 19:16:45 +02:00
Łukasz Magiera
88016c17e4 miner info: Fix avail calc, print aggregate deal info 2020-08-22 19:15:08 +02:00
Aayush Rajasekaran
984e52acbc Indicate whether a sector has been marked for upgrade 2020-08-21 15:53:39 -04:00
Steven Allen
5733c71c50 Lint everything 
We were ignoring quite a few error cases, and had one case where we weren't
actually updating state where we wanted to. Unfortunately, if the linter doesn't
pass, nobody has any reason to actually check lint failures in CI.

There are three remaining XXXs marked in the code for lint.
 2020-08-20 20:46:36 -07:00