Commit Graph

1348 Commits

Author SHA1 Message Date
frrist
fb8340acb2 polish(chainwatch): clean up logging 2020-08-27 11:47:53 -07:00
Łukasz Magiera
df635579c4 storagefsm: Handle sectors with expired deals better 2020-08-27 13:51:38 +02:00
Łukasz Magiera
788c7dbf48 storagefsm: Separate satte for submitting commit message 2020-08-27 12:57:28 +02:00
Łukasz Magiera
51ca460f18 miner: Fix sorting of some sector states in miner-info 2020-08-27 12:41:12 +02:00
Łukasz Magiera
e236173417 miner: Print (pre)commit message cids in sector status 2020-08-27 12:40:19 +02:00
Raúl Kripalani
cb8e105a94 reduce diff noise. 2020-08-26 16:44:06 +01:00
Raúl Kripalani
efdfd3ee3e Merge branch 'master' into inmem-journal 2020-08-26 16:38:23 +01:00
Raúl Kripalani
4e1ef09751 make journal a global var. 2020-08-26 16:09:37 +01:00
Whyrusleeping
0009f7c8dc
Merge pull request #3300 from filecoin-project/fix/set-peer-id
fix parsing of peerID in input to set-peer-id
2020-08-25 17:26:05 -07:00
Whyrusleeping
cd2e794d3f
Merge pull request #3299 from filecoin-project/steb/update-deps
update deps for bug fixes
2020-08-25 17:18:02 -07:00
whyrusleeping
9bb862d025 fix parsing of peerID in input to set-peer-id 2020-08-25 17:10:06 -07:00
Steven Allen
7fb4851eb9 update deps for bug fixes
* updates bitswap to include _many_ perf enhancements and bug fixes.
* updates go-fs-lock because the version here is pretty old.
* updates go-libp2p
* updates bbloom _just_ in case, because the version we were depending on had bugs (looks like we're not actually using it).
2020-08-25 17:06:07 -07:00
frrist
0d61e0d717 refactor(ctx): update to latest go-jsonrpc 2020-08-25 15:20:41 -07:00
Steven Allen
f84bbd4520 Fix more lint warnings.
This way we can keep CI green.
2020-08-25 12:56:30 -07:00
Travis Person
fb033a3719 lotus-fountain: remove make miner workflow 2020-08-25 05:10:12 +00:00
whyrusleeping
90337995ff print out genesis cid 2020-08-24 22:48:48 +02:00
whyrusleeping
aa2cad1a66 small usability tweak, fix lint 2020-08-24 22:48:47 +02:00
whyrusleeping
4f6dc0748d print out genesis block accounts 2020-08-24 22:48:11 +02:00
whyrusleeping
6b8191121c add lotus-shed command to verify some stuff about the genesis car 2020-08-24 22:48:11 +02:00
Łukasz Magiera
ecc3ff4a5c
Merge pull request #3254 from filecoin-project/fix/chainwatch/independent-processor-subtasks
fix(chainwatch): Make processor failures independent of each other
2020-08-24 22:45:02 +02:00
Łukasz Magiera
71a2dc06d7
Merge pull request #3259 from GFZRZK/master
Bugfix: fix some typo and correct recoveries datasource
2020-08-24 22:44:36 +02:00
Łukasz Magiera
6a7cb669ac
Merge pull request #3250 from filecoin-project/fix/miner-info-avail
miner info: Fix avail calc, print aggregate deal info
2020-08-24 18:10:07 +02:00
WC
119f6ff2e6
Bugfix: fix some typo and correct recoveries datasource
Bugfix: fix some typo and correct recoveries data source
2020-08-24 14:56:44 +08:00
Mike Greenberg
80f8f71a96 fix(lint): Cleanup unneeded error returns; go mod tidy 2020-08-23 16:51:12 -04:00
Mike Greenberg
7e0ba4aa32 fix(chainwatch): Reduce default max-batch to 50 2020-08-23 13:01:10 -04:00
Mike Greenberg
da8dbc8ffe fix(chainwatch): Make processor failures independent of each other 2020-08-23 01:59:15 -04:00
Łukasz Magiera
a236957538
Merge pull request #3232 from filecoin-project/asr/marked-for-upgrade
Indicate whether a sector has been marked for upgrade
2020-08-22 21:48:45 +02:00
Łukasz Magiera
12af420d7e mod tidy 2020-08-22 19:16:45 +02:00
Łukasz Magiera
88016c17e4 miner info: Fix avail calc, print aggregate deal info 2020-08-22 19:15:08 +02:00
Aayush Rajasekaran
984e52acbc Indicate whether a sector has been marked for upgrade 2020-08-21 15:53:39 -04:00
Steven Allen
5733c71c50 Lint everything
We were ignoring quite a few error cases, and had one case where we weren't
actually updating state where we wanted to. Unfortunately, if the linter doesn't
pass, nobody has any reason to actually check lint failures in CI.

There are three remaining XXXs marked in the code for lint.
2020-08-20 20:46:36 -07:00
Whyrusleeping
af3fe206d6
Merge pull request #3122 from filecoin-project/feat/cmd-improvements
sorted deal listings
2020-08-20 13:29:01 -07:00
Aayush Rajasekaran
93e566d7e0 Change docs.lotu.sh links to lotu.sh 2020-08-20 12:45:41 -04:00
Łukasz Magiera
364e3229b9
Merge pull request #3178 from filecoin-project/feat/miner-init-from-flag
add a from flag for miner init
2020-08-20 17:09:03 +02:00
Łukasz Magiera
0acc461cb1
Merge pull request #3185 from filecoin-project/fix/chainwatch/fix-nil-smoothing-estimate
fix(chainwatch): Handle RewardState.EpochSmoothingEstimate == nil
2020-08-20 11:20:58 +02:00
Łukasz Magiera
cd82f79d35
Merge pull request #3191 from filecoin-project/feat/miner-data-transfers
Add data transfer list command to miner
2020-08-20 11:18:56 +02:00
hannahhoward
0086f76a90 feat(lotus-miner): add data transfer list cmd
add equivalent command to list data transfers on miner side, extract common functionality for reuse
2020-08-20 01:35:48 -07:00
Travis Person
3eeec8d438 lotus-pcr: fix refund math 2020-08-20 08:28:53 +00:00
Mike Greenberg
bf10de82df fix(chainwatch): Handle RewardState.EpochSmoothingEstimate == nil 2020-08-20 01:55:17 -04:00
whyrusleeping
2675ffb128 add a from flag for miner init 2020-08-19 17:34:58 -07:00
Łukasz Magiera
885f357c59
Merge pull request #3175 from filecoin-project/feat/control-addersses-control
Wire up miner control addresses, use for PoSt
2020-08-20 02:24:33 +02:00
Łukasz Magiera
de41f63fa4 miner info: Also print locked pledge 2020-08-20 02:03:42 +02:00
Łukasz Magiera
a4807b18bc gofmt, api docstring 2020-08-20 01:26:13 +02:00
Łukasz Magiera
5ea61abfe1 Wire up miner control addresses, use for post 2020-08-20 01:17:03 +02:00
Łukasz Magiera
f943ea7d5d
Merge pull request #3170 from filecoin-project/frrist/chainwatch-SectorOnChainInfo-ext
refactor(cw): add new values to sector_info table and smoothing estimate
2020-08-19 23:58:22 +02:00
Łukasz Magiera
ed098390cb
Merge pull request #3172 from filecoin-project/feat/lotus-shed-jwt
lotus-shed: add simple jwt creation support
2020-08-19 23:32:01 +02:00
frrist
05f1a23c94 feat(chainwatch): power actor smoothing estimate 2020-08-19 13:34:58 -07:00
frrist
fecaeda382 feat(chainwatch): reward actor smoothing estimate 2020-08-19 13:05:07 -07:00
frrist
3df85ca784 refactor(chainwatch): add new values to sector_info table 2020-08-19 13:05:07 -07:00
whyrusleeping
2ab202a03d fixup ID allocation and a few other things 2020-08-19 12:54:33 -07:00
Travis Person
f1632376e7 lotus-shed: add simple jwt creation support 2020-08-19 19:21:36 +00:00
Łukasz Magiera
e47e51275a
Merge pull request #3138 from filecoin-project/feat/remainder
place the remainder of unallocated funds in a 'remainder' account
2020-08-18 23:52:19 +02:00
whyrusleeping
916bebadef setup proper template defaults 2020-08-18 14:34:35 -07:00
Łukasz Magiera
19be380b53
Merge pull request #3152 from filecoin-project/fix/chainwatch/rpc-peer-id-bug
fix(api): Filter malformed peer ID before RPC marshaling
2020-08-18 23:07:55 +02:00
Mike Greenberg
8675ca561d fix(api): Filter malformed peer ID before RPC marshaling 2020-08-18 16:29:21 -04:00
Łukasz Magiera
3fd4921ea3
Merge pull request #3147 from filecoin-project/feat/fsm-seal-limits
fsm: Config for limiting max sealing sectors
2020-08-18 21:54:41 +02:00
Łukasz Magiera
d1cb60bdee
Merge pull request #3118 from filecoin-project/feat/improve-pcr
lotus-pcr: refund provecommit sectors
2020-08-18 21:18:45 +02:00
Łukasz Magiera
2570712a29
Merge pull request #3135 from filecoin-project/feat/genesis-block-linkage
proper genesis block history
2020-08-18 19:28:55 +02:00
Łukasz Magiera
e7d65be90a gofmt 2020-08-18 18:27:28 +02:00
Mike Greenberg
fabf26cc21 fix(chainwatch): Actually capture human actor names 2020-08-18 00:22:01 -04:00
Mike Greenberg
94e4f8d116 fix(chainwatch): Ignore blocks missing from local blockstore during processing 2020-08-18 00:22:01 -04:00
Mike Greenberg
6734287789 fix(chainwatch): Change tmp table names to not collide 2020-08-18 00:22:01 -04:00
whyrusleeping
13e5b72cdb proper genesis block history
Commit hash originally stamped into the ethereum blockchain:
https://etherscan.io/tx/0xe8f51c9eefb682cd866f059462577b6dd3d2685ff4b6437f6c940ff4f4aaf067
2020-08-17 21:13:43 -07:00
Aayush Rajasekaran
4ef5a58b36 strip peerid when setting on-chain addrs 2020-08-17 21:18:26 -04:00
Aayush Rajasekaran
01b5118a08 Add a CLI method to set peerid 2020-08-17 20:53:02 -04:00
whyrusleeping
ef8b9eae93 add lotus keygen utility 2020-08-17 17:29:26 -07:00
whyrusleeping
f05cff478f sorted deal listings 2020-08-17 14:48:49 -07:00
Travis Person
5040623a12 lotus-pcr: refund provecommit sectors 2020-08-17 21:29:59 +00:00
Łukasz Magiera
2e78ed685f
Merge pull request #3113 from filecoin-project/fix/chainwatch/calibration-improvements
Chainwatch Improvements
2020-08-17 19:06:05 +02:00
Łukasz Magiera
29db7047a3
Merge pull request #3112 from filecoin-project/fix/sched-hang
Fix sealing sched hands on unclean worker disconnect
2020-08-17 18:43:25 +02:00
Łukasz Magiera
6ef7a30b19
Merge pull request #3089 from filecoin-project/integrate/storage-fsm
integrate extern/{storage-fsm,sector-storage} into lotus source tree
2020-08-17 18:37:54 +02:00
Mike Greenberg
80fef50b90 feat(chainwatch): Include detailed economic data per epoch 2020-08-17 12:22:34 -04:00
Łukasz Magiera
f31473c4cf Update jsonrpc to fix sealing sched hangs 2020-08-17 17:36:21 +02:00
Łukasz Magiera
09dbd12638
Merge pull request #3107 from yaohcn/feat/addpiece-configurable
make addpiece configurable
2020-08-17 17:35:09 +02:00
Mike Greenberg
b37a39588e feat(chainwatch): Add full version to help/startup log via build param 2020-08-17 11:31:59 -04:00
Mike Greenberg
0b498d25f6 fix(chainwatch): Actor code are human readable 2020-08-17 11:18:35 -04:00
Raúl Kripalani
862bafc63a fix lint errors. 2020-08-17 14:39:33 +01:00
Raúl Kripalani
efdc428d5d keep storage-fsm (renamed to storage-sealing) and sector-storage in extern. 2020-08-17 14:26:18 +01:00
Łukasz Magiera
7595b1d8d4 cli: pprof goroutines command 2020-08-17 11:49:11 +02:00
yaohcn
39bcfab37c make addpiece configurable 2020-08-17 17:39:50 +08:00
yaohcn
aded4b4199 add missing restart flag 2020-08-17 16:04:50 +08:00
Łukasz Magiera
c5c819afca
Merge pull request #3098 from filecoin-project/feat/config-cmd
Add config command that prints the default config file for a storage …
2020-08-17 08:36:51 +02:00
lanzafame
0d3aaabd2c Add config command that prints the default config file for a storage miner 2020-08-17 13:51:04 +10:00
Raúl Kripalani
3c17cd655e integrate extern/sector-storage into lotus proper. 2020-08-16 11:09:58 +01:00
Raúl Kripalani
fb0ccc9260 integrate extern/storage-fsm into lotus proper. 2020-08-16 10:42:13 +01:00
vyzo
7f27c80a6a move sleep into the select
as it is it simply slows down the writer if there are many messages
2020-08-15 21:20:02 +03:00
whyrusleeping
8774a7b2dd add a market balance command, and a verbose mode for storage-deals list 2020-08-14 16:45:40 -07:00
Łukasz Magiera
45476a208e
Merge pull request #3053 from filecoin-project/feat/worker-addpiece2
Support AddPiece on workers
2020-08-14 23:50:17 +02:00
Aayush Rajasekaran
0359a458e4 Include more info in StateCirculatingSupply 2020-08-14 16:53:30 -04:00
Łukasz Magiera
0c75dd3865 Support AddPiece on workers 2020-08-14 16:06:53 +02:00
Łukasz Magiera
75eaa1bf5b Merge remote-tracking branch 'origin/next' into feat/fix-rename-miner-withdraw 2020-08-14 13:40:12 +02:00
frrist
50d4c2e0ac fix: error checking for actor not found 2020-08-13 14:10:05 -07:00
frrist
55f88b46cf fix: best attempt at fixing the id_address_map 2020-08-13 11:14:58 -07:00
Łukasz Magiera
7fc15b70ec
Merge pull request #3025 from filecoin-project/feat/retdeals-in-allinfo
miner: Add retrieval deal list to miner allinfo
2020-08-13 15:58:12 +02:00
Łukasz Magiera
a366522c8d Fix lotus-fountain build 2020-08-13 14:04:45 +02:00
Łukasz Magiera
9a39bb4e78 api: Remove unused StatePledgeCollateral 2020-08-13 14:03:59 +02:00
Łukasz Magiera
3b23ab952b gofmt 2020-08-13 13:44:43 +02:00
Łukasz Magiera
069c39fc12 Add reachability info to miner info all 2020-08-13 13:44:03 +02:00
Łukasz Magiera
066bac0607 miner: Add retrieval deal list to miner allinfo 2020-08-13 10:51:13 +02:00
Łukasz Magiera
02650c7f25 miner: drop rewardsCmd from miner cmd list 2020-08-13 10:25:21 +02:00
Łukasz Magiera
936d861df5 gofmt 2020-08-13 10:20:41 +02:00
Łukasz Magiera
f0d32f2c01 miner: fix/rename miner actor withdraw 2020-08-13 10:20:09 +02:00
frrist
69a472c4ea bug: fix id_address_map table conflicts on reorg 2020-08-12 16:54:45 -07:00
Łukasz Magiera
e7e068ebb5
Merge pull request #3008 from filecoin-project/fix/lints
Fix lint errors an broken tests
2020-08-12 23:28:01 +02:00
Łukasz Magiera
5561d66082
Merge pull request #3002 from keyko-io/feat/verified-price
Showing verified price in asks
2020-08-12 23:26:53 +02:00
Steven Allen
3ef3f570fb Fix lint errors an broken tests 2020-08-12 23:16:44 +02:00
Łukasz Magiera
12f7e2d9bf Use a struct for send metadata in MpoolPushMessage 2020-08-12 22:17:29 +02:00
Łukasz Magiera
e1a1b325bc Merge remote-tracking branch 'origin/next' into feat/max-msg-fee-config 2020-08-12 21:55:03 +02:00
Łukasz Magiera
6fe743f3a9 Fix tests 2020-08-12 20:03:07 +02:00
Steven Allen
e18904bff5 [WIP] fix post submission 2020-08-12 10:33:18 -07:00
Steven Allen
9135a5d048 Pass bitfields by-value
This ensures we can't end up decoding nil bitfields from clients when not
expecting them.

Part of https://github.com/filecoin-project/specs-actors/issues/895. Please see
this issue for details and leave any comments there.
2020-08-12 10:32:39 -07:00
Łukasz Magiera
d0147aa50f Add maxFee param to MpoolPushMessage 2020-08-12 19:06:16 +02:00
Sami Mäkelä
b252715f53 bad merge 2020-08-12 17:40:29 +03:00
Sami Mäkelä
8367e79279 now working 2020-08-12 17:36:07 +03:00
Sami Mäkelä
5169785c91 merge 2020-08-12 14:15:03 +03:00
Sami Mäkelä
ac6e716ebd merge 2020-08-12 14:12:33 +03:00
Jakub Sztandera
b309e80e41
Wire in Ticket Quality to MpoolSelect
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-08-11 16:14:27 +02:00
Raúl Kripalani
2ea5abdfb5 wire journal into miner. 2020-08-11 13:48:32 +01:00
Raúl Kripalani
bca516b028 Merge remote-tracking branch 'origin/next' into inmem-journal 2020-08-11 12:42:39 +01:00
Raúl Kripalani
92598237c3 Merge branch 'next' into inmem-journal 2020-08-11 12:41:11 +01:00
Łukasz Magiera
f25611d768
Merge pull request #2974 from filecoin-project/asr/spelling
fix spelling
2020-08-11 10:17:26 +02:00
yaohcn
6b0f607f4b add space check in StorageFindSector 2020-08-11 15:27:03 +08:00
Aayush Rajasekaran
5e54219be9 fix spelling 2020-08-11 01:10:12 -04:00
Mike Greenberg
b2b7f14432 feat(chainwatch): capture circulating fil per tipset metric 2020-08-07 19:39:52 -04:00
Łukasz Magiera
f7273bc4ee
Merge pull request #2904 from filecoin-project/fix/lotus-pcr-bigint
lotus-pcr: initialize bigint; send refund to worker
2020-08-07 21:54:59 +02:00
Travis Person
cdc6086308 lotus-pcr: initialize bigint; send refund to worker 2020-08-07 19:25:53 +00:00
Mike Greenberg
4ed968b79c feat(chainwatch): track message size in bytes 2020-08-07 14:25:35 -04:00
Łukasz Magiera
9898b4504f
Merge pull request #2889 from filecoin-project/feat/lotus-pcr
add lotus-pcr command tool
2020-08-07 19:39:31 +02:00
Travis Person
f5f11af73f lotus-pcr: ignore all actors except miners 2020-08-07 17:20:18 +00:00
Travis Person
2f9cef38a1 add lotus-pcr command tool
Lotus PCR will attempt to reimbursement the initial pledge collateral
of the PreCommitSector miner actor method for all miners on the network.
2020-08-07 16:56:30 +00:00
Łukasz Magiera
a939c30256 chainwatch: Record parent_base_fee in blocks 2020-08-07 18:38:19 +02:00
Mike Greenberg
79b701d347 fix(chainwatch): gas columns are snake_cased; fix SQL bugs 2020-08-06 18:28:54 -04:00
Łukasz Magiera
07bf155295 Merge remote-tracking branch 'origin/next' into feat/dyn-base-fee 2020-08-06 23:41:54 +02:00
Jakub Sztandera
ab08858b45
Delete GasPrice from this world
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-08-06 23:08:42 +02:00
Łukasz Magiera
4f509d9b67
Merge pull request #2813 from filecoin-project/feat/unseal-on-workers
workers: Enable unseal support
2020-08-06 22:03:43 +02:00
Łukasz Magiera
e54a87f91b
Merge pull request #2838 from filecoin-project/feat/message-pool-selection
New message pool selection logic
2020-08-06 20:19:35 +02:00
Łukasz Magiera
711b626a8b
Merge pull request #2852 from filecoin-project/jeff
Jeff
2020-08-06 13:01:14 +02:00
vyzo
6f660f7915 repair references to defunct miner.SelectMessages 2020-08-06 10:46:48 +03:00
Łukasz Magiera
f8b8ecc0c3 Consensus filter 2020-08-06 03:16:39 +02:00
Travis Person
ca53bf9097
lotus-worker: change address flag to listen (#2848)
* lotus-worker: change address flag to listen

Clarify the flag on the worker process to be the local address and port
the worker will listen on, and not the address of the miner.

* fixup! lotus-worker: change address flag to listen

Co-authored-by: Travis Person <travisperson@users.noreply.github.com>
2020-08-06 02:54:00 +02:00
Łukasz Magiera
ca4e4fa964
Merge pull request #2814 from filecoin-project/feat/secstor-fetch-reserve
Update sector-storage with fetch storage reservation
2020-08-05 23:37:30 +02:00
Łukasz Magiera
0073f10b62
Merge pull request #2821 from filecoin-project/feat/miner-allinfo
miner: Command to dump all miner info
2020-08-05 20:33:27 +02:00
Łukasz Magiera
2b7732bc2f Update sector-storage with fetch storage reservation 2020-08-05 20:32:28 +02:00
Ingar Shu
80546d0451 Add "retrieval-deals list" miner CLI 2020-08-05 17:27:15 +02:00
Ingar Shu
9e07b310d1 WIP 2020-08-05 17:27:08 +02:00
Łukasz Magiera
a7acc81490 miner: Command to dump all miner info 2020-08-04 20:57:48 +02:00
Łukasz Magiera
1feec642da
Merge pull request #2815 from filecoin-project/fix/storage-deals-prop-cid
Fix proposal CID in `lotus-miner storage-deals list`
2020-08-04 17:41:51 +02:00
hannahhoward
1b38791d94 fix(lotus-miner): output correct proposal CID
update storage-deals list command to output the correct proposal CID. previously we were taking the
CID without the client signature, which will not be the same CID
2020-08-04 08:22:47 -07:00
Łukasz Magiera
d8d6f9cb51
Merge pull request #2792 from filecoin-project/feat/sector-deals
feat(chainwatch) define relation from dealIDs to sectorID
2020-08-04 14:49:02 +02:00
Łukasz Magiera
de18d5521e workers: Enable unseal support 2020-08-04 14:32:09 +02:00