Commit Graph

3135 Commits

Author SHA1 Message Date
Mikers
41fce94db4
perf: eth: gas estimate set applyTsMessages false (#10546)
* have gas estimate call callInternal with applyTsMessages = false and other calls with applyTsMessages=true for gas caclulation optimization

* set applyTsMessages = true in CallWithGas call in shed

* update test with new callwithgas api optimization for eth call

* Update chain/stmgr/call.go

Co-authored-by: Łukasz Magiera <magik6k@users.noreply.github.com>

* env flag LOTUS_SKIP_APPLY_TS_MESSAGE_CALL_WITH_GAS must be 1 in order to have applyTsMessages change

* env flag LOTUS_SKIP_APPLY_TS_MESSAGE_CALL_WITH_GAS must be 1 in order to have applyTsMessages change

* make sure that even if we arent apply ts messages we grab ts messages from the particular user who is requesting gas estimation

---------

Co-authored-by: Jiaying Wang <42981373+jennijuju@users.noreply.github.com>
Co-authored-by: Łukasz Magiera <magik6k@users.noreply.github.com>
Co-authored-by: Ubuntu <ubuntu@ip-10-0-4-29.us-east-2.compute.internal>
2023-03-23 18:27:01 -04:00
Aayush Rajasekaran
4efc29aa64
Merge pull request #10513 from filecoin-project/feat/shed-chainwatch
feat: shed: incoming block-sub chainwatch tool
2023-03-23 17:50:41 -04:00
Aayush
7b55de21bd fix: miner: call ExtendSectorExpiration2 2023-03-23 17:32:55 -04:00
Aayush
a467e1ab31 fix: miner: correctly count sector extensions 2023-03-23 17:32:51 -04:00
Aayush
3070227b00 fix: miner: call ExtendSectorExpiration2 2023-03-23 17:28:16 -04:00
Aayush
2d9412d97f fix: miner: correctly count sector extensions 2023-03-23 17:28:16 -04:00
Łukasz Magiera
b484d72c80
Merge pull request #10323 from mtelka/info-noadmin
fix: state: lotus-miner info should show deals info without admin permission
2023-03-23 12:39:28 +01:00
Łukasz Magiera
e2ff9027f9 shed chainwatch: Appease the linter 2023-03-23 12:33:00 +01:00
vyzo
8abe0ea608
Merge pull request #10452 from filecoin-project/vyzo/feat/chain/msgindex
feat:chain: Message Index
2023-03-22 17:02:34 +02:00
ZenGround0
43da108466
feat:config:force existing users to opt into new defaults (#10488)
* Config default does not comment out EnableSplitstore

* Loadability check

* Remove test used for debugging

* regexp for properly safe check that config is set

* regexp for safely matching the EnableSpitstore field in the config

* Add instructions for undeleting config and remind users to set splitstore false for full archive

* UpdateConfig small docs and functional opts

* make gen

* Lint

* Fix

* nil pointer check on validate

* Unit testing of EnableSplitstore cases

* Address Review

---------

Co-authored-by: zenground0 <ZenGround0@users.noreply.github.com>
2023-03-20 12:19:14 -04:00
Łukasz Magiera
02db37bf37 feat: shed: incoming block-sub chainwatch tool 2023-03-20 10:37:48 +01:00
vyzo
1676d51484 shed: expand homedir in repo path for msgindex tools 2023-03-16 17:17:26 +02:00
Łukasz Magiera
7e414ac390 Merge remote-tracking branch 'origin/master' into feat/go-data-transfer-v2 2023-03-15 11:37:53 +01:00
Steven Allen
dcb49dc8ee
refactor: update cache to the new generic version (#10463)
- Adds type safety.
- Reduces allocations.
- Fixes the drand cache (was storing by value, but retrieving by pointer)
2023-03-13 15:29:09 -07:00
vyzo
6deec4c5f4 lint 2023-03-13 17:26:20 +02:00
vyzo
06f93861bc make gen 2023-03-13 17:00:16 +02:00
vyzo
27dc4951eb lotus-shed tools for msgindex 2023-03-13 16:51:21 +02:00
vyzo
88d7a4e610 more lint 2023-03-12 16:13:05 +02:00
vyzo
1415391988 lint
lint

lint
2023-03-12 15:50:10 +02:00
vyzo
171734ea31 hook the index into the rest of lotus 2023-03-12 15:25:07 +02:00
Travis Person
f641139bf2
Merge pull request #10282 from filecoin-project/feat/cache-migrated-stateroot
feat: stmgr: cache migrated stateroots
2023-03-09 11:47:43 -08:00
Łukasz Magiera
3e85591c6c
Merge pull request #10390 from beck-8/chore/compute-wdpost-human-readable
chore: make debugging windowPoSt-failures human readable
2023-03-09 11:08:40 +01:00
Łukasz Magiera
d114d8fe7e deprecate MarketListRetrievalDeals, make gen 2023-03-08 17:15:16 +01:00
hannahhoward
16dad6342c
feat(deps): update to go-data-transfer v2, still wip 2023-03-07 11:44:29 -08:00
beck
f0ba0ebb64 indent output 2023-03-06 18:04:55 +08:00
beck
668b24fb23 make debugging windowPoSt-failures human readable 2023-03-04 15:00:44 +08:00
Phi
51b645f8d0 Hide lotus-worker set command
Hide the `lotus-worker set` command and print that this command will be deprecated.
2023-03-03 14:13:35 +01:00
Aayush
4e57626e42 feat: update renew-sectors with FIP-0045 logic 2023-03-02 16:38:05 -05:00
Steven Allen
dbbcf4b2ee
feat: vm: switch to the new exec trace format (#10372)
This is now "FVM" native. Changes include:

1. Don't treat "trace" messages like off-chain messages. E.g., don't
include CIDs, versions, etc.
2. Include IPLD codecs where applicable.
3. Remove fields that aren't filled by the FVM (timing, some errors,
code locations, etc.).
2023-03-01 16:02:18 -08:00
Aayush
19f1ad2762 Merge branch 'releases' into asr/merge-release-into-master 2023-03-01 14:18:35 -05:00
Travis Person
814c146626 feat: stmgr: cache migrated stateroots 2023-03-01 16:17:34 +00:00
Łukasz Magiera
9a2b83064b
Merge pull request #10364 from filecoin-project/chore/rm-market-info-lsm
chore: Remove legacy market info from lotus-miner info
2023-03-01 14:21:29 +01:00
Łukasz Magiera
807610131a
Merge pull request #10331 from filecoin-project/fix/deprecate-wait-quiet
fix: worker: Hide `wait-quiet` cmd
2023-02-28 14:18:54 +01:00
Phi
dd0c4a0a34 Tune down parallel reads
Tuning down the default post-parallel-reads to a conservative number.
2023-02-28 10:25:33 +01:00
Łukasz Magiera
9aba7dc17a chore: Remove legacy market info from lotus-miner info 2023-02-28 09:55:47 +01:00
Łukasz Magiera
aa7b5c40b8
Merge pull request #10319 from filecoin-project/fix/allinfo-test
fix: tests: Fix TestMinerAllInfo test
2023-02-23 14:16:40 +01:00
Phi
ab6aaf5013 Hide wait-quiet cmd
Hide `wait-quiet` cmd
2023-02-23 09:46:06 +01:00
Marcel Telka
7f33db90d8 lotus-miner info should show deals info without admin permission 2023-02-21 11:10:38 +01:00
Łukasz Magiera
51aecb6b17 fix: tests: Make TestWorkerKeyChange not flaky 2023-02-20 17:38:18 +01:00
Łukasz Magiera
d2c0603717 fix: tests: Fix TestMinerAllInfo test 2023-02-20 14:11:49 +01:00
Aayush Rajasekaran
1ec02c5c95
Merge pull request #10296 from filecoin-project/asr/migration-test
feat: shed: test the nv18 migration
2023-02-17 16:20:51 -05:00
Aayush
984b4c78cb Merge branch 'release/v1.20.0' into asr/merge-release-into-master 2023-02-17 16:08:22 -05:00
Jorropo
2d3065ae8e chore: all: bump go-libipfs to replace go-block-format
Includes changes from:
- https://github.com/ipfs/go-block-format/pull/37
- https://github.com/ipfs/go-libipfs/pull/58

(cherry picked from commit f572852d06)
2023-02-17 18:46:11 +01:00
Aayush
fab7ea6ca1 feat: shed: test the nv18 migration 2023-02-17 11:09:52 -05:00
Łukasz Magiera
8f1c23296e
Merge pull request #10169 from filecoin-project/feat/shed-read-sector
feat: shed: Add a tool to read data from sectors
2023-02-16 17:11:37 +01:00
Łukasz Magiera
12656b05fe feat: shed: Add a tool for removing sector data 2023-02-16 16:47:13 +01:00
Łukasz Magiera
285dfed338
Merge pull request #10202 from filecoin-project/feat/faster-sectors-list
sp cli: make sectors list much faster
2023-02-15 19:59:17 +01:00
Łukasz Magiera
6028d7ba18 sectors list: Explain http mode 2023-02-15 19:41:46 +01:00
Aayush
4f259d8644 Revert "Standardize path variable"
This reverts commit a9c1caa188.
2023-02-15 11:09:24 -05:00
Aayush
63b03a48d0 Merge branch 'release/v1.20.0' into asr/merge-release-into-master 2023-02-10 18:39:51 -05:00
Łukasz Magiera
7aa6663127
Merge pull request #10232 from filecoin-project/worker-all-task-flag2
fix: worker: add all tasks flag
2023-02-10 12:59:47 +01:00
Łukasz Magiera
83a7d6e297
Merge pull request #10134 from filecoin-project/gstuart/shed-path-fix
fix: shed: Standardize use of path flag
2023-02-09 18:04:04 +01:00
Łukasz Magiera
17adcb77c3 sp cli: correct order in parallel sectors list 2023-02-09 17:02:41 +01:00
Łukasz Magiera
81e056be1a sp cli: make sectors list much faster 2023-02-09 16:57:08 +01:00
Łukasz Magiera
25babace8f
Merge pull request #10208 from filecoin-project/fix/seal-delay-seconds
fix: cli: option to set-seal-delay in seconds
2023-02-09 16:51:20 +01:00
Phi
662fc37976 Option to set-seal-delay seconds
Add the option to set-seal-delay in seconds
2023-02-08 09:34:44 +01:00
Phi-rjan
21d6020179
Update cmd/lotus-worker/tasks.go
Co-authored-by: Łukasz Magiera <magik6k@users.noreply.github.com>
2023-02-07 16:47:30 +01:00
Phi-rjan
3fc1346d5b
Update cmd/lotus-worker/tasks.go
Co-authored-by: Łukasz Magiera <magik6k@users.noreply.github.com>
2023-02-07 16:47:23 +01:00
Phi-rjan
58c7c514c6
Update cmd/lotus-worker/tasks.go
Co-authored-by: Łukasz Magiera <magik6k@users.noreply.github.com>
2023-02-07 16:47:16 +01:00
Phi
cf0997b434 fix: worker: add all task type flag
Add all flag for the `lotus-worker tasks enable/disable` cmd
2023-02-07 16:12:31 +01:00
Aayush
f291572b4a Merge branch 'release/v1.20.0' into asr/merge-release-into-master 2023-02-03 09:27:04 -05:00
0x5459
e1c00bdbba cli: fix extend cmd to get the right sector number 2023-02-03 14:56:54 +08:00
Geoff Stuart
e200df4def
Merge pull request #10060 from filecoin-project/raulk/eth-check-tipsets-cmd
add a lotus-shed eth check-tipsets command.
2023-02-01 18:05:34 -05:00
Łukasz Magiera
0a35e9659b feat: shed: Add a tool to read data from sectors 2023-02-01 17:51:12 +01:00
Phi
b334b2055f fix: cli: add ArgsUsage
fix: cli: add ArgsUsage
2023-01-31 11:56:55 +01:00
Łukasz Magiera
1286d76988 gateway: eth_subscribe support 2023-01-31 10:28:12 +01:00
Łukasz Magiera
13fc5b688f
Merge pull request #10028 from filecoin-project/gstuart/cli-color-cleanup
chore: cli: Remove unneeded individual color flags
2023-01-31 09:23:16 +01:00
Geoff Stuart
a9c1caa188 Standardize path variable 2023-01-27 11:27:13 -05:00
Jorropo
f572852d06 chore: all: bump go-libipfs to replace go-block-format
Includes changes from:
- https://github.com/ipfs/go-block-format/pull/37
- https://github.com/ipfs/go-libipfs/pull/58
2023-01-26 17:03:18 +01:00
Łukasz Magiera
4682e8f326
Merge pull request #10105 from filecoin-project/addr-encode
chore:shed:encode address to bytes
2023-01-24 10:34:47 +01:00
zenground0
f03c7a8880 encode address into byte 2023-01-24 20:18:04 +13:00
Aayush
65ac5669a9 Merge branch 'master' into asr/merge-release-into-master 2023-01-23 12:37:24 -05:00
Geoff Stuart
807a60b4e4 Remove unneeded individual color flags 2023-01-23 11:11:12 -05:00
Travis Person
91a6eabab5
Merge pull request #9982 from filecoin-project/feat/obj-stats
feat: add toolshed commands to inspect statetree size
2023-01-19 08:37:32 -08:00
Raúl Kripalani
5541694922 fix lint. 2023-01-19 14:14:37 +00:00
Raúl Kripalani
4dee0ba7fb add a lotus-shed eth check-tipsets command.
This checks Eth API consistency by walking the chain backwards
from HEAD and verifying that all data returned from eth_getBlockByNumber
is consistent with eth_getBlockByHash.
2023-01-19 14:01:39 +00:00
Travis Person
a0c58b5582 feat: add toolshed commands to inspect statetree size 2023-01-19 00:48:22 +00:00
Geoff Stuart
70db738bff
Merge pull request #10037 from filecoin-project/feat/lotus-shed-beneficiary-cli
feat: shed: Add beneficiary commands
2023-01-18 18:04:22 -05:00
zenground0
72baa3d916 cid -> bytes command 2023-01-17 12:19:04 -07:00
zenground0
14d921f64f Err handle 2023-01-17 09:56:17 -07:00
Phi
51d2a883f0 Beneficiary cmd in lotus-shed
Add `ProposeChangeBeneficiary` and `ConfirmChangeBeneficiary` to lotus-shed
2023-01-17 12:39:55 +01:00
zenground0
7383a761f6 Fix 2023-01-16 17:54:38 -07:00
zenground0
39ae4b04be Add cid to cbor cmd 2023-01-16 17:50:47 -07:00
Aayush
e715384173 Merge branch 'release/v1.20.0' into asr/merge-release-into-master 2023-01-16 10:51:22 -05:00
Łukasz Magiera
67023886c8
Merge pull request #9920 from filecoin-project/gstuart/extend-or-renew
feat: cli: Refactor renew and remove extend
2023-01-16 16:31:11 +01:00
Richard Guan
fc82aab74b add bool flag and gen documentation 2023-01-16 16:14:19 +11:00
raulk
cdf3812e40
NV18: Filecoin EVM runtime + Actor Events + EthAccount + EAM + f4 addressing (#9998)
Co-authored-by: Steven Allen <steven@stebalien.com>
Co-authored-by: Raul Kripalani <raulk@users.noreply.github.com>
Co-authored-by: Kevin Li <ychiaoli18@users.noreply.github.com>
Co-authored-by: vyzo <vyzo@hackzen.org>
Co-authored-by: Ian Davis <nospam@iandavis.com>
Co-authored-by: Aayush Rajasekaran <arajasek94@gmail.com>
Co-authored-by: Jiaying Wang <42981373+jennijuju@users.noreply.github.com>
Co-authored-by: Jennifer Wang <jiayingw703@gmail.com>
Co-authored-by: Geoff Stuart <geoff.vball@gmail.com>
Co-authored-by: Shrenuj Bansal <shrenuj.bansal@protocol.ai>
Co-authored-by: Shrenuj Bansal <108157875+shrenujbansal@users.noreply.github.com>
Co-authored-by: Geoff Stuart <geoffrey.stuart@protocol.ai>
Co-authored-by: Aayush Rajasekaran <aayushrajasekaran@Aayushs-MacBook-Pro.local>
Co-authored-by: ZenGround0 <5515260+ZenGround0@users.noreply.github.com>
Co-authored-by: zenground0 <ZenGround0@users.noreply.github.com>
2023-01-13 19:11:13 +00:00
Geoff Stuart
0ebdbed30b Refactor renew and remove extend 2023-01-11 14:44:08 -05:00
Łukasz Magiera
9a46682d9d
Merge pull request #9481 from consensus-shipyard/adlrocha/cns-iface-master
IPC: Abstract common consensus functions and consensus interface
2023-01-11 14:49:27 +01:00
Phi
f8195deb54 fix: cli: remove requirements
Remove the requirements from the `lotus-worker run` cli
2023-01-06 12:43:12 +01:00
Peter Rabbitson
3de006364e This stat-set does not belong in core lotus 2023-01-04 16:02:25 +01:00
Łukasz Magiera
273184b084
Merge pull request #9941 from beck-8/feat/add_renew_max_sectors
add renew max-sectors flag
2023-01-04 14:45:30 +01:00
beck
4f9119f211 add check GetAddressedSectorsMax 2023-01-04 19:39:40 +08:00
Phi
c6f69946be fix: bench: remove unused env
fix: bench: remove unused environment variable.
2023-01-02 09:07:45 +01:00
beck
0f9d198dbd add renew max-sectors flag 2022-12-25 21:05:44 +08:00
Geoff Stuart
d615b1c806 Update go-state-types 2022-12-14 19:33:47 -05:00
Geoff Stuart
ae4010ffb6 Drop actor keys from chain/actors/manifest.go 2022-12-13 18:02:34 -05:00
Shrenuj Bansal
466f0c583f cli: Add lotus-shed cli for computing frc42 method num 2022-12-12 11:45:44 -05:00
Łukasz Magiera
c46bf475f7 fix: miner info: Output correct StartTime 2022-12-09 10:23:49 +01:00
Alfonso de la Rocha
25edb23c3f
minor fix after rebase 2022-12-05 18:22:10 +01:00
Alfonso de la Rocha
075216d9da Merge remote-tracking branch 'upstream/master' into adlrocha/cns-iface-master 2022-12-05 18:16:14 +01:00
Łukasz Magiera
cdf169ed83 fix: chain: Fix flaky TestChainExportImport 2022-12-02 22:13:12 +01:00
Łukasz Magiera
6abf7384e2
Merge pull request #9741 from filecoin-project/feat/faster-snapshot-import
feat: chain: Faster snapshot imports, zstd import
2022-11-29 18:17:36 +01:00
Ian Davis
dfbf4d0f43 Bump http-server-timeout default to 30s 2022-11-29 14:38:44 +00:00
Ian Davis
0a4efd4820 Merge branch 'main' into id/update-go-version 2022-11-29 14:29:11 +00:00
Łukasz Magiera
ac8ab3ef9e feat: chain: Faster snapshot imports, zstd imports 2022-11-29 14:10:15 +01:00
Geoff Stuart
949aa26f52 Make gen 2022-11-28 13:05:44 -05:00
Geoff Stuart
68c9db0c82 small fix 2022-11-28 11:03:30 -05:00
Geoff Stuart
1f70ced8e5 Make http server timeouts configurable for cli commands 2022-11-25 17:32:42 -05:00
Geoff Stuart
f04aca767f Maybe rest of linter errors 2022-11-25 16:41:04 -05:00
Geoff Stuart
d2b7c3889b Add more timeouts 2022-11-25 16:24:09 -05:00
Geoff Stuart
b55e121642 Fix some more linter errors 2022-11-25 16:19:20 -05:00
Ian Davis
e4fe47d598 Add in two missing error checks 2022-11-25 11:43:26 +00:00
Ian Davis
9f85d3dca7 Address simple linter issues 2022-11-24 16:32:27 +00:00
Łukasz Magiera
ea9a8303c8 sealing: tasks: TTReleaseUnsealed -> TTFinalizeUnsealed 2022-11-23 18:57:17 +01:00
Łukasz Magiera
87e5549af5 sealing: Split unsealed cleanup from Finalize 2022-11-23 18:57:16 +01:00
Aloxaf
729952eb88 fix: cli: show task counts correctly 2022-11-23 15:26:53 +08:00
Geoff Stuart
70dc920f8c
Merge pull request #9703 from filecoin-project/asr/fix-panic
fix: cli: check found before dereferencing SectorInfo
2022-11-22 12:54:52 -05:00
Aayush
610a3eee5d fix: cli: correctly return error panic-less-ly 2022-11-22 12:10:12 -05:00
Aayush
b472de1bcd fix: cli: check found before dereferencing SectorInfo 2022-11-22 12:06:45 -05:00
Aayush Rajasekaran
6067968c07
Merge pull request #9654 from filecoin-project/gstuart/gas-estimation-tooling
feat: cli: gas estimation tooling
2022-11-22 09:55:19 -05:00
Alfonso de la Rocha
0b9b89bf2b
minor fix 2022-11-22 10:59:43 +01:00
Alfonso de la Rocha
0f92bced9d
Merge branch 'master' into adlrocha/cns-iface-master 2022-11-22 10:28:18 +01:00
Geoff Stuart
96035005b8 Fold together call functions 2022-11-18 00:10:12 -05:00
Steven Allen
ba2e665fc2
fix: tvx: missing parentheses (#9649)
https://github.com/filecoin-project/ref-fvm/issues/944#issuecomment-1315245773
2022-11-16 17:19:45 -05:00
Geoff Stuart
21afb3f5ea Review fixes 2022-11-16 15:07:23 -05:00
Geoff Stuart
62fedfbce3 Make pre-migration optional 2022-11-15 23:12:04 -05:00
Geoff Stuart
cde4b804e3 gas estimation shed command 2022-11-15 21:39:56 -05:00
Łukasz Magiera
fd593186fa
Merge pull request #9643 from filecoin-project/gstuart/proving-check-fix
fix: miner-cli: Fix lotus-miner proving check
2022-11-14 22:53:50 +01:00
Geoff Stuart
95af40543a Fix lotus-miner proving check 2022-11-14 15:29:50 -05:00
Łukasz Magiera
c79085e5b7
Merge pull request #9598 from filecoin-project/fix/ancient-snap-deals-terrible
fix:sealing-fsm:wait mutable fsm state for immutable sector upgrade error
2022-11-14 19:53:37 +01:00
Geoff Stuart
3e96a0630c Add beneficiary to actor control list 2022-11-11 22:02:38 -05:00
Aayush Rajasekaran
9c5f3854ab
Merge pull request #9604 from filecoin-project/steb/fix-tvx-fvm
fix: tvx: make it work with the FVM
2022-11-08 14:28:18 +00:00
Łukasz Magiera
ec89424c42 make repo not depend on ffi 2022-11-08 09:37:43 +00:00
Łukasz Magiera
e66d5a0537 cli: Move EpochTime to cliutil 2022-11-08 09:37:43 +00:00
Aayush
14ef069ea1 tvx: fixup VM creation 2022-11-07 17:24:15 -05:00
Aayush
ed83595e33 tvx: stores: implement View() 2022-11-07 16:38:50 -05:00
Aayush
be5adc7622 Merge branch 'master' into asr/merge-release-into-master 2022-11-07 15:35:10 -05:00
Aayush Rajasekaran
abfabd267d
Merge pull request #9572 from filecoin-project/asr/change-control
shed: set control address: add dump bytes option
2022-11-07 15:30:03 +00:00
zenground0
6dee0d8ca8 Rough draft no tests 2022-11-07 14:56:53 +00:00
Aayush
c0b7343e60 Merge branch 'release/v1.18.0' into asr/merge-release-into-master 2022-11-06 14:40:13 -05:00
Łukasz Magiera
a0e3111b64 feat: shed: Online export-car 2022-11-04 11:48:24 +00:00
Aayush Rajasekaran
db86c7d121 shed: set control address: add dump bytes option 2022-10-31 13:14:20 +00:00
Geoff Stuart
0d056b5edf make gen 2022-10-31 11:39:37 +00:00
Geoff Stuart
5d465056ce Migration cli takes a stateroot cid and a height 2022-10-27 12:37:31 +01:00
Geoff Stuart
10b9d3fa96 add lotus-shed invariance method 2022-10-27 12:24:24 +01:00
Aayush Rajasekaran
65f89ff128 Invariant checks: Only include not-activated deals 2022-10-24 13:47:47 -04:00
Aayush Rajasekaran
394c3b6deb fix invariant check: number of entries in datacap actor should include verifreg 2022-10-24 13:44:55 -04:00
Aayush Rajasekaran
04f32ba119 Add invariant checks to migration 2022-10-24 13:44:50 -04:00
Aayush
7609655986 address review 2022-10-20 13:49:29 -04:00