cerc-io/lotus
16
0
Fork 0
Code Issues Pull Requests Packages Projects Releases 27 Wiki Activity
20,722 Commits 24 Branches 342 Tags 314 MiB
entrypoint_update
Commit Graph

3385 Commits

Author SHA1 Message Date
Mikers
4f0e2f3276 Added CPU profiling option to lotus-shed 
This commit includes the following updates:

- Added a new 'pprof' flag to the command-line arguments in main.go. This flag allows the user to specify a file name for writing CPU profile information, enabling performance analysis.

- Implemented functionality to start CPU profiling in the 'Before' function. If a file name is provided via the 'pprof' flag, the function creates the specified file and begins CPU profiling.

- Added an 'After' function to stop CPU profiling once the program execution is finished.

These changes provide a way to analyze the CPU usage of the 'lotus-shed' application, which can be valuable for performance tuning and optimization.
 2023-08-02 01:20:06 +00:00
Mikers
1eca520076 Added support for Filecoin network version 21 (v12 state types) 
This commit includes the following updates:

- Imported v12 of the filecoin state types in migrations.go. This allows the system to interpret and operate on the latest structure of filecoin state information, ensuring compatibility with the latest version of the Filecoin network.

- Updated the 'getMigrationFuncsForNetwork' function to include a case for network.Version21, enabling the use of the UpgradeActorsV12 and PreUpgradeActorsV12 functions for network migration. These changes ensure the system correctly handles migrations when the network upgrades to version 21.

- Implemented a new 'checkNv21Invariants' function to check the invariants for version 21 of the Filecoin network. This function:

  1. Loads the new state root from the actor store.
  2. Retrieves the actor code IDs for the current state version (v12).
  3. Loads the actor tree from the state root and checks state invariants using the actor code IDs.
  4. Logs any error messages generated during the invariant check.
  5. Finally, prints a message with the time taken to complete the checks.

By checking these invariants, we can ensure the system's state is consistent and valid after migrating to network version 21.
 2023-08-01 14:23:55 -10:00
Łukasz Magiera
fbac220208 feat: chain node: Move consensus slasher to internal service 2023-08-01 12:06:18 -04:00
Aayush
50a86f2161 feat: improvements to the consensus slasher 2023-08-01 12:05:06 -04:00
Aayush
0f6207a755 feat: slasher: print error on failure 2023-08-01 12:04:57 -04:00
Łukasz Magiera
fe7cf0c39a feat: chain node: Move consensus slasher to internal service 2023-08-01 17:34:44 +02:00
ZenGround0
d900acc506
Merge pull request #11078 from filecoin-project/shed/zip-partition-info 
feat:shed:gather partition metadata
 2023-07-31 18:18:16 -04:00
zenground0
482c90412d Lint 2023-07-31 11:12:56 -06:00
zenground0
6a07def34a gen 2023-07-31 10:53:07 -06:00
Fridrik Asmundsson
719215122b Address PR feedback and move each epoch inside own tx 2023-07-24 14:18:31 +00:00
Fridrik Asmundsson
8a5950b3e9 Add new lotus-shed command for backfillling actor events 2023-07-24 11:37:30 +00:00
zenground0
df17f709a4 Record faulty status of sectors 2023-07-21 13:07:25 -06:00
zenground0
8c4e705df3 Count all precommit sector numbers that we are checking 2023-07-21 09:30:45 -06:00
zenground0
2776e29042 Gather info about overhead operations in deadline summary 2023-07-21 08:53:24 -06:00
ZenGround0
15faab8412
Merge pull request #11075 from filecoin-project/bench/amt-churn 
feat:lotus-bench:AMT benchmarking
 2023-07-20 19:27:27 -04:00
zenground0
4d8f8d2600 Review Response 2023-07-20 16:59:11 -06:00
Phi-rjan
9624dc53f8
Merge pull request #11032 from filecoin-project/feat/remove-existing-chain 2023-07-20 18:41:25 +02:00
Aayush Rajasekaran
2ddb52e103
feat: daemon: import: only setup stmgr if validating chain (#11084) 2023-07-18 08:03:34 -10:00
Łukasz Magiera
7adf8237f6 add synthPoRep support to bench simple 2023-07-18 10:27:40 -07:00
Aayush
09b566dde1 fix: daemon: set real beacon schedule when importing chain 2023-07-17 09:36:41 -04:00
zenground0
38b21a713a Lint 2023-07-13 08:41:34 -06:00
Andrew Jackson (Ajax)
1a799aec37 fixes 2023-07-13 15:48:08 +02:00
Andrew Jackson (Ajax)
7f306a5b02 Synthetic PoRep Impl 2023-07-13 15:47:59 +02:00
Andrew Jackson (Ajax)
08038540e4 Impl synthPoRep 2023-07-13 15:47:59 +02:00
Andrew Jackson (Ajax)
b43665a3c1 synthPoRep in PreferredSeal..() 2023-07-13 15:47:58 +02:00
zenground0
6eadc0ee57 gen 2023-07-13 07:37:51 -06:00
zenground0
eaf0200fe1 amt bench in good state 2023-07-12 23:58:02 -06:00
mx
e9f57ae77f feat: daemon: improvemens to the consensus slasher 2023-07-11 16:40:28 +08:00
zenground0
9bd0e9ed58 Fix classic bug 2023-07-10 16:32:37 -06:00
zenground0
3f4429a5ef match json parsing 2023-07-10 16:00:03 -06:00
zenground0
921bdb85ab correct json parsing of addr 2023-07-10 15:54:07 -06:00
zenground0
921e5520ea debug 2023-07-10 15:32:19 -06:00
zenground0
cff7716707 Tool for measuring partition summaries 2023-07-10 15:28:14 -06:00
Aayush
4bc032430b feat: slasher: improve UX 2023-07-08 13:40:38 -04:00
Aayush
7180b52d2c feat: improvements to the consensus slasher 2023-07-08 11:21:35 -04:00
Aayush
4cfdf8e83c feat: slasher: print error on failure 2023-07-08 11:14:41 -04:00
ZenGround0
1358d70128
Merge pull request #11012 from filecoin-project/feat/stat-snapshot 
feat:profiling:state summary and visualization
 2023-07-06 16:28:05 -04:00
Łukasz Magiera
e30f8af2d1 make gen 2023-07-06 09:35:10 +02:00
Phi
2061c32a2e Check error 
Check error
 2023-07-04 11:53:28 +02:00
Phi
dedfa143ce Extract removeExistingChain to seperate func 
Extract removeExistingChain to seperate func
 2023-07-04 11:30:06 +02:00
Phi
13224e3e0b Remove unused function 
Remove unused clearSplitStoreDir function
 2023-07-04 11:07:50 +02:00
Łukasz Magiera
7b21420831 feat: shed: command for decoding block headers 2023-06-30 14:24:07 +02:00
Phi
5201744199 feat: snapshot: remove existing chain 
Remove existing chain on a snapshot-import

log info instead of print

log info instead of print

Remove defer lock

Remove defer lock, and explicitly close the lockedRepo instead
 2023-06-30 14:14:16 +02:00
zenground0
ab72f2e230 Lint 2023-06-28 22:35:28 -06:00
mike seiler
a1bfdfbc04 Refactor state invariant checks for different actor versions 
This commit refactors the code in `invariants.go` to support state invariant checks for different actor versions. The code now includes checks for versions 10 and 11 of the actors. The `CheckStateInvariants` function is invoked based on the actor version, passing the appropriate parameters. This change ensures that state invariant checks are performed correctly for different actor versions.

The changes made are as follows:
- Added imports for actor versions 10 and 11.
- Added `case` statements for versions 10 and 11 in the switch statement.
- Invoked `CheckStateInvariants` function with the correct parameters for each version.
- Handled errors returned by the `CheckStateInvariants` function.

These changes enhance the flexibility and compatibility of the code with different actor versions, improving the accuracy of state invariant checks.
 2023-06-28 12:50:15 -07:00
zenground0
d2b2fba799 Remove debug pprof serving 2023-06-28 10:11:47 -06:00
zenground0
3cacbdfa18 Lint fixes 2023-06-28 09:52:47 -06:00
zenground0
016661b657 More cleanup 2023-06-28 09:17:57 -06:00
zenground0
3897bf14d1 Cleanup 2023-06-28 09:15:38 -06:00
zenground0
0cfdc9b5b6 Refactor for cleanup + measure top level HAMT churn 2023-06-27 17:57:00 -06:00
zenground0
77ea7ef90d Tweak path stuff 2023-06-27 11:29:14 -06:00
zenground0
4aa977f119 Touch up pathing 2023-06-27 11:00:20 -06:00
zenground0
8f3123d75b Churn json output is working 2023-06-27 00:54:02 -06:00
zenground0
36a88f45fc Output is buggy but halfway there 2023-06-25 17:36:21 -06:00
zenground0
d599833b64 WIP 2023-06-25 15:55:41 -06:00
Jorropo
6c01310728
chore: migrate to boxo 
This migrates everything except the `go-car` librairy: https://github.com/ipfs/boxo/issues/218#issuecomment-1529922103

I didn't migrated everything in the previous release because all the boxo code wasn't compatible with the go-ipld-prime one due to a an in flight (/ aftermath) revert of github.com/ipfs/go-block-format. go-block-format has been unmigrated since slight bellow absolutely everything depends on it that would have required everything to be moved on boxo or everything to optin into using boxo which were all deal breakers for different groups.

This worked fine because lotus's codebase could live hapely on the first multirepo setup however boost is now trying to use boxo's code with lotus's (still on multirepo) setup: https://filecoinproject.slack.com/archives/C03AQ3QAUG1/p1685022344779649

The alternative would be for boost to write shim types which just forward calls and return with the different interface definitions.

Btw why is that an issue in the first place is because unlike what go's duck typing model suggest interfaces are not transparent https://github.com/golang/go/issues/58112, interfaces are strongly typed but they have implicit narrowing. The issue is if you return an interface from an interface Go does not have a function definition to insert the implicit conversion thus instead the type checker complains you are not returning the right type.

Stubbing types were reverted https://github.com/ipfs/boxo/issues/218#issuecomment-1478650351

Last time I only migrated `go-bitswap` to `boxo/bitswap` because of the security issues and because we never had the interface return an interface problem (we had concrete wrappers where the implicit conversion took place).
 2023-06-19 14:45:05 -07:00
mx
36b5f485cd Merge branch 'slashfilter' of https://github.com/storswiftlabs/lotus into slashfilter 2023-06-09 10:18:45 +08:00
mx
2fca475dd4 fix: supply extra params for ReportConsensusFaultParams 2023-06-09 10:15:14 +08:00
swift-mx
e3c796c848
Merge branch 'master' into slashfilter 2023-06-08 18:56:49 +08:00
mx
16b9787db9 fix: handle the parent-grinding mining fault 2023-06-08 18:49:39 +08:00
Fridrik Asmundsson
4d90d0475f Upgrade urfave dependency which now supports DisableSliceFlagSeparator flag 2023-06-07 15:47:58 -05:00
Friðrik Ásmundsson
9e4f1a4d23
Add new lotus-shed command for computing eth hash for a given message cid (#10961) 2023-06-06 17:53:04 -05:00
Fridrik Asmundsson
26b4866841 Move back to lotus-shed and add subcategory for indexes 2023-06-03 12:22:25 -05:00
Fridrik Asmundsson
9240776237 fix: improve perf of msgindex backfill 2023-06-01 14:36:05 +00:00
swift-mx
2fd8602c5a
Merge branch 'master' into slashfilter 2023-05-31 10:02:01 +08:00
Łukasz Magiera
6cc506f5cf
Merge pull request #10923 from filecoin-project/feat/sectors-upgradebounds-cli 
feat: miner cli: sectors list upgrade-bounds tool
 2023-05-30 20:34:38 +02:00
Łukasz Magiera
120502408c
Merge pull request #10761 from filecoin-project/10752-bench-rpc 
Add new RPC stress testing tool (lotus-bench rpc) with rich reporting
 2023-05-30 19:37:38 +02:00
Łukasz Magiera
96fa081ca6
Merge pull request #10913 from filecoin-project/feat/piecereader-perf 
feat: piecereader: Allow parallel access
 2023-05-30 18:49:41 +02:00
swift-mx
42aa8451f8
fix: error log 
Co-authored-by: Aayush Rajasekaran <arajasek94@gmail.com>
 2023-05-30 23:54:07 +08:00
huangxinheng@storswift.com
d365f7b0a1 fix: docs gen 2023-05-30 07:01:24 +00:00
mx
425661772d style:Refactoring slashfilter 2023-05-30 14:33:35 +08:00
Aayush
c0942ebc2c feat: cli: Make compact partitions cmd better 2023-05-29 13:06:25 -04:00
Fridrik Asmundsson
e1b69f84d6 Cleanup after removing urface upgrade 2023-05-27 10:55:10 +00:00
Fridrik Asmundsson
b563a36a99 Address review comments 2023-05-27 10:55:10 +00:00
Fridrik Asmundsson
4b0ca30daf Add --watch option to see progress while benchmark is running 2023-05-27 10:55:10 +00:00
Fridrik Asmundsson
dcc72a43ee Also report on json errors (not only http errors) 2023-05-27 10:55:10 +00:00
Fridrik Asmundsson
d0e9502bfe small fixes 2023-05-27 10:55:10 +00:00
Fridrik Asmundsson
78d7ccd391 Add new RPC stress testing tool (lotus-bench rpc) with rich reporting 
This benchmark is designed to stress test the rpc methods of a lotus node so that we can simulate real world usage and measure the performance of rpc methods on the node.

This benchmark has the following features:
* Can query each method both sequentially and concurrently
* Supports rate limiting
* Can query multiple different endpoints at once (supporting different concurrency level and rate limiting for each method)
* Gives a nice reporting summary of the stress testing of each method (including latency distribution, histogram and more)
* Easy to use

To use this benchmark you must specify the rpc methods you want to test using the --method options, the format of it is:

  --method=NAME[:CONCURRENCY][:QPS][:PARAMS] where only METHOD is required.

Here are some real examples:
  lotus-bench rpc --method='eth_chainId' // run eth_chainId with default concurrency and qps
  lotus-bench rpc --method='eth_chainId:3'  // override concurrency to 3
  lotus-bench rpc --method='eth_chainId::100' // override to 100 qps while using default concurrency
  lotus-bench rpc --method='eth_chainId:3:100' // run using 3 workers but limit to 100 qps
  lotus-bench rpc --method='eth_getTransactionCount:::["0xd4c70007F3F502f212c7e6794b94C06F36173B36", "latest"]' // run using optional params while using default concurrency and qps
  lotus-bench rpc --method='eth_chainId' --method='eth_getTransactionCount:10:0:["0xd4c70007F3F502f212c7e6794b94C06F36173B36", "latest"]' // run multiple methods at once`,

Fixes: https://github.com/filecoin-project/lotus/issues/10752
 2023-05-27 10:55:10 +00:00
Friðrik Ásmundsson
b269a1ba35
Merge pull request #10877 from filecoin-project/lotus-shed-cancel-context 
feat: run lotus-shed commands in context that is cancelled on sigterm
 2023-05-27 10:30:52 +00:00
Fridrik Asmundsson
a4c94957e6 Update message when user hits CRTL+C to not imply handling SIGSTOP but SIGTERM/SIGKILL 2023-05-27 10:10:30 +00:00
Łukasz Magiera
4b5a665422 Merge remote-tracking branch 'origin/master' into feat/piecereader-perf 2023-05-26 13:00:42 +02:00
Łukasz Magiera
14f9770859 feat: miner cli: sectors list upgrade-bounds tool 2023-05-26 12:29:36 +02:00
Jianhui Xie
479018e3b3 set default data-cap same as MinVerifiedDealSize 2023-05-24 22:09:29 -07:00
Jianhui Xie
41203f7b8e pass the right g-recaptcha data 2023-05-24 21:06:03 -07:00
Łukasz Magiera
6c62e6d8e2 fix tests/lint 2023-05-23 12:26:13 +02:00
Maciej Witowski
c233b4317d Small UI improvements for faucet 2023-05-22 17:34:07 +02:00
Maciej Witowski
fff151f07e Fix button color so it doesn't look disabled when hovering over 2023-05-22 17:16:30 +02:00
Phi-rjan
bd85a6a72f
Merge pull request #10860 from filecoin-project/phi-fix-args-redeclare 
fix: cli: make redeclare cmd work properly
 2023-05-18 19:13:07 +02:00
Phi
b08dbde2da Update redeclare cmd on Lotus-Workers 
Update redeclare cmd on Lotus-Workers
 2023-05-18 18:04:10 +02:00
Jennifer Wang
de0726fcb0 make ledger sign work 2023-05-17 22:01:04 -04:00
Fridrik Asmundsson
0131781808 feat: run lotus-shed commands in context that is cancelled on sigterm 2023-05-16 11:25:57 +00:00
Phi
a29e8226c7 Set drop-missing to true 
Set drop-missing to true
 2023-05-15 11:51:43 +02:00
Jianhui Xie
4f3b6175c0 follow the new style for html from master branch 2023-05-12 10:59:28 -07:00
Jianhui Xie
9486aa98db fixed the merged break for to->cmd/lotus-fountain/main.go 2023-05-12 10:48:18 -07:00
JesseXie
9b0cbbb0a8
Merge branch 'master' into lotus-fountain-add-datacap 2023-05-12 10:42:39 -07:00
Phi
f671654bdd Make redeclare cmd work 
- Fix an issue where `lotus-miner storage redeclare --all` required an argument
- Actually implement the logic to redeclare a single sectors in a single storage path
 2023-05-12 16:35:00 +02:00
Jianhui Xie
96c1ab413f run gofmt to clean the imports error 2023-05-11 00:06:05 -07:00
Jianhui Xie
0ec3d44276 add grant-datacap support for lotus fountain 2023-05-10 23:30:43 -07:00
Maciej Witowski
08e6e04145 Unify error handling 2023-05-10 22:21:15 -04:00
Maciej Witowski
dbb892d89f lotus-fountain: make compatible with 0x addresses #10560 2023-05-10 22:21:15 -04:00
Łukasz Magiera
488b7966e7
Merge pull request #10785 from filecoin-project/maciej/fountain-ui 
Make lotus-fountain UI slightly friendlier
 2023-05-09 18:13:34 +02:00
Łukasz Magiera
3b4fa779ac
Merge pull request #10797 from filecoin-project/sealerFlagForDataCid3 
feat: sealing: flag to run data_cid untied from addpiece
 2023-05-09 16:26:00 +02:00
Andrew Jackson (Ajax)
313c701be6 nit: docs space 2023-05-08 15:39:47 -05:00
Andrew Jackson (Ajax)
30fae764ae doc 2023-05-08 12:22:25 -05:00
Andrew Jackson (Ajax)
6a66a11e54 comment responses 2023-05-08 11:36:43 -05:00
Phi-rjan
5697645748
Merge pull request #10837 from filecoin-project/feat/ux-friendly-batch-cmd 
feat: cli: More ux-friendly batching cmds
 2023-05-08 17:40:01 +02:00
Phi
426bfb795a Hide lotus-miner legacy markets cmds 
Hide lotus-miner legacy markets cmds
 2023-05-08 13:13:18 +02:00
Phi
059cbedb40 Add missing else bracket 
Add missing else bracket
 2023-05-05 15:21:44 +02:00
Phi
075d068ccd Add errcheck 
Add errcheck
 2023-05-05 14:59:25 +02:00
Phi
93618c0687 cli: Add more ux-friendly batching cmd 
cli: Add more ux-friendly batching cmd
 2023-05-05 14:20:09 +02:00
Maciej Witowski
c6bda331b8 Make lotus-fountain UI slightly friendlier 
CSS generated by ChatGTP
 2023-05-05 13:23:08 +02:00
Phi
efdc32f60e Change arg from minerAddress to minerID 
Change arg from minerAddress to minerID
 2023-05-04 15:21:05 +02:00
Łukasz Magiera
3ff8a09183
feat: worker: Ensure tempdir exists (#10433) 2023-05-03 10:59:41 -04:00
Aayush
49f5825296 feat: chainstore: batch writes of tipsets 2023-05-02 17:26:07 -04:00
Andrew Jackson (Ajax)
8c31ea1814 feat: sealing: data_cid flag untied from addpiece 2023-05-01 19:41:44 -05:00
Aayush
b4c2c249db chore: deps: update to FVM 3.3.1 2023-05-01 10:37:43 -04:00
Aayush
0d8a3cbaf8 feat: shed tool to report on any consensus mismatches in history 2023-04-28 13:47:24 -04:00
Aayush Rajasekaran
cf8587522a
Merge pull request #10714 from filecoin-project/fix/tvx-post-fvm 
fix: tvx: make extract-multiple support the FVM
 2023-04-26 16:17:33 -04:00
Aayush Rajasekaran
2af8b6e30e
Merge pull request #10762 from filecoin-project/asr/add-reminder 
shed: migrations: add reminder about continuity testing tool
 2023-04-26 10:35:04 -04:00
Aayush
33ca0f1f79 shed: migrations: add reminder about continuity testing tool 2023-04-26 09:50:16 -04:00
Łukasz Magiera
71f184f5cb feat: daemon: Auto-resume interrupted snapshot imports 2023-04-25 09:31:19 +02:00
Aayush
fd7a0e1922 feat: shed: refactor market cron-state command 2023-04-24 11:02:43 -04:00
zenground0
c8e78f7911 Fix lint after merge 2023-04-23 15:43:53 -06:00
Aayush
5a061e4677 Merge branch 'releases' into asr/merge-release-into-master 2023-04-23 14:58:50 -04:00
Steven Allen
7b6f6843a7 fix: tvx: correctly lookup actor codes in extract-many 2023-04-20 13:27:44 -07:00
Łukasz Magiera
0a46fc7e73
Merge pull request #10562 from Jorropo/boxo 
chore: boxo: migrate from go-libipfs to boxo
 2023-04-20 16:24:22 +02:00
ZenGround0
327760acff
chore: build: Merge/v22 into 21 for 23 (#10702) 
* chore: update ffi to increase execution parallelism

* Don't enforce walking receipt tree during compaction

* fix: build: drop drand incentinet servers

* chore: release lotus v1.20.4

* Apply suggestions from code review

Co-authored-by: Jiaying Wang <42981373+jennijuju@users.noreply.github.com>

* feat: Introduce nv19 skeleton

Update to go-state-types v0.11.0-alpha-1

Introduce dummy v11 actor bundles

Make new actors adapters

Add upgrade to Upgrade Schedules

make jen

Update to go-state-types v0.11.0-alpha-2

* feat: vm: switch to the new exec trace format (#10372)

This is now "FVM" native. Changes include:

1. Don't treat "trace" messages like off-chain messages. E.g., don't
include CIDs, versions, etc.
2. Include IPLD codecs where applicable.
3. Remove fields that aren't filled by the FVM (timing, some errors,
code locations, etc.).

* feat: implement FIP-0061

* Address review

* Add and test the FIP-0061 migration

* Update actors bundles to fip/20230406

* Update to go-state-types master

* Update to actors v11.0.0-rc1

* - Update go state types
- Keep current expiration defaults on creation, extension some tests
- Update ffi

* ffi experiment

* Integration nv19 migration

- Open splitstore in migration shed tool
- Update state root version

* Post rebase fixup

* Fix

* gen

* nv19 invariant checking

* Try fixig blockstore so bundle is loaded

* Debug

* Fix

* Make butterfly upgrades happen

* Another ffi experiment

* Fix copy paste error

* Actually schedule migration (#10656)

Co-authored-by: zenground0 <ZenGround0@users.noreply.github.com>

* Butterfly artifacts

* Set calibration net upgrade height

* Review Response

* Fix state tree version assert

* Quick butterfly upgrade to sanity check (#10660)

* Quick butterfly upgrade to sanity check

* Update butterfly artifacts

* Revert fake fix

* Give butterfly net correct genesis

* Butterfly artifacts

* Give time before upgrade

---------

Co-authored-by: zenground0 <ZenGround0@users.noreply.github.com>

* chore:releasepolish v1.22 release (#10666)

* Update butterfly artifacts

* register actors v11

* Update calibration upgrade time

* State inspection shed cmds

* Fix

* make gen

* Fix swallowed errors

* Lint fixup

---------

Co-authored-by: zenground0 <ZenGround0@users.noreply.github.com>

* v1.22.0-rc3

* bundle fix

* Feat/expedite nv19 (#10681)

* Update go-state-types

* Modify upgrade schedule and params

* Revert fip 0052

* Update gst

* docsgen

* fast butterfly migration to validate migration

* Correct epoch to match specified date

* Update actors v11

* Update changelog build version

* Update butterfly artifacts

* Fix lotus-miner init to work after upgrade

---------

Co-authored-by: zenground0 <ZenGround0@users.noreply.github.com>

* fix:deps:stable ffi for stable release  (#10698)

* Point to stable ffi for stable lotus release

* go mod tidy

---------

Co-authored-by: zenground0 <ZenGround0@users.noreply.github.com>

* Update CHANGELOG.md

Co-authored-by: Jiaying Wang <42981373+jennijuju@users.noreply.github.com>

---------

Co-authored-by: Aayush Rajasekaran <arajasek94@gmail.com>
Co-authored-by: zenground0 <ZenGround0@users.noreply.github.com>
Co-authored-by: Jiaying Wang <42981373+jennijuju@users.noreply.github.com>
Co-authored-by: Steven Allen <steven@stebalien.com>
Co-authored-by: jennijuju <jiayingw703@gmail.com>
 2023-04-19 18:40:18 -04:00
Jorropo
fe42d974a2 chore: all: migrate from go-libipfs to boxo 
github.com/ipfs/libipfs/blocks was unmigrated to github.com/ipfs/go-block-format due to compatibility issues with the rest of the IPLD stack.
 2023-04-18 17:22:18 +02:00
Shrenuj Bansal
0befed7200
Add API and CLI to unseal sector (#10626) 2023-04-17 12:12:15 -04:00
Phi
d211b5eb69 fix: cli: Check if the sector exists 
Check if the sector exists before running `SectorRemove`, and error out if the SectorID has not bee created.
 2023-04-03 14:04:45 +02:00
Jennifer Wang
b82726f57f make lint happy 2023-03-31 15:16:24 -04:00
Jennifer Wang
28fdc3abb8 docsgen 2023-03-31 15:13:13 -04:00
Jennifer Wang
4a1eccd447 add unique 2023-03-31 15:05:03 -04:00
Jennifer Wang
77883aa72b add accounts 2023-03-31 15:05:00 -04:00
Jennifer Wang
07c9367467 wording 2023-03-31 15:04:27 -04:00
zenground0
1a5e8603c7 Fix dumb mistake 2023-03-31 15:04:27 -04:00
zenground0
3b0d8fdd29 P0 fix 2023-03-31 15:04:27 -04:00
Jennifer Wang
ec90ccf72e point to the hot store 2023-03-31 15:04:27 -04:00
Jennifer Wang
661d8608bc evm account balances 
Please enter the commit message for your changes. Lines starting
 2023-03-31 15:04:24 -04:00
Aayush Rajasekaran
13f73623a8
Merge pull request #10544 from filecoin-project/asr/fix-extend-sectors 
fix: miner: correctly count sector extensions
 2023-03-30 10:10:42 -04:00
Jiaying Wang
caa6dd9c41
Merge pull request #10594 from filecoin-project/phi/v1210-rc2 
build: release: v1.21.0-rc2
 2023-03-29 15:59:56 -04:00
Aayush
66fc6dc3e5 refactor: stop using deprecated io/ioutil 2023-03-29 15:40:49 -04:00
Aayush
a724a713da refactor: stop using deprecated io/ioutil 2023-03-29 15:38:46 -04:00
Mikers
06294351fa perf: eth: gas estimate set applyTsMessages false (#10546) 
* have gas estimate call callInternal with applyTsMessages = false and other calls with applyTsMessages=true for gas caclulation optimization

* set applyTsMessages = true in CallWithGas call in shed

* update test with new callwithgas api optimization for eth call

* Update chain/stmgr/call.go

Co-authored-by: Łukasz Magiera <magik6k@users.noreply.github.com>

* env flag LOTUS_SKIP_APPLY_TS_MESSAGE_CALL_WITH_GAS must be 1 in order to have applyTsMessages change

* env flag LOTUS_SKIP_APPLY_TS_MESSAGE_CALL_WITH_GAS must be 1 in order to have applyTsMessages change

* make sure that even if we arent apply ts messages we grab ts messages from the particular user who is requesting gas estimation

---------

Co-authored-by: Jiaying Wang <42981373+jennijuju@users.noreply.github.com>
Co-authored-by: Łukasz Magiera <magik6k@users.noreply.github.com>
Co-authored-by: Ubuntu <ubuntu@ip-10-0-4-29.us-east-2.compute.internal>
 2023-03-29 14:25:40 -04:00
Aayush Rajasekaran
687f0c070f
Merge pull request #10556 from filecoin-project/10537-populate-index-after-snapshot 
feat: populate the index on snapshot import
 2023-03-28 11:41:43 -04:00
Fridrik Asmundsson
83e2408f81 Only populate message index if config EnableMsgIndex is set 2023-03-28 16:28:47 +02:00
Aayush Rajasekaran
0b018e56cd
Merge pull request #10555 from filecoin-project/asr/fix-extend-sectors-backport 
backport: fix: miner: correctly count sector extensions
 2023-03-28 09:40:42 -04:00
Phi
8bb7272bb1 Initialize with same length as partition 
Initialize the postParam.Partitions slice with the same length as i.Partitions before iterating over it in the loop.
 2023-03-27 15:54:59 +02:00
Phi
0711fdc3dd Initialize with same length as partition 
Initialize the postParam.Partitions slice with the same length as i.Partitions before iterating over it in the loop.
 2023-03-27 10:04:15 +02:00
Fridrik Asmundsson
59640a8b22 Populate the index on snapshot import 
Fixes: https://github.com/filecoin-project/lotus/issues/10537
 2023-03-24 11:41:27 +00:00
Mikers
41fce94db4
perf: eth: gas estimate set applyTsMessages false (#10546) 
* have gas estimate call callInternal with applyTsMessages = false and other calls with applyTsMessages=true for gas caclulation optimization

* set applyTsMessages = true in CallWithGas call in shed

* update test with new callwithgas api optimization for eth call

* Update chain/stmgr/call.go

Co-authored-by: Łukasz Magiera <magik6k@users.noreply.github.com>

* env flag LOTUS_SKIP_APPLY_TS_MESSAGE_CALL_WITH_GAS must be 1 in order to have applyTsMessages change

* env flag LOTUS_SKIP_APPLY_TS_MESSAGE_CALL_WITH_GAS must be 1 in order to have applyTsMessages change

* make sure that even if we arent apply ts messages we grab ts messages from the particular user who is requesting gas estimation

---------

Co-authored-by: Jiaying Wang <42981373+jennijuju@users.noreply.github.com>
Co-authored-by: Łukasz Magiera <magik6k@users.noreply.github.com>
Co-authored-by: Ubuntu <ubuntu@ip-10-0-4-29.us-east-2.compute.internal>
 2023-03-23 18:27:01 -04:00
Aayush Rajasekaran
4efc29aa64
Merge pull request #10513 from filecoin-project/feat/shed-chainwatch 
feat: shed: incoming block-sub chainwatch tool
 2023-03-23 17:50:41 -04:00
Aayush
7b55de21bd fix: miner: call ExtendSectorExpiration2 2023-03-23 17:32:55 -04:00
Aayush
a467e1ab31 fix: miner: correctly count sector extensions 2023-03-23 17:32:51 -04:00
Aayush
3070227b00 fix: miner: call ExtendSectorExpiration2 2023-03-23 17:28:16 -04:00
Aayush
2d9412d97f fix: miner: correctly count sector extensions 2023-03-23 17:28:16 -04:00
Łukasz Magiera
b484d72c80
Merge pull request #10323 from mtelka/info-noadmin 
fix: state: lotus-miner info should show deals info without admin permission
 2023-03-23 12:39:28 +01:00
Łukasz Magiera
e2ff9027f9 shed chainwatch: Appease the linter 2023-03-23 12:33:00 +01:00
vyzo
8abe0ea608
Merge pull request #10452 from filecoin-project/vyzo/feat/chain/msgindex 
feat:chain: Message Index
 2023-03-22 17:02:34 +02:00
ZenGround0
43da108466
feat:config:force existing users to opt into new defaults (#10488) 
* Config default does not comment out EnableSplitstore

* Loadability check

* Remove test used for debugging

* regexp for properly safe check that config is set

* regexp for safely matching the EnableSpitstore field in the config

* Add instructions for undeleting config and remind users to set splitstore false for full archive

* UpdateConfig small docs and functional opts

* make gen

* Lint

* Fix

* nil pointer check on validate

* Unit testing of EnableSplitstore cases

* Address Review

---------

Co-authored-by: zenground0 <ZenGround0@users.noreply.github.com>
 2023-03-20 12:19:14 -04:00
Łukasz Magiera
02db37bf37 feat: shed: incoming block-sub chainwatch tool 2023-03-20 10:37:48 +01:00
vyzo
1676d51484 shed: expand homedir in repo path for msgindex tools 2023-03-16 17:17:26 +02:00
Łukasz Magiera
7e414ac390 Merge remote-tracking branch 'origin/master' into feat/go-data-transfer-v2 2023-03-15 11:37:53 +01:00
Steven Allen
dcb49dc8ee
refactor: update cache to the new generic version (#10463) 
- Adds type safety.
- Reduces allocations.
- Fixes the drand cache (was storing by value, but retrieving by pointer)
 2023-03-13 15:29:09 -07:00
vyzo
6deec4c5f4 lint 2023-03-13 17:26:20 +02:00
vyzo
06f93861bc make gen 2023-03-13 17:00:16 +02:00
vyzo
27dc4951eb lotus-shed tools for msgindex 2023-03-13 16:51:21 +02:00
vyzo
88d7a4e610 more lint 2023-03-12 16:13:05 +02:00
vyzo
1415391988 lint 
lint

lint
 2023-03-12 15:50:10 +02:00
vyzo
171734ea31 hook the index into the rest of lotus 2023-03-12 15:25:07 +02:00
Travis Person
f641139bf2
Merge pull request #10282 from filecoin-project/feat/cache-migrated-stateroot 
feat: stmgr: cache migrated stateroots
 2023-03-09 11:47:43 -08:00
Łukasz Magiera
3e85591c6c
Merge pull request #10390 from beck-8/chore/compute-wdpost-human-readable 
chore: make debugging windowPoSt-failures human readable
 2023-03-09 11:08:40 +01:00
Łukasz Magiera
d114d8fe7e deprecate MarketListRetrievalDeals, make gen 2023-03-08 17:15:16 +01:00
hannahhoward
16dad6342c
feat(deps): update to go-data-transfer v2, still wip 2023-03-07 11:44:29 -08:00
beck
f0ba0ebb64 indent output 2023-03-06 18:04:55 +08:00
beck
668b24fb23 make debugging windowPoSt-failures human readable 2023-03-04 15:00:44 +08:00
Phi
51b645f8d0 Hide lotus-worker set command 
Hide the `lotus-worker set` command and print that this command will be deprecated.
 2023-03-03 14:13:35 +01:00
Aayush
4e57626e42 feat: update renew-sectors with FIP-0045 logic 2023-03-02 16:38:05 -05:00
Steven Allen
dbbcf4b2ee
feat: vm: switch to the new exec trace format (#10372) 
This is now "FVM" native. Changes include:

1. Don't treat "trace" messages like off-chain messages. E.g., don't
include CIDs, versions, etc.
2. Include IPLD codecs where applicable.
3. Remove fields that aren't filled by the FVM (timing, some errors,
code locations, etc.).
 2023-03-01 16:02:18 -08:00
Aayush
19f1ad2762 Merge branch 'releases' into asr/merge-release-into-master 2023-03-01 14:18:35 -05:00
Travis Person
814c146626 feat: stmgr: cache migrated stateroots 2023-03-01 16:17:34 +00:00
Łukasz Magiera
9a2b83064b
Merge pull request #10364 from filecoin-project/chore/rm-market-info-lsm 
chore: Remove legacy market info from lotus-miner info
 2023-03-01 14:21:29 +01:00
Łukasz Magiera
807610131a
Merge pull request #10331 from filecoin-project/fix/deprecate-wait-quiet 
fix: worker: Hide `wait-quiet` cmd
 2023-02-28 14:18:54 +01:00
Phi
dd0c4a0a34 Tune down parallel reads 
Tuning down the default post-parallel-reads to a conservative number.
 2023-02-28 10:25:33 +01:00
Łukasz Magiera
9aba7dc17a chore: Remove legacy market info from lotus-miner info 2023-02-28 09:55:47 +01:00
Łukasz Magiera
aa7b5c40b8
Merge pull request #10319 from filecoin-project/fix/allinfo-test 
fix: tests: Fix TestMinerAllInfo test
 2023-02-23 14:16:40 +01:00
Phi
ab6aaf5013 Hide wait-quiet cmd 
Hide `wait-quiet` cmd
 2023-02-23 09:46:06 +01:00
Marcel Telka
7f33db90d8 lotus-miner info should show deals info without admin permission 2023-02-21 11:10:38 +01:00
Łukasz Magiera
51aecb6b17 fix: tests: Make TestWorkerKeyChange not flaky 2023-02-20 17:38:18 +01:00
Łukasz Magiera
d2c0603717 fix: tests: Fix TestMinerAllInfo test 2023-02-20 14:11:49 +01:00
Aayush Rajasekaran
1ec02c5c95
Merge pull request #10296 from filecoin-project/asr/migration-test 
feat: shed: test the nv18 migration
 2023-02-17 16:20:51 -05:00
Aayush
984b4c78cb Merge branch 'release/v1.20.0' into asr/merge-release-into-master 2023-02-17 16:08:22 -05:00
Jorropo
2d3065ae8e chore: all: bump go-libipfs to replace go-block-format 
Includes changes from:
- https://github.com/ipfs/go-block-format/pull/37
- https://github.com/ipfs/go-libipfs/pull/58

(cherry picked from commit f572852d06)
 2023-02-17 18:46:11 +01:00
Aayush
fab7ea6ca1 feat: shed: test the nv18 migration 2023-02-17 11:09:52 -05:00
Łukasz Magiera
8f1c23296e
Merge pull request #10169 from filecoin-project/feat/shed-read-sector 
feat: shed: Add a tool to read data from sectors
 2023-02-16 17:11:37 +01:00
Łukasz Magiera
12656b05fe feat: shed: Add a tool for removing sector data 2023-02-16 16:47:13 +01:00
Łukasz Magiera
285dfed338
Merge pull request #10202 from filecoin-project/feat/faster-sectors-list 
sp cli: make sectors list much faster
 2023-02-15 19:59:17 +01:00
Łukasz Magiera
6028d7ba18 sectors list: Explain http mode 2023-02-15 19:41:46 +01:00
Aayush
4f259d8644 Revert "Standardize path variable" 
This reverts commit a9c1caa188.
 2023-02-15 11:09:24 -05:00
Aayush
63b03a48d0 Merge branch 'release/v1.20.0' into asr/merge-release-into-master 2023-02-10 18:39:51 -05:00
Łukasz Magiera
7aa6663127
Merge pull request #10232 from filecoin-project/worker-all-task-flag2 
fix: worker: add all tasks flag
 2023-02-10 12:59:47 +01:00
Łukasz Magiera
83a7d6e297
Merge pull request #10134 from filecoin-project/gstuart/shed-path-fix 
fix: shed: Standardize use of path flag
 2023-02-09 18:04:04 +01:00
Łukasz Magiera
17adcb77c3 sp cli: correct order in parallel sectors list 2023-02-09 17:02:41 +01:00
Łukasz Magiera
81e056be1a sp cli: make sectors list much faster 2023-02-09 16:57:08 +01:00
Łukasz Magiera
25babace8f
Merge pull request #10208 from filecoin-project/fix/seal-delay-seconds 
fix: cli: option to set-seal-delay in seconds
 2023-02-09 16:51:20 +01:00
Phi
662fc37976 Option to set-seal-delay seconds 
Add the option to set-seal-delay in seconds
 2023-02-08 09:34:44 +01:00
Phi-rjan
21d6020179
Update cmd/lotus-worker/tasks.go 
Co-authored-by: Łukasz Magiera <magik6k@users.noreply.github.com>
 2023-02-07 16:47:30 +01:00
Phi-rjan
3fc1346d5b
Update cmd/lotus-worker/tasks.go 
Co-authored-by: Łukasz Magiera <magik6k@users.noreply.github.com>
 2023-02-07 16:47:23 +01:00
Phi-rjan
58c7c514c6
Update cmd/lotus-worker/tasks.go 
Co-authored-by: Łukasz Magiera <magik6k@users.noreply.github.com>
 2023-02-07 16:47:16 +01:00
Phi
cf0997b434 fix: worker: add all task type flag 
Add all flag for the `lotus-worker tasks enable/disable` cmd
 2023-02-07 16:12:31 +01:00
Aayush
f291572b4a Merge branch 'release/v1.20.0' into asr/merge-release-into-master 2023-02-03 09:27:04 -05:00
0x5459
e1c00bdbba cli: fix extend cmd to get the right sector number 2023-02-03 14:56:54 +08:00
Geoff Stuart
e200df4def
Merge pull request #10060 from filecoin-project/raulk/eth-check-tipsets-cmd 
add a lotus-shed eth check-tipsets command.
 2023-02-01 18:05:34 -05:00
Łukasz Magiera
0a35e9659b feat: shed: Add a tool to read data from sectors 2023-02-01 17:51:12 +01:00
Phi
b334b2055f fix: cli: add ArgsUsage 
fix: cli: add ArgsUsage
 2023-01-31 11:56:55 +01:00
Łukasz Magiera
1286d76988 gateway: eth_subscribe support 2023-01-31 10:28:12 +01:00
Łukasz Magiera
13fc5b688f
Merge pull request #10028 from filecoin-project/gstuart/cli-color-cleanup 
chore: cli: Remove unneeded individual color flags
 2023-01-31 09:23:16 +01:00
Geoff Stuart
a9c1caa188 Standardize path variable 2023-01-27 11:27:13 -05:00
Jorropo
f572852d06 chore: all: bump go-libipfs to replace go-block-format 
Includes changes from:
- https://github.com/ipfs/go-block-format/pull/37
- https://github.com/ipfs/go-libipfs/pull/58
 2023-01-26 17:03:18 +01:00
Łukasz Magiera
4682e8f326
Merge pull request #10105 from filecoin-project/addr-encode 
chore:shed:encode address to bytes
 2023-01-24 10:34:47 +01:00
zenground0
f03c7a8880 encode address into byte 2023-01-24 20:18:04 +13:00
Aayush
65ac5669a9 Merge branch 'master' into asr/merge-release-into-master 2023-01-23 12:37:24 -05:00
Geoff Stuart
807a60b4e4 Remove unneeded individual color flags 2023-01-23 11:11:12 -05:00
Travis Person
91a6eabab5
Merge pull request #9982 from filecoin-project/feat/obj-stats 
feat: add toolshed commands to inspect statetree size
 2023-01-19 08:37:32 -08:00
Raúl Kripalani
5541694922 fix lint. 2023-01-19 14:14:37 +00:00
Raúl Kripalani
4dee0ba7fb add a lotus-shed eth check-tipsets command. 
This checks Eth API consistency by walking the chain backwards
from HEAD and verifying that all data returned from eth_getBlockByNumber
is consistent with eth_getBlockByHash.
 2023-01-19 14:01:39 +00:00
Travis Person
a0c58b5582 feat: add toolshed commands to inspect statetree size 2023-01-19 00:48:22 +00:00
Geoff Stuart
70db738bff
Merge pull request #10037 from filecoin-project/feat/lotus-shed-beneficiary-cli 
feat: shed: Add beneficiary commands
 2023-01-18 18:04:22 -05:00
zenground0
72baa3d916 cid -> bytes command 2023-01-17 12:19:04 -07:00
zenground0
14d921f64f Err handle 2023-01-17 09:56:17 -07:00
Phi
51d2a883f0 Beneficiary cmd in lotus-shed 
Add `ProposeChangeBeneficiary` and `ConfirmChangeBeneficiary` to lotus-shed
 2023-01-17 12:39:55 +01:00
zenground0
7383a761f6 Fix 2023-01-16 17:54:38 -07:00
zenground0
39ae4b04be Add cid to cbor cmd 2023-01-16 17:50:47 -07:00
Aayush
e715384173 Merge branch 'release/v1.20.0' into asr/merge-release-into-master 2023-01-16 10:51:22 -05:00
Łukasz Magiera
67023886c8
Merge pull request #9920 from filecoin-project/gstuart/extend-or-renew 
feat: cli: Refactor renew and remove extend
 2023-01-16 16:31:11 +01:00
Richard Guan
fc82aab74b add bool flag and gen documentation 2023-01-16 16:14:19 +11:00
raulk
cdf3812e40
NV18: Filecoin EVM runtime + Actor Events + EthAccount + EAM + f4 addressing (#9998) 
Co-authored-by: Steven Allen <steven@stebalien.com>
Co-authored-by: Raul Kripalani <raulk@users.noreply.github.com>
Co-authored-by: Kevin Li <ychiaoli18@users.noreply.github.com>
Co-authored-by: vyzo <vyzo@hackzen.org>
Co-authored-by: Ian Davis <nospam@iandavis.com>
Co-authored-by: Aayush Rajasekaran <arajasek94@gmail.com>
Co-authored-by: Jiaying Wang <42981373+jennijuju@users.noreply.github.com>
Co-authored-by: Jennifer Wang <jiayingw703@gmail.com>
Co-authored-by: Geoff Stuart <geoff.vball@gmail.com>
Co-authored-by: Shrenuj Bansal <shrenuj.bansal@protocol.ai>
Co-authored-by: Shrenuj Bansal <108157875+shrenujbansal@users.noreply.github.com>
Co-authored-by: Geoff Stuart <geoffrey.stuart@protocol.ai>
Co-authored-by: Aayush Rajasekaran <aayushrajasekaran@Aayushs-MacBook-Pro.local>
Co-authored-by: ZenGround0 <5515260+ZenGround0@users.noreply.github.com>
Co-authored-by: zenground0 <ZenGround0@users.noreply.github.com>
 2023-01-13 19:11:13 +00:00
Geoff Stuart
0ebdbed30b Refactor renew and remove extend 2023-01-11 14:44:08 -05:00
Łukasz Magiera
9a46682d9d
Merge pull request #9481 from consensus-shipyard/adlrocha/cns-iface-master 
IPC: Abstract common consensus functions and consensus interface
 2023-01-11 14:49:27 +01:00
Phi
f8195deb54 fix: cli: remove requirements 
Remove the requirements from the `lotus-worker run` cli
 2023-01-06 12:43:12 +01:00
Peter Rabbitson
3de006364e This stat-set does not belong in core lotus 2023-01-04 16:02:25 +01:00
Łukasz Magiera
273184b084
Merge pull request #9941 from beck-8/feat/add_renew_max_sectors 
add renew max-sectors flag
 2023-01-04 14:45:30 +01:00
beck
4f9119f211 add check GetAddressedSectorsMax 2023-01-04 19:39:40 +08:00
Phi
c6f69946be fix: bench: remove unused env 
fix: bench: remove unused environment variable.
 2023-01-02 09:07:45 +01:00
beck
0f9d198dbd add renew max-sectors flag 2022-12-25 21:05:44 +08:00
Geoff Stuart
d615b1c806 Update go-state-types 2022-12-14 19:33:47 -05:00
Geoff Stuart
ae4010ffb6 Drop actor keys from chain/actors/manifest.go 2022-12-13 18:02:34 -05:00
Shrenuj Bansal
466f0c583f cli: Add lotus-shed cli for computing frc42 method num 2022-12-12 11:45:44 -05:00
Łukasz Magiera
c46bf475f7 fix: miner info: Output correct StartTime 2022-12-09 10:23:49 +01:00
Alfonso de la Rocha
25edb23c3f
minor fix after rebase 2022-12-05 18:22:10 +01:00