cerc-io/lotus
15
0
Fork 0
Code Issues Pull Requests Packages Projects Releases 27 Wiki Activity
14,176 Commits 24 Branches 342 Tags 314 MiB
d42f7e4a1c
Commit Graph

14176 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Cory Schwartz
d42f7e4a1c packer snap 2021-12-17 17:06:32 -08:00
Łukasz Magiera
dc26f3bd74
Merge pull request #7750 from filecoin-project/gstuart/lotus-vm-gas-tracing-env-var 
Expose EnableGasTracing as an env_var
 2021-12-12 12:16:24 +01:00
Łukasz Magiera
8652f80ab3
Merge pull request #7760 from filecoin-project/feat/open-telemetry-fix 
Minor improvement for OpenTelemetry
 2021-12-12 12:14:55 +01:00
gstuart
9108828aeb Make Lotus vm gas tracing an env var 2021-12-10 17:27:44 -05:00
hannahhoward
8e376c84cf feat(tracing): setup logging 2021-12-10 13:50:12 -08:00
Łukasz Magiera
a0d76bda99
Merge pull request #7749 from filecoin-project/gstuart/sort-lotus-miner-retrieval-deals 
Sort lotus-miner retrieval-deals by dealId
 2021-12-10 12:16:00 +01:00
Łukasz Magiera
36f1a8f3ca
Merge pull request #7746 from filecoin-project/feat/faster-retrieval 
Make retrieval even faster
 2021-12-10 12:01:01 +01:00
Łukasz Magiera
e8ef39e734 stores: Reduce log spam during retrievals 2021-12-10 11:28:04 +01:00
Jiaying Wang
509aea5d04
Merge pull request #7751 from filecoin-project/fix/getnode 
dep/fix 7701 Dependency: update to ipld-legacy to v0.1.1
 2021-12-09 21:16:53 -05:00
Jennifer Wang
f7a49e7be7 update to ipld-legacy to v0.1.1 2021-12-09 21:02:24 -05:00
gstuart
21e6c963ab Sort lotus-miner retrieval-deals by dealId 2021-12-09 19:53:13 -05:00
Łukasz Magiera
74d3ba6b5e fix lint 2021-12-09 18:10:34 +01:00
Łukasz Magiera
c31f4de7d5 Fix mock ReadPiece 2021-12-09 16:26:59 +01:00
Łukasz Magiera
6fd1609410 fr32: Reduce MTTresh from 32M to 512k per core 
This results in 64x less bytes allocated when spawning new readers
for larger pieces.

Results in about 30% speedup in 1G unpad benchmark on AMD TR 2950x
 2021-12-09 16:14:47 +01:00
Łukasz Magiera
9c75a3aaa8 piecereader: Avoid allocating 1024MB slices per read 2021-12-09 15:49:43 +01:00
Łukasz Magiera
a3d8494a04 piecereader: Avoid redundant roundtrips when seeking 2021-12-09 14:52:33 +01:00
Łukasz Magiera
13b260e7f7 piecereader: Move closer to storage 2021-12-08 23:20:20 +01:00
Łukasz Magiera
49c619d65d
Merge pull request #7735 from filecoin-project/feat/storlocks-cmd 
Command to list active sector locks
 2021-12-08 00:11:17 +01:00
Łukasz Magiera
9ccd4ee240
Merge pull request #7737 from filecoin-project/feat/opt-ds-pr 
dagstore pieceReader: Always read full in ReadAt
 2021-12-06 23:14:21 +01:00
Łukasz Magiera
84c48de5d9 CARv2 v2.1.0 2021-12-06 15:39:03 +01:00
Łukasz Magiera
9f6265e0b4 dagstore pieceReader: Fix wrong ErrUnexpectedEOF return in ReadAt 2021-12-03 23:36:36 +01:00
Łukasz Magiera
3969d6b767 dagstore pieceReader: Always read full in ReadAt 2021-12-03 20:14:35 +01:00
Łukasz Magiera
dad9190142 Add metrics to dagstore piecereader 2021-12-03 17:07:14 +01:00
Łukasz Magiera
9d143426ee
Merge pull request #7734 from filecoin-project/feat/splitstore-upgrade-protection 
SplitStore: supress compaction near upgrades
 2021-12-03 15:18:07 +01:00
Łukasz Magiera
727765b248 Command to list active sector locks 2021-12-03 12:33:23 +01:00
vyzo
489782e21b satisfy the spellchecker that masquarades as a linter 2021-12-03 12:15:28 +02:00
vyzo
5d6398f20e hook the upgrade schedule to splitstore start 2021-12-03 12:11:54 +02:00
vyzo
6ce5879071 add unit test for compaction supression 2021-12-03 12:05:15 +02:00
vyzo
05c1325885 add logic for supressing compaction near upgrade boundaries 2021-12-03 11:50:35 +02:00
Łukasz Magiera
9331714089
Merge pull request #7707 from filecoin-project/fix/app-image-build 
Disable appimage
 2021-12-02 14:39:48 +01:00
Łukasz Magiera
d5e1cc095c
Merge pull request #7725 from filecoin-project/feat/open-telemetry 
Initial switch to OpenTelemetry
 2021-12-02 14:39:20 +01:00
hannahhoward
bfd1099ef3 fix(main): fix bug in startup when tracing is not present 2021-12-01 18:53:00 -08:00
hannahhoward
f3b691d618 feat(tracing): switch to OpenTelemetry 
Switch the underlying tracing library to OpenTelemetry, with a bridge to OpenCensus for
compatibility
 2021-12-01 16:19:47 -08:00
Travis Person
66c8c66f40 disable building of appimage on release 
appimage testing is currently broken due to a requirement to have access
to /dev/snd, which is not present on the image we are using in circleci.
 2021-12-01 19:15:35 +00:00
Jiaying Wang
0cfc344f82
Merge pull request #7717 from filecoin-project/jen/bumpmaster 
Bump the master version to v1.13.3-dev
 2021-11-30 19:06:46 -05:00
Jennifer Wang
c3ecf8355d docs gen 2021-11-30 18:29:13 -05:00
Jennifer Wang
a09aa0aa72 Bump the master version to v1.13.3-dev 2021-11-30 18:24:34 -05:00
Łukasz Magiera
26c9120d22
Merge pull request #7714 from filecoin-project/feat/sched-review 
Address Scheduler enhancements (#7703) review
 2021-11-30 23:03:03 +01:00
Łukasz Magiera
71329f6c41 Address Scheduler enhancements (#7703) review 2021-11-30 20:50:40 +01:00
Łukasz Magiera
73f16f08e3
Merge pull request #7703 from filecoin-project/feat/scheduler-enhancements 
Scheduler enhancements
 2021-11-30 19:14:25 +01:00
Łukasz Magiera
330cfc33ee worker: Typo in resources cmd usage 
Co-authored-by: Aayush Rajasekaran <arajasek94@gmail.com>
 2021-11-30 02:06:58 +01:00
Łukasz Magiera
cf20b0b2b8 worker: Command to print resource-table env vars 2021-11-30 02:06:58 +01:00
Łukasz Magiera
001ecbb561 fix lint 2021-11-30 02:06:58 +01:00
Łukasz Magiera
a597b072b8 fix sched tests 2021-11-30 02:06:58 +01:00
Łukasz Magiera
f25efecb74 worker: Test resource table overrides 2021-11-30 02:06:58 +01:00
Łukasz Magiera
6d52d8552b Fix docsgen 2021-11-30 02:06:58 +01:00
Łukasz Magiera
c9a2ff4007 cleanup worker resource overrides 2021-11-30 02:06:58 +01:00
Łukasz Magiera
b961e1aab5 sched resources: Separate Parallelism defaults depending on GPU presence 2021-11-30 02:06:58 +01:00
Łukasz Magiera
36868a8749 sched: C2 is not all-core load 2021-11-30 02:06:58 +01:00
Clint Armstrong
4ef8543128 Permit workers to override resource table 
In an environment with heterogenious worker nodes, a universal resource
table for all workers does not allow effective scheduling of tasks. Some
workers may have different proof cache settings, changing the required
memory for different tasks. Some workers may have a different count of
CPUs per core-complex, changing the max parallelism of PC1.

This change allows workers to customize these parameters with
environment variables. A worker could set the environment variable
PC1_MIN_MEMORY for example to customize the minimum memory requirement
for PC1 tasks. If no environment variables are specified, the resource
table on the miner is used, except for PC1 parallelism.

If PC1_MAX_PARALLELISM is not specified, and
FIL_PROOFS_USE_MULTICORE_SDR is set, PC1_MAX_PARALLELSIM will
automatically be set to FIL_PROOFS_MULTICORE_SDR_PRODUCERS + 1.
 2021-11-30 02:06:58 +01:00