cerc-io/lotus
16
0
Fork 0
Code Issues Pull Requests Packages Projects Releases 27 Wiki Activity
15,771 Commits 24 Branches 342 Tags 314 MiB
d0c97e07f9
Commit Graph

2624 Commits

Author SHA1 Message Date
Łukasz Magiera
c974872494 lotus-miner: More sector-related data in info all 2022-02-17 16:35:09 +01:00
Łukasz Magiera
7823363bba lotus-miner: Support update files in storage find 2022-02-17 16:29:27 +01:00
Travis Person
ca9bcc90a5 lotus-seed: set current network version from params 
allows automation to correctly set the network version for the currently
built network with no variable inputs.
 2022-02-16 21:02:51 +00:00
Łukasz Magiera
6f21a10a56
Merge pull request #8098 from filecoin-project/feat/sectorlist-pledge 
feat: lotus-miner sectors list --initial-pledge
 2022-02-15 16:44:49 +01:00
Łukasz Magiera
a3e785cb4a
Merge pull request #8057 from mtelka/info-noadmin 
fix: state: Allow lotus-miner info to complete without admin permission
 2022-02-15 15:00:29 +01:00
Łukasz Magiera
0b7addc031 lotus-miner sectors list --initial-pledge 2022-02-15 14:21:30 +01:00
Aayush
eebe784191 fix: sealer: allow enable/disabling ReplicaUpdate tasks 2022-02-14 15:08:28 -05:00
Steven Allen
e89f7d9023 feat: shed: add a state-tree diff command to lotus shed 
This makes it easier to debug state mismatches by providing a nice way
to figure out which actors differ between two state-trees and
how (balance, nonce, state, etc.).

It doesn't provide a way to actually _diff_ those state-trees, but one
can use `lotus chain get` to figure that out (although it would be
_nice_ to provide something a bit smarter).
 2022-02-11 10:35:56 -08:00
Marcel Telka
3c82ee49c0 Allow lotus-miner info to complete without admin permission 2022-02-10 12:45:57 +01:00
Jennifer Wang
de1f4792cd Merge remote-tracking branch 'origin/master' into jen/v15 2022-02-09 19:27:34 -05:00
Łukasz Magiera
e7038d286d
Merge pull request #8018 from filecoin-project/feat/fru 
FinalizeReplicaUpdate
 2022-02-09 17:40:47 +00:00
Łukasz Magiera
eff73c9728
Merge pull request #7941 from filecoin-project/chore/more_detailed_network-wide_shed_stats 
chore: shed: storage stats 2.0
 2022-02-09 12:03:49 +00:00
Łukasz Magiera
947000c94f fsm: Call ReleaseSectorKey after WinningPoSt lookback period 2022-02-09 12:41:39 +01:00
Jennifer Wang
6ed97f0d04 Merge branch 'release/v1.14.0' into jen/v15 2022-02-09 03:17:38 -05:00
Łukasz Magiera
09cfad9d71 Add FinalizeReplicaUpdate into some more places 2022-02-08 17:22:41 +01:00
Aarsh Shah
399a1afd94 Merge remote-tracking branch 'origin/master' into feat/cid-to-piece-idx 2022-02-08 12:37:57 +04:00
Łukasz Magiera
98f4d37f1a Merge remote-tracking branch 'origin/master' into feat/post-worker 2022-01-31 19:50:52 +00:00
Aayush
1b18236f91 feat: sealer: allow users to abort in-flight snap upgrades 2022-01-25 13:01:51 -05:00
Raúl Kripalani
3aab77af8d tvx: add missing network upgrade names. 2022-01-24 20:13:04 +00:00
Raúl Kripalani
85447abe7f tvx: supply network version when extracting messages. 2022-01-24 20:06:07 +00:00
Aarsh Shah
9ee940098d Merge remote-tracking branch 'origin/master' into feat/cid-to-piece-idx 2022-01-20 16:21:48 +04:00
Łukasz Magiera
b38141601c Untangle ffi from api 2022-01-18 11:57:04 +01:00
Łukasz Magiera
03fa955e9e Cleanup imports 2022-01-18 11:37:24 +01:00
Łukasz Magiera
0c062f9c08 Merge remote-tracking branch 'origin/master' into feat/post-worker 2022-01-18 10:49:42 +01:00
Jennifer Wang
ca444bb71d revert #7646 from v1.14.0 - this is not concensus breaking change and needs more testing before landing 2022-01-14 19:00:33 -05:00
Aayush Rajasekaran
51b4458d32 Resolve conflict 2022-01-14 17:18:47 -05:00
Aayush Rajasekaran
790ba155b8 Fast migration for v15 2022-01-14 17:15:15 -05:00
Aayush Rajasekaran
e4cb68e05d format 2022-01-14 17:14:32 -05:00
Jennifer Wang
60cf2a71cf fix lint 2022-01-14 17:14:32 -05:00
Jennifer Wang
87babdf3e7 Disable mark-for-upgrade two days before the network v15 OhSnap upgrade to avoid unexpected edge cases that may cause deal/sector failure 2022-01-14 17:14:32 -05:00
Aayush Rajasekaran
ca57546ef5 Remove unnecessary params from VerifyWinningPost 2022-01-14 17:14:32 -05:00
Łukasz Magiera
7bd9af7856 address review 2022-01-14 17:14:32 -05:00
zenground0
d6aa17e21f Snap Deals Integration 
- FSM handles the actual cc upgrade process including error states
- PoSting (winning and window) works over upgraded and upgrading sectors
- Integration test and changes to itest framework to reduce flakes
- Update CLI to handle new upgrade
- Update dependencies
 2022-01-14 17:14:32 -05:00
Aayush Rajasekaran
a8cb027c08 Integrate v7 actors 2022-01-14 17:14:32 -05:00
Łukasz Magiera
4a874eff70 post workers: Cleanup, tests 2022-01-14 14:17:52 +01:00
Peter Rabbitson
e3c250f240 Force float in output to remain decimal 2022-01-14 13:17:45 +01:00
Peter Rabbitson
d568d6fabc As per Why&Aayush: slashing deals is not really a thing 2022-01-13 20:03:33 +01:00
Peter Rabbitson
9a5b13b7c8 Storage stats 2.0 2022-01-13 17:21:13 +01:00
Aayush Rajasekaran
52411b12e3 Resolve conflict 2022-01-12 19:15:56 -05:00
Aayush Rajasekaran
b161f56bd2
Merge pull request #7933 from filecoin-project/asr/migration-autobatch 
feat: state: Fast migration for v15
 2022-01-12 17:17:49 -05:00
Aarsh Shah
8c8652e7bb add a new cli 2022-01-12 18:06:48 +04:00
Aarsh Shah
edfc2c215c Merge remote-tracking branch 'origin/main' into feat/cid-to-piece-idx 2022-01-12 12:48:54 +04:00
Aayush Rajasekaran
f87d8d0b7f
Merge pull request #7900 from filecoin-project/7891 
enhancement: #7891 sectors: disable existing existing cc upgrade path 2 days before the upgrade epoch
 2022-01-11 18:12:16 -05:00
Aayush Rajasekaran
8aabe1b488 Fast migration for v15 2022-01-11 17:19:38 -05:00
Aayush Rajasekaran
1e24ef4d0d format 2022-01-11 12:50:34 -05:00
Aayush Rajasekaran
d645c5fbab Remove unnecessary params from VerifyWinningPost 2022-01-11 12:06:39 -05:00
Łukasz Magiera
960759d22b address review 2022-01-11 17:31:27 +01:00
Jiaying Wang
93653d9a58
Merge branch 'feat/snap-deals' into 7891 2022-01-10 22:22:46 -05:00
Łukasz Magiera
cf7dd36829 Merge branch 'feat/decoupling-post-worker' of github.com:wusirdcenter/lotus into feat/decoupling-post-worker 2022-01-10 15:06:04 +01:00
zenground0
33f2d24f54 Snap Deals Integration 
- FSM handles the actual cc upgrade process including error states
- PoSting (winning and window) works over upgraded and upgrading sectors
- Integration test and changes to itest framework to reduce flakes
- Update CLI to handle new upgrade
- Update dependencies
 2022-01-10 15:39:38 +05:30
Jennifer Wang
bf23e59900 fix lint 2022-01-07 18:24:57 -05:00
Jennifer Wang
c578efaabd Disable mark-for-upgrade two days before the network v15 OhSnap upgrade to avoid unexpected edge cases that may cause deal/sector failure 2022-01-07 18:05:36 -05:00
zenground0
61e173215b Snap Deals Integration 
- FSM handles the actual cc upgrade process including error states
- PoSting (winning and window) works over upgraded and upgrading sectors
- Integration test and changes to itest framework to reduce flakes
- Update CLI to handle new upgrade
- Update dependencies
 2022-01-05 03:10:31 -05:00
Raúl Kripalani
75d8c52004 tvx runner: exec: add support for multiple-level dirs. 2022-01-04 18:13:24 +00:00
mz-sirius
3fd55fa56b decoupling winningpost and windowpost from lotus-miner 2022-01-05 01:50:49 +08:00
Łukasz Magiera
63d7ca328f
Merge branch 'master' into asr/shed-balances 2022-01-04 16:52:37 +01:00
hannahhoward
ced22687eb fix(cmd): fix cli peer decoding 2021-12-22 13:41:56 -08:00
hannahhoward
cddf63efe9 feat(storageminer): add api for transfer diagnostics 
Add API + CLI for inspecting in depth diagnostics on graphsync transfers with a given peer
 2021-12-22 13:41:29 -08:00
Aayush Rajasekaran
1bc987772c
Merge pull request #7818 from filecoin-project/asr/vm-nvfactor 
Refactor: VM: Remove the NetworkVersionGetter
 2021-12-21 12:19:53 -05:00
Aayush Rajasekaran
dd20829dbe
Merge pull request #7762 from filecoin-project/feat/sectors-update-state-guard 
sectors update-state checks if sector exists before changing its state
 2021-12-17 19:21:26 -05:00
Aayush Rajasekaran
670bd993f3 Refactor: VM: Remove the NetworkVersionGetter 2021-12-17 19:14:21 -05:00
Aayush Rajasekaran
6f6f5d79fb Refactor: State: Let Rand get network versions 2021-12-17 18:54:17 -05:00
Aayush Rajasekaran
3f4eaa99d5 Refactor: State: Rename stmgr::GetNtwkVersion to GetNetworkVersion 2021-12-17 18:43:39 -05:00
gstuart
27e48d73dd Check if sector exists before changing its state 2021-12-17 14:32:18 -05:00
Łukasz Magiera
66f8f8aff2 fix shed 2021-12-17 13:05:44 +01:00
Łukasz Magiera
bc384c01e3 Merge remote-tracking branch 'origin/master' into deps/update-ctx-dsbs 2021-12-17 13:01:22 +01:00
Łukasz Magiera
29d5976c01
Merge pull request #7774 from filecoin-project/asr/shed-pieces 
Shed: Add a util to list terminated deals
 2021-12-17 11:26:01 +01:00
vyzo
6ba2533e2b fix lotus-shed 2021-12-17 11:47:28 +02:00
vyzo
dd327f0b22 plumb more contexts 2021-12-17 11:42:09 +02:00
Jennifer Wang
fac769ff17 i forced pushed and brought a bug that was fixed back so im fixing it back 2021-12-16 22:25:00 -05:00
Aayush Rajasekaran
0e2278cc76 Merge branch 'master' into deps/update-ctx-dsbs 2021-12-14 18:08:29 -05:00
Aayush Rajasekaran
80d5e52923 Merge branch 'master' into next 2021-12-13 13:24:28 -05:00
vyzo
e4233e45be plumb contexts in lotus-sim 2021-12-13 15:15:38 +02:00
vyzo
47bac4a0c9 plumb context in tvx 2021-12-13 15:03:54 +02:00
vyzo
5eb5fcd0f4 fix lotus-bench 2021-12-13 14:46:49 +02:00
vyzo
a8fcaeb141 plumb contexts in lotus-shed 2021-12-13 14:35:24 +02:00
vyzo
2e057b8f52 plumb contexts in lotus-miner 2021-12-13 14:28:29 +02:00
vyzo
84710cf27e plumb more contexts in lotus 2021-12-13 14:26:59 +02:00
Jennifer Wang
8c4c2eeffc add client address 2021-12-13 04:02:53 -05:00
Aayush Rajasekaran
d7528557df Shed: Add a util to list terminated deals 2021-12-12 22:37:05 -05:00
gstuart
21e6c963ab Sort lotus-miner retrieval-deals by dealId 2021-12-09 19:53:13 -05:00
Aayush Rajasekaran
b0a9a27288 Shed: Allow send-csv to specify params and method 2021-12-07 17:14:29 -05:00
Aayush Rajasekaran
c9a557e0d9 Address review 2021-12-07 17:09:07 -05:00
Aayush Rajasekaran
fcb7cd0eb0 Shed: Add a util to send a batch of messages 2021-12-07 17:09:07 -05:00
Łukasz Magiera
727765b248 Command to list active sector locks 2021-12-03 12:33:23 +01:00
hannahhoward
bfd1099ef3 fix(main): fix bug in startup when tracing is not present 2021-12-01 18:53:00 -08:00
hannahhoward
f3b691d618 feat(tracing): switch to OpenTelemetry 
Switch the underlying tracing library to OpenTelemetry, with a bridge to OpenCensus for
compatibility
 2021-12-01 16:19:47 -08:00
Łukasz Magiera
330cfc33ee worker: Typo in resources cmd usage 
Co-authored-by: Aayush Rajasekaran <arajasek94@gmail.com>
 2021-11-30 02:06:58 +01:00
Łukasz Magiera
cf20b0b2b8 worker: Command to print resource-table env vars 2021-11-30 02:06:58 +01:00
Clint Armstrong
93e4656a27 Use a float to represent GPU utilization 
Before this change workers can only be allocated one GPU task,
regardless of how much of the GPU resources that task uses, or how many
GPUs are in the system.

This makes GPUUtilization a float which can represent that a task needs
a portion, or multiple GPUs. GPUs are accounted for like RAM and CPUs so
that workers with more GPUs can be allocated more tasks.

A known issue is that PC2 cannot use multiple GPUs. And even if the
worker has multiple GPUs and is allocated multiple PC2 tasks, those
tasks will only run on the first GPU.

This could result in unexpected behavior when a worker with multiple
GPUs is assigned multiple PC2 tasks. But this should not suprise any
existing users who upgrade, as any existing users who run workers with
multiple GPUs should already know this and be running a worker per GPU
for PC2. But now those users have the freedom to customize the GPU
utilization of PC2 to be less than one and effectively run multiple PC2
processes in a single worker.

C2 is capable of utilizing multiple GPUs, and now workers can be
customized for C2 accordingly.
 2021-11-30 02:06:58 +01:00
Clint Armstrong
c4f46171ae Report memory used and swap used in worker res 
Attempting to report "memory used by other processes" in the MemReserved
field fails to take into account the fact that the system's memory used
includes memory used by ongoing tasks.

To properly account for this, worker should report the memory and swap
used, then the scheduler that is aware of the memory requirements for a
task can determine if there is sufficient memory available for a task.
 2021-11-30 02:06:58 +01:00
Jiaying Wang
4d2f3375e8
Merge pull request #7699 from filecoin-project/feat/listcids-verbose 
Add verbose mode to lotus-miner pieces list-cids
 2021-11-29 17:43:09 -05:00
Łukasz Magiera
f8b132890c Add verbose mode to lotus-miner pieces list-cids 2021-11-29 17:19:47 +01:00
Jakub Sztandera
4d8be81a8f
Add usage 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2021-11-26 15:01:05 +01:00
Jakub Sztandera
e3c7b8d006
Fix typo 
Co-authored-by: Aayush Rajasekaran <arajasek94@gmail.com>
 2021-11-26 14:42:18 +01:00
Jakub Sztandera
af113f867d
Add dump code 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2021-11-25 20:53:49 +01:00
Łukasz Magiera
b522901845 update storage attach allowTo usage 2021-11-23 16:23:06 +01:00
Łukasz Magiera
e362d47903 Add optional group flags to storage attach commands 2021-11-23 16:11:04 +01:00
Łukasz Magiera
b1781c33ce Show group info in storage list 2021-11-23 16:11:04 +01:00
Łukasz Magiera
51753a1e25
Merge pull request #7414 from filecoin-project/feat/shed-wallet-balancer 
shed: simple wallet balancer util
 2021-11-22 18:11:42 +01:00
Łukasz Magiera
0262f1cd6e shed: simple wallet balancer util 2021-11-22 14:29:23 +01:00
Łukasz Magiera
81a2f2f06d
Merge pull request #7329 from filecoin-project/feat/lotus-stats-update 
Add caches to lotus-stats and splitcode
 2021-11-22 12:44:00 +01:00
Łukasz Magiera
9adaa9b967 lotus-shed msg: Decode submessages/msig proposals 2021-11-17 23:10:14 +01:00
Aayush Rajasekaran
1449644c34 Integrate v7 actors 2021-11-17 15:55:14 -05:00
Anton Evangelatov
5454aebf13
CLI tools for the DAGStore inverted index (#7361) 
* cli commands for dagstore

* address comments from Dirk

* rename inverted index to piece index
 2021-11-17 15:39:45 +02:00
Dirk McCormick
599a6bfb24 fix: err message 2021-11-17 12:37:15 +01:00
Dirk McCormick
501308239f feat: CLI command to announce deal to indexers 2021-11-17 12:16:22 +01:00
Aayush Rajasekaran
495f08473d Shed: Add a util to list miner faults 2021-11-07 23:33:37 +00:00
Aayush Rajasekaran
3be0c068b9 Shed: Add a util to create miners more easily 2021-11-03 00:20:48 +00:00
Travis Person
2d4f5958e2 Add caches to lotus-stats and splitcode 2021-11-01 09:05:14 +00:00
Jennifer Wang
dc6bd2b015 use existing util 2021-10-26 20:53:16 -04:00
Jennifer Wang
18834de7d0 parse attofil to fil 2021-10-26 19:37:29 -04:00
Aayush Rajasekaran
e1deed3b1a
Merge pull request #7544 from filecoin-project/asr/shed 
Shed: Add a util to find miner based on peerid
 2021-10-20 17:55:16 -07:00
Łukasz Magiera
f7884c4f45
Merge pull request #7527 from filecoin-project/feat/show-prepared-waitres 
Show prepared tasks in sealing jobs
 2021-10-20 15:22:35 +01:00
Aayush Rajasekaran
9ba7f372cd Shed: Add a util to find miner based on peerid 2021-10-19 18:46:09 -07:00
Łukasz Magiera
ba171954b4
Merge pull request #7479 from filecoin-project/feat/prov-check-by-storage 
Add storage-id flag to proving check
 2021-10-19 10:06:30 +01:00
Łukasz Magiera
261238e157 Show prepared tasks in sealing jobs 2021-10-18 18:44:56 +02:00
Jennifer Wang
d1e15e61d0 Merge branch 'release/v1.12.0' into jen/12-master 2021-10-11 14:37:32 -04:00
Jennifer Wang
16743a25c2 print confidence in decimal 2021-10-11 12:34:51 -04:00
dirkmc
f9433811c7
Merge pull request #7454 from filecoin-project/nonsense/retry-in-publish-deal 
itests: retry deal when control addr is out of funds
 2021-10-11 15:14:27 +02:00
Jakub Sztandera
61e1297cc7 gofmt 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2021-10-11 08:24:55 -04:00
Jakub Sztandera
e40c7b7a86 Fix withdrawn amount equiality check 
Co-authored-by: Jiaying Wang <42981373+jennijuju@users.noreply.github.com>
 2021-10-11 08:24:33 -04:00
Jakub Sztandera
177033d0f2 Fix withdrawn amount equiality check 
Co-authored-by: Jiaying Wang <42981373+jennijuju@users.noreply.github.com>
 2021-10-11 08:24:24 -04:00
Aayush Rajasekaran
cab724841a Update cmd/lotus-miner/actor.go 
Co-authored-by: Jiaying Wang <42981373+jennijuju@users.noreply.github.com>
 2021-10-11 08:24:00 -04:00
Aayush Rajasekaran
2241f02621 Bugfix: actor withdraw CLI should depend on network version 2021-10-11 08:23:53 -04:00
Jakub Sztandera
5abba9ca9f
gofmt 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2021-10-11 14:10:06 +02:00
Anton Evangelatov
1acb6b4328 update CLI command to take arg; reduce time for itest 2021-10-11 14:03:56 +02:00
Anton Evangelatov
6e5ccc87cf cli: add retry for deals stuck in Publish with no funds 2021-10-11 14:03:55 +02:00
Jakub Sztandera
8533ae0032
Fix withdrawn amount equiality check 
Co-authored-by: Jiaying Wang <42981373+jennijuju@users.noreply.github.com>
 2021-10-11 14:03:28 +02:00
Jakub Sztandera
90ff1d3ccf
Fix withdrawn amount equiality check 
Co-authored-by: Jiaying Wang <42981373+jennijuju@users.noreply.github.com>
 2021-10-11 14:03:21 +02:00
Aayush Rajasekaran
be774f55ce
Update cmd/lotus-miner/actor.go 
Co-authored-by: Jiaying Wang <42981373+jennijuju@users.noreply.github.com>
 2021-10-10 10:40:22 -04:00
Aayush Rajasekaran
e158b1d1e4 Bugfix: actor withdraw CLI should depend on network version 2021-10-09 20:17:03 -04:00
Łukasz Magiera
bfcfb199a0 Add storage-id flag to proving check 2021-10-08 14:56:08 +02:00
Peter Rabbitson
8b01725129 Dep upgrade pass 
Touching just the seemingly non-controversial ones
 2021-10-08 12:37:40 +02:00
Aayush Rajasekaran
89db4235ce Shed: Add a util to find the most recent null tipset 2021-10-06 19:37:35 -04:00
Jennifer Wang
38e01cba83 Merge branch 'release/v1.12.0' into jen/12tomaster 2021-10-04 02:38:00 -04:00
Aayush Rajasekaran
a335cb3767 Update to latest actors 2021-10-01 17:11:05 -04:00
Łukasz Magiera
a8a9818043 Expose storage states on the metrics endpoint 2021-10-01 14:45:01 +02:00
Łukasz Magiera
95e8b59367
Merge pull request #7341 from filecoin-project/mg/feat/panic-reporter 
feat: Catch panic to generate report and reraise
 2021-10-01 10:50:19 +01:00
Mike Greenberg
2f8a2fc907
fix: Update lotusminer default paths 
Co-authored-by: Łukasz Magiera <magik6k@users.noreply.github.com>
 2021-09-30 09:06:55 -04:00
Aayush Rajasekaran
2bafdf7271 Modify tooling to support new WithdrawBalance return 2021-09-29 13:01:04 -04:00
Aayush Rajasekaran
c3c46e9097 Fix Drand fetching around null tipsets 2021-09-29 11:57:59 -04:00
Łukasz Magiera
83c8e981b4 lotus shed: fr32 utils 2021-09-27 18:31:36 +02:00
Łukasz Magiera
53a9dd5da4 Add more info to miner allinfo command 2021-09-24 12:02:06 +02:00
Łukasz Magiera
0e7e665e6d
Merge pull request #7312 from filecoin-project/nonsense/crossref-datatransfer-storagedeal 
add `lotus-miner storage-deals list --format=json` with transfers
 2021-09-24 10:57:59 +01:00
Aarsh Shah
a80bc34d59 fix build 2021-09-21 15:23:01 +04:00
Mike Greenberg
3508a5b664 chore: Use After hooks and proper args 2021-09-17 18:01:54 -04:00
Aayush Rajasekaran
888b2040de Miner CLI: Allow trying to change owners of any miner actor 2021-09-14 11:50:30 +02:00
Anton Evangelatov
3e10f2e250 make gen 2021-09-10 15:18:32 +02:00
Anton Evangelatov
67dc7523d5 fixup 2021-09-10 15:09:37 +02:00