Łukasz Magiera
6ddbe41376
Merge remote-tracking branch 'origin/master' into feat/post-worker
2022-03-18 10:54:44 +01:00
Łukasz Magiera
ff14cd3f9d
fix: Estimate deal weight in sector list when upgrading
2022-03-17 14:52:54 +01:00
Łukasz Magiera
a3bdd29615
Merge pull request #8330 from filecoin-project/feat/snap-queue
...
feat: sealing: Sector upgrade queue
2022-03-16 22:24:45 +01:00
Łukasz Magiera
a431fdbdde
miner cli: Treat Activating sectors like Proving in sectors list
2022-03-16 22:16:39 +01:00
Darko Brdareski
79453663b3
feat: Add additional test annotations ( #8272 )
...
* Annotate api,proxy_util,blockstore_badger, policy tests
* Annotate splitstore: bsbadger / markset
* Annotate splitstore feature
* Annotate union/timed blockstore tests
* Annotate openrpc, diff_adt tests
* Annotate error,drand,events tests
* Annotate predicates_test
* Fix annotations
* Annotate tscache, gen tests
* Annotate fundmanager test
* Annotate repub and selection tests
* Annotate statetree_test
* Annotate forks_test
* Annotate searchwait_test.go
* Fix duplicated @@ symbols
* Annotate chain stmgr/store tests
* Annotate more (types) tests
* More tests annotated
* Annotate conformance chaos actor tests
* Annotate more integration tests
* Annotate journal system tests
* Annotate more tests.
* Annotate gas,head buffer behaviors
* Fix markset annotations
* doc: test annotations for the markets dagstore wrapper
* Annotate miner_api test in dagstore
* Annotate more test files
* Remove bad annotations from fsrepo
* Annotate wdpost system
* Remove bad annotations
* Renamce "conformance" to "chaos_actor" tests
* doc: stm annotations for blockheader & election proof tests
* Annotate remaining "A" tests
* annotate: stm for error_test
* memrepo_test.go
* Annotate "b" file tests
* message_test.go
* doc: stm annotate for fsrepo_test
* Annotate "c" file tests
* Annotate "D" test files
* message_test.go
* doc: stm annotate for chain, node/config & client
* docs: stm annotate node_test
* Annotate u,v,wl tests
* doc: stm annotations for various test files
* Annotate "T" test files
* doc: stm annotate for proxy_util_test & policy_test
* doc: stm annotate for various tests
* doc: final few stm annotations
* Add mempool unit tests
* Add two more memPool Add tests
* Update submodules
* Add check function tests
* Add stm annotations, refactor test helper
* Annotate api,proxy_util,blockstore_badger, policy tests
* Annotate splitstore: bsbadger / markset
solving merge conflicts
* Annotate splitstore feature
* Annotate union/timed blockstore tests
* Annotate openrpc, diff_adt tests
* Annotate error,drand,events tests
* Annotate predicates_test
* Fix annotations
* Annotate tscache, gen tests
* Annotate fundmanager test
* Annotate statetree_test
* Annotate forks_test
* Annotate searchwait_test.go
* Fix duplicated @@ symbols
* Annotate chain stmgr/store tests
* Annotate more (types) tests
* More tests annotated
* Annotate conformance chaos actor tests
* Annotate more integration tests
* Annotate journal system tests
* Annotate more tests.
* Annotate gas,head buffer behaviors
solve merge conflict
* Fix markset annotations
* Annotate miner_api test in dagstore
* Annotate more test files
* doc: test annotations for the markets dagstore wrapper
* Annotate wdpost system
* Renamce "conformance" to "chaos_actor" tests
* Annotate remaining "A" tests
* doc: stm annotations for blockheader & election proof tests
* annotate: stm for error_test
* Annotate "b" file tests
* memrepo_test.go
* Annotate "c" file tests
* message_test.go
* Annotate "D" test files
* doc: stm annotate for fsrepo_test
* Annotate u,v,wl tests
* message_test.go
* doc: stm annotate for chain, node/config & client
* docs: stm annotate node_test
* Annotate "T" test files
* doc: stm annotations for various test files
* Add mempool unit tests
solve merge conflict
* doc: stm annotate for proxy_util_test & policy_test
* doc: stm annotate for various tests
* doc: final few stm annotations
* Add two more memPool Add tests
* Update submodules
* Add check function tests
solve conflict
* Add stm annotations, refactor test helper
solve merge conflict
* Change CLI test kinds to "unit"
* Fix double merged test
* Fix ccupgrade_test merge
* Fix lint issues
* Add stm annotation to types_Test
* Test vectors submodule
* Add file annotation to burn_test
Co-authored-by: Nikola Divic <divicnikola@gmail.com>
Co-authored-by: TheMenko <themenkoprojects@gmail.com>
2022-03-16 18:37:34 +01:00
Łukasz Magiera
aef2ec513f
feat: sealing: Sector upgrade queue
2022-03-16 17:33:05 +01:00
Łukasz Magiera
9f6f94bd02
Merge pull request #8215 from filecoin-project/feat/remove-mark-for-upgrade
...
chore:sealing:remove endpoint from cli
2022-03-16 15:33:21 +01:00
Łukasz Magiera
c6bda0e5d4
fix: storage cli: Output primary sector status correctly
2022-03-15 14:29:21 +01:00
Łukasz Magiera
ce99aad438
Fix provingCheckProvableCmd
2022-03-11 18:13:51 +01:00
Łukasz Magiera
046a9f8af0
Merge remote-tracking branch 'origin/master' into feat/post-worker
2022-03-09 16:27:03 +01:00
Łukasz Magiera
5416ce5443
Merge pull request #7313 from filecoin-project/feat/cid-to-piece-idx
...
feat: markets: Integrate index ingest protocol and retrieve by any CID
2022-03-03 16:50:35 +00:00
zenground0
874124c4e7
Handle finalize failures in fsm
2022-03-02 09:33:33 -07:00
Masih H. Derkani
769b0f30ef
Address review comments
...
- Add comment to clarify the reason for loop in testkit
- Trim common prefix in state printed in CLI commands for better
readability
- Upgrade to a tagged release of `go-fil-markets` that includes indexing
work; see: https://github.com/filecoin-project/go-fil-markets/pull/673
- Fix typo in CLI usage.
- Add comments to note that it is safe to use fx `OnStart` context when
starting the provider engine.
- Fix string concatenation in error message formatting.
2022-03-02 11:04:50 +00:00
zenground0
a463c90057
remove endpoint from cli
2022-03-01 11:27:03 -07:00
zenground0
77a954c7c3
Merge branch 'master' into feat/cid-to-piece-idx
2022-02-28 12:57:11 -07:00
duzy555666
296ae4305f
avoid panic
2022-02-28 16:51:15 +08:00
jennijuju
52756128da
add flag usage
2022-02-25 10:49:18 -05:00
zenground0
367146f032
add rdi flag for abort upgrade
2022-02-24 15:20:21 -07:00
zenground0
abe04c33c1
Fix fault tracker to handle snap deals
2022-02-23 09:56:47 -07:00
Aarsh Shah
e3f5b7c59f
update dagstore top level index db
2022-02-18 14:00:01 +04:00
Łukasz Magiera
c974872494
lotus-miner: More sector-related data in info all
2022-02-17 16:35:09 +01:00
Łukasz Magiera
7823363bba
lotus-miner: Support update files in storage find
2022-02-17 16:29:27 +01:00
Łukasz Magiera
6f21a10a56
Merge pull request #8098 from filecoin-project/feat/sectorlist-pledge
...
feat: lotus-miner sectors list --initial-pledge
2022-02-15 16:44:49 +01:00
Łukasz Magiera
a3e785cb4a
Merge pull request #8057 from mtelka/info-noadmin
...
fix: state: Allow lotus-miner info to complete without admin permission
2022-02-15 15:00:29 +01:00
Łukasz Magiera
0b7addc031
lotus-miner sectors list --initial-pledge
2022-02-15 14:21:30 +01:00
Aayush
eebe784191
fix: sealer: allow enable/disabling ReplicaUpdate tasks
2022-02-14 15:08:28 -05:00
Marcel Telka
3c82ee49c0
Allow lotus-miner info to complete without admin permission
2022-02-10 12:45:57 +01:00
Jennifer Wang
de1f4792cd
Merge remote-tracking branch 'origin/master' into jen/v15
2022-02-09 19:27:34 -05:00
Łukasz Magiera
947000c94f
fsm: Call ReleaseSectorKey after WinningPoSt lookback period
2022-02-09 12:41:39 +01:00
Jennifer Wang
6ed97f0d04
Merge branch 'release/v1.14.0' into jen/v15
2022-02-09 03:17:38 -05:00
Aayush
1b18236f91
feat: sealer: allow users to abort in-flight snap upgrades
2022-01-25 13:01:51 -05:00
Aarsh Shah
9ee940098d
Merge remote-tracking branch 'origin/master' into feat/cid-to-piece-idx
2022-01-20 16:21:48 +04:00
Łukasz Magiera
b38141601c
Untangle ffi from api
2022-01-18 11:57:04 +01:00
Aayush Rajasekaran
51b4458d32
Resolve conflict
2022-01-14 17:18:47 -05:00
Aayush Rajasekaran
e4cb68e05d
format
2022-01-14 17:14:32 -05:00
Jennifer Wang
60cf2a71cf
fix lint
2022-01-14 17:14:32 -05:00
Jennifer Wang
87babdf3e7
Disable mark-for-upgrade two days before the network v15 OhSnap upgrade to avoid unexpected edge cases that may cause deal/sector failure
2022-01-14 17:14:32 -05:00
zenground0
d6aa17e21f
Snap Deals Integration
...
- FSM handles the actual cc upgrade process including error states
- PoSting (winning and window) works over upgraded and upgrading sectors
- Integration test and changes to itest framework to reduce flakes
- Update CLI to handle new upgrade
- Update dependencies
2022-01-14 17:14:32 -05:00
Aayush Rajasekaran
52411b12e3
Resolve conflict
2022-01-12 19:15:56 -05:00
Aarsh Shah
8c8652e7bb
add a new cli
2022-01-12 18:06:48 +04:00
Aarsh Shah
edfc2c215c
Merge remote-tracking branch 'origin/main' into feat/cid-to-piece-idx
2022-01-12 12:48:54 +04:00
Aayush Rajasekaran
1e24ef4d0d
format
2022-01-11 12:50:34 -05:00
Jiaying Wang
93653d9a58
Merge branch 'feat/snap-deals' into 7891
2022-01-10 22:22:46 -05:00
zenground0
33f2d24f54
Snap Deals Integration
...
- FSM handles the actual cc upgrade process including error states
- PoSting (winning and window) works over upgraded and upgrading sectors
- Integration test and changes to itest framework to reduce flakes
- Update CLI to handle new upgrade
- Update dependencies
2022-01-10 15:39:38 +05:30
Jennifer Wang
bf23e59900
fix lint
2022-01-07 18:24:57 -05:00
Jennifer Wang
c578efaabd
Disable mark-for-upgrade two days before the network v15 OhSnap upgrade to avoid unexpected edge cases that may cause deal/sector failure
2022-01-07 18:05:36 -05:00
zenground0
61e173215b
Snap Deals Integration
...
- FSM handles the actual cc upgrade process including error states
- PoSting (winning and window) works over upgraded and upgrading sectors
- Integration test and changes to itest framework to reduce flakes
- Update CLI to handle new upgrade
- Update dependencies
2022-01-05 03:10:31 -05:00
hannahhoward
ced22687eb
fix(cmd): fix cli peer decoding
2021-12-22 13:41:56 -08:00
hannahhoward
cddf63efe9
feat(storageminer): add api for transfer diagnostics
...
Add API + CLI for inspecting in depth diagnostics on graphsync transfers with a given peer
2021-12-22 13:41:29 -08:00
Aayush Rajasekaran
dd20829dbe
Merge pull request #7762 from filecoin-project/feat/sectors-update-state-guard
...
sectors update-state checks if sector exists before changing its state
2021-12-17 19:21:26 -05:00
gstuart
27e48d73dd
Check if sector exists before changing its state
2021-12-17 14:32:18 -05:00
vyzo
dd327f0b22
plumb more contexts
2021-12-17 11:42:09 +02:00
Aayush Rajasekaran
0e2278cc76
Merge branch 'master' into deps/update-ctx-dsbs
2021-12-14 18:08:29 -05:00
vyzo
2e057b8f52
plumb contexts in lotus-miner
2021-12-13 14:28:29 +02:00
gstuart
21e6c963ab
Sort lotus-miner retrieval-deals by dealId
2021-12-09 19:53:13 -05:00
Łukasz Magiera
727765b248
Command to list active sector locks
2021-12-03 12:33:23 +01:00
hannahhoward
bfd1099ef3
fix(main): fix bug in startup when tracing is not present
2021-12-01 18:53:00 -08:00
hannahhoward
f3b691d618
feat(tracing): switch to OpenTelemetry
...
Switch the underlying tracing library to OpenTelemetry, with a bridge to OpenCensus for
compatibility
2021-12-01 16:19:47 -08:00
Clint Armstrong
93e4656a27
Use a float to represent GPU utilization
...
Before this change workers can only be allocated one GPU task,
regardless of how much of the GPU resources that task uses, or how many
GPUs are in the system.
This makes GPUUtilization a float which can represent that a task needs
a portion, or multiple GPUs. GPUs are accounted for like RAM and CPUs so
that workers with more GPUs can be allocated more tasks.
A known issue is that PC2 cannot use multiple GPUs. And even if the
worker has multiple GPUs and is allocated multiple PC2 tasks, those
tasks will only run on the first GPU.
This could result in unexpected behavior when a worker with multiple
GPUs is assigned multiple PC2 tasks. But this should not suprise any
existing users who upgrade, as any existing users who run workers with
multiple GPUs should already know this and be running a worker per GPU
for PC2. But now those users have the freedom to customize the GPU
utilization of PC2 to be less than one and effectively run multiple PC2
processes in a single worker.
C2 is capable of utilizing multiple GPUs, and now workers can be
customized for C2 accordingly.
2021-11-30 02:06:58 +01:00
Clint Armstrong
c4f46171ae
Report memory used and swap used in worker res
...
Attempting to report "memory used by other processes" in the MemReserved
field fails to take into account the fact that the system's memory used
includes memory used by ongoing tasks.
To properly account for this, worker should report the memory and swap
used, then the scheduler that is aware of the memory requirements for a
task can determine if there is sufficient memory available for a task.
2021-11-30 02:06:58 +01:00
Łukasz Magiera
f8b132890c
Add verbose mode to lotus-miner pieces list-cids
2021-11-29 17:19:47 +01:00
Łukasz Magiera
b522901845
update storage attach allowTo usage
2021-11-23 16:23:06 +01:00
Łukasz Magiera
e362d47903
Add optional group flags to storage attach commands
2021-11-23 16:11:04 +01:00
Łukasz Magiera
b1781c33ce
Show group info in storage list
2021-11-23 16:11:04 +01:00
Anton Evangelatov
5454aebf13
CLI tools for the DAGStore inverted index ( #7361 )
...
* cli commands for dagstore
* address comments from Dirk
* rename inverted index to piece index
2021-11-17 15:39:45 +02:00
Dirk McCormick
599a6bfb24
fix: err message
2021-11-17 12:37:15 +01:00
Dirk McCormick
501308239f
feat: CLI command to announce deal to indexers
2021-11-17 12:16:22 +01:00
Aayush Rajasekaran
3be0c068b9
Shed: Add a util to create miners more easily
2021-11-03 00:20:48 +00:00
Jennifer Wang
dc6bd2b015
use existing util
2021-10-26 20:53:16 -04:00
Jennifer Wang
18834de7d0
parse attofil to fil
2021-10-26 19:37:29 -04:00
Łukasz Magiera
f7884c4f45
Merge pull request #7527 from filecoin-project/feat/show-prepared-waitres
...
Show prepared tasks in sealing jobs
2021-10-20 15:22:35 +01:00
Łukasz Magiera
ba171954b4
Merge pull request #7479 from filecoin-project/feat/prov-check-by-storage
...
Add storage-id flag to proving check
2021-10-19 10:06:30 +01:00
Łukasz Magiera
261238e157
Show prepared tasks in sealing jobs
2021-10-18 18:44:56 +02:00
Jennifer Wang
d1e15e61d0
Merge branch 'release/v1.12.0' into jen/12-master
2021-10-11 14:37:32 -04:00
Jennifer Wang
16743a25c2
print confidence in decimal
2021-10-11 12:34:51 -04:00
dirkmc
f9433811c7
Merge pull request #7454 from filecoin-project/nonsense/retry-in-publish-deal
...
itests: retry deal when control addr is out of funds
2021-10-11 15:14:27 +02:00
Jakub Sztandera
e40c7b7a86
Fix withdrawn amount equiality check
...
Co-authored-by: Jiaying Wang <42981373+jennijuju@users.noreply.github.com>
2021-10-11 08:24:33 -04:00
Aayush Rajasekaran
cab724841a
Update cmd/lotus-miner/actor.go
...
Co-authored-by: Jiaying Wang <42981373+jennijuju@users.noreply.github.com>
2021-10-11 08:24:00 -04:00
Aayush Rajasekaran
2241f02621
Bugfix: actor withdraw CLI should depend on network version
2021-10-11 08:23:53 -04:00
Anton Evangelatov
1acb6b4328
update CLI command to take arg; reduce time for itest
2021-10-11 14:03:56 +02:00
Anton Evangelatov
6e5ccc87cf
cli: add retry for deals stuck in Publish with no funds
2021-10-11 14:03:55 +02:00
Jakub Sztandera
8533ae0032
Fix withdrawn amount equiality check
...
Co-authored-by: Jiaying Wang <42981373+jennijuju@users.noreply.github.com>
2021-10-11 14:03:28 +02:00
Aayush Rajasekaran
be774f55ce
Update cmd/lotus-miner/actor.go
...
Co-authored-by: Jiaying Wang <42981373+jennijuju@users.noreply.github.com>
2021-10-10 10:40:22 -04:00
Aayush Rajasekaran
e158b1d1e4
Bugfix: actor withdraw CLI should depend on network version
2021-10-09 20:17:03 -04:00
Łukasz Magiera
bfcfb199a0
Add storage-id flag to proving check
2021-10-08 14:56:08 +02:00
Jennifer Wang
38e01cba83
Merge branch 'release/v1.12.0' into jen/12tomaster
2021-10-04 02:38:00 -04:00
Łukasz Magiera
95e8b59367
Merge pull request #7341 from filecoin-project/mg/feat/panic-reporter
...
feat: Catch panic to generate report and reraise
2021-10-01 10:50:19 +01:00
Mike Greenberg
2f8a2fc907
fix: Update lotusminer default paths
...
Co-authored-by: Łukasz Magiera <magik6k@users.noreply.github.com>
2021-09-30 09:06:55 -04:00
Aayush Rajasekaran
2bafdf7271
Modify tooling to support new WithdrawBalance return
2021-09-29 13:01:04 -04:00
Łukasz Magiera
53a9dd5da4
Add more info to miner allinfo command
2021-09-24 12:02:06 +02:00
Łukasz Magiera
0e7e665e6d
Merge pull request #7312 from filecoin-project/nonsense/crossref-datatransfer-storagedeal
...
add `lotus-miner storage-deals list --format=json` with transfers
2021-09-24 10:57:59 +01:00
Aarsh Shah
a80bc34d59
fix build
2021-09-21 15:23:01 +04:00
Mike Greenberg
3508a5b664
chore: Use After hooks and proper args
2021-09-17 18:01:54 -04:00
Aayush Rajasekaran
888b2040de
Miner CLI: Allow trying to change owners of any miner actor
2021-09-14 11:50:30 +02:00
Anton Evangelatov
3e10f2e250
make gen
2021-09-10 15:18:32 +02:00
Anton Evangelatov
67dc7523d5
fixup
2021-09-10 15:09:37 +02:00
Anton Evangelatov
caaff9b7af
remove flag
2021-09-10 15:06:51 +02:00
Anton Evangelatov
fe602ab3bb
refactor
2021-09-10 15:05:51 +02:00
Łukasz Magiera
b4a3eb55e1
Show more deal states in miner info
2021-09-10 12:21:33 +02:00
Anton Evangelatov
027c1b5ab8
add lotus-miner storage-deals lwt
2021-09-10 12:21:02 +02:00
