sirius
07416e8c0c
update: builtin to builtin11 in wdpost worker
2023-04-21 12:19:06 +08:00
ZenGround0
327760acff
chore: build: Merge/v22 into 21 for 23 ( #10702 )
...
* chore: update ffi to increase execution parallelism
* Don't enforce walking receipt tree during compaction
* fix: build: drop drand incentinet servers
* chore: release lotus v1.20.4
* Apply suggestions from code review
Co-authored-by: Jiaying Wang <42981373+jennijuju@users.noreply.github.com>
* feat: Introduce nv19 skeleton
Update to go-state-types v0.11.0-alpha-1
Introduce dummy v11 actor bundles
Make new actors adapters
Add upgrade to Upgrade Schedules
make jen
Update to go-state-types v0.11.0-alpha-2
* feat: vm: switch to the new exec trace format (#10372 )
This is now "FVM" native. Changes include:
1. Don't treat "trace" messages like off-chain messages. E.g., don't
include CIDs, versions, etc.
2. Include IPLD codecs where applicable.
3. Remove fields that aren't filled by the FVM (timing, some errors,
code locations, etc.).
* feat: implement FIP-0061
* Address review
* Add and test the FIP-0061 migration
* Update actors bundles to fip/20230406
* Update to go-state-types master
* Update to actors v11.0.0-rc1
* - Update go state types
- Keep current expiration defaults on creation, extension some tests
- Update ffi
* ffi experiment
* Integration nv19 migration
- Open splitstore in migration shed tool
- Update state root version
* Post rebase fixup
* Fix
* gen
* nv19 invariant checking
* Try fixig blockstore so bundle is loaded
* Debug
* Fix
* Make butterfly upgrades happen
* Another ffi experiment
* Fix copy paste error
* Actually schedule migration (#10656 )
Co-authored-by: zenground0 <ZenGround0@users.noreply.github.com>
* Butterfly artifacts
* Set calibration net upgrade height
* Review Response
* Fix state tree version assert
* Quick butterfly upgrade to sanity check (#10660 )
* Quick butterfly upgrade to sanity check
* Update butterfly artifacts
* Revert fake fix
* Give butterfly net correct genesis
* Butterfly artifacts
* Give time before upgrade
---------
Co-authored-by: zenground0 <ZenGround0@users.noreply.github.com>
* chore:releasepolish v1.22 release (#10666 )
* Update butterfly artifacts
* register actors v11
* Update calibration upgrade time
* State inspection shed cmds
* Fix
* make gen
* Fix swallowed errors
* Lint fixup
---------
Co-authored-by: zenground0 <ZenGround0@users.noreply.github.com>
* v1.22.0-rc3
* bundle fix
* Feat/expedite nv19 (#10681 )
* Update go-state-types
* Modify upgrade schedule and params
* Revert fip 0052
* Update gst
* docsgen
* fast butterfly migration to validate migration
* Correct epoch to match specified date
* Update actors v11
* Update changelog build version
* Update butterfly artifacts
* Fix lotus-miner init to work after upgrade
---------
Co-authored-by: zenground0 <ZenGround0@users.noreply.github.com>
* fix:deps:stable ffi for stable release (#10698 )
* Point to stable ffi for stable lotus release
* go mod tidy
---------
Co-authored-by: zenground0 <ZenGround0@users.noreply.github.com>
* Update CHANGELOG.md
Co-authored-by: Jiaying Wang <42981373+jennijuju@users.noreply.github.com>
---------
Co-authored-by: Aayush Rajasekaran <arajasek94@gmail.com>
Co-authored-by: zenground0 <ZenGround0@users.noreply.github.com>
Co-authored-by: Jiaying Wang <42981373+jennijuju@users.noreply.github.com>
Co-authored-by: Steven Allen <steven@stebalien.com>
Co-authored-by: jennijuju <jiayingw703@gmail.com>
2023-04-19 18:40:18 -04:00
Phi
9fd69377df
fix: unseal: check if sealed sector exists
...
Check if sealed or update sector exists when `SectorsUnsealPiece` is called.
2023-04-10 09:53:19 +02:00
Aayush
66fc6dc3e5
refactor: stop using deprecated io/ioutil
2023-03-29 15:40:49 -04:00
Aayush
a724a713da
refactor: stop using deprecated io/ioutil
2023-03-29 15:38:46 -04:00
Łukasz Magiera
7e414ac390
Merge remote-tracking branch 'origin/master' into feat/go-data-transfer-v2
2023-03-15 11:37:53 +01:00
Łukasz Magiera
80ccd14447
Merge pull request #10356 from filecoin-project/feat/assigner-experiments
...
feat: sched: Assigner experiments
2023-03-09 01:28:31 +01:00
Łukasz Magiera
d114d8fe7e
deprecate MarketListRetrievalDeals, make gen
2023-03-08 17:15:16 +01:00
Łukasz Magiera
b0ebdb6882
make gen
2023-03-06 15:07:49 +01:00
Łukasz Magiera
9a295e58b0
post worker sched: Retry on alternative worker on RPC errors
2023-03-06 14:30:58 +01:00
Łukasz Magiera
e170487faf
post worker sched: Filter out disabled workers correctly
2023-03-06 13:56:23 +01:00
Łukasz Magiera
c484c38735
worker sched: Separate resource def for preparing window
2023-02-28 10:52:50 +01:00
Łukasz Magiera
2316363f7a
sched: Share active/preparing task counters
2023-02-28 09:08:49 +01:00
Łukasz Magiera
745476c9ab
feat: sched: Assigner experiments
2023-02-27 17:54:25 +01:00
Łukasz Magiera
fc6721cff7
feat: wdpost: Emit more detailed errors
2023-01-26 11:57:16 +01:00
Adin Schmahmann
d35818293a
fix: stub out the FileSize command so lotus libraries can build on Windows
2023-01-17 01:03:10 -05:00
Phi
bd28a4bca4
Add snap-sector types
...
Add snap-sector types
2022-12-15 14:29:58 +01:00
Phi
87e384e7fd
Update svg-image
...
We do not depend on specs-storage anymore, this has been moved into lotus (storiface)
2022-12-15 10:49:58 +01:00
Phi
a8b406e7b7
Update svg-file
...
Update svg-file and headings
2022-12-15 10:15:07 +01:00
Ian Davis
0a4efd4820
Merge branch 'main' into id/update-go-version
2022-11-29 14:29:11 +00:00
Łukasz Magiera
1597e85906
sched: Address review
2022-11-29 11:46:51 +01:00
Łukasz Magiera
5a458a60c2
fix sched_test
2022-11-29 11:44:57 +01:00
Łukasz Magiera
5881edb75e
feat: sched: Cache worker calls
2022-11-29 11:44:57 +01:00
Łukasz Magiera
d82b2a5804
Merge pull request #9738 from filecoin-project/feat/sched-cycle-metrics
...
feat: sched: Add metrics around sched cycle
2022-11-28 23:57:58 +01:00
Łukasz Magiera
285cc66773
Merge pull request #9648 from filecoin-project/fix/snap-abort-cleanup
...
fix: sealing: More complete snapdeals abort cleanup
2022-11-28 23:26:32 +01:00
Łukasz Magiera
8ba4355cab
Merge pull request #9694 from filecoin-project/9159-allow-lotus-worker-to-unseal-sector-even-if-does-not-store-unsealed-data-long-term
...
fix: sealing: Set all path types for Unseal pipeline to sealing storage
2022-11-28 20:15:17 +01:00
Łukasz Magiera
c0fce07889
sched: Metrics around scheduldng workload
2022-11-28 19:51:18 +01:00
Łukasz Magiera
bc879c5bd8
feat: sched: Add metrics around sched cycle
2022-11-28 19:07:35 +01:00
Ian Davis
9f85d3dca7
Address simple linter issues
2022-11-24 16:32:27 +00:00
Shrenuj Bansal
fa596eee5b
Move unsealed sector from sealing to long term storage after Unseal
2022-11-23 15:22:14 -05:00
Łukasz Magiera
ea9a8303c8
sealing: tasks: TTReleaseUnsealed -> TTFinalizeUnsealed
2022-11-23 18:57:17 +01:00
Łukasz Magiera
d6f73c1a81
sealing: Address snap cleanup review
2022-11-23 18:57:17 +01:00
Łukasz Magiera
dc6c2b68fe
sealing: Fix tests after finalize changes
2022-11-23 18:57:16 +01:00
Łukasz Magiera
87e5549af5
sealing: Split unsealed cleanup from Finalize
2022-11-23 18:57:16 +01:00
Łukasz Magiera
0bba2bd1ba
sealing: Use FinalizeSector in snap abort for cleanup
2022-11-23 18:57:16 +01:00
Łukasz Magiera
211712bf6d
itests: Test snapdeals abort cleanup
2022-11-23 18:57:16 +01:00
Shrenuj Bansal
e4ce056ac6
Set all path types for Unseal pipeline to sealing storage
2022-11-21 14:40:50 -05:00
Łukasz Magiera
71a84bb092
feat: wdpost: Configurable pre-check timeouts
2022-11-17 18:25:30 +01:00
Aayush
69c55d807a
Sealing manager: minor refactor
2022-11-09 09:09:59 -05:00
Łukasz Magiera
fcad93dc10
netbs: Fix lint
2022-11-08 09:37:43 +00:00
Łukasz Magiera
ec89424c42
make repo not depend on ffi
2022-11-08 09:37:43 +00:00
Łukasz Magiera
5f5cc794f0
make config not depend on ffi
2022-11-08 09:37:43 +00:00
Aayush
c0b7343e60
Merge branch 'release/v1.18.0' into asr/merge-release-into-master
2022-11-06 14:40:13 -05:00
Łukasz Magiera
32de871243
fix: post worker sched: Don't check worker session in a busy loop
2022-10-14 15:58:25 +02:00
Aayush
97b04b7f77
More tweaking of PreSeal for genesis
2022-10-06 11:06:21 -04:00
Aayush Rajasekaran
6510e5f129
Tweak PreSeal struct to be infra-friendly
2022-10-06 11:06:21 -04:00
Geoff Stuart
b4c04ad927
update markets
2022-10-06 11:06:21 -04:00
Łukasz Magiera
39af6e0365
Merge pull request #9328 from filecoin-project/fix/ffiwrap-close-ap
...
fix: ffiwrapper: Close readers in AddPiece
2022-09-19 17:47:15 +02:00
Łukasz Magiera
859c2606f0
sealing: Address review
2022-09-19 12:13:06 +02:00
Łukasz Magiera
a05593da5b
systar: Create file after header checks
2022-09-19 12:13:06 +02:00
Łukasz Magiera
fec9c0f981
sector import: Fix lint
2022-09-19 12:13:06 +02:00
Łukasz Magiera
474c60203b
tarutil: Strict header checks
2022-09-19 12:13:06 +02:00
Łukasz Magiera
830c2ffdf5
sector import: FinalizeInto, send finalized cacde in itest
2022-09-19 12:13:06 +02:00
Łukasz Magiera
9c6d531ae7
sector import: Plumb sector download task canfig
2022-09-19 12:13:06 +02:00
Łukasz Magiera
3caa010779
sector import: Update type-gen
2022-09-19 12:13:06 +02:00
Łukasz Magiera
cde23be559
sector import: Fix tests
2022-09-19 12:13:05 +02:00
Łukasz Magiera
ea99bd9763
sector import: Sector data download
2022-09-19 12:13:05 +02:00
Łukasz Magiera
fbb487ae2b
sector import: Plumbing for DownloadSectorData in the sealing system
2022-09-19 12:13:05 +02:00
Łukasz Magiera
d68bb937d8
fix: ffiwrapper: Close readers in AddPiece
2022-09-19 09:52:57 +02:00
Eng Zer Jun
abef90423d
refactor: use os.ReadDir for lightweight directory reading
...
`os.ReadDir` was added in Go 1.16 as part of the deprecation of `ioutil`
package. It is a more efficient implementation than `ioutil.ReadDir`.
Reference: https://pkg.go.dev/io/ioutil#ReadDir
Signed-off-by: Eng Zer Jun <engzerjun@gmail.com>
2022-09-09 19:53:40 +08:00
Łukasz Magiera
088bf56f2a
Merge pull request #9231 from filecoin-project/fix/datacid-res-envvars
...
sealing: fix: Make DataCid resource env vars make more sense
2022-08-30 02:36:02 +02:00
Łukasz Magiera
08b22edd89
fix make gen
2022-08-29 16:25:30 +02:00
Łukasz Magiera
d00e1e78bb
resources: Use 32G AP resources for DC
2022-08-29 16:12:02 +02:00
Łukasz Magiera
e4ed3f8cf8
sealing: fix: Make DataCid resource env vars make more sense
2022-08-29 15:57:58 +02:00
Dirk McCormick
964bbca792
fix: DataCid - ensure reader is closed
2022-08-29 10:31:11 +02:00
Aayush
5e80276631
fix: mock sealer: grab lock in ReadPiece
2022-08-23 17:24:28 -04:00
nujz
76f6eb3edf
cgroupV1: memory.memsw.usage_in_bytes: no such file or directory
2022-08-23 17:37:47 +08:00
Rob Quist
f5086c98e8
fix: Add information on what worker a job was assigned to in logs
...
More detailed logs
2022-08-10 21:33:19 +02:00
Łukasz Magiera
cb2b4fa4aa
Merge remote-tracking branch 'origin/master' into feat/storage-redeclare
2022-08-05 21:26:15 +02:00
Łukasz Magiera
819314de46
Merge remote-tracking branch 'origin/master' into feat/storage-redeclare
2022-08-05 09:01:30 +02:00
LexLuthr
a59d73d64a
Merge branch 'master' into feat/SchedRemoveRequest
2022-08-04 02:24:14 +05:30
LexLuthr
fad79f3218
respond to caller. Add itest
2022-08-04 02:00:24 +05:30
LexLuthr
cdc08e566f
fix everything pointed as per review
2022-08-04 02:00:24 +05:30
LexLuthr
c736dedfa6
move requestremove inside runSched
2022-08-04 02:00:24 +05:30
LexLuthr
cf78fa99ee
Rebase on master
2022-08-04 01:59:48 +05:30
Łukasz Magiera
da33d82e1b
feat: sealer: Custom worker name config
2022-08-03 12:58:49 +02:00
Łukasz Magiera
4d10adae3c
Merge branch 'hostname_variable' of github.com:clinta/lotus into feat/worker-name-set
2022-08-03 12:40:18 +02:00
Łukasz Magiera
3309e10b0d
itests: Test storage detach/redeclare
2022-08-01 15:58:06 +02:00
Łukasz Magiera
d690b49d17
storage: Fix linter warnings
2022-08-01 15:58:06 +02:00
Łukasz Magiera
8cff52aef6
Storage detach/attach in lotus-miner, cli commands
2022-08-01 15:58:06 +02:00
Shrenuj Bansal
dfea74cca8
Add stop cmd for lotus worker
2022-07-29 18:33:30 -04:00
Łukasz Magiera
db9105e166
storage: Add one more test case to TestFileTypeAnyAllow
2022-07-15 12:47:46 +02:00
Łukasz Magiera
ac2ea039b5
path index: Raise alerts on bad filter config
2022-07-12 21:45:12 +02:00
Łukasz Magiera
91e474e72e
sealer: Pass correct args to SubAllowed in selectors
2022-07-12 21:45:12 +02:00
Łukasz Magiera
43db2fb8a4
miner cli: Print allow/deny types in storage list
2022-07-12 21:45:12 +02:00
Łukasz Magiera
cd682e200b
sealer: Fix no-remote move selector
2022-07-12 21:45:12 +02:00
Łukasz Magiera
6ac5c16d2b
storage: Path type filters
2022-07-12 21:45:12 +02:00
Łukasz Magiera
84881f64ad
sealer: Config for disabling builtin PoSt
2022-07-01 21:24:54 +02:00
Łukasz Magiera
db676acdf8
storage: Cleanup interfaces a bit
2022-06-17 13:52:19 +02:00
Łukasz Magiera
58416d0881
storage: Don't depend on specs-storage, move to storiface
2022-06-17 13:36:33 +02:00
Łukasz Magiera
05cdeb80c3
chore: remove redundant import prefixes
2022-06-15 12:06:22 +02:00
Łukasz Magiera
39cede946c
chore: Fix more imports with '2' suffix
2022-06-14 21:37:54 +02:00
Łukasz Magiera
28099a3905
storage: Move storage/sealer/stores to storage/paths
2022-06-14 20:25:52 +02:00
Łukasz Magiera
82857e6d5d
chore: rerun gen with moved packages
2022-06-14 20:13:31 +02:00
Łukasz Magiera
a9600b8a6f
storage: Move extern/sector-storage to storage/sealer
2022-06-14 20:03:38 +02:00
