Andrew Jackson (Ajax)
a888b6320c
harmonytask bump http protocol spec & lints
2023-09-22 18:06:26 -05:00
Andrew Jackson (Ajax)
a520ee85d6
master-to-sturdy
2023-09-21 10:37:02 -05:00
Shrenuj Bansal
15247486ae
anotha one
2023-08-22 12:19:18 -04:00
Shrenuj Bansal
068416ecfc
experiment
2023-08-22 11:48:38 -04:00
Shrenuj Bansal
459255d1f0
make linter happy
2023-08-22 11:06:16 -04:00
Shrenuj Bansal
a51e55390a
address moar comments
2023-08-22 10:43:50 -04:00
Shrenuj Bansal
95709a0583
fix a couple of bugs and address comments
2023-08-21 11:54:51 -04:00
Shrenuj Bansal
9262eb4fc9
change table names and address other comments
2023-08-17 13:23:03 -04:00
Shrenuj Bansal
169f953de4
add unlock
2023-08-16 15:36:00 -04:00
Shrenuj Bansal
cdf90b83ed
address more comments
2023-08-16 10:57:08 -04:00
Shrenuj Bansal
28efd718c7
Remove commented out code
2023-08-15 12:17:23 -04:00
Shrenuj Bansal
854d3c80dd
add stake lock handling
2023-08-14 21:47:27 -04:00
Shrenuj Bansal
16fb7cc0da
Implement Sector Index locks APIs
2023-08-14 18:46:41 -04:00
Shrenuj Bansal
e4c2bfc150
i hate this linter
2023-08-14 13:56:29 -04:00
Shrenuj Bansal
d746d6e6df
make more lint more happy hopefully
2023-08-14 11:35:18 -04:00
Shrenuj Bansal
5161528399
make lint happy
2023-08-14 09:24:00 -04:00
Shrenuj Bansal
7759444247
address review comments
2023-08-10 18:35:35 -04:00
Shrenuj Bansal
84d9dc5dfe
fix bigint overflow bug
2023-08-09 15:27:12 -04:00
Shrenuj Bansal
652ee04ce2
working changes
2023-08-08 20:59:21 -04:00
Shrenuj Bansal
864e8219ae
WIP: sector index yugabyte impl
2023-08-05 16:15:23 -04:00
Łukasz Magiera
c79acf9ca4
sealing: Use only non-assigned deals when selecting snap sectors
2023-06-23 18:40:46 +02:00
Jorropo
6c01310728
chore: migrate to boxo
...
This migrates everything except the `go-car` librairy: https://github.com/ipfs/boxo/issues/218#issuecomment-1529922103
I didn't migrated everything in the previous release because all the boxo code wasn't compatible with the go-ipld-prime one due to a an in flight (/ aftermath) revert of github.com/ipfs/go-block-format. go-block-format has been unmigrated since slight bellow absolutely everything depends on it that would have required everything to be moved on boxo or everything to optin into using boxo which were all deal breakers for different groups.
This worked fine because lotus's codebase could live hapely on the first multirepo setup however boost is now trying to use boxo's code with lotus's (still on multirepo) setup: https://filecoinproject.slack.com/archives/C03AQ3QAUG1/p1685022344779649
The alternative would be for boost to write shim types which just forward calls and return with the different interface definitions.
Btw why is that an issue in the first place is because unlike what go's duck typing model suggest interfaces are not transparent https://github.com/golang/go/issues/58112 , interfaces are strongly typed but they have implicit narrowing. The issue is if you return an interface from an interface Go does not have a function definition to insert the implicit conversion thus instead the type checker complains you are not returning the right type.
Stubbing types were reverted https://github.com/ipfs/boxo/issues/218#issuecomment-1478650351
Last time I only migrated `go-bitswap` to `boxo/bitswap` because of the security issues and because we never had the interface return an interface problem (we had concrete wrappers where the implicit conversion took place).
2023-06-19 14:45:05 -07:00
Aayush Rajasekaran
ce5e242d76
Merge pull request #10915 from filecoin-project/fix/upgrade-sector-selection
...
sealing: Improve upgrade sector selection
2023-05-30 13:32:52 -04:00
Łukasz Magiera
17915dce5a
sealing: Don't select sectors with no deals lined up for upgrading
2023-05-27 13:03:21 +02:00
Łukasz Magiera
4b5a665422
Merge remote-tracking branch 'origin/master' into feat/piecereader-perf
2023-05-26 13:00:42 +02:00
Łukasz Magiera
090b98ad33
sealing: Attempt to improve upgrade sector selection
2023-05-26 12:31:35 +02:00
Łukasz Magiera
b58daf5340
piecereader: address review
2023-05-25 16:05:36 +02:00
Łukasz Magiera
5e58f64380
piecereader: Fix double buffer free
2023-05-23 16:45:46 +02:00
Łukasz Magiera
f0fec13ec9
piecereader: Metrics fixes
2023-05-23 14:15:46 +02:00
Łukasz Magiera
326a0356a4
piecereader: Add metrics
2023-05-23 13:32:17 +02:00
Łukasz Magiera
6c62e6d8e2
fix tests/lint
2023-05-23 12:26:13 +02:00
Łukasz Magiera
587c3fde58
piecereader: Fix parallel buffer access, close readers in readInto
2023-05-23 12:26:13 +02:00
Łukasz Magiera
cd75ea0fe4
piecereader: Retune to allow parallel ReadAt calls
2023-05-23 12:26:13 +02:00
Łukasz Magiera
8b2ef40f4e
storage: Weave end offset into unsealed reader code
2023-05-23 12:26:13 +02:00
Łukasz Magiera
6fd93ed170
fix: sched: Address GET_32G_MAX_CONCURRENT regression ( #10850 )
...
* Fix 1.21 regression: GET_32G_MAX_CONCURRENT + mixed prepared/executing leads to stuck scheduler
If you have 12 GET tasks and GET_32G_MAX_CONCURRENT=1, sealing jobs will only show assigned tasks for GET of the miner
and is stuck.
I believe this to be a regression of 1.21 unifying the counters, in the case of GETs where PrepType and TaskType
both being seal/v0/fetch leading to a state where tasks are blocked since already counted towards the limit.
* itests: Repro issue from PR #10633
* make counters int (non-working)
* fix: worker sched: Send taskDone notifs after tasks are done
* itests: Make TestPledgeMaxConcurrentGet actually reproduce the issue
* make the linter happy
---------
Co-authored-by: Steffen Butzer <steffen.butzer@outlook.com>
2023-05-10 15:43:42 -04:00
Łukasz Magiera
2f469c2f58
fix: tests: Use mutex-wrapped datastore in storage tests
2023-05-09 18:06:41 +02:00
Shrenuj Bansal
78800a4e77
fix: sealing: Make lotus-worker report GPU usage to miner during ReplicaUpdate task ( #10806 )
...
* Make lotus-worker report GPU usage to miner during ReplicaUpdate task
* make gen
---------
Co-authored-by: Jacob Crowther <jcrowthe@users.noreply.github.com>
2023-05-03 12:28:03 -04:00
Łukasz Magiera
9d2d53b58e
fix: prover: Propagate skipped sectors in local PoSt
2023-04-27 09:26:12 +02:00
Łukasz Magiera
aeee542fb9
Merge pull request #10696 from filecoin-project/fix/nil-terminate-wait
...
fix: sealing pipeline: Allow nil message in TerminateWait
2023-04-25 19:28:52 +02:00
Łukasz Magiera
7e34b49b5d
Merge pull request #10661 from filecoin-project/fix/cleanup-temp-failed-fetch
...
fix: storage: Remove temp fetching files after failed fetch
2023-04-25 19:28:33 +02:00
Aayush
5a061e4677
Merge branch 'releases' into asr/merge-release-into-master
2023-04-23 14:58:50 -04:00
Łukasz Magiera
b44ae9a7d8
Merge pull request #10647 from filecoin-project/sbansal/split-pcb
...
feat: sealing: Split PCA/PCB batches if gas used exceeds block limit
2023-04-21 18:30:27 +02:00
sirius
07416e8c0c
update: builtin to builtin11 in wdpost worker
2023-04-21 12:19:06 +08:00
Shrenuj Bansal
d1f3380850
change comment
2023-04-20 12:15:51 -04:00
Shrenuj Bansal
0c83781a7f
Add tests for PCB/PCA batch splitting
2023-04-19 18:44:32 -04:00
ZenGround0
327760acff
chore: build: Merge/v22 into 21 for 23 ( #10702 )
...
* chore: update ffi to increase execution parallelism
* Don't enforce walking receipt tree during compaction
* fix: build: drop drand incentinet servers
* chore: release lotus v1.20.4
* Apply suggestions from code review
Co-authored-by: Jiaying Wang <42981373+jennijuju@users.noreply.github.com>
* feat: Introduce nv19 skeleton
Update to go-state-types v0.11.0-alpha-1
Introduce dummy v11 actor bundles
Make new actors adapters
Add upgrade to Upgrade Schedules
make jen
Update to go-state-types v0.11.0-alpha-2
* feat: vm: switch to the new exec trace format (#10372 )
This is now "FVM" native. Changes include:
1. Don't treat "trace" messages like off-chain messages. E.g., don't
include CIDs, versions, etc.
2. Include IPLD codecs where applicable.
3. Remove fields that aren't filled by the FVM (timing, some errors,
code locations, etc.).
* feat: implement FIP-0061
* Address review
* Add and test the FIP-0061 migration
* Update actors bundles to fip/20230406
* Update to go-state-types master
* Update to actors v11.0.0-rc1
* - Update go state types
- Keep current expiration defaults on creation, extension some tests
- Update ffi
* ffi experiment
* Integration nv19 migration
- Open splitstore in migration shed tool
- Update state root version
* Post rebase fixup
* Fix
* gen
* nv19 invariant checking
* Try fixig blockstore so bundle is loaded
* Debug
* Fix
* Make butterfly upgrades happen
* Another ffi experiment
* Fix copy paste error
* Actually schedule migration (#10656 )
Co-authored-by: zenground0 <ZenGround0@users.noreply.github.com>
* Butterfly artifacts
* Set calibration net upgrade height
* Review Response
* Fix state tree version assert
* Quick butterfly upgrade to sanity check (#10660 )
* Quick butterfly upgrade to sanity check
* Update butterfly artifacts
* Revert fake fix
* Give butterfly net correct genesis
* Butterfly artifacts
* Give time before upgrade
---------
Co-authored-by: zenground0 <ZenGround0@users.noreply.github.com>
* chore:releasepolish v1.22 release (#10666 )
* Update butterfly artifacts
* register actors v11
* Update calibration upgrade time
* State inspection shed cmds
* Fix
* make gen
* Fix swallowed errors
* Lint fixup
---------
Co-authored-by: zenground0 <ZenGround0@users.noreply.github.com>
* v1.22.0-rc3
* bundle fix
* Feat/expedite nv19 (#10681 )
* Update go-state-types
* Modify upgrade schedule and params
* Revert fip 0052
* Update gst
* docsgen
* fast butterfly migration to validate migration
* Correct epoch to match specified date
* Update actors v11
* Update changelog build version
* Update butterfly artifacts
* Fix lotus-miner init to work after upgrade
---------
Co-authored-by: zenground0 <ZenGround0@users.noreply.github.com>
* fix:deps:stable ffi for stable release (#10698 )
* Point to stable ffi for stable lotus release
* go mod tidy
---------
Co-authored-by: zenground0 <ZenGround0@users.noreply.github.com>
* Update CHANGELOG.md
Co-authored-by: Jiaying Wang <42981373+jennijuju@users.noreply.github.com>
---------
Co-authored-by: Aayush Rajasekaran <arajasek94@gmail.com>
Co-authored-by: zenground0 <ZenGround0@users.noreply.github.com>
Co-authored-by: Jiaying Wang <42981373+jennijuju@users.noreply.github.com>
Co-authored-by: Steven Allen <steven@stebalien.com>
Co-authored-by: jennijuju <jiayingw703@gmail.com>
2023-04-19 18:40:18 -04:00
Łukasz Magiera
4bdb6b34b3
fix: sealing pipeline: Allow nil message in TerminateWait
2023-04-19 15:43:50 +02:00
Shrenuj Bansal
79826447f5
fix unit and integration test breaks
2023-04-12 21:45:43 -04:00
Łukasz Magiera
7a4f69721c
fix: storage: Remove temp fetching files after failed fetch
2023-04-12 17:00:10 -07:00
Shrenuj Bansal
4eb4af639a
Split PCA msg into smaller batches
2023-04-12 00:30:19 -04:00