cerc-io/lotus
16
0
Fork 0
Code Issues Pull Requests Packages Projects Releases 27 Wiki Activity
19,266 Commits 24 Branches 342 Tags 314 MiB
ea9a8bf83f
Commit Graph

1369 Commits

Author SHA1 Message Date
Łukasz Magiera
cb2b4fa4aa Merge remote-tracking branch 'origin/master' into feat/storage-redeclare 2022-08-05 21:26:15 +02:00
Łukasz Magiera
11e4914531 Merge branch 'feat/SchedRemoveRequest' of github.com:LexLuthr/lotus into LexLuthr-feat/SchedRemoveRequest 2022-08-05 10:40:45 +02:00
Łukasz Magiera
8a39b79ee8 Merge branch 'desc' of github.com:ysrotciv/lotus into docs/ysrotciv-desc 2022-08-05 09:33:26 +02:00
Łukasz Magiera
e196742ece cli: Update docsgen, don't require args in storage redeclare 2022-08-05 09:05:46 +02:00
LexLuthr
25bec140fb make gen after rebase 2022-08-04 02:07:22 +05:30
LexLuthr
c736dedfa6 move requestremove inside runSched 2022-08-04 02:00:24 +05:30
LexLuthr
cf78fa99ee Rebase on master 2022-08-04 01:59:48 +05:30
Łukasz Magiera
4b47881950 Merge branch 'master' into sbansal/lotus-worker-stop-cmd 2022-08-03 10:42:19 +02:00
Łukasz Magiera
01a6cdaf03 Merge branch 'feat/minerWithdrawBalanceAPI' of github.com:LexLuthr/lotus into LexLuthr-feat/minerWithdrawBalanceAPI 2022-08-03 10:33:09 +02:00
Aayush
468a4ff2ac feat: build: run fiximports on make actors-gen 2022-08-02 18:05:57 -04:00
LexLuthr
f5a7a650e7 rename to ActorWithdrawBalance 2022-08-02 13:04:54 +05:30
LexLuthr
e0e0b0b62f don't wait for msg to land on chain 2022-08-01 23:41:24 +05:30
Shrenuj Bansal
e7bace9341 Update API docs 2022-08-01 11:36:34 -04:00
LexLuthr
9e9a3825aa rerun make gen 2022-07-29 20:32:05 +05:30
LexLuthr
4f03486011 miner withdrawbalance API 2022-07-29 20:09:49 +05:30
Jennifer Wang
9d08c4bc8f update interop assets 2022-07-28 10:44:57 -04:00
Jennifer Wang
d85d4f6094 butterfly artifacts 2022-07-13 08:54:19 -04:00
Łukasz Magiera
6ac5c16d2b storage: Path type filters 2022-07-12 21:45:12 +02:00
Jiaying Wang
2b4d4f3f02
Merge pull request #9008 from 1475-IPFS/change-bootstrap-peer 
change 1475 bootstrap peer
 2022-07-12 09:06:45 -04:00
lifei
12f07998b9
change 1475 bootstrap peer 2022-07-11 11:27:50 +08:00
Łukasz Magiera
413183e4fa fix: Delegate storage auth on market nodes 2022-07-06 22:22:41 +02:00
Jennifer Wang
c3f3eb0812 Merge branch 'releases' into jen/masterbp 2022-06-27 15:13:12 -04:00
Jennifer Wang
83d796f34d bump the version to v1.16.0 2022-06-23 17:20:39 -04:00
Aayush Rajasekaran
b3890d59f0
Merge pull request #8907 from filecoin-project/gstuart/api-actors-cids 
feat: api: api call to get actors cids
 2022-06-23 16:34:20 -04:00
Aayush
42a16546c1 Update actors to v8.0.0 2022-06-23 15:45:20 -04:00
Geoff Stuart
83d7db88cf review fixes 2022-06-23 14:32:14 -04:00
Geoff Stuart
e684248f48 Added api call to get actors cids 2022-06-23 14:07:23 -04:00
Jennifer Wang
69b7594aec fix the the upgrade epoch in changelog 2022-06-22 22:20:21 -04:00
Jennifer Wang
781f92402a add mainnet upgrade epoch 2022-06-22 14:27:15 -04:00
Jennifer Wang
ea823558de bump version to v1.16.0-rc2 2022-06-22 14:27:15 -04:00
Jennifer Wang
820013a31e add mainnet upgrade epoch for nv16 2022-06-22 14:27:15 -04:00
Aayush
e122d113c7 chore: deps: update to actors v8.0.0-rc.2, except for calibnet 2022-06-22 14:17:40 -04:00
Steven Allen
1ced322310 feat: support overriding actor versions per-network 2022-06-22 10:47:04 -07:00
Jennifer Wang
1ccd9051a3 update butterfly artifects 2022-06-20 10:38:08 +02:00
Łukasz Magiera
58416d0881 storage: Don't depend on specs-storage, move to storiface 2022-06-17 13:36:33 +02:00
Łukasz Magiera
7de400b5ac Merge remote-tracking branch 'origin/master' into chore/drop-pipeline-adapters 2022-06-17 11:31:05 +02:00
Jiaying Wang
8815fc1c1f
Merge pull request #8875 from filecoin-project/phi/update-version 
build: bump master version to v1.17.1-dev
 2022-06-16 16:34:44 -04:00
Jennifer Wang
8375cc9f3e make gen 2022-06-16 16:19:56 -04:00
Phi
34b04ccbe3 bump version 2022-06-16 22:05:45 +02:00
Jennifer Wang
ae37db71a8 update bundles for v16# Please enter the commit message for your changes. Lines starting 2022-06-16 14:27:17 -04:00
Łukasz Magiera
9c4d10ec73 api: handle no-precommit in StateSectorPreCommitInfo gracefully 2022-06-16 15:20:58 +02:00
Łukasz Magiera
2dc1df878d api: Move StateComputeDataCID to full-node 2022-06-16 13:29:35 +02:00
Łukasz Magiera
6c3361b5a4 chore: fix imports conflict 2022-06-14 18:58:19 +02:00
Łukasz Magiera
422f66776f
Merge pull request #8859 from filecoin-project/chore/import-fix 
chore: Fix imports
 2022-06-14 18:54:03 +02:00
Łukasz Magiera
e65fae28de chore: fix imports 2022-06-14 17:00:51 +02:00
Jennifer Wang
ed091b6d49 update butterfly artifects 2022-06-14 03:23:58 -04:00
Jennifer Wang
e3fbe53f76 Merge branch 'release/v1.16.0' into jen/backport 2022-06-14 02:35:01 -04:00
Jennifer Wang
b0c8dd5454 remove wrongly added whiteblock cid 2022-06-13 23:31:12 -04:00
Jennifer Wang
9254085bd4 correct the upgrade time comment 2022-06-13 23:27:31 -04:00
Jennifer Wang
b3adf6f09c docsgen 2022-06-13 23:12:19 -04:00
Steven Allen
e9157e9dcc
fix: build: really make macos compatible (#8853) 2022-06-14 03:02:43 +00:00
Jennifer Wang
35791682aa upgrade to 8.0.0-rc.1 bundle & manifest 2022-06-13 23:02:02 -04:00
Jennifer Wang
14e37adc95 fix: build: add calibrationnet to the actors bundle 2022-06-13 23:01:37 -04:00
Steven Allen
4b7f141230 fix: build: make the build/actors/pack.sh script work on macos 2022-06-13 22:51:58 -04:00
Steven Allen
b16d3c07c1 fix: build: add calibrationnet to the actors bundle 2022-06-13 19:35:08 -07:00
Steven Allen
d8d8ed1f1c fix: build: make the build/actors/pack.sh script work on macos 2022-06-13 19:34:29 -07:00
Jennifer Wang
cda21546c4 chore: update butterfly for reset of v16 2022-06-13 21:02:08 -04:00
Jennifer Wang
2b8aaf7261 update calib v16 skyr upgrade 2022-06-13 20:32:33 -04:00
Steven Allen
ddc9425c07 feat: refactor: actor bundling system (#8838) 
1. Include the builtin-actors in the lotus source tree.
2. Embed the bundle on build instead of downloading at runtime.
3. Avoid reading the bundle whenever possible by including bundle
   metadata (the bundle CID, the actor CIDs, etc.).
4. Remove everything related to dependency injection.
    1. We're no longer downloading the bundle, so doing anything ahead
       of time doesn't really help.
    2. We register the manifests on init because, unfortunately, they're
       global.
    3. We explicitly load the current actors bundle in the genesis
       state-tree method.
    4. For testing, we just change the in-use bundle with a bit of a
       hack. It's not great, but using dependency injection doesn't make
       any sense either because, again, the manifest information is
       global.
    5. Remove the bundle.toml file. Bundles may be overridden by
       specifying an override path in the parameters file, or an
       environment variable.

fixes #8701
 2022-06-13 10:51:49 -07:00
Steven Allen
30981d0fdd
feat: refactor: actor bundling system (#8838) 
1. Include the builtin-actors in the lotus source tree.
2. Embed the bundle on build instead of downloading at runtime.
3. Avoid reading the bundle whenever possible by including bundle
   metadata (the bundle CID, the actor CIDs, etc.).
4. Remove everything related to dependency injection.
    1. We're no longer downloading the bundle, so doing anything ahead
       of time doesn't really help.
    2. We register the manifests on init because, unfortunately, they're
       global.
    3. We explicitly load the current actors bundle in the genesis
       state-tree method.
    4. For testing, we just change the in-use bundle with a bit of a
       hack. It's not great, but using dependency injection doesn't make
       any sense either because, again, the manifest information is
       global.
    5. Remove the bundle.toml file. Bundles may be overridden by
       specifying an override path in the parameters file, or an
       environment variable.

fixes #8701
 2022-06-13 10:15:00 -07:00
Geoff Stuart
b7010c9e60 Implement function to migrate actors with only code changes 2022-06-10 15:52:32 -04:00
Geoff Stuart
801c670edd Remove ChainPutMany 2022-06-10 14:09:05 -04:00
Geoff Stuart
3c4792d3e9 review fixes 2022-06-10 11:35:01 -04:00
Steven Allen
36a4c1791c fix: build: fix 2k build params 2022-06-09 14:23:26 -07:00
Aayush Rajasekaran
c661d247e5
Merge pull request #8810 from filecoin-project/asr/feat-into-master 
Merge nv16 changes into master
 2022-06-09 16:09:35 -04:00
Geoff Stuart
5c0f2c8ae6 Add putObj and putMany to apiBlockstore 2022-06-09 15:13:42 -04:00
Aayush Rajasekaran
05c19b37a4
Merge pull request #8756 from filecoin-project/jen/devnetfixport 
fix: build: genesis miner network version
 2022-06-06 23:33:01 -04:00
Aayush
b28c11a57d Merge branch 'feat/nv16' 2022-06-03 14:01:49 -04:00
Aayush Rajasekaran
8212b2c5d9
Merge pull request #8755 from filecoin-project/jen/devnetver 
fix: build: use the genesis network version when creating a network
 2022-06-03 13:43:29 -04:00
Aayush
89531e33a1 fixup merge 2022-06-03 13:16:44 -04:00
Jennifer Wang
2e59d0129d Merge branch 'release/v1.15.3' into jen/mergev1153to16 2022-05-31 16:33:18 -04:00
Jennifer Wang
64709dd587 remove wrongly committed bundle cars 2022-05-30 17:24:46 -04:00
Jennifer Wang
157d519dd4 remove wrongly committed bundle cars 2022-05-30 17:21:44 -04:00
Jiaying Wang
5b3a6e89ff
Merge pull request #8670 from filecoin-project/jen/actorcid 
chore: state: add cli to get the manifest & actor cid for network v16 & up
 2022-05-30 15:31:22 -04:00
Jennifer Wang
2c1cf42aa0 add cli to get the actor cid forthe current network version 2022-05-30 14:20:14 -04:00
Jennifer Wang
f7b0bbf0d8 fix genesis miner netwokr version 2022-05-30 13:33:10 -04:00
Jennifer Wang
a476816f40 fix genesis miner netwokr version 2022-05-30 13:32:04 -04:00
Aayush Rajasekaran
e59edfdd0c
Merge pull request #8754 from filecoin-project/jen/backport 
fix: deps: restore butterfly network genesis from v1.14.4
 2022-05-30 13:22:59 -04:00
Travis Person
860298d65b fix: deps: restore butterfly network genesis from v1.14.4 2022-05-30 12:58:21 -04:00
Aayush Rajasekaran
2a5e36c542
Merge pull request #8742 from filecoin-project/jen/butterldly 
chore: bundle: butterfly manifest cid & epoch
 2022-05-30 12:11:45 -04:00
Jiaying Wang
dbeec2900b Update params_butterfly for upgrade v16 epoch and cid 2022-05-30 11:55:30 -04:00
Geoff Stuart
4469d0c819 Reset interopnet 2022-05-27 16:46:29 -04:00
Geoff Stuart
e11f03a1fc Replace caterpillar manifest cid 2022-05-27 14:37:01 -04:00
Jiaying Wang
7de6d93e26
Update params_interop.go 2022-05-27 13:10:11 -04:00
Jiaying Wang
92ef099f5a
Update params_interop.go 2022-05-27 13:09:11 -04:00
Aayush
de65d8c3b4 Update actors 2022-05-27 12:07:45 -04:00
Łukasz Magiera
032e598962 feat: gateway: OpenRPC support 2022-05-27 17:03:56 +02:00
Aayush
4fa04abb8c Add disable flag for Skyr upgrade 2022-05-26 18:20:49 -04:00
Geoff Stuart
30e7f89662 Check for manifest CID while loading bundle 2022-05-26 17:30:32 -04:00
Geoff Stuart
c159290868 Reset interopnet 2022-05-26 00:03:24 -04:00
Aayush Rajasekaran
06279b5f1a
Merge pull request #8606 from filecoin-project/asr/fix-drand-round 
Fix: drand: calculation of round from Filecoin epochs
 2022-05-25 15:36:53 -04:00
Aayush Rajasekaran
8127473bab Update actors to dev/20220525 2022-05-25 14:21:08 -04:00
Aayush Rajasekaran
6924a3d5f2 Fix calculation of Drand round from Filecoin epochs 2022-05-25 12:43:52 -04:00
Łukasz Magiera
2bdc729fe7 Merge remote-tracking branch 'origin/master' into feat/worker-task-count-limits 2022-05-25 18:25:15 +02:00
vyzo
bb0e3a6cb0 don't clobber test bundles during migration 2022-05-25 19:16:11 +03:00
Łukasz Magiera
666dc00e63 docsgen 2022-05-25 16:37:40 +02:00
Geoff Stuart
8323ff77b6 Reset interopnet 2022-05-24 17:22:58 -04:00
Aayush Rajasekaran
c2f0bd3c62
Merge pull request #8668 from filecoin-project/asr/fix-post-test 
fix wdpost_dispute tests
 2022-05-24 14:22:01 -04:00
Jennifer Wang
4c6598e861 bump the version to v1.15.3-rc2 2022-05-24 14:01:01 -04:00
Aayush
2b847a98ae fix wdpost_dispute tests 2022-05-24 13:58:30 -04:00
Steven Allen
496799f867 build: set NetworkBundle in params file 
Otherwise, we end up overriding the ldflags.

fixes #8684
 2022-05-24 09:42:22 -07:00
Jiaying Wang
5e7f5029d8
Merge pull request #8677 from filecoin-project/jennijuju-patch-3 
Update bundle.go
 2022-05-24 12:40:59 -04:00
Travis Person
cd5b6e30fa fix: deps: restore butterfly network genesis from v1.14.4 2022-05-23 15:20:07 -04:00
Travis Person
f2d09b65cc fix: deps: restore butterfly network genesis from v1.14.4 2022-05-23 18:57:52 +00:00
jennijuju
dbe146b0c9 bump the version to v1.15.4-rc1 2022-05-23 19:02:26 +02:00
Aayush
6fecccdf26 Update builtin-actors to dev/20220520 2022-05-20 11:51:13 -04:00
Geoff Stuart
9be120a04e Reset interopnet take 5 2022-05-18 21:23:39 -04:00
Geoff Stuart
c0a00f48ce Reset interopnet 2022-05-18 21:23:39 -04:00
Jiaying Wang
23eee4b3df
Update bundle.go 2022-05-18 11:54:23 -04:00
Jennifer Wang
125272a526 make devnet get the right bundle 2022-05-18 11:04:10 -04:00
Geoff Stuart
e7b4242b1c reset interopnet 2022-05-18 10:17:48 -04:00
Jennifer Wang
67a7ed0ac5 upgrade to v16 sooner! 2022-05-17 23:48:06 -04:00
Jennifer Wang
a7fb84ef3b update interop info 2022-05-17 23:35:49 -04:00
Aayush
8cca9b1970 Use new go-state-types accessors 2022-05-17 15:21:27 -04:00
vyzo
93417fca7d
Merge pull request #8660 from filecoin-project/fix/issue-8659 
[nv16] use network bundle names consistent with the network name
 2022-05-17 22:13:02 +03:00
vyzo
dbbbab4f8a use dev bundle release 2022-05-17 22:01:38 +03:00
vyzo
ccb2e44e36 make path/url be a map of network name to car uri 2022-05-17 21:45:17 +03:00
vyzo
d949b6c8ef fix envvar handling 2022-05-17 21:14:49 +03:00
vyzo
daf452a180 flexible bundle loading 2022-05-17 20:38:32 +03:00
vyzo
e9ece8eb3f improve comment 2022-05-17 20:06:17 +03:00
vyzo
5981495740
Update build/README-bundle.md 
Co-authored-by: Aayush Rajasekaran <arajasek94@gmail.com>
 2022-05-16 22:42:21 +03:00
vyzo
314b417446 use network bundle names consistent with the network name 2022-05-16 22:02:37 +03:00
vyzo
5c0c4d64e2 more storage blah 2022-05-16 21:52:34 +03:00
vyzo
31301e2b9d storage blah 2022-05-16 21:50:50 +03:00
vyzo
6360107d53 godocs for bundle struct 2022-05-16 21:48:12 +03:00
vyzo
60bf397569
fix typo 
Co-authored-by: raulk <raul@protocol.ai>
 2022-05-16 21:39:22 +03:00
vyzo
06f6b2885a
fix typo 
Co-authored-by: raulk <raul@protocol.ai>
 2022-05-16 21:39:08 +03:00
vyzo
30283e60f5 add basic readme for bundle specifications 2022-05-16 21:13:58 +03:00
vyzo
46a85fc11e niceties for development bundle loading 2022-05-16 21:09:09 +03:00
Geoff Stuart
56d30d3e0c Update interopnet genesis car 2022-05-15 17:58:11 -04:00
Geoff Stuart
05c7d86d55 Reset caterpillar 2022-05-14 16:59:42 -04:00
jennijuju
5d65d9f7c8 release v1.15.3-rc1 2022-05-13 02:03:38 -04:00
LexLuthr
6115bd02f1 run make gen 2022-05-13 00:27:26 +05:30
vyzo
30d339842e rename bundle.toml to bundles.toml 2022-05-12 21:14:03 +03:00
vyzo
515a2dba8f use embeded toml spec for actor bundles 2022-05-12 20:53:12 +03:00
vyzo
7be42d9935 refactor to pass the network bundle name through ldflags from build 2022-05-12 16:42:59 +03:00
vyzo
74f300290e dynamic loading of builtin actor bundles 2022-05-11 22:30:07 +03:00
Raúl Kripalani
10d77f1f0c run gen. 2022-05-10 15:00:58 +01:00
Raúl Kripalani
7ba14f706c Merge branch 'feat/nv16' into fix/nv16-gas-outputs 2022-05-10 14:40:32 +01:00
Raúl Kripalani
8218109045 set build version to 1.16.0-dev. 2022-05-10 14:38:44 +01:00
Raúl Kripalani
e0a52da4f7 run gen. 2022-05-10 14:32:52 +01:00
Raúl Kripalani
6050d04c7c Merge tag 'v1.15.2' into feat/nv16-merge-v1.15.2 2022-05-10 14:17:29 +01:00
Jennifer Wang
304fa02d59 v1.15.2 prep 2022-05-06 01:57:03 -04:00
simlecode
962e37e893 add StateGetNetworkParams api 2022-05-05 14:16:30 +08:00
vyzo
f9a5c17c5a update builtin-actors 2022-05-04 20:19:07 +03:00
jennijuju
7020892631 v1.15.3-rc3 prep 2022-05-03 15:46:43 -04:00
Travis Person
f0673daaad Reset interopnet 2022-04-29 21:46:23 +00:00
vyzo
f80d10f3be make docsgen 2022-04-27 17:57:05 +03:00
vyzo
7c9ce49362 update bundles 2022-04-27 17:57:00 +03:00
Łukasz Magiera
d7c52f8adf sealing: ComputeDataCid miner API 2022-04-26 21:37:48 +02:00
jennijuju
48c54605ae release v1.15.2-rc2 2022-04-26 21:19:03 +02:00
Łukasz Magiera
1aed631fe5 sealing: DataCid on workers 2022-04-26 20:36:23 +02:00
vyzo
30ed272aa9 fetch testing-fwp bundle 
use testing-fwp bundle when InsecurePostValidation is true

testing-fwp is testing-fake-proofs
 2022-04-26 18:38:52 +03:00
Aayush
eb9aa039bb Set interop (caterpillarnet) params 2022-04-21 17:00:44 -04:00
vyzo
8ea00a3fc0 update builtin-actors bundle 2022-04-21 13:21:24 +03:00
vyzo
34dfc78f57 only check hash if we have the file 2022-04-19 19:12:25 +03:00
Geoff Stuart
a3a3fefb1c
Merge pull request #8486 from filecoin-project/gstuart/robust-address-endpoint 
Feat: API: Implement StateLookupRobustAddress
 2022-04-19 11:37:23 -04:00
vyzo
7e1c55cdf9 use build tags to embed appropriate bundles 2022-04-19 15:20:40 +03:00
vyzo
959b62a2df new bundle fetcher 2022-04-19 14:42:53 +03:00
lifei
77615e9583 add 1475 bootstrapper 2022-04-15 12:38:07 +08:00
Geoff Stuart
49d6c07280 Implemented StateLoockupRobustAddress 2022-04-14 17:41:18 -04:00
vyzo
cede67bfdd make gen 2022-04-14 19:49:23 +03:00
vyzo
2690b69831 fix rebase issues 2022-04-14 19:49:08 +03:00
vyzo
65de3e7f6c add retries to curl when fetching bundles 2022-04-14 19:34:40 +03:00
Raúl Kripalani
30ed847531 make fetch-bundles.sh portable. 2022-04-14 19:34:26 +03:00
vyzo
0ac8708396 simplify fetch-bundles script 2022-04-14 19:33:24 +03:00
vyzo
c9ac0020d7 make gateway a variable 2022-04-14 19:30:47 +03:00
vyzo
34022f3844 add script to fetch bundles 2022-04-14 19:30:47 +03:00
vyzo
c3fb3301ab embed actors v8 bundle 2022-04-14 19:29:22 +03:00
Aayush
3370847f3e Implement FIP-0031 2022-04-14 19:28:16 +03:00
jennijuju
372dd2ced9 v1.15.2-rc1 2022-04-13 19:11:02 +02:00
jennijuju
787bcef130 bump the version to v1.15.3 2022-04-12 15:53:45 +02:00
Łukasz Magiera
6bef1aeb82 feat: cli: lotus client list-asks --protocols 2022-04-11 19:49:52 +02:00
Łukasz Magiera
54cb55a7ae feat: miner: API/CLI to compute window-post 2022-03-28 17:06:51 -04:00
Aayush Rajasekaran
b0ff3dfb90
Revert "Update params for interopnet for fvm" 2022-03-25 22:21:36 -04:00
Łukasz Magiera
7401fa234e
Merge pull request #7971 from filecoin-project/feat/post-worker 
feat: PoSt workers
 2022-03-25 20:31:49 -04:00
Aayush
02a0770436 Caterpillarnet 2022-03-25 17:05:45 -04:00
Łukasz Magiera
82343a06e7 Merge remote-tracking branch 'origin/master' into feat/post-worker 2022-03-25 16:49:46 -04:00
Łukasz Magiera
701d0a111e Merge branch 'feat/net-ping' of github.com:ychiaoli18/lotus into feat/net-ping 2022-03-21 13:06:11 +01:00
Łukasz Magiera
cca69a6c16 gen 2022-03-21 10:49:30 +01:00
Łukasz Magiera
aa124cf414 fix lint issues 2022-03-18 11:38:27 +01:00
Darko Brdareski
79453663b3
feat: Add additional test annotations (#8272) 
* Annotate api,proxy_util,blockstore_badger, policy tests

* Annotate splitstore: bsbadger / markset

* Annotate splitstore feature

* Annotate union/timed blockstore tests

* Annotate openrpc, diff_adt tests

* Annotate error,drand,events tests

* Annotate predicates_test

* Fix annotations

* Annotate tscache, gen tests

* Annotate fundmanager test

* Annotate repub and selection tests

* Annotate statetree_test

* Annotate forks_test

* Annotate searchwait_test.go

* Fix duplicated @@ symbols

* Annotate chain stmgr/store tests

* Annotate more (types) tests

* More tests annotated

* Annotate conformance chaos actor tests

* Annotate more integration tests

* Annotate journal system tests

* Annotate more tests.

* Annotate gas,head buffer behaviors

* Fix markset annotations

* doc: test annotations for the markets dagstore wrapper

* Annotate miner_api test in dagstore

* Annotate more test files

* Remove bad annotations from fsrepo

* Annotate wdpost system

* Remove bad annotations

* Renamce "conformance" to "chaos_actor" tests

* doc: stm annotations for blockheader & election proof tests

* Annotate remaining "A" tests

* annotate: stm for error_test

* memrepo_test.go

* Annotate "b" file tests

* message_test.go

* doc: stm annotate for fsrepo_test

* Annotate "c" file tests

* Annotate "D" test files

* message_test.go

* doc: stm annotate for chain, node/config & client

* docs: stm annotate node_test

* Annotate u,v,wl tests

* doc: stm annotations for various test files

* Annotate "T" test files

* doc: stm annotate for proxy_util_test & policy_test

* doc: stm annotate for various tests

* doc: final few stm annotations

* Add mempool unit tests

* Add two more memPool Add tests

* Update submodules

* Add check function tests

* Add stm annotations, refactor test helper

* Annotate api,proxy_util,blockstore_badger, policy tests

* Annotate splitstore: bsbadger / markset

solving merge conflicts

* Annotate splitstore feature

* Annotate union/timed blockstore tests

* Annotate openrpc, diff_adt tests

* Annotate error,drand,events tests

* Annotate predicates_test

* Fix annotations

* Annotate tscache, gen tests

* Annotate fundmanager test

* Annotate statetree_test

* Annotate forks_test

* Annotate searchwait_test.go

* Fix duplicated @@ symbols

* Annotate chain stmgr/store tests

* Annotate more (types) tests

* More tests annotated

* Annotate conformance chaos actor tests

* Annotate more integration tests

* Annotate journal system tests

* Annotate more tests.

* Annotate gas,head buffer behaviors

solve merge conflict

* Fix markset annotations

* Annotate miner_api test in dagstore

* Annotate more test files

* doc: test annotations for the markets dagstore wrapper

* Annotate wdpost system

* Renamce "conformance" to "chaos_actor" tests

* Annotate remaining "A" tests

* doc: stm annotations for blockheader & election proof tests

* annotate: stm for error_test

* Annotate "b" file tests

* memrepo_test.go

* Annotate "c" file tests

* message_test.go

* Annotate "D" test files

* doc: stm annotate for fsrepo_test

* Annotate u,v,wl tests

* message_test.go

* doc: stm annotate for chain, node/config & client

* docs: stm annotate node_test

* Annotate "T" test files

* doc: stm annotations for various test files

* Add mempool unit tests

solve merge conflict

* doc: stm annotate for proxy_util_test & policy_test

* doc: stm annotate for various tests

* doc: final few stm annotations

* Add two more memPool Add tests

* Update submodules

* Add check function tests

solve conflict

* Add stm annotations, refactor test helper

solve merge conflict

* Change CLI test kinds to "unit"

* Fix double merged test

* Fix ccupgrade_test merge

* Fix lint issues

* Add stm annotation to types_Test

* Test vectors submodule

* Add file annotation to burn_test

Co-authored-by: Nikola Divic <divicnikola@gmail.com>
Co-authored-by: TheMenko <themenkoprojects@gmail.com>
 2022-03-16 18:37:34 +01:00
Jennifer Wang
56b80c41b6 bump the master version to v1.15.2-dev 2022-03-15 19:32:28 -04:00
hannahhoward
49742f8fdc feat(deps): update to graphsync v0.13.0 with 2.0 protocol 2022-03-09 18:06:35 +00:00
Masih H. Derkani
aacc246ba3
Merge branch 'master' into feat/cid-to-piece-idx 2022-03-02 14:06:30 +00:00
Łukasz Magiera
e9a6f5f287 Merge remote-tracking branch 'origin/master' into feat/paych-avail-reuse 2022-03-02 12:56:56 +00:00
zenground0
77a954c7c3 Merge branch 'master' into feat/cid-to-piece-idx 2022-02-28 12:57:11 -07:00
zenground0
abe04c33c1 Fix fault tracker to handle snap deals 2022-02-23 09:56:47 -07:00
Łukasz Magiera
a0cb6094c6 Merge remote-tracking branch 'origin/master' into feat/paych-avail-reuse 2022-02-22 10:55:03 +01:00
Łukasz Magiera
31ad8e647a
Merge pull request #8104 from ychiaoli18/feat/gateway-msig-get-vesting-schedule 
feat: gateway: add MsigGetVestingSchedule to gateway api
 2022-02-21 00:06:18 +01:00
Aayush
d35216434f Merge branch 'releases' into asr/releases-master 2022-02-18 13:45:08 -05:00
jennijuju
94bfd5cf66 version v1.14.1 2022-02-18 09:12:43 -05:00
Jiaying Wang
c5bd019a7c Fix mainnet upgrade date, epoch is correct 2022-02-18 09:11:49 -05:00
Aarsh Shah
e3f5b7c59f update dagstore top level index db 2022-02-18 14:00:01 +04:00
Aayush Rajasekaran
b311c26e21 Lotus version 1.14.0: set OhSnap upgrade epoch 2022-02-17 20:28:38 -05:00
Kevin Li
ba72eff3e6 feat: cli/net: implement 'net ping' command 2022-02-17 17:22:52 +08:00
Łukasz Magiera
384999556c paychmgr: AvailableAmt -> NonReservedAmt 2022-02-16 20:39:43 +01:00
Łukasz Magiera
681b90768a Merge remote-tracking branch 'origin/master' into feat/paych-avail-reuse 2022-02-16 10:06:36 +01:00
Kevin Li
f677995603 feat: add MsigGetVestingSchedule to gateway api 
expose MsigGetVestingSchedule method to gateway api
 2022-02-16 16:11:46 +08:00
Łukasz Magiera
f61eb23f8f api: separate method for paych funding 2022-02-14 19:56:02 +01:00
Łukasz Magiera
10af768c60 Merge commit 'origin/release/v1.15.0~2' into feat/paych-avail-reuse 2022-02-14 19:27:12 +01:00
Masih H. Derkani
230b8554f6 Override testnetnet to mainnet in indexer ingest topic 
Override `testnetnet` to `mainnet` when constructing indexer ingestion
topic.
 2022-02-11 19:52:19 +00:00
Jennifer Wang
99d5ad097c Merge remote-tracking branch 'origin/master' into jen/v151 2022-02-11 00:16:52 -05:00
Jennifer Wang
1b2bbd3888 bump master version to v1.15.1-dev 2022-02-11 00:13:18 -05:00
Jennifer Wang
cb2518716c v1.14.0-rc7 2022-02-10 17:43:57 -05:00
Łukasz Magiera
229cfafa8d make gen 2022-02-10 17:29:39 -05:00
Łukasz Magiera
9a117fa39a try ClearCache for update cache 2022-02-10 17:27:24 -05:00
Jennifer Wang
de1f4792cd Merge remote-tracking branch 'origin/master' into jen/v15 2022-02-09 19:27:34 -05:00
Jennifer Wang
6ed97f0d04 Merge branch 'release/v1.14.0' into jen/v15 2022-02-09 03:17:38 -05:00
Łukasz Magiera
4ad97f6a36 make gen 2022-02-08 17:22:41 +01:00
Łukasz Magiera
e271bae5ec try ClearCache for update cache 2022-02-08 17:22:41 +01:00
Jennifer Wang
1865e8f088 reset butterfly net 2022-02-08 10:43:51 -05:00
Jennifer Wang
fdae1face5 Set Calib OhSnap upgrade epoch 2022-02-08 10:43:43 -05:00
Aayush Rajasekaran
ad39d8707d build: add empty sector update params 2022-02-08 10:41:18 -05:00
Aarsh Shah
399a1afd94 Merge remote-tracking branch 'origin/master' into feat/cid-to-piece-idx 2022-02-08 12:37:57 +04:00
Jennifer Wang
b8f3d936c4 bump the version to v1.14.0-rc6 2022-02-08 01:53:15 -05:00
Jennifer Wang
8d4876d1ee remove unrelated parmas 2022-02-07 17:45:05 -05:00
Travis Person
9b68174231 reset of the butterfly network 2022-02-04 21:31:09 +00:00
Jennifer Wang
9117b89b83 update the calib upgrade epoch 2022-02-04 15:37:07 -05:00
Aarsh Shah
4691b2b809 changes to the indexer message relay PR 2022-02-04 12:15:01 +04:00
Aarsh Shah
3ecf478ff0
Merge pull request #8026 from gammazero/feat/cid-to-piece-idx 
Lotus chain nodes relay indexer pubsub messages
 2022-02-04 12:05:46 +04:00
gammazero
c084130d3e Lotus chain nodes relay indexer pubsub messages 
Content providers announce the availability of indexer data using gossip pubsub.  The content providers are not connected directly to indexers, so the pubsub messages are relayed to indexers via chain nodes. This PR makes chain nodes relay gossip pubsub messages, on the /indexer/ingest/<netname> topic.
 2022-02-03 14:56:21 -08:00
Jennifer Wang
c65142782f reset butterfly net 2022-02-03 14:54:25 -05:00
Jennifer Wang
e23768fa58 Set Calib OhSnap upgrade epoch 2022-02-03 14:26:59 -05:00
Will Scott
7247f8e41f
add net protect api methods 
fix #8015
 2022-02-03 17:24:49 +01:00
Jennifer Wang
ac5cbe5a82 update to the final proof for snap 
source: https://github.com/filecoin-project/rust-fil-proofs/blob/master/parameters.json
 2022-02-03 11:15:40 -05:00
Aayush
40485eb88a Lotus release v1.14.0-rc5 2022-01-27 15:36:25 -05:00
Aayush
6cc9eecc85 Lotus release v1.14.0-rc4 2022-01-25 13:28:03 -05:00
Aayush Rajasekaran
6e44de1e10 Update params_2k.go 2022-01-25 13:04:22 -05:00
Aayush
6b7b488e00 Lotus release v1.14.0-rc3 2022-01-25 13:02:08 -05:00
Aayush
1b18236f91 feat: sealer: allow users to abort in-flight snap upgrades 2022-01-25 13:01:51 -05:00
Aayush Rajasekaran
a3c5fadcc0 feat: sealing: Add ReplicaUpdate work to Resource table 2022-01-25 13:01:05 -05:00
Aayush Rajasekaran
0358ad83cb
Update params_2k.go 2022-01-24 15:44:20 -05:00
Łukasz Magiera
550e2743d7 paych: Don't return settling/collected chennals from OutboundActiveByFromTo 2022-01-20 18:24:01 +01:00
Aarsh Shah
b8bf2af3e3 upgrade on master 2022-01-20 16:34:13 +04:00
vyzo
b360c9403f make gen and friends 2022-01-20 11:44:01 +02:00
Aayush Rajasekaran
3ff23ecbfa :fix: checkReplica incorrectly returns ErrBadPR 2022-01-19 12:00:27 -05:00
Jiaying Wang
07e68aa064 update snap net upgrade epoch 2022-01-14 17:17:51 -05:00
Jennifer Wang
1b264d5a53 update network version for test ground 2022-01-14 17:17:51 -05:00
Jennifer Wang
03cb555d1d Update the ntwk v15 name to OhSnap 2022-01-14 17:17:51 -05:00
Jennifer Wang
e097578e85 add butterfly ohsnap epoch 2022-01-14 17:17:51 -05:00
Aayush Rajasekaran
84e6ba5dff Update butterflynet params 2022-01-14 17:17:36 -05:00
Jennifer Wang
b7ba08476c remove power change 2022-01-14 17:15:44 -05:00
Aayush Rajasekaran
ca57546ef5 Remove unnecessary params from VerifyWinningPost 2022-01-14 17:14:32 -05:00
zenground0
d6aa17e21f Snap Deals Integration 
- FSM handles the actual cc upgrade process including error states
- PoSting (winning and window) works over upgraded and upgrading sectors
- Integration test and changes to itest framework to reduce flakes
- Update CLI to handle new upgrade
- Update dependencies
 2022-01-14 17:14:32 -05:00
Jennifer Wang
ba816a1c13 bump the version to v1.14.0-rc1 2022-01-14 17:14:32 -05:00
zenground0
d1480c36c0 RemoveData and Decode 
- Unsealing replica update with sector key works and tested
- Sector key generation added and tested
 2022-01-14 17:14:32 -05:00
Jennifer Wang
e24b454a1f Bump the master version to v1.13.3-dev 2022-01-14 17:14:32 -05:00
zenground0
93656e65f8 WIP sector storage and integration test 2022-01-14 17:14:32 -05:00
Aayush Rajasekaran
3a7c364562 Address review 2022-01-14 17:14:32 -05:00
Aayush Rajasekaran
a8cb027c08 Integrate v7 actors 2022-01-14 17:14:32 -05:00
Jiaying Wang
60fae3a59d
Merge pull request #7922 from filecoin-project/build/15dev 
build: release: bump master version to v1.15.0-dev
 2022-01-12 20:11:02 -05:00
Jennifer Wang
c1d04a9d13 bump master version to v1.15.0-dev 2022-01-12 19:28:08 -05:00
Jiaying Wang
16d491a134
update snap net upgrade epoch 2022-01-11 21:41:58 -05:00
Jennifer Wang
4cdd830003 update network version for test ground 2022-01-11 17:46:49 -05:00
Jennifer Wang
cd8d3a0c88 Update the ntwk v15 name to OhSnap 2022-01-11 17:41:20 -05:00
Jennifer Wang
8729ee4fa2 add butterfly ohsnap epoch 2022-01-11 17:37:06 -05:00
Jiaying Wang
0b9a2cc11c
Merge branch 'master' into ntwk-butterfly-snapnet 2022-01-11 17:22:16 -05:00
Jennifer Wang
edd3486d2c add temp snap params 2022-01-11 17:01:15 -05:00
Aayush Rajasekaran
d645c5fbab Remove unnecessary params from VerifyWinningPost 2022-01-11 12:06:39 -05:00
zenground0
33f2d24f54 Snap Deals Integration 
- FSM handles the actual cc upgrade process including error states
- PoSting (winning and window) works over upgraded and upgrading sectors
- Integration test and changes to itest framework to reduce flakes
- Update CLI to handle new upgrade
- Update dependencies
 2022-01-10 15:39:38 +05:30
Jennifer Wang
20d1a5db70 bump the version to v1.13.2 2022-01-09 22:39:09 -05:00
Aayush Rajasekaran
a98ca86a45 Update butterflynet params 2022-01-07 16:54:15 -05:00
Jennifer Wang
a777cf7166 remove power change 2022-01-07 00:37:14 -05:00
Jennifer Wang
09cd258780 lotus v1.13.2-rc7 2022-01-05 19:27:00 -05:00
Jennifer Wang
ff949d84ad v1.13.2-rc6 prep 2022-01-04 17:58:18 -05:00
zl
4172a3c8b7 ExampleValue for a silce is nil 2022-01-04 14:27:10 +08:00
hannahhoward
cddf63efe9 feat(storageminer): add api for transfer diagnostics 
Add API + CLI for inspecting in depth diagnostics on graphsync transfers with a given peer
 2021-12-22 13:41:29 -08:00
Jennifer Wang
eabb9639a3 v1.13.2-rc5 prep 2021-12-17 15:02:42 -05:00
Dirk McCormick
b1734f84b3 feat: retrieval ask CLI command 2021-12-17 15:55:12 +01:00
Aayush Rajasekaran
80d5e52923 Merge branch 'master' into next 2021-12-13 13:24:28 -05:00
Jennifer Wang
1ffc3ed3a6 v1.13.2-rc4 2021-12-10 16:58:58 -05:00
Jennifer Wang
3f9f9eb667 v1.13.2-rc3 2021-12-09 21:15:49 -05:00
Jennifer Wang
4768c425d1 bump version to v1.13.2-rc2 2021-12-08 02:04:39 -05:00
zenground0
a5be80828a RemoveData and Decode 
- Unsealing replica update with sector key works and tested
- Sector key generation added and tested
 2021-12-03 15:21:06 -05:00
Łukasz Magiera
727765b248 Command to list active sector locks 2021-12-03 12:33:23 +01:00
Jennifer Wang
027017d0d2 update the version to v1.13.2-rc1 2021-11-30 19:03:24 -05:00
Jennifer Wang
c3ecf8355d docs gen 2021-11-30 18:29:13 -05:00
Jennifer Wang
a09aa0aa72 Bump the master version to v1.13.3-dev 2021-11-30 18:24:34 -05:00
Łukasz Magiera
6d52d8552b Fix docsgen 2021-11-30 02:06:58 +01:00
Łukasz Magiera
5b5e6b9e44 retrieval: DagSpec.MatchPath -> ExportMerkleProof 2021-11-29 21:14:00 +01:00
Łukasz Magiera
9538fc9723 mod tidy, docsgen 2021-11-29 20:56:40 +01:00
zenground0
7d2b3f05db WIP sector storage and integration test 2021-11-29 10:24:00 -05:00
Łukasz Magiera
135796d4fa Merge remote-tracking branch 'origin/master' into feat/partret-ux 2021-11-23 19:08:56 +01:00
Łukasz Magiera
83f65a673b retrieval: Docsgen 2021-11-23 17:45:56 +01:00
Łukasz Magiera
e362d47903 Add optional group flags to storage attach commands 2021-11-23 16:11:04 +01:00
Łukasz Magiera
f88c514be9 make lint happy 2021-11-22 12:52:11 +01:00
Travis Person
17cb5117f4 add additional methods to lotus gateway 2021-11-22 12:19:27 +01:00
Aayush Rajasekaran
5f1783c9a5 Address review 2021-11-19 15:11:13 -05:00
Aayush Rajasekaran
32fc03886d CLI: Add a lotus multisig cancel command 2021-11-18 19:21:17 -05:00
Aayush Rajasekaran
1449644c34 Integrate v7 actors 2021-11-17 15:55:14 -05:00
Anton Evangelatov
5454aebf13
CLI tools for the DAGStore inverted index (#7361) 
* cli commands for dagstore

* address comments from Dirk

* rename inverted index to piece index
 2021-11-17 15:39:45 +02:00
Dirk McCormick
501308239f feat: CLI command to announce deal to indexers 2021-11-17 12:16:22 +01:00
Jennifer Wang
14c26567b2 bump the master version to v1.13.2-dev 2021-10-26 21:58:02 -04:00
Jiaying Wang
67c732a100
Merge pull request #7537 from filecoin-project/jen/13tomaster 
misc: back-port v1.13.0 back to master
 2021-10-20 17:30:47 -07:00
jennijuju
7b8d1cc54c Merge branch 'releases' into jen/13tomaster 2021-10-18 20:58:28 -07:00
jennijuju
76d009e409 bump the version to v1.13.0 
export SEND_GRID_USER_VERIFICATION_ID=d-cee69cd8d2e34c09b8454cb58cb18b69
 2021-10-18 13:55:06 -07:00
Łukasz Magiera
19f52b4541 inline-gen: Slightly nicer comment format 2021-10-18 17:21:53 +02:00
jennijuju
e1a08b1c89 Merge branch 'releases' into jen/v1.13.0-rc3-prep 2021-10-12 20:15:18 -04:00
jennijuju
57f1cd71ad bump the version to v1.12.0 2021-10-12 15:21:06 -04:00
Łukasz Magiera
ddef708178 Basic inline codegen 2021-10-11 22:25:41 +02:00
Jennifer Wang
d1e15e61d0 Merge branch 'release/v1.12.0' into jen/12-master 2021-10-11 14:37:32 -04:00
Jennifer Wang
9fcc27edd5 Merge branch 'release/v1.12.0' into jen/v1.13.0-rc3-prep 2021-10-11 14:11:01 -04:00
Aayush Rajasekaran
42a233c083 Bugfix: Use current startup network versions 2021-10-11 13:15:57 -04:00
Anton Evangelatov
6e5ccc87cf cli: add retry for deals stuck in Publish with no funds 2021-10-11 14:03:55 +02:00
Aayush Rajasekaran
23c6597836 Bugfix: Use current startup network versions 2021-10-11 08:02:58 -04:00
Aayush Rajasekaran
1723793c35 Bugfix: Use current startup network versions 2021-10-10 14:26:10 -04:00
Jennifer Wang
fb4ef413f4 bump the version to v1.12.0-rc2 2021-10-08 15:15:29 -04:00
Jennifer Wang
46688e501b set network v14 chocolate upgrade epoch 2021-10-08 15:10:10 -04:00
Jennifer Wang
e62aaa3d3d update to actor v6-rc2 2021-10-08 15:09:57 -04:00
Jennifer Wang
a572787013 v1.13.0-rc1 2021-10-06 21:20:19 -04:00
Jennifer Wang
bac783774d v1.13.0-rc1 2021-10-06 00:36:23 -04:00
Jennifer Wang
4221461ede bump master to v1.13.1-dev 2021-10-06 00:31:41 -04:00
Peter Rabbitson
5e6aceeb0e Merge remote-tracking branch 'origin/master' into feat/datamodel-selector-retrieval 2021-10-05 18:15:51 +02:00
Peter Rabbitson
2a1094fc17 Merge banch feat/go-fil-markets-v1.13.0 into feat/datamodel-selector-retrieval 2021-10-04 21:56:11 +02:00
Jennifer Wang
38e01cba83 Merge branch 'release/v1.12.0' into jen/12tomaster 2021-10-04 02:38:00 -04:00
Aayush Rajasekaran
41be8fc9e5 Set the calibnet chocolate epoch 2021-10-02 17:28:46 -04:00
Aayush Rajasekaran
ec14259b5a Prep the butterfly network for v14 2021-10-02 17:27:39 -04:00
Jennifer Wang
faece90316 update butterfly 2021-10-01 20:37:13 -04:00
Jennifer Wang
2931be5fc5 bump the version to v1.12.0-rc1 2021-10-01 19:45:49 -04:00
Aayush Rajasekaran
50ce475701 Upgrade to actors v6-rc1 2021-10-01 17:57:32 -04:00
Aayush Rajasekaran
77de45f684 Set Chocolate upgrade epoch for butterfly 2021-10-01 17:50:46 -04:00
Travis Person
9b80ea4cf1 reset of the butterfly network 2021-10-01 17:33:58 -04:00
Travis Person
c104cb446b reset butterfly network 2021-10-01 17:25:59 -04:00
Aayush Rajasekaran
54695c6f8c Extend FaultMaxAge to 6 weeks for actors v6 on test networks only 2021-10-01 15:47:23 -04:00
Łukasz Magiera
95e8b59367
Merge pull request #7341 from filecoin-project/mg/feat/panic-reporter 
feat: Catch panic to generate report and reraise
 2021-10-01 10:50:19 +01:00
Mike Greenberg
89d7a72a4b fix: undo hasty changes 2021-09-28 11:30:35 -04:00
Mike Greenberg
c3faadf749 fix: Remove debug syscall; Tighten perms; Strip spaces in label 2021-09-27 17:54:43 -04:00
Jennifer Wang
f57d4b4126 say bye to more nerpa 2021-09-22 21:17:05 -04:00
Mike Greenberg
574b5c03dc chore: Expose build.BuildTypeString() 2021-09-22 09:58:07 -04:00
Mike Greenberg
b3816bc2dc chore: inline build version within PanicReporter 2021-09-22 04:55:39 -04:00
Jennifer Wang
6064d2f2f1 remove nerpanet related code base as it was deprecated on aug 16 https://docs.filecoin.io/about-filecoin/networks/#deprecated-networks 2021-09-22 00:59:38 -04:00
Aayush Rajasekaran
7b4c657e90 Add v6 actors 2021-09-21 14:23:14 -04:00
Aayush Rajasekaran
b9bfcc4b69 Randomness: Move getters from ChainAPI to StateAPI 2021-09-21 14:20:15 -04:00
Mike Greenberg
926858aeec fix: persist defaults to repo path; incl version dump 2021-09-20 15:40:48 -04:00
Mike Greenberg
b4a129068a fix: lint errors 2021-09-17 18:11:56 -04:00
Mike Greenberg
ccf24b9952 chore: Configurable LOTUS_PANIC_JOURNAL_LOOKBACK 2021-09-17 18:09:47 -04:00
Mike Greenberg
f79d34be5c chore: Separate repo and persistance paths 2021-09-17 18:01:26 -04:00
Mike Greenberg
595b51ecdd feat: Catch panic to generate report and reraise 2021-09-16 22:51:10 -04:00
Aayush Rajasekaran
1d6db306ec Randomness: Move getters from ChainAPI to StateAPI 2021-09-15 00:03:13 +02:00
Peter Rabbitson
0444435589 Expose basic text-based datamodel selector on retrieval 
Syntaxt of selection is located at
https://pkg.go.dev/github.com/ipld/go-ipld-selector-text-lite#SelectorSpecFromPath

Example use, assuming that:
  - The root of the deal is a plain dag-pb unixfs directory
  - The directory is not sharded
  - The user wants to retrieve the first entry in that directory

  lotus client retrieve --miner f0XXXXX --datamodel-path-selector 'Links/0/Hash' bafyROOTCID ~/output

For a much more elaborate example see the top of ./itests/deals_partial_retrieval_test.go
 2021-09-10 09:44:11 +02:00
Jennifer Wang
6907797783 version bump v1.11.3-rc1 2021-09-08 01:31:23 -04:00
Jennifer Wang
612befc962 bump master to v1.11.4-dev 2021-09-08 01:23:35 -04:00
Łukasz Magiera
8b9e9fede4 docsgen 2021-09-07 18:49:53 +02:00
Steven Allen
1cf556c3a2 feat: expose ChainGetPath on the gateway 2021-08-30 16:43:21 -07:00
Łukasz Magiera
1ba427f638 alerting: Address review 2021-08-26 16:09:18 +02:00
Aayush Rajasekaran
de79bf57e5 Bump version to v1.11.13-dev 2021-08-25 11:18:38 -04:00
Łukasz Magiera
12875a9664 api/command for encoding actor params 2021-08-20 17:32:57 +02:00
Jennifer Wang
7ff5844aa2 Merge branch 'releases' into jen/mas 2021-08-17 10:38:36 -04:00
Aarsh Shah
d7076778e2
integrate DAG store and CARv2 in deal-making (#6671) 
This commit removes badger from the deal-making processes, and
moves to a new architecture with the dagstore as the cental
component on the miner-side, and CARv2s on the client-side.

Every deal that has been handed off to the sealing subsystem becomes
a shard in the dagstore. Shards are mounted via the LotusMount, which
teaches the dagstore how to load the related piece when serving
retrievals.

When the miner starts the Lotus for the first time with this patch,
we will perform a one-time migration of all active deals into the
dagstore. This is a lightweight process, and it consists simply
of registering the shards in the dagstore.

Shards are backed by the unsealed copy of the piece. This is currently
a CARv1. However, the dagstore keeps CARv2 indices for all pieces, so
when it's time to acquire a shard to serve a retrieval, the unsealed
CARv1 is joined with its index (safeguarded by the dagstore), to form
a read-only blockstore, thus taking the place of the monolithic
badger.

Data transfers have been adjusted to interface directly with CARv2 files.
On inbound transfers (client retrievals, miner storage deals), we stream
the received data into a CARv2 ReadWrite blockstore. On outbound transfers
(client storage deals, miner retrievals), we serve the data off a CARv2
ReadOnly blockstore.

Client-side imports are managed by the refactored *imports.Manager
component (when not using IPFS integration). Just like it before, we use
the go-filestore library to avoid duplicating the data from the original
file in the resulting UnixFS DAG (concretely the leaves). However, the
target of those imports are what we call "ref-CARv2s": CARv2 files placed
under the `$LOTUS_PATH/imports` directory, containing the intermediate
nodes in full, and the leaves as positional references to the original file
on disk.

Client-side retrievals are placed into CARv2 files in the location:
`$LOTUS_PATH/retrievals`.

A new set of `Dagstore*` JSON-RPC operations and `lotus-miner dagstore`
subcommands have been introduced on the miner-side to inspect and manage
the dagstore.

Despite moving to a CARv2-backed system, the IPFS integration has been
respected, and it continues to be possible to make storage deals with data
held in an IPFS node, and to perform retrievals directly into an IPFS node.

NOTE: because the "staging" and "client" Badger blockstores are no longer
used, existing imports on the client will be rendered useless. On startup,
Lotus will enumerate all imports and print WARN statements on the log for
each import that needs to be reimported. These log lines contain these
messages:

- import lacks carv2 path; import will not work; please reimport
- import has missing/broken carv2; please reimport

At the end, we will print a "sanity check completed" message indicating
the count of imports found, and how many were deemed broken.

Co-authored-by: Aarsh Shah <aarshkshah1992@gmail.com>
Co-authored-by: Dirk McCormick <dirkmdev@gmail.com>

Co-authored-by: Raúl Kripalani <raul@protocol.ai>
Co-authored-by: Dirk McCormick <dirkmdev@gmail.com>
 2021-08-16 23:34:32 +01:00