Commit Graph

436 Commits

Author SHA1 Message Date
Ian Davis
f5048ec61c Don't publish new homebrew releases for RC builds 2022-09-21 12:20:26 -04:00
Łukasz Magiera
142894895d sector import: Implement seed/ticket/commr/commd checks 2022-09-19 12:13:06 +02:00
Łukasz Magiera
fef7232c6b sector import: Initial SectorReceive itest 2022-09-19 12:13:06 +02:00
Shrenuj Bansal
4be8861f41 Merge branch 'master' into sbansal/nonce-coordination-and-consensus-for-chain-nodes 2022-09-13 17:41:06 -04:00
Shrenuj Bansal
a50a21b076 cleanup 2022-09-13 16:52:47 -04:00
Shrenuj Bansal
8f1b1bb1ff WIP: Raft consensus for lotus nodes in a cluster 2022-09-12 16:10:15 -04:00
Shrenuj Bansal
b3175f0b5c Merge branch 'master' into 9171-add-retries-to-mpool-push-message 2022-08-26 12:31:35 -04:00
Shrenuj Bansal
217cc846c3 Address more comments 2022-08-26 11:55:20 -04:00
Shrenuj Bansal
b972e079b8 Address comments 2022-08-22 17:32:43 -04:00
Łukasz Magiera
129eba2b5d sealing: numassign: itests/bug fixes 2022-08-22 16:58:36 -04:00
Shrenuj Bansal
942c3a879c Change go version for circleci 2022-08-17 15:21:03 -04:00
Shrenuj Bansal
087a838db5 make gen for tests 2022-08-17 14:02:53 -04:00
Geoff Stuart
84a2ebcbfd Update xcode version for macos builds 2022-08-15 12:23:20 -04:00
Jennifer Wang
e7628229fc Merge branch 'releases' into jen/17tomaster 2022-08-09 13:23:02 -04:00
Geoff Stuart
e24198ab22
Merge pull request #9133 from filecoin-project/ianconsolata/parallel-snap-publish
_ci_: Run snap builds for lotus and lotus-filecoin in parallel
2022-08-08 19:48:03 -04:00
Ian Davis
837fa4eae9 Run snap builds for lotus and lotus-filecoin in parallel 2022-08-05 15:13:29 -07:00
ZenGround0
0c91b0dc10
feat:chain:splitstore chain prune (#9056)
* Splitstore chain prune
* Protect on reification for simpler logic and sound cold compact protect
* Recovery from checkpoint during chain prune
* Splitstore (discard and universal mode) running in itests
* Add pause and restart functions to itest block miner
* Add config options to itest full nodes
* Add FsRepo support for itest full ndoes

Co-authored-by: zenground0 <ZenGround0@users.noreply.github.com>
2022-08-05 16:34:16 -04:00
Łukasz Magiera
819314de46 Merge remote-tracking branch 'origin/master' into feat/storage-redeclare 2022-08-05 09:01:30 +02:00
Ian Davis
5a8bc204b7 Change default shell options for snapcraft publish
The builds were erroring only in CircleCI, when run manually the same
command worked fine. I reached out to CircleCI support, and got the
following message:

>>>
The reason you are seeing this error when running in CircleCI and not while debugging with SSH is due to the -e set in #!/bin/bash -eo pipefail at the beginning of the shell while the debugging shell would just be #!/bin/bash. The -e sets to exit to the shell when any non zero [0] exit code status.

Since you say the command works when debugging with SSH you can set the shell to use /bin/bash -o pipefail using a default shell options. Here is an example:

      - run:
          name: <<command name>>
          shell: /bin/bash -o pipefail
          command: |
            << some commands>>

Notice that I still added -o pipefail as that prevents errors in a pipeline from being masked.
2022-08-03 21:29:35 -07:00
Ian Davis
9a9428789d Build / Publish snap twice (lotus-filecoin + lotus) 2022-08-03 12:15:53 -07:00
Łukasz Magiera
384b6433c0 circle: Fix template 2022-08-03 11:14:53 +02:00
Łukasz Magiera
a38a9ea144 Merge remote-tracking branch 'origin/master' into push-lotus-gateway-container 2022-08-03 11:12:26 +02:00
Łukasz Magiera
92d27aa6d2 Merge remote-tracking branch 'origin/master' into feat/storage-redeclare 2022-08-03 00:56:23 +02:00
Aayush
5e98b8a0d6 add a test for Post max sectors recovery 2022-08-02 18:09:18 -04:00
Aayush
1b45f42d70 fix makegen 2022-08-02 15:55:04 -04:00
Łukasz Magiera
3309e10b0d itests: Test storage detach/redeclare 2022-08-01 15:58:06 +02:00
Ian Davis
52aef0b926 make circleci 2022-07-28 21:17:46 -07:00
Ian Davis
83199661ce Add separate names to build-and-push-image jobs 2022-07-28 20:37:42 -07:00
Ian Davis
7f1b4dc438 Use goreleaser to build universal darwin binaries
This is a small refactor of our workflow to test out goreleaser, a yaml
based tool for building, packaging, and releasing go binaries on
multiple platforms. It supports building binaries for to most of the platforms we
care about, including linux and  macos, and also supports publishing
those binaries automatically as releases in Github, homebrew, snap, and
even apt / deb.

If this trial goes well, I think we should eventually replace the entire
release workflow with goreleaser. For now, this test is more tightly
scoped to only automated the MacOS release process, since that is the
one we have the most issues with. This PRi / commit:
- Builds darwin-amd64 and darwin-arm64 binaries of lotus, lotus-miner,
  and lotus-worker
- Packages them into a universal darwin binary
- Publishes those to a release in Github based on the current tag
- Uses the binaries in the release to auto-publish and updated homebrew
  configuration to filecoin-project/homebrew-lotus
- Does a `dry-run` build to produce a snapshot on release branches with
  no tag
- Manually generate and upload checksums after goreleaser
2022-07-28 20:37:42 -07:00
Ian Davis
564aaa7bb1 Snapcraft push was renamed to snapcraft upload 2022-07-27 13:40:16 -07:00
Ian Davis
c2887b3e59 Make snap build more verbose to debug issues. 2022-07-27 13:16:58 -07:00
Ian Davis
7e47ab2a1e Don't publish a stable release on RC tags 2022-07-27 13:16:58 -07:00
Ian Davis
04fce8a5fa Fix snap publishing flow, publish assets independently 2022-07-26 08:55:48 +02:00
Ian Davis
8a41a6bb5b Fix snap publishing flow, publish assets independently 2022-07-24 22:16:16 -07:00
zenground0
9d407f100f another try 2022-07-19 11:41:55 -07:00
zenground0
cf4b39db8c Remove codecov from CI 2022-07-19 11:37:35 -07:00
Łukasz Magiera
9eb8f4ee9d
Merge pull request #9013 from filecoin-project/feat/path-type-filters
feat: storage: Path type filters
2022-07-15 13:08:43 +02:00
Aayush Rajasekaran
ca713c57e7
Merge pull request #8084 from filecoin-project/itest_net_tests
test: net: net and conngater tests
2022-07-13 15:59:17 -04:00
Łukasz Magiera
59d069dc4d itests: Tests for storage path filters 2022-07-12 21:45:12 +02:00
Łukasz Magiera
0ca1cc2bcd itests: Test lotus-miner with no store/seal paths 2022-07-12 21:45:12 +02:00
Aayush
9662c1463d Fixup itest net tests 2022-07-10 11:09:54 -04:00
TheMenko
0d437f732d add tests for netstat and netlimit, fix error checking 2022-07-10 10:17:40 -04:00
Steven Allen
d192b821a9
fix: gas: estimate gas with a zero base-fee
Otherwise, an account will need funds to estimate the max possible gas a
message could take (which is usually the block gas limit).

This does mean gas estimation no longer checks if the sending account
has enough funds to cover the message cost, but MpoolPush will now do
this.
2022-07-08 09:47:45 -07:00
Cory Schwartz
91e678bdcb fix circleci template 2022-07-05 11:42:24 -07:00
Cory Schwartz
c079a12c9c push lotus-gateway to docker hub 2022-07-05 11:18:51 -07:00
Łukasz Magiera
9a97d83889 wdpost: itests for new config fields 2022-07-04 16:15:23 +02:00
Łukasz Magiera
82857e6d5d chore: rerun gen with moved packages 2022-06-14 20:13:31 +02:00
Łukasz Magiera
a9600b8a6f storage: Move extern/sector-storage to storage/sealer 2022-06-14 20:03:38 +02:00
Geoff Stuart
b7010c9e60 Implement function to migrate actors with only code changes 2022-06-10 15:52:32 -04:00
Jennifer Wang
2e59d0129d Merge branch 'release/v1.15.3' into jen/mergev1153to16 2022-05-31 16:33:18 -04:00
Geoff Stuart
4a40eb5af9 make gen 2022-05-30 10:29:05 -04:00
vyzo
73f6402ade bundle fetcher script does not exist any more 2022-05-11 22:34:43 +03:00
Raúl Kripalani
6050d04c7c Merge tag 'v1.15.2' into feat/nv16-merge-v1.15.2 2022-05-10 14:17:29 +01:00
Travis Person
5efa364d50 fix: ci: build macos and linux assets on tagged releases 2022-05-06 01:59:57 -04:00
Travis Person
85be0aad1b fix: ci: build macos and linux assets on tagged releases 2022-05-04 16:24:54 +00:00
Steven Allen
baef8c0c27 chore: update golang and go-ipfs
1. go 1.16.4 is not supported.
2. go-ipfs 0.4.22 is NOT SUPPORTED!
3. switch go cimg/go
4. Remove unnecessary CI dependencies.
2022-05-04 15:38:15 +03:00
Travis Person
704833cd29 ci: build-all and build-macos on all ci runs 2022-05-03 15:12:12 -04:00
Travis Person
19ec0ef25d ci: deps: remove install-deps for macos builds 2022-05-03 15:12:01 -04:00
Travis Person
415b506a85 ci: build-all and build-macos on all ci runs 2022-05-02 20:37:49 +00:00
Travis Person
d6618c75a0 ci: deps: remove install-deps for macos builds 2022-05-02 20:37:49 +00:00
jennijuju
bd9e8c7663 update go version thats needed by the new libp2p 2022-04-23 22:20:07 +02:00
Steven Allen
5f5bd31f58 chore: update golang and go-ipfs
1. go 1.16.4 is not supported.
2. go-ipfs 0.4.22 is NOT SUPPORTED!
3. switch go cimg/go
4. Remove unnecessary CI dependencies.
2022-04-20 12:06:25 +02:00
vyzo
942f05ad6a set LOTUS_SRC_DIR for tests in CI 2022-04-19 18:30:04 +03:00
vyzo
eb7fc47290 update CI workflow for bundle fetching 2022-04-19 15:38:14 +03:00
Geoff Stuart
49d6c07280 Implemented StateLoockupRobustAddress 2022-04-14 17:41:18 -04:00
vyzo
1dbfb3bea9 fetch builtin actor bundles as part of prepare workflow 2022-04-14 19:30:47 +03:00
jennijuju
0dcad9cc18 Merge branch 'releases' into jen/mergeback 2022-04-12 01:25:02 +02:00
Cory Schwartz
76c10807d6 disable publish-packer 2022-04-07 11:04:45 -04:00
Cory Schwartz
a4c24985e8 disable publish-packer 2022-04-07 10:32:15 -04:00
Jennifer Wang
5915d4ac6a fix ci 2022-04-01 15:31:10 -04:00
Cory Schwartz
cc57f732d2 fix template 2022-04-01 00:07:48 -04:00
Cory Schwartz
f410da2a0a restore filters 2022-04-01 00:07:28 -04:00
Cory Schwartz
cb39ce66bc add packer executor 2022-04-01 00:07:10 -04:00
Cory Schwartz
eb0d52a249 copy packer_build source 2022-04-01 00:05:27 -04:00
Cory Schwartz
2804c2ca99 tmp: remove filters 2022-04-01 00:05:23 -04:00
Cory Schwartz
71614bd639 add debug 2022-04-01 00:05:19 -04:00
Cory Schwartz
78187ab8d1 fix template 2022-04-01 00:05:10 -04:00
Cory Schwartz
6b4cc44060 fix template 2022-04-01 00:05:06 -04:00
Cory Schwartz
61742f5d5a restore filters 2022-04-01 00:05:02 -04:00
Cory Schwartz
c330641866 use 1.8 2022-04-01 00:04:58 -04:00
Cory Schwartz
33019ee496 add packer executor 2022-04-01 00:04:53 -04:00
Cory Schwartz
b40b7cc40e copy packer_build source 2022-04-01 00:04:38 -04:00
Cory Schwartz
17bcf91910 tmp: remove filters 2022-04-01 00:04:29 -04:00
Cory Schwartz
f04b5f2963 add debug 2022-04-01 00:04:23 -04:00
Cory Schwartz
b493855195 fix template 2022-03-30 23:10:17 -07:00
Cory Schwartz
4bb8865e2f fix template 2022-03-30 22:57:02 -07:00
Cory Schwartz
9c25aea327 restore filters 2022-03-30 22:53:57 -07:00
Cory Schwartz
cc5e96b23f use 1.8 2022-03-30 22:35:20 -07:00
Cory Schwartz
0095d93686 add packer executor 2022-03-30 22:30:17 -07:00
Cory Schwartz
1da3e2c711 copy packer_build source 2022-03-30 22:27:18 -07:00
Cory Schwartz
73468e706e tmp: remove filters 2022-03-30 22:03:41 -07:00
Cory Schwartz
4894e0b18d add debug 2022-03-30 22:02:43 -07:00
Łukasz Magiera
82343a06e7 Merge remote-tracking branch 'origin/master' into feat/post-worker 2022-03-25 16:49:46 -04:00
Łukasz Magiera
92e4caa151 Merge remote-tracking branch 'origin/master' into feat/post-worker 2022-03-21 12:09:47 +01:00
Łukasz Magiera
e767981aaf itests: Fix ccupgrade post test 2022-03-21 12:07:00 +01:00
Łukasz Magiera
49a6d7ebcc itests: Breakup ccupgrade_test.go 2022-03-21 12:07:00 +01:00
Łukasz Magiera
efdcd00da4
Merge pull request #7956 from filecoin-project/nonsense/add-lotus-test-image-building
feat: infra/ci: add `lotus-test` image as CI build step
2022-03-21 10:26:37 +01:00
Anton Evangelatov
fee69a889b modify .circleci/template.yml 2022-03-21 08:41:30 +01:00
Łukasz Magiera
046a9f8af0 Merge remote-tracking branch 'origin/master' into feat/post-worker 2022-03-09 16:27:03 +01:00
Anton Evangelatov
e1c2cf446e add lotus-test image as CI build step 2022-03-03 15:50:23 +01:00
Masih H. Derkani
aacc246ba3
Merge branch 'master' into feat/cid-to-piece-idx 2022-03-02 14:06:30 +00:00
Łukasz Magiera
91ae72d47a
Merge pull request #7819 from filecoin-project/digitalocean-use-snap
feat: ci: packer snap
2022-03-02 13:17:48 +00:00
Łukasz Magiera
a74c466b50
Merge pull request #7943 from filecoin-project/fix/restore-appimage
ci: appimage: re-install appimage CI
2022-03-02 12:54:14 +00:00
zenground0
77a954c7c3 Merge branch 'master' into feat/cid-to-piece-idx 2022-02-28 12:57:11 -07:00
Cory Schwartz
cdd2d5cc6a update template 2022-02-18 15:37:53 -08:00
Cory Schwartz
6ec82b7446 Merge branch 'master' into digitalocean-use-snap 2022-02-18 15:26:13 -08:00
Nikola Divic
0e8a709f92 Merge branch 'master' of https://github.com/filecoin-project/lotus into bloxico/mempool_tests 2022-02-12 17:11:24 +01:00
zenground0
03bc45a26a Update ci config to match auto gen 2022-02-08 12:47:23 -05:00
Jennifer Wang
932110fb93 update the param version 2022-02-08 10:44:36 -05:00
Cory Schwartz
8cbf1a3e1b undo tmp edits 2022-01-19 12:30:36 -08:00
Cory Schwartz
afac38e492 spelling 2022-01-18 17:36:44 -08:00
Cory Schwartz
1cd93e63fd edge 2022-01-18 17:35:34 -08:00
Cory Schwartz
a3458213f4 Merge branch 'master' into digitalocean-use-snap 2022-01-18 17:02:41 -08:00
Łukasz Magiera
4a874eff70 post workers: Cleanup, tests 2022-01-14 14:17:52 +01:00
Cory Schwartz
899db1f7c3 fix template 2022-01-14 03:07:20 -08:00
Cory Schwartz
d9562e2aee restore appiamge 2022-01-14 03:01:12 -08:00
Aarsh Shah
edfc2c215c Merge remote-tracking branch 'origin/main' into feat/cid-to-piece-idx 2022-01-12 12:48:54 +04:00
zenground0
4963fe7809 Fix template 2022-01-09 09:41:53 +05:30
zenground0
a64cf77e84 generated vectors from v7 for bleeding edge 2022-01-09 09:33:07 +05:30
Cory Schwartz
d42f7e4a1c packer snap 2021-12-17 17:06:32 -08:00
Aayush Rajasekaran
80d5e52923 Merge branch 'master' into next 2021-12-13 13:24:28 -05:00
Travis Person
66c8c66f40 disable building of appimage on release
appimage testing is currently broken due to a requirement to have access
to /dev/snd, which is not present on the image we are using in circleci.
2021-12-01 19:15:35 +00:00
c r
e16e9ad343
reorder transfer checks so as to ensure sending more money than you have to yourself fails with an error (fixing issue 7596)
PR #7637, also adds tests to make sure behavior is correct across versions.
2021-11-29 17:26:47 -05:00
Peter Rabbitson
46937a1b9f Add tests cementing the DM-level behavior on simple paths 2021-11-24 15:31:15 +01:00
Dirk McCormick
025d8ebc59 feat: include TestDealRetrieveByAnyCid in CI 2021-11-12 09:43:42 +01:00
Anton Evangelatov
6e5ccc87cf cli: add retry for deals stuck in Publish with no funds 2021-10-11 14:03:55 +02:00
Peter Rabbitson
778483166f Remove obsolete GS testplan - it now lives in go-graphsync 2021-10-07 12:23:43 +02:00
Cory Schwartz
001fc7dd53 restore filters for the build-macos job 2021-10-06 13:40:44 -07:00
Peter Rabbitson
2a1094fc17 Merge banch feat/go-fil-markets-v1.13.0 into feat/datamodel-selector-retrieval 2021-10-04 21:56:11 +02:00
Jennifer Wang
d7690aa719 Merge branch 'releases' into jen/backport 2021-09-29 03:21:19 -04:00
Jennifer Wang
6064d2f2f1 remove nerpanet related code base as it was deprecated on aug 16 https://docs.filecoin.io/about-filecoin/networks/#deprecated-networks 2021-09-22 00:59:38 -04:00
Mike Greenberg
90827afa47 feat(ci): include version/cli checks in tagged releases 2021-09-15 12:12:05 -04:00
Jennifer Wang
cd08788792 Bump the xcode version for ci and run build macos jobs more 2021-09-10 13:35:25 -04:00
ognots
143b6d7a37 remove job to install jq
jq is already installed now in either a newer version of CircleCI's MacOS VMs or in a previous CI step.
I ran a failing macos job with ssh enabled, and inspected '/usr/local/bin' and found found the following output

lrwxr-xr-x    1 distiller  admin    23 Jun 22 14:50 jq -> ../Cellar/jq/1.6/bin/jq

the existing symlink causes the 'Install jq' job to fail.
removing this job should resolve the issue
2021-09-10 13:32:17 -04:00
ognots
4d9b852875 remove job to install jq
jq is already installed now in either a newer version of CircleCI's MacOS VMs or in a previous CI step.
I ran a failing macos job with ssh enabled, and inspected '/usr/local/bin' and found found the following output

lrwxr-xr-x    1 distiller  admin    23 Jun 22 14:50 jq -> ../Cellar/jq/1.6/bin/jq

the existing symlink causes the 'Install jq' job to fail.
removing this job should resolve the issue
2021-09-10 10:21:40 -04:00
Peter Rabbitson
0444435589 Expose basic text-based datamodel selector on retrieval
Syntaxt of selection is located at
https://pkg.go.dev/github.com/ipld/go-ipld-selector-text-lite#SelectorSpecFromPath

Example use, assuming that:
  - The root of the deal is a plain dag-pb unixfs directory
  - The directory is not sharded
  - The user wants to retrieve the first entry in that directory

  lotus client retrieve --miner f0XXXXX --datamodel-path-selector 'Links/0/Hash' bafyROOTCID ~/output

For a much more elaborate example see the top of ./itests/deals_partial_retrieval_test.go
2021-09-10 09:44:11 +02:00
Anton Evangelatov
992cc3ffbf itests: MaxStagingDealsBytes integration test 2021-09-06 17:39:35 +02:00
Dirk McCormick
7b7a5b0b21 revert: changes to OnDealExpiredOrChanged in #5431 #7201 2021-08-30 10:42:41 +02:00
Dirk McCormick
07dcb074f8 fix: catch deal slashed because sector was terminated 2021-08-27 12:56:23 +02:00
dirkmc
77a19774cf fix events API timeout handling for nil blocks (#7184) 2021-08-27 09:05:00 +02:00
Raúl Kripalani
2dde022a00 itests: support larger sector sizes; add large deal test. 2021-08-20 15:53:24 +01:00
Peter Rabbitson
8d873e3edc Tests for online and offline dealpadding
Also bump the times on several flaky tests that can not complete in time
on a typical laptop ( and fail half the time on CircleCI )
2021-07-24 17:46:04 +02:00
Cory Schwartz
f68b43a526 make work with go gen 2021-07-22 14:15:27 -07:00
Cory Schwartz
6c6df04112 publish to dockerhub circleci 2021-07-20 15:23:29 -07:00
hunjixin
a48a6a168a add test for new api 2021-07-15 14:52:12 +08:00
Łukasz Magiera
7526a074d9 sealing: collateral buffer / falback config 2021-07-13 17:04:58 +02:00
Łukasz Magiera
83f2368507 Add CollateralFromMinerBalance config 2021-07-12 14:11:58 +02:00
Łukasz Magiera
13d4563c25
Merge pull request #6663 from filecoin-project/raulk/test-incremental-nonce
add an incremental nonce itest.
2021-07-02 23:33:52 +02:00
Łukasz Magiera
8a94ab676e storage: Fix FinalizeSector with sectors in stoage paths 2021-07-02 19:54:45 +02:00
Raúl Kripalani
ca40234031 update circleci config. 2021-07-02 17:04:57 +01:00