cerc-io/lotus
16
0
Fork 0
Code Issues Pull Requests Packages Projects Releases 27 Wiki Activity
16,991 Commits 24 Branches 342 Tags 314 MiB
ea4b57854b
Commit Graph

1420 Commits

Author SHA1 Message Date
Raúl Kripalani
3795cc2bd2 segregate chain and state blockstores. 
This paves the way for better object lifetime management.

Concretely, it makes it possible to:
- have different stores backing chain and state data.
- having the same datastore library, but using different parameters.
- attach different caching layers/policies to each class of data, e.g.
  sizing caches differently.
- specifying different retention policies for chain and state data.

This separation is important because:
- access patterns/frequency of chain and state data are different.
- state is derivable from chain, so one could never expunge the chain
  store, and only retain state objects reachable from the last finality
  in the state store.
 2021-02-28 22:49:44 +00:00
Jakub Sztandera
ccebc4f53c
Fix riceing by importing the main package 
Go 1.16 elides dependencies from go.sum when you don't use a package
which has these dependencies.

This means dependencies for the `rice` command where not in our
`go.sum`.

Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2021-02-24 15:58:40 +01:00
Łukasz Magiera
35759fa07e
Merge pull request #5635 from filecoin-project/deps/cbg-soft-map 
Update markets, cbor-gen with soft map decoding
 2021-02-22 18:27:38 +01:00
Dirk McCormick
a8b40b77fa update to go-fil-markets v1.1.9 2021-02-22 17:01:28 +01:00
Dirk McCormick
7046e2721a feat: update go-fil-markets version 2021-02-22 14:25:29 +01:00
Steven Allen
b177e67a7a chore: normalize deps 2021-02-19 15:27:38 -08:00
Aayush Rajasekaran
df32f5d060 Update actors to v3.0.2 2021-02-19 15:08:30 -05:00
Łukasz Magiera
26399dba70 Update markets, cbor-gen with soft map decoding 2021-02-19 20:11:43 +01:00
Łukasz Magiera
d12545af6f
Merge pull request #5469 from filecoin-project/feat/faucet-captcha 
Add spam protection to fountain
 2021-02-17 20:17:28 +01:00
Łukasz Magiera
5f998038c7 Update go-jsonrpc 2021-02-17 18:59:31 +01:00
Łukasz Magiera
5ad4d72fe0 Update go-jsonrpc fixing websocket reconnecting 2021-02-16 21:16:13 +01:00
Dirk McCormick
a6e3856776 Revert "feat: deals - show data transfer %" 
This reverts commit b6c9ddccff.
 2021-02-16 12:32:45 +01:00
Steven Allen
6b6f0acaf0 update go-bitfield 
optimizes subtract operations
 2021-02-15 13:14:13 -08:00
Łukasz Magiera
95e47cf998
Merge pull request #5553 from filecoin-project/feat/data-xfer-percent 
show data transfer % for storage deals
 2021-02-11 13:29:43 +01:00
Dirk McCormick
b6c9ddccff feat: deals - show data transfer % 2021-02-10 09:56:23 +01:00
Anton Evangelatov
307fc14093 go.mod: do not depend on gocheck 2021-02-09 17:08:19 +01:00
Dirk McCormick
e7a63b7dd5 feat: updated to go-fil-markets@1.1.7 2021-02-05 12:12:48 +01:00
Dirk McCormick
6baddccff2 feat: update to go-fil-markets v1.1.6 2021-02-05 09:41:42 +01:00
Dirk McCormick
fc8ee481a8 refactor: move waiting for publish deals from markets into lotus 2021-02-03 10:36:38 +01:00
Dirk McCormick
a19d6ce8a3 fix: zero price-per-byte retrieval 2021-02-01 16:55:18 +01:00
Steven Allen
e9eecad2c5 fix verified registry migration 2021-01-28 16:14:38 -08:00
Jakub Sztandera
ba94f271db
Add spam protection to fountain 
Uses reCAPTCHAv3, `RECAPTCHA_SITE_KEY` and `RECAPTCHA_SECRET_KEY` need to be
set in env.

Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2021-01-28 19:58:09 +01:00
Steven Allen
997e7d18d9 fix: update specs-actors to fix a bug in the migration logic 2021-01-27 21:53:11 -08:00
Steven Allen
7905c3bbd8 update deps 
Most changes are just tagging deps. However,

* Updates go-ipld-hamt to fix a bug in the new V3 HAMT.
* Updates bitfield to save ~10% for some operations.
 2021-01-27 11:52:32 -08:00
Steven Allen
94089a6a15 remove todos 2021-01-22 11:15:43 -08:00
Steven Allen
c27ec4ed22 latest specs actors master 2021-01-21 15:21:20 -08:00
Steven Allen
fb5f3c5703 update specs actors 2021-01-21 15:21:19 -08:00
Steven Allen
dffa514518 update specs-actors for h/amt interface refactor 2021-01-21 15:21:19 -08:00
Steven Allen
64e805926f update specs-actors for migration name change 
Actors v3 is network version 10.
 2021-01-21 15:21:19 -08:00
Aayush Rajasekaran
aa9eef48f0 Use temp commit of actors 2021-01-21 15:21:19 -08:00
Aayush Rajasekaran
ba3b32cfe7 Pull in actors v3 2021-01-21 15:21:18 -08:00
Raúl Kripalani
931cfe1ed1 upgrade to raulk/go-watchdog@v1.0.1 
This pulls in the improvements introduced in:
  - https://github.com/raulk/go-watchdog/releases/tag/v1.0.0
  - https://github.com/raulk/go-watchdog/releases/tag/v1.0.1

Lotus tries to initialize the watchdog in the following order of precedence:
  1. If a max heap limit has been provided, initialize a heap-driven watchdog.
  2. Else, try to initialize a cgroup-driven watchdog.
  3. Else, try to initialize a system-driven watchdog.
  4. Else, log a warning that the system is flying solo, and return.

This PR also enabled automatic heap profile capture when memory usage
surpasses 90% of the limit. Profiles are written to <LOTUS_HOME>/heapprof.
A single heap profile is captured per episode, with a max of 10 episodes
captured during the lifetime of the process. Episode = instance of usage
climbing above the 90% threshold.
 2021-01-20 18:09:19 +00:00
Dirk McCormick
1206154718 feat: update to go-fil-markets v1.1.0 for better retry config 2021-01-20 10:00:02 +01:00
Dirk McCormick
835fd4b23c feat: markets - miner should not dial client on restart 2021-01-14 16:38:56 +01:00
vyzo
62e76bbcab update go-libp2p-pubsub to v0.4.1 2021-01-12 17:24:15 +02:00
Łukasz Magiera
594737ff6c Upgrade specs-actors 2020-12-19 21:34:57 +01:00
Dirk McCormick
72cb130e17 feat: show data transfer ID in list-deals 2020-12-08 15:23:26 +01:00
Raúl Kripalani
e8a5e0d2fe integrate memory watchdog; impose limits on badger caches. 2020-12-02 16:40:28 +00:00
Łukasz Magiera
354b5af55a
Merge pull request #5032 from filecoin-project/fix/cancel-transfer 
Cancel transfer cancels storage deal
 2020-12-01 14:57:58 +01:00
Dirk McCormick
c5a8b7076c feat: go-fil-markets v1.0.9 2020-12-01 11:58:28 +01:00
Dirk McCormick
7bab281449 feat: go-data-transfer v1.2.2 / go-fil-markets v1.0.8 2020-12-01 11:12:41 +01:00
Dirk McCormick
c66e594046 fix: cancel transfer cancels storage deal 2020-11-27 15:37:22 +01:00
Łukasz Magiera
3672053ae9 worker: Support setting task types at runtime 2020-11-26 17:33:34 +01:00
Łukasz Magiera
41d370557f Merge remote-tracking branch 'origin/master' into feat/deal-await-precommit 2020-11-26 12:09:52 +01:00
Łukasz Magiera
fcec665267 Merge remote-tracking branch 'origin/master' into feat/deal-await-precommit 2020-11-26 11:51:36 +01:00
Łukasz Magiera
506624f509 Update go-jsonrpc to v0.1.2 2020-11-26 11:42:31 +01:00
Dirk McCormick
97a76a4b9a feat: update to go-graphsync v0.5.1 2020-11-25 13:18:41 +01:00
hannahhoward
694834e8d5 feat(graphsync): configure simultaneous requests 
allow configuration of the number of simultaneous requests graphsync will process at once
 2020-11-24 14:32:30 -08:00
hannahhoward
47a4128311 feat(markets): update to tagged go-fil-markets 2020-11-24 13:26:14 -08:00
Dirk McCormick
239e180683 feat: markets - separate watching for pre-commit from prove-commit 2020-11-24 13:24:41 -08:00
Łukasz Magiera
9cef300535
Merge pull request #4971 from filecoin-project/chore/new_sr2_deal_rollup_cmd 
New SR-specific lotus-shed cmd
 2020-11-24 17:50:10 +01:00
Lucas Molas
8b8449faee update jsonrpc with max req size 2020-11-24 16:46:35 +01:00
Peter Rabbitson
2609342356 New SR-specific lotus-shed cmd 2020-11-23 05:41:14 +00:00
hannahhoward
218f7c2c5d feat(markets): update markets, extract commp 2020-11-20 13:29:14 -08:00
Dirk McCormick
e7b8511622 feat: upgrade to go-fil-markets 1.0.5 2020-11-19 10:16:49 +01:00
Aayush Rajasekaran
8575f5518c Merge branch 'master' into release/v1.2.0 2020-11-17 19:49:46 -05:00
Aayush Rajasekaran
52d34c8a5e Update to ipfs-blockstore 1.0.3 2020-11-17 19:43:20 -05:00
Aayush Rajasekaran
68a16afeda Merge branch 'master' into release/v1.2.0 2020-11-17 19:40:05 -05:00
Łukasz Magiera
50146fb9b9
Merge pull request #4872 from filecoin-project/raulk/fix-blockstore-import 
fix badger double open on daemon --import-snapshot; chainstore lifecycle
 2020-11-18 01:36:16 +01:00
Jakub Sztandera
7ce4e5342b
Upgrade actors to v2.3.2 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-11-17 20:43:32 +01:00
hannahhoward
a2abeef727 feat(markets): upgrade to fix cid recording issue 2020-11-16 17:57:57 -08:00
Łukasz Magiera
8db9c19e1c mod tidy 2020-11-16 19:19:17 +01:00
Łukasz Magiera
444239a643 update ffi 2020-11-16 19:17:07 +01:00
Steven Allen
638900f97f Remove static proof type configuration from market subsystem 
Instead, use proof type from miner actor. This will, in turn, use the upgraded
proof type if/when it's switched at runtime.

TODO: Consider making this some form of config option instead?
 2020-11-16 19:04:17 +01:00
Steven Allen
d7c2c073a3 update specs-storage to fix build 2020-11-16 19:03:30 +01:00
Łukasz Magiera
6bea9dd178 Making sealing logic work with multiple seal proof types 2020-11-16 19:03:30 +01:00
Raúl Kripalani
b13a41a44d go mod tidy. 2020-11-16 16:30:17 +00:00
Raúl Kripalani
87d6daf745 fix blockstore double open issue on --import-snapshot. 
Fixes https://github.com/filecoin-project/lotus/issues/4850.
 2020-11-16 15:21:47 +00:00
Aayush Rajasekaran
6d0b3978b9 Merge branch 'master' into release/v1.2.0 2020-11-15 19:03:18 -05:00
Steven Allen
ae76711ab4 chore(dep): update bitswap to fix an initialization race that could panic 
In rare cases, if bitswap receives a message before it finishes starting up, it
could panic. This release fixes that.
 2020-11-13 14:11:29 -08:00
Steven Allen
5f1737379a update libp2p for stream interface changes 2020-11-12 13:57:19 -08:00
Aayush Rajasekaran
5d9c79811f
Update to actors v2.3.0 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-11-12 18:49:11 +01:00
Aayush Rajasekaran
90dd39d581
Merge pull request #4787 from filecoin-project/refactor/fund-mgr-integ 
refactor: integrate new FundManager
 2020-11-11 03:58:59 -05:00
Dirk McCormick
9011e88f9f fix: go mod tidy 2020-11-11 09:45:32 +01:00
Dirk McCormick
0e20a65a0b feat: upgrade markets to v1.0.4 2020-11-11 09:41:27 +01:00
Aayush Rajasekaran
029c516cbc Update to latest go-address 2020-11-11 00:46:02 -05:00
hannahhoward
ebd6b0da49 fix(deps): update to tagged go-graphsync 2020-11-10 21:18:29 -08:00
hannahhoward
9f7204ee26 feat(builder): finish new FundManager setup 
Finish setup of new FundManager and provide a migration for previously reserved funds
 2020-11-10 21:11:05 -08:00
Aayush Rajasekaran
1323dbddfe
Merge pull request #4793 from filecoin-project/asr/bitfield-update 
Update to latest go-bitfield
 2020-11-10 20:36:08 -05:00
Aayush Rajasekaran
735c04f999
Merge pull request #4681 from filecoin-project/badger-viewable 
move to native badger blockstore; leverage zero-copy View() to deserialize in-place
 2020-11-10 18:08:12 -05:00
Aayush Rajasekaran
075297d8ad Update to latest go-bitfield 2020-11-10 17:43:50 -05:00
Raúl Kripalani
379dd02fb6 upgrade dependencies. 2020-11-10 16:32:23 +00:00
Raúl Kripalani
577476b8fe import Viewable non-terminal blockstores. 2020-11-10 13:16:24 +00:00
hannahhoward
ea726c9f17 feat(markets): update to 1.0.1 
update to tagged 1.0.1 release & also fix lint error
 2020-11-09 20:02:02 -08:00
hannahhoward
7519bdde42 feat(markets): check deal equality 
in OnDealSectorCommitted, verify that deals looked up match the deal proposals which were made
 2020-11-09 18:48:28 -08:00
hannahhoward
09a0d6e607 style(lint): fix lint issues 2020-11-09 18:48:28 -08:00
hannahhoward
d2acc78787 feat(markets): handle deal ID changes 
make OnDealSectorCommitted handle changes to deal ids
 2020-11-09 18:48:28 -08:00
Steven Allen
4a3ff8ff9e update yamux 
This new release:

* Ensures we send window updates on-time to avoid sawtooth bandwidth utilization.
* Limits the number of outgoing pings to 1 (no need to send any more at a time).
* Limits the number of buffered pongs to 32 (there should never be more than 1,
  maybe 2, at a time).
* Fast-tracks outgoing pings so they don't get stuck behind large queued writes.
 2020-11-06 12:51:50 -08:00
Jakub Sztandera
258cc0067b
Update go-bitfield v0.2.2 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-11-06 20:16:05 +01:00
Raúl Kripalani
809111336a Merge branch 'master' into badger-viewable 2020-11-03 18:29:10 +00:00
hannahhoward
af1743f9f3 fix(datatransfer): update with memory leak fixes 2020-11-02 17:25:02 -08:00
Raúl Kripalani
634467d24b go mod tidy. 2020-11-01 17:38:38 +00:00
Raúl Kripalani
95f512aa69 update/add dependencies. 2020-11-01 13:05:07 +00:00
Łukasz Magiera
843c0719e0 Update FFI 2020-10-27 15:37:11 +01:00
Łukasz Magiera
c81db5a21c
Merge pull request #4420 from filecoin-project/deps/drand-v1.2.0 
Chore: update drand to v1.2.0
 2020-10-23 18:25:00 +02:00
Jakub Sztandera
0341944350 Inject prometheus 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-10-22 14:57:05 +02:00
whyrusleeping
00d1e6b549 add measure datastore wrapper around bench chain datastore 2020-10-22 14:57:04 +02:00
Will Scott
9dc9bf5eb0 go mod tidy 2020-10-21 19:49:38 -07:00
Will Scott
035a762358 update drand to v1.2.1 
* stop autowatching
* set user-agent
 2020-10-21 16:49:59 -07:00
Łukasz Magiera
c767399fc6
Merge pull request #4504 from filecoin-project/feat/clientdeal-miner-picker 
Miner finder for interactive client deal CLI
 2020-10-21 05:46:07 +02:00
Aayush Rajasekaran
556f92a823 Update to actors v2.2.0 at PostLiftoff epoch 2020-10-20 17:23:35 -04:00
hannahhoward
e08032da93 feat(markets): update markets v1.0.0 2020-10-20 13:56:13 -07:00
Łukasz Magiera
dc40469cb3 Miner finder for interactive client deal CLI 2020-10-20 21:54:39 +02:00
Łukasz Magiera
955d7f9c54
Merge pull request #4393 from filecoin-project/vectors/support-multiple-versions 
conformance: support multiple protocol versions.
 2020-10-15 14:29:23 +02:00
Raúl Kripalani
7e6ede7563 update schema; test-vectors submodule. 2020-10-15 12:49:23 +01:00
Hector Sanjuan
925606ff26 Chore: update drand to v1.2.0 2020-10-15 12:02:12 +02:00
hannahhoward
8df58064e3 feat(markets): update to 0.9.1 bugfix release 2020-10-14 13:20:18 -07:00
Raúl Kripalani
45cd510da1 conformance: support multiple protocol versions. 
This PR introduces support for running multiple variants of a vector,
each of which targets a unique protocol version.

tvx tooling has been adapted to produce and parse the new version
of the schema.
 2020-10-14 14:39:43 +01:00
hannahhoward
58662b79b3 fix(deps): use tagged go-fil-markets 0.9.0 2020-10-13 19:50:13 -07:00
hannahhoward
4edebcec2b feat(markets): update markets 0.9.0 and add data transfer restart command 2020-10-13 03:41:08 -07:00
Łukasz Magiera
65883cbb6b
Merge pull request #4290 from filecoin-project/feat/ledger-integration 
adding in ledger support
 2020-10-12 15:09:27 +02:00
Steven Allen
92177b5738 implement tape upgrade 
Upgrade to specs-actors v2.1 and network version 5. This fixes the bug where
prove commits were not accepted.
 2020-10-12 02:00:27 -04:00
Jakub Sztandera
fda8b932ba
Ask for confirmation when creating a key 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-10-12 01:27:15 +02:00
whyrusleeping
b35f9b56b4
WIP: adding in ledger support 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-10-12 00:07:40 +02:00
Steven Allen
10d464a1eb upgrade to specs-actors v2.0.3 2020-10-09 21:52:01 -07:00
Łukasz Magiera
597d065e05 Update go-jsonrpc with http(s) client support 2020-10-09 01:39:06 +02:00
hannahhoward
c60d13ee56 feat(markets): update markets v0.7.1 2020-10-08 13:52:39 -07:00
Raúl Kripalani
21de538d09 upgrade go-libp2p-noise to v0.1.2. 
Improves throughput in large and/or fast transfers
and reduces syscalls when data is queued in receive
buffer, by using bufio.Reader.
 2020-10-08 21:19:09 +01:00
vyzo
8a175a7465 update go-libp2p-pubsub and go-libp2p-quic-transport 2020-10-08 21:32:10 +03:00
Raúl Kripalani
8d2d74438b
Merge pull request #4221 from filecoin-project/conformance/randomness 2020-10-08 15:16:32 +01:00
Raúl Kripalani
1f9446f91f upgrade to test vectors schema v0.0.4. 2020-10-08 15:00:35 +01:00
Raúl Kripalani
5bd6a3cdad conformance: record randomness in tvx; replay in driver. 2020-10-07 19:57:42 +01:00
Aayush Rajasekaran
839d1121ce Update to actors v2.0.1 2020-10-06 20:37:54 -04:00
Steven Allen
00187d4aa8 update the AMT implementation 
This change ensures the bitmap is reset on flush.
 2020-10-06 17:43:45 -04:00
Steven Allen
b6500beaab Merge branch 'master' into asr/spec-v1 2020-10-05 10:29:09 -07:00
Jakub Sztandera
feb85a272c
Update go-bitfield 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-10-05 19:14:21 +02:00
Steven Allen
8292d60196 Merge branch 'master' into asr/spec-v1 2020-10-02 18:03:03 -07:00
Steven Allen
c5de617af6 decouple network version and upgrades 
Not all upgrades require network version bumps.
 2020-10-02 17:10:57 -07:00
Steven Allen
1cc0f74744 make the upgrade schedule fully configurable 
This should help with testing.
 2020-10-01 15:02:40 -07:00
Aayush Rajasekaran
3d91633699 Update to v2/actors master 2020-10-01 05:07:00 -04:00
Aayush Rajasekaran
7699f195f1
Merge pull request #4108 from filecoin-project/feat/nice-sectorslist 
Improve miner sectors list UX
 2020-09-30 19:07:23 -04:00
Steven Allen
941c1947be Merge branch 'master' into asr/spec-v1 2020-09-30 13:03:58 -07:00
Łukasz Magiera
feecee310d
Merge pull request #4089 from filecoin-project/feat/update-markets-0.7.0 
Markets 0.7.0 with updated data stores
 2020-09-30 21:49:14 +02:00
hannahhoward
be884e27be feat(markets): update markets 0.7.0 2020-09-30 10:26:50 -07:00
Steven Allen
724306c110 update specs-actors 2020-09-30 09:23:04 -07:00
Steven Allen
4989b1cc90 Merge branch 'master' into asr/spec-v1 2020-09-30 09:19:12 -07:00
Łukasz Magiera
5bffea6f54
Merge pull request #4064 from filecoin-project/tvx 
tvx: a test vector extraction and execution tool
 2020-09-30 17:22:42 +02:00
Łukasz Magiera
4d4bab12eb Improve miner sectors list UX 2020-09-30 13:34:05 +02:00
Raúl Kripalani
eb6191d0ff tvx: precursor selection modes; canonical message fetching; basefee. 2020-09-30 11:02:10 +01:00
Jakub Sztandera
247a5e2c49
Go mod tidy 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-09-29 14:50:08 +02:00
Jakub Sztandera
7e8c6e5070
Remove statediff, fix lint, go mod tidy 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-09-29 14:49:47 +02:00
Jakub Sztandera
76db65b1af
Update pebble 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-09-29 14:49:47 +02:00
Jakub Sztandera
0771c23fb0
Use pebble 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-09-29 14:49:46 +02:00
Jakub Sztandera
1c6214b76d
Usage go-bitfield with buffer pool 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-09-29 14:49:45 +02:00
Jakub Sztandera
f21c5cbbe2
Add start-at 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-09-29 14:49:18 +02:00
Steven Allen
c0e190344d check state invariants after upgrade 2020-09-28 17:42:29 -07:00
Raúl Kripalani
4b3b35c9de conformance: record and feed circulating supply. 2020-09-28 23:04:52 +01:00
Steven Allen
947d1e2902 Merge branch 'master' into asr/spec-v1 2020-09-28 12:53:40 -07:00
Steven Allen
5f3160cf5b continue expanding vm abstraction layer 2020-09-28 12:48:08 -07:00
Raúl Kripalani
e5c56da321 move conformance tvx tool to lotus. 2020-09-27 20:10:05 +01:00
Łukasz Magiera
6a502090f4
Merge pull request #4028 from filecoin-project/asr/address-update 
Add an envvar to set address network version
 2020-09-26 10:14:10 +02:00
Łukasz Magiera
ef28ebb14a Ignition upgrades, much excite. 2020-09-25 23:55:37 -07:00
Aayush Rajasekaran
ebad0ded3d Introduce v1 actors 2020-09-25 12:49:39 -07:00
Aayush Rajasekaran
60e43ccbb1 Add an envvar to set address network version 2020-09-25 15:45:27 -04:00
hannahhoward
4ff38aa856 feat(markets): update to 0.6.3 2020-09-25 02:35:34 -07:00
hannahhoward
3fc791b0e8 feat(markets): update markets v0.6.2 2020-09-23 12:17:16 -07:00
Łukasz Magiera
70faa36b7f Merge remote-tracking branch 'origin/master' into refactor/net-upgrade 2020-09-18 19:29:06 +02:00
Aayush Rajasekaran
fce423c743 Appease the linter and get everything building 2020-09-18 02:14:18 -04:00
hannahhoward
a894c1e8e6 feat(markets): upgrade markets v0.6.1 2020-09-17 12:30:26 -07:00
hannahhoward
691bd9f442 feat(markets): complete markets conversion 
complete markets conversion to using chain/actors types, also replacing DealProposal/DealState
interfaces with structs
 2020-09-17 00:43:14 -07:00
Steven Allen
02dcb5e182 Merge branch 'master' into refactor/net-upgrade 2020-09-14 14:53:57 -07:00
Steven Allen
9804310cc8 Update specs-actors to 0.9.10 
Moves the Keyer type (and helpers) into go-state-types.
 2020-09-14 14:32:57 -07:00
Steven Allen
32eeb96ce7 Update to specs-actors 0.9.9 
This patch changes the runtime interfaces, to make it possible to abstract over them.
 2020-09-14 12:47:39 -07:00
Łukasz Magiera
06ec571c20 Merge remote-tracking branch 'origin/master' into refactor/net-upgrade 2020-09-14 15:09:52 +02:00
Raúl Kripalani
6d29d75724 Merge branch 'master' into inmem-journal 2020-09-14 12:17:45 +01:00
Łukasz Magiera
38f87981c1 Fix some build errors 2020-09-14 13:14:06 +02:00
Steven Allen
d3594835c4 [WIP] Network upgrade support 
This patch starts adding support for network upgrades.

* It adds an actors abstraction layer for loading abstract (cross-version) actors.
* It starts switching over to a shared deadline type.
* It adds an abstraction for ADTs (hamt/amt).
* It removes the callback-based API in the StateManager (difficult to abstract
across actor versions).
* It _does not_ actually add support for actors v2. We can do that in a followup
patch but that should be relatively easy.

This patch is heavily WIP and does not compile. Feel free to push changes
directly to this branch.

Notes:

* State tree access now needs a network version, because the HAMT type will change.
* I haven't figured out a nice way to abstract over changes to the _message_
types. However, many of them will be type aliased to actors v0 in actors v2 so
we can likely continue using the v0 versions (or use the v2 versions
everywhere). I've been renaming imports to `v0*` to make it clear that we're
importing types from a _specific_ actors version.

TODO:

* Consider merging incremental improvements? We'd have to get this compiling
again first but we could merge in the new abstractions, and slowly switch over.
* Finish migrating to the new abstractions.
* Remove all actor state types from the public API. See `miner.State.Info()` for
the planned approach here.
* Fix the tests. This is likely going to be a massive pain.
 2020-09-11 20:16:29 -07:00
Ingar Shu
2e3ff9e401
Update market client/provider adapters to WaitForMessage API 2020-09-11 11:00:42 -07:00
Łukasz Magiera
b89aa02d77
Merge pull request #3710 from filecoin-project/feat/window-post-faulty-sectors 
windowed post generation now returns faulty sectors
 2020-09-11 11:15:32 +02:00
Łukasz Magiera
a3f228d05a
Merge pull request #3739 from filecoin-project/upd/badger 
Upgrade badger
 2020-09-11 11:14:39 +02:00
Łukasz Magiera
d0175392c0 Merge remote-tracking branch 'origin/master' into feat/window-post-faulty-sectors 2020-09-11 10:47:39 +02:00
Aayush Rajasekaran
774e068436 Update to specs-actors v0.9.8 2020-09-10 17:41:55 -04:00
Aayush Rajasekaran
86ba21029d Update to go state types 001afaca718c 2020-09-10 17:41:55 -04:00
Aayush Rajasekaran
316ac61875 Update to go state types 3ca0d2890090 2020-09-10 17:41:55 -04:00
Jakub Sztandera
564d0ae974 Upgrade drand 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-09-10 17:41:55 -04:00
Jakub Sztandera
df5750a21c
go mod tidy 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-09-10 23:15:56 +02:00
Łukasz Magiera
e996a5246b Merge remote-tracking branch 'origin/master' into feat/window-post-faulty-sectors 2020-09-10 22:18:17 +02:00
Łukasz Magiera
bbac86f745 gofmt, mod tidy 2020-09-10 22:07:20 +02:00
vyzo
bfa47b3663 update go-libp2p-pubsub@master 2020-09-10 16:11:23 +03:00
Łukasz Magiera
5e7737f55d wdpost: Handle skipped sectors correctly 2020-09-10 02:59:37 +02:00
Raúl Kripalani
e8d1bab914 make the runner call statediff as a binary. 2020-09-09 13:03:43 +01:00
Aayush Rajasekaran
f91f665f3f Update test-vectors 2020-09-08 01:24:30 -04:00
Aayush Rajasekaran
6eea5dd109 Update to specs 0.9.7 and markets 0.6.0 2020-09-07 17:11:32 -04:00
Aayush Rajasekaran
529002c2b7 Update to markets master 2020-09-07 15:48:42 -04:00
Aayush Rajasekaran
4367d74102 Update statediff and test-vectors 2020-09-07 15:48:42 -04:00
hannahhoward
2db4b57013 feat(markets): upgrade markets 0.6.0 2020-09-07 15:48:42 -04:00
Aayush Rajasekaran
be7fb9d3df Use custom markets 2020-09-07 15:48:42 -04:00
Aayush Rajasekaran
39755a294a Update to specs v0.9.6 2020-09-07 15:48:41 -04:00
vyzo
219c8b927d go mod tidy 2020-09-07 13:46:23 +03:00
vyzo
7fdab46729 update go-libp2p-pubsub@master 2020-09-07 13:40:42 +03:00
Raúl Kripalani
1ec534d607 Merge branch 'master' into inmem-journal 2020-09-04 10:55:40 +01:00
Łukasz Magiera
2177fd59ef
Merge pull request #3521 from filecoin-project/conformance/tipset-actor-address 
conformance: various changes
 2020-09-04 04:18:41 +02:00
Raúl Kripalani
c723554d2e upgrade test-vectors deps. 2020-09-03 23:44:21 +01:00
Łukasz Magiera
10acc04ba5
Merge pull request #3497 from filecoin-project/feat/bandwidth-tracking 
add apis and command to inspect bandwidth usage
 2020-09-03 14:37:54 +02:00
whyrusleeping
a59dadccc9 add apis and command to inspect bandwidth usage 2020-09-02 15:25:53 -07:00
hannahhoward
d2a10413a1 feat(markets): upgrade to v0.5.9 2020-09-02 13:19:39 -07:00
Łukasz Magiera
8ba0385b3a
Revert "adx blst" 2020-09-02 21:05:38 +02:00
Raúl Kripalani
3206f92063 Merge branch 'master' into inmem-journal 2020-09-02 19:50:52 +01:00
Raúl Kripalani
fd04a19544 go mod tidy. 2020-09-02 19:46:57 +01:00
Raúl Kripalani
7cc9c83ab8 upgrade test-vectors. 2020-09-02 14:12:27 +01:00
Raúl Kripalani
0962292f92 conformance: add driver for tipset-class vectors. 2020-09-02 14:09:12 +01:00
Łukasz Magiera
fa6bae988e
Revert "conformance: add driver for tipset-class vectors." 2020-09-02 14:49:55 +02:00
Łukasz Magiera
80ecbeddbb
Merge pull request #3464 from filecoin-project/feat/blst-adx 
adx blst
 2020-09-02 14:25:00 +02:00
Łukasz Magiera
e86749dfe2
Merge pull request #3449 from filecoin-project/tipset-vector 
conformance: add driver for tipset-class vectors.
 2020-09-02 13:42:42 +02:00
Travis Person
630dfb9b55 adx blst 2020-09-02 01:04:56 +00:00
vyzo
f9df806f15 update go-libp2p-pubsub@master 2020-09-01 20:46:12 +03:00
Raúl Kripalani
01737ef1cc upgrade test-vectors deps. 2020-09-01 17:00:18 +01:00
Raúl Kripalani
3321f36b51 update test-vectors commit. 2020-09-01 16:35:26 +01:00
hannahhoward
0a36db06ed feat(markets): update to markets v0.5.8 2020-08-28 18:03:27 -07:00
Łukasz Magiera
398cbd7f2c deps: Update markets 2020-08-28 01:09:45 +02:00
whyrusleeping
36ff37ba47 Wait until blocks show up full nodes 'head' before claiming block has been mined 2020-08-26 17:51:16 -07:00
Raúl Kripalani
4709e231b8 drop aurora as dep; upgrade test-vectors. 2020-08-26 18:35:41 +01:00
Raúl Kripalani
efdfd3ee3e Merge branch 'master' into inmem-journal 2020-08-26 16:38:23 +01:00
Raúl Kripalani
4e1ef09751 make journal a global var. 2020-08-26 16:09:37 +01:00
Raúl Kripalani
e19087722f Merge branch 'master' into conformance-tests 2020-08-26 15:13:46 +01:00
Raúl Kripalani
d3ac243cea Merge remote-tracking branch 'origin/master' into conformance-tests 2020-08-26 15:12:02 +01:00
vyzo
e042ce21f6 gomod: update go-libp2p-pubsub@v0.3.5 2020-08-26 08:36:58 +03:00
Whyrusleeping
cd2e794d3f
Merge pull request #3299 from filecoin-project/steb/update-deps 
update deps for bug fixes
 2020-08-25 17:18:02 -07:00
Steven Allen
7fb4851eb9 update deps for bug fixes 
* updates bitswap to include _many_ perf enhancements and bug fixes.
* updates go-fs-lock because the version here is pretty old.
* updates go-libp2p
* updates bbloom _just_ in case, because the version we were depending on had bugs (looks like we're not actually using it).
 2020-08-25 17:06:07 -07:00
frrist
0d61e0d717 refactor(ctx): update to latest go-jsonrpc 2020-08-25 15:20:41 -07:00
Łukasz Magiera
55cbb3480c Merge branch 'master' of github.com:clinta/lotus into update/quic 2020-08-24 23:27:01 +02:00
Łukasz Magiera
12af420d7e mod tidy 2020-08-22 19:16:45 +02:00
Łukasz Magiera
0df6e1e2c7
Merge pull request #3220 from shaodan/fix-import 
Fix import storage-fsm
 2020-08-22 10:38:36 +02:00
hannahhoward
438fa637df feat(markets): update to markets v0.5.7 2020-08-21 11:49:16 -07:00
Dan Shao
f21ce3e8ee Fix import storage-fsm -> extern/storage-sealing 2020-08-21 16:52:33 +08:00
vyzo
7c1e0d2132 update go-libp2p-pubsub@master 2020-08-21 10:53:30 +03:00
vyzo
d1718369a1
Merge pull request #3205 from filecoin-project/fix/update-pubsub 
update pubsub and bump behaviour penalty threshold to 6
 2020-08-20 23:37:17 +03:00
Whyrusleeping
af3fe206d6
Merge pull request #3122 from filecoin-project/feat/cmd-improvements 
sorted deal listings
 2020-08-20 13:29:01 -07:00
vyzo
ccd000cc16 update go-libp2p-pubsub@master 2020-08-20 22:52:40 +03:00
Clint Armstrong
db240359f7 upgrade libp2p-quic-transport to v0.8.0 for go 1.15 compatibility 2020-08-20 14:27:31 -04:00
vyzo
67bf952c5a gomod: update go-libp2p-pubsub@master 2020-08-20 18:06:06 +03:00
Raúl Kripalani
04e4bab313 register chaos actor only if selector says to do so. 2020-08-19 18:10:56 +01:00
Raúl Kripalani
dddf7951ef update test-vectors commit. 2020-08-19 17:33:30 +01:00
Raúl Kripalani
b13681df32 update test-vectors commit. 2020-08-19 14:40:55 +01:00
hannahhoward
66ac7c195c feat(cli): add updates to data transfer 
Add an API to get data transfer updates and add modify the CLI to be an
ongoing monitoring plan
 2020-08-18 17:36:29 -07:00
Aayush Rajasekaran
446a4f6272 Update to specs-actors v0.9.3 2020-08-18 14:24:46 -04:00
whyrusleeping
f05cff478f sorted deal listings 2020-08-17 14:48:49 -07:00
Łukasz Magiera
29db7047a3
Merge pull request #3112 from filecoin-project/fix/sched-hang 
Fix sealing sched hands on unclean worker disconnect
 2020-08-17 18:43:25 +02:00
Łukasz Magiera
f31473c4cf Update jsonrpc to fix sealing sched hangs 2020-08-17 17:36:21 +02:00
Raúl Kripalani
3c17cd655e integrate extern/sector-storage into lotus proper. 2020-08-16 11:09:58 +01:00
Raúl Kripalani
fb0ccc9260 integrate extern/storage-fsm into lotus proper. 2020-08-16 10:42:13 +01:00
Łukasz Magiera
a52e406c0d Fix AddPiece with data and multiple workers 2020-08-15 01:36:29 +02:00
Łukasz Magiera
d9ad6fb8c8 worker: Make disconnects less bad 2020-08-14 23:24:41 +02:00
Łukasz Magiera
0377d6952b Merge remote-tracking branch 'origin/next' into feat/worker-addpiece2 2020-08-14 21:17:30 +02:00
Łukasz Magiera
ec242c1ba7 Update jsonrpc with stacktraces on panic 2020-08-14 21:16:42 +02:00
hannahhoward
6b5525b8d2 feat(markets): update markets 0.5.6 
update markets to 0.5.6, removing use of validators that moved inside markets
 2020-08-14 11:14:03 -07:00
Łukasz Magiera
0c75dd3865 Support AddPiece on workers 2020-08-14 16:06:53 +02:00
Aayush Rajasekaran
c2a24b7b4c Update markets 2020-08-13 22:13:31 -04:00
hannahhoward
c9a4bfba1a feat(markets): update markets v0.5.5 2020-08-12 19:02:20 -07:00
Dirk McCormick
335d165db6 refactor: use spec-actors paych with AMT for lane states 2020-08-12 17:06:18 -07:00
Steven Allen
3ef3f570fb Fix lint errors an broken tests 2020-08-12 23:16:44 +02:00
Steven Allen
5c715021c1 update chain-validation 2020-08-12 10:33:07 -07:00
Steven Allen
9248e5a572 Update specs-actors, cbor-gen, and go-address 2020-08-12 10:32:39 -07:00
Steven Allen
9135a5d048 Pass bitfields by-value 
This ensures we can't end up decoding nil bitfields from clients when not
expecting them.

Part of https://github.com/filecoin-project/specs-actors/issues/895. Please see
this issue for details and leave any comments there.
 2020-08-12 10:32:39 -07:00
Łukasz Magiera
f537c48f93 v28 Proofs 2020-08-12 00:33:30 +02:00
Raúl Kripalani
d53c6f2599 storage-fsm: emit sealing state transition notifications. 2020-08-11 13:23:40 +01:00
Raúl Kripalani
bca516b028 Merge remote-tracking branch 'origin/next' into inmem-journal 2020-08-11 12:42:39 +01:00
Raúl Kripalani
92598237c3 Merge branch 'next' into inmem-journal 2020-08-11 12:41:11 +01:00
Łukasz Magiera
6d85d379ba Merge remote-tracking branch 'origin/master' into next 2020-08-10 23:09:00 +02:00
vyzo
110ccfc88f gomod: update go-libp2p-pubsub@v0.3.4 2020-08-10 22:08:29 +03:00
Łukasz Magiera
624731cb80 More gomod fixing 2020-08-10 18:03:54 +02:00
Łukasz Magiera
823d8a64e1 Merge remote-tracking branch 'origin/master' into update/next-master 2020-08-07 05:09:26 +02:00
Aayush Rajasekaran
bab7b8029b update chain-val again 2020-08-06 22:34:30 -04:00
Aayush Rajasekaran
754d6cfea3 Update chain-val 2020-08-06 19:47:23 -04:00
Łukasz Magiera
e372e7dc63
Merge pull request #2850 from filecoin-project/deps/actors-v0.8.7-ish 
Update specs-actors
 2020-08-06 03:28:31 +02:00
Łukasz Magiera
e90b52eb8d
Merge pull request #2835 from filecoin-project/fix/sealing-fixes 
Update FSM with sealing fixes
 2020-08-06 02:47:22 +02:00
hannahhoward
80ef0b020e fix(markets): update to tagged version 2020-08-05 15:45:54 -07:00
hannahhoward
a89c290f62 feat(markets): update to 0.5.4 2020-08-05 15:35:59 -07:00
Łukasz Magiera
df38fe4bf6 Update specs-actors 2020-08-06 00:29:07 +02:00
Łukasz Magiera
ca4e4fa964
Merge pull request #2814 from filecoin-project/feat/secstor-fetch-reserve 
Update sector-storage with fetch storage reservation
 2020-08-05 23:37:30 +02:00
Łukasz Magiera
e60af00ec4
Merge pull request #2764 from filecoin-project/feat/burn-above-estimate 
Burn sclaing amount dependon on how much overestimation there was
 2020-08-05 23:20:42 +02:00
Łukasz Magiera
8ce8801789 Use chain-val master 2020-08-05 23:04:12 +02:00
Łukasz Magiera
2b7732bc2f Update sector-storage with fetch storage reservation 2020-08-05 20:32:28 +02:00
Łukasz Magiera
9681ac3fb9 Update FSM with sealing fixes 2020-08-05 03:35:40 +02:00
Jakub Sztandera
86a522ef22
go mod tidy 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-08-05 02:17:13 +02:00
Aayush Rajasekaran
9eea11662c
Update chain-val to support burn gaslimit changes 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-08-05 02:10:25 +02:00
vyzo
14535cc400 gomod: update go-libp2p 2020-08-04 23:04:53 +03:00
Aayush Rajasekaran
593a7b623c
Merge pull request #2820 from filecoin-project/feat/update-markets-0.5.3 
Update to go-fil-markets v0.5.3
 2020-08-04 14:34:18 -04:00
hannahhoward
761a999ebc feat(deps): update to go-fil-markets v0.5.3 2020-08-04 11:13:03 -07:00
Łukasz Magiera
adee59c795 client cli: improve lit-deals output 2020-08-04 19:07:17 +02:00
Łukasz Magiera
c839ca456f wdpost: Test pleding a sector after recovery 2020-08-03 21:02:27 +02:00
Łukasz Magiera
e5ca4b22d5 Improve gas price estimator 2020-08-01 09:40:11 +02:00
Aayush Rajasekaran
c33e38eef2 Update markets 2020-07-31 15:43:34 -04:00
Łukasz Magiera
910f9f00bd
Merge pull request #2749 from filecoin-project/deps/cbor-gen 
update to latest cbor-gen
 2020-07-31 21:42:03 +02:00
Aayush Rajasekaran
d3da20ab27 Update chain-val 2020-07-31 15:37:00 -04:00
Łukasz Magiera
6d21255678 Merge remote-tracking branch 'origin/master' into next 2020-07-31 21:36:14 +02:00
whyrusleeping
b83629c4d5 update to latest cbor-gen 2020-07-31 11:19:30 -07:00
Aayush Rajasekaran
0552d23b77 Upgrade to specs-actors v0.8.5 2020-07-31 12:40:45 -04:00
vyzo
886e2e57dc gomod: update go-libp2p-pubsub@master 2020-07-31 19:17:09 +03:00
Łukasz Magiera
4cb4e7c2c2 Merge remote-tracking branch 'origin/master' into next 2020-07-31 14:02:04 +02:00
vyzo
741818ee67 gomod: update go-libp2p-pubsub@feat/trace-topics 2020-07-31 10:05:39 +03:00
Aayush Rajasekaran
9d987280c9 remove unused imports 2020-07-31 01:51:40 -04:00
whyrusleeping
e19ff4c958 sprinkle in some color 2020-07-31 01:50:12 -04:00
whyrusleeping
146e59fe56 wire through new retrieval apis 2020-07-31 01:47:37 -04:00
Łukasz Magiera
38bcb9bc09 Update sector-storage with ReadPiece fixes 2020-07-31 01:03:39 -04:00
Aayush Rajasekaran
c881f287ad Update specs-actors and chain-val...again 2020-07-31 00:29:44 -04:00
Aayush Rajasekaran
8daef5aa23 Update chain-val and specs-actors some more 2020-07-30 17:33:33 -04:00
vyzo
04b4a5e0c3 gomod: update libp2p dependencies 2020-07-30 20:36:24 +03:00
Łukasz Magiera
9ef69c91e4 Merge remote-tracking branch 'origin/next' into asr/deal-collateral 2020-07-30 17:19:33 +02:00
Jakub Sztandera
97009c8f0a
Update to chain-val master 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-07-30 16:49:17 +02:00
Jakub Sztandera
14460d397a
go mod tidy 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-07-30 16:25:57 +02:00
Jakub Sztandera
7f722623ca
Allow messages with not enough funds for transfer to apply 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-07-30 16:23:30 +02:00
Łukasz Magiera
0d0fa1e670 Update specs-actors more 2020-07-30 15:22:34 +02:00
Łukasz Magiera
4d328cad54 Get things to mostly work 2020-07-30 14:31:50 +02:00
Aayush Rajasekaran
729c052f64 Update specs-actors, support deal provider collateral bounds 2020-07-30 00:55:37 -04:00
Aayush Rajasekaran
b51e2a868b
Merge branch 'next' into feat/cid-builder 2020-07-28 21:02:30 -04:00
Aayush Rajasekaran
93ed4e5035 Update chain val 2020-07-28 16:45:53 -04:00
Łukasz Magiera
aad91a5b3c One more specs-actors commit 2020-07-28 21:20:26 +02:00
hannahhoward
5d930ed15c fix(deps): update to tagged go-fil-markets 
use 0.5.2 instead of custom commit
 2020-07-28 12:00:53 -07:00
Łukasz Magiera
ed04c80bb1 Fix precommit deposit 2020-07-28 20:55:31 +02:00
Łukasz Magiera
927ee2406a Downgrade actors, get tests to pass 2020-07-28 19:51:58 +02:00
Łukasz Magiera
1fd23248ff gofmt 2020-07-28 16:38:26 +02:00
Łukasz Magiera
473a1f91d5 Update specs-actors to 33f4d6e 2020-07-28 16:36:32 +02:00
Łukasz Magiera
09b90773d8 Merge remote-tracking branch 'origin/next' into feat/cid-builder 2020-07-28 16:06:06 +02:00
Łukasz Magiera
86bfca696a Use markets master 2020-07-28 13:11:53 +02:00
hannahhoward
5a623cccb5 feat(markets): update markets mulitple deal stores 2020-07-27 23:13:28 -07:00
Łukasz Magiera
d557c407c6
Merge pull request #2608 from filecoin-project/feat/storage-remote-improvements 
Update sector-storage, sealing sched-diag
 2020-07-27 15:17:38 +02:00
Łukasz Magiera
135b77dab5 Update sector-storage, sealing sched-diag 2020-07-27 13:23:43 +02:00
Simon Peffers
78739d9417 Fixes for failed CI tests 2020-07-26 00:46:23 -04:00
Simon Peffers
0f3105a01f Integrate blst signature library: https://github.com/supranational/blst 2020-07-25 21:38:18 -04:00
Łukasz Magiera
8227b7d16f
Merge pull request #2573 from filecoin-project/feat/storage-remote-improvements 
Update sector-storage, parallel fetch limit
 2020-07-25 23:36:22 +02:00
hannahhoward
dd885b7302 feat(multistore): extract multistore code to repo 
Extract multistore + multiread blockstore to a seperate repo
 2020-07-24 14:47:22 -07:00
Whyrusleeping
f69cce4089
Merge pull request #2576 from filecoin-project/fix/testnet-compat 
pull in specs actors fix for testnet
 2020-07-24 13:17:41 -07:00
Łukasz Magiera
958cc8b947 Update sector-storage, parallel fetch limit 2020-07-24 22:11:11 +02:00
whyrusleeping
cda0326cc3 go mod tidy 2020-07-24 13:09:19 -07:00
whyrusleeping
3bdcae9a59 dont update go-fil-commcid 2020-07-24 12:41:23 -07:00
whyrusleeping
1163d36b02 hardcode legacy multihash types for backward compat 2020-07-24 12:33:04 -07:00
whyrusleeping
d764d86e89 pull in specs actors fix for testnet 2020-07-24 11:36:19 -07:00
Steven Allen
b7a4dbb07f Support inline CIDs 
And use the new CidBuilder from the spec actors.

This patch does not switch over to inline CIDs by default, but paves the way.
 2020-07-23 23:12:32 -07:00
Aayush Rajasekaran
bac42c5121 Update specs-actors 2020-07-23 21:53:15 -04:00
Łukasz Magiera
b0b2e02248 Merge remote-tracking branch 'origin/next' into feat/storage-gas 2020-07-23 23:19:42 +02:00
Aayush Rajasekaran
4351d033f3 Update CV 2020-07-23 17:13:04 -04:00
Łukasz Magiera
062eaa9eac
Merge pull request #2558 from filecoin-project/feat/upgrade-markets-0.5.1 
Update to markets 0.5.1
 2020-07-23 23:05:58 +02:00
Jakub Sztandera
0d91dbb681
Go mod tidy 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-07-23 23:02:19 +02:00
hannahhoward
5b8d3068f7 feat(markets): update to markets 0.5.1 
update to markets 0.5.1, pass on params v1 correctly for retrieval
 2020-07-23 14:01:34 -07:00
Jakub Sztandera
673c5ac851
Update specs actors 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-07-23 23:01:05 +02:00
Aayush Rajasekaran
e8837688a2 update specs actors 2020-07-23 16:44:09 -04:00
Łukasz Magiera
824c9dae32 Update sector-storage more 2020-07-23 22:11:25 +02:00
Łukasz Magiera
f9ef83b4bf wdpost: Test sector/partition faulting 2020-07-23 19:23:21 +02:00
Łukasz Magiera
2633bdd838 miner: sealing jobs command 2020-07-21 20:08:03 +02:00
Raúl Kripalani
b8475114ba Merge branch 'next' into inmem-journal 2020-07-21 17:42:51 +01:00
Raúl Kripalani
4e82cf369c rename journal entries to journal events. 2020-07-21 17:32:01 +01:00
Raúl Kripalani
d6e6eedd58 pipe sealing events to the journal. 2020-07-21 13:02:51 +01:00
Łukasz Magiera
b1eb2cf3a7 Update storage-fsm 2020-07-21 01:21:44 +02:00
Łukasz Magiera
5301aa4db2 Update specs-actor with unsafa param fixes 2020-07-20 14:31:18 +02:00
Łukasz Magiera
b41ed492df Update chain-val 2020-07-20 11:37:25 +02:00
Aayush Rajasekaran
34c7acf022 Update specs-actors 2020-07-20 02:15:45 -04:00
Łukasz Magiera
d266c665b0 Update sector-storage with windowed scheduler 2020-07-18 00:38:02 +02:00
Łukasz Magiera
76ff938e00 Update chain-val 2020-07-18 00:27:17 +02:00
Łukasz Magiera
956f4d5e14 update specs-actors more 2020-07-17 22:58:04 +02:00
Mike Greenberg
d30e120608 Merge branch 'master' into fix/master-merge 
* master:
  fix(chainwatch): Parallel reward persistence; Tighten rpc logging
  fix(chainwatch): Remove --front switch
  feat(chainwatch): Add miner index on top_miners_by_base_reward view
  fix(chainwatch): Backoff processor when no work exists to process
  fix(log): Move metrics and stage updates to debug; Add --log-level switch
  fix(chainwatch): Correct index name on state_height view
  feat(chainwatch): Capture base_block_reward per epoch; Top miner by reward view
  SwapSigner API methods
  refactor: remove unused code
  refactor: wire up new processor and syncer
  refactor: implement processor and syncer

 Conflicts:
        Makefile
        cmd/lotus-chainwatch/storage.go
        cmd/lotus-chainwatch/sync.go
 2020-07-17 15:18:33 -04:00
Łukasz Magiera
0a471bb12c Update chain-val 2020-07-17 15:59:03 +02:00
Łukasz Magiera
06acda0ab9 mod tidy, gofmt 2020-07-17 15:18:40 +02:00
Łukasz Magiera
cb6767a02b Merge remote-tracking branch 'origin/next' into feat/actors-miner-refactor 2020-07-17 15:18:11 +02:00
Łukasz Magiera
b026de2feb Use specs-actors master 2020-07-17 15:03:59 +02:00
Łukasz Magiera
389d148a60
Merge pull request #2447 from filecoin-project/dep/badger 
Update badger
 2020-07-17 01:48:57 +02:00
Peter Rabbitson
e266f3b955 Bump fil-commcid and filecoin-ffi deps 
Propagates correct on-chain commX CIDs
 2020-07-17 00:38:42 +02:00
Jakub Sztandera
2b0492c6d6
Update badger 
Replace is needed as badger master's latest tag is v2.0.1

Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-07-17 00:14:51 +02:00
Łukasz Magiera
19f7fd304d Update sector-storage, fixes #1950 2020-07-16 18:30:42 +02:00
Aayush Rajasekaran
a5ef629cef Add expected seal duration to custom deal logic, reject deals that start too early 2020-07-15 17:31:50 -04:00
Łukasz Magiera
9b6afd82aa
Merge pull request #2422 from filecoin-project/feat/upgrade-retrieval 
Update markets with new retrieval
 2020-07-15 23:10:20 +02:00
hannahhoward
61f120222f feat(markets): update markets with new retrieval 2020-07-15 14:04:31 -07:00
Jakub Sztandera
399c171f03
Update gas limits, update storage-fsm 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-07-15 21:21:53 +02:00
frrist
41f4f1fd83 refactor: implement processor and syncer 
- When chainwatch is ran it will first start a Syncer that continuously collects blocks from the
ChainNotify channel and persists them to the blocks_synced table. Once the Syncer has caught the
blocks_synced table up to the lotus daemons current head a Processor is started. The Processor
selects a batch of contiguous blocks and extracts and stores their data. It attempts to do as much
work as it can in parallel. When the blocks are done being processed their corresponding
processed_at and is_processed fields in the blocks_synced table are filled out.
 2020-07-15 11:42:19 -07:00
Jakub Sztandera
61156afd90
Update chain val 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-07-15 20:01:57 +02:00
Jakub Sztandera
347c2ed498
Update chain-val to new gas values 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-07-15 20:01:57 +02:00
Łukasz Magiera
1efb8b4cc0 update cbor-gen 2020-07-15 16:54:29 +02:00
Raúl Kripalani
a44e80c829 Merge branch 'next' into mock-clock 2020-07-15 15:51:11 +01:00
Jakub Sztandera
6ecc96d193
Update to drand devnet 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-07-14 21:16:26 +02:00
Raúl Kripalani
0484496d92 Merge branch 'next' into mock-clock 2020-07-14 18:08:26 +01:00
Łukasz Magiera
faebc4c948 WIP Integrating specs-actors with refactored miner state 2020-07-14 13:45:45 +02:00
Łukasz Magiera
896f0c69fc gomod: Use chain-val master 2020-07-13 12:27:35 +02:00
Aayush Rajasekaran
6504b914ba Update chain-val and storage-fsm to temp commits 2020-07-12 01:15:47 -04:00
Aayush Rajasekaran
7e9f9106c9 Update specs actors 2020-07-12 00:30:42 -04:00
Raúl Kripalani
13de81b3b2 introduce the ability to mock time. 2020-07-10 15:51:45 +01:00
Łukasz Magiera
c3b208869a Fix osx build 2020-07-09 20:49:59 +02:00
Łukasz Magiera
5ca1be567d
Merge pull request #2323 from filecoin-project/feat/fastretrieval 
Support fast-retrieval deals
 2020-07-08 21:54:46 +02:00
Łukasz Magiera
b1bd8a4394 Use sector-storage next branch 2020-07-08 21:53:50 +02:00
Łukasz Magiera
2c00b92325 Merge remote-tracking branch 'origin/master' into next 2020-07-08 21:47:05 +02:00
Jakub Sztandera
0e7b7c9fdb
Update go-ds-badger2 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-07-08 21:08:23 +02:00
Łukasz Magiera
99796220f9 Support fast-retrieval deals 2020-07-08 20:42:07 +02:00
Jakub Sztandera
40286e4192
Use mostly defaults for badger options 
This options are the defults in badger `master` now.
We should update to next badger version as soon as it is stable, it has
some nice improvments.

Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-07-08 17:54:33 +02:00
hannahhoward
aff1d02046 feat(markets): use tagged go-fil-markets 2020-07-08 02:12:18 -07:00
hannahhoward
24e3a4218b feat(markets): upgrade to latest 
upgrade to latest markets with fast retrieval, underlying data transfer upgrade
 2020-07-08 01:35:50 -07:00
Aayush Rajasekaran
411c82ae8f Update storage-FSM, add API to set sector seal delay 2020-07-07 15:23:23 -04:00
Aayush Rajasekaran
9a182bb247 i guess i'll tidy up go mod while i'm at it 2020-07-03 17:36:17 -04:00
Jakub Sztandera
9936439608
Merge remote-tracking branch 'origin/master' into next 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-07-03 14:56:06 +02:00
Jakub Sztandera
cc02092aae
Go mod tidy 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-07-02 21:53:21 +02:00
Jakub Sztandera
3e4b80e7f6
Update specs actors 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-07-02 21:52:55 +02:00
hannahhoward
7e1e9bcd60 fix(markets): upgrade markets to 0.3.1.1 
upgrade to 0.3.1.1 to get critical node restart fixes and retrieval map access fix
 2020-07-02 08:03:10 -07:00
Łukasz Magiera
746669046a Use fsm next branch 2020-07-02 00:45:16 +02:00
Łukasz Magiera
0770b77336 Merge remote-tracking branch 'origin/next' into feat/cc-upgrade 2020-07-01 21:10:56 +02:00
Łukasz Magiera
4346f7d59d
Merge pull request #2215 from filecoin-project/feat/specs-actors-v0.7.1 
specs actors v0.7.1
 2020-07-01 21:08:22 +02:00
Aayush Rajasekaran
7b0b1b5977 Update chain-validation 2020-07-01 13:00:42 -04:00
Łukasz Magiera
5946aa7a3a Merge remote-tracking branch 'origin/master' into next 2020-07-01 17:32:27 +02:00
Łukasz Magiera
02c3f8ed80 Update paramfetch 2020-07-01 17:23:50 +02:00
Łukasz Magiera
82e2cd4746 Basic CC Upgrade support 2020-07-01 17:01:06 +02:00
Łukasz Magiera
4c422c2d50 specs-actors v0.7.1 2020-07-01 13:47:40 +02:00
hannahhoward
be29f3bd99 feat(markets): update to markets v0.3.2 
Update to markets v0.3.2, which neccesitates merging master & adding one more node function
 2020-07-01 12:06:29 +02:00
Łukasz Magiera
cfdbc2312d Merge branch 'master' into next 2020-07-01 11:22:57 +02:00
Łukasz Magiera
e1799f1524
Merge pull request #2155 from filecoin-project/feat/ffi-0.30.1 
Update FFI to 0.30.1
 2020-07-01 11:17:18 +02:00
Łukasz Magiera
6927a532cf Update sector-storage with lower resource requirements 2020-06-30 21:03:44 +02:00
Jakub Sztandera
c811133aac
Update go-log 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-06-30 19:39:13 +02:00
Łukasz Magiera
24529bf35d Merge branch 'next' into feat/specs-actors-v0.7.0 2020-06-29 22:45:50 +02:00
Łukasz Magiera
77b3bf8bc2 Update FFI to 0.30.1 2020-06-29 20:24:27 +02:00
hannahhoward
4e32c7edb3 feat(markets): update to markets 0.3.1 
Update to markets 0.3.1 with multiaddr support for miners
 2020-06-29 10:24:23 -07:00
Łukasz Magiera
2bab5d1ddd Merge remote-tracking branch 'origin/master' into next 2020-06-29 17:45:58 +02:00
Łukasz Magiera
90a470ed78 Update go-bitfield with fixed empty marshaling 2020-06-29 16:06:57 +02:00
Aayush Rajasekaran
1f57d9462c Don't return nil interfaces from runtime.Send() 2020-06-29 01:13:45 -04:00
Aayush Rajasekaran
73e973c29b Update chain-val, using temp commits 2020-06-26 14:28:33 -04:00
Łukasz Magiera
5d6fcbeccf Change initial pledge calc to PrecommitInfo 2020-06-26 18:00:50 +02:00
Łukasz Magiera
a6d1323eba Update specs-actors to v0.7.0; More correct genesis sector import 2020-06-26 15:08:12 +02:00
Łukasz Magiera
8f585713fa Update storage, FSM 2020-06-26 13:11:34 +02:00
Łukasz Magiera
d27ff60ae2 Merge remote-tracking branch 'origin/master' into next 2020-06-26 13:08:37 +02:00
Aayush Rajasekaran
50aa1e6baa Update bitfield 2020-06-25 13:49:15 -04:00
Łukasz Magiera
7e342e60d1 sealing: Give priority to sectors with deals 2020-06-25 18:13:45 +02:00
Jakub Sztandera
008a2969b2
Fix two races in events 
Also race fix: depends on https://github.com/ipfs/go-blockservice/pull/65
Resolves #2092, #2099, #2108, #1930, #2110

Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-06-24 17:05:24 +02:00
Łukasz Magiera
11c53c26ff Update sector-storage to fix #2080 and #1917 2020-06-24 00:47:47 +02:00
Łukasz Magiera
a7d662a7d8 Update to actually working sector-storage 2020-06-24 00:23:39 +02:00
Łukasz Magiera
6f8c464393 Merge remote-tracking branch 'origin/master' into feat/sector-remove 2020-06-23 23:54:27 +02:00
Łukasz Magiera
69559bcf4f Use fsm, sector-storage master 2020-06-23 23:32:12 +02:00
Jakub Sztandera
d7f710806b
Implement golden tests for Poisson distribution 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-06-23 16:24:02 +02:00
Łukasz Magiera
abd400801c mod tidy 2020-06-23 11:46:20 +02:00
whyrusleeping
3752311f44 update to latest libp2p release 2020-06-22 16:25:41 -07:00
Łukasz Magiera
101ba0b796 Update deps to support removing sectors 2020-06-22 19:03:35 +02:00
Łukasz Magiera
324b659d33 Update sector-storage with 32G checkFiles fix 2020-06-18 09:34:28 +02:00
Łukasz Magiera
cc179c5270
Merge pull request #2047 from filecoin-project/feat/parallel-sealing-bench 
allow sealing bench to run parallel seals
 2020-06-18 01:28:56 +02:00
Łukasz Magiera
290512ee68 Update storage FSM with a bunch of fixes 2020-06-17 20:42:08 +02:00
Jakub Sztandera
5c5a3f2264
go mod tidy 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-06-17 20:04:28 +02:00
Jeromy
d66c70d1e6 add configurable paralellism for sub portions of the sealing process 2020-06-17 11:02:48 -07:00
Jakub Sztandera
b91e7a9860
Update to specs actors with ChargeGas interface 
Based on `lotus-0.6.1-chargegas` in specs-actors.

Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-06-17 20:00:30 +02:00
Jeromy
ec693008d7 allow sealing bench to run parallel seals 2020-06-16 17:39:51 -07:00
Łukasz Magiera
6bff52483b
Merge pull request #1973 from filecoin-project/feat/drand-upd 
Update to new drand
 2020-06-16 15:30:40 +02:00
Jakub Sztandera
fd6c8769dd
Update to new drand 
WIP

Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-06-16 14:46:30 +02:00
Łukasz Magiera
bac6a47c67 specs-actors v0.6.1 2020-06-16 12:30:54 +02:00
hannahhoward
a422647819 fix(lint): fix lint error 
fix lint error and update to tagged package
 2020-06-15 15:53:39 -07:00
hannahhoward
9262661135 chore(deps): update to fil-markets 0.3.0 
Updates to latest fil markets with resumability and other fixes
 2020-06-15 15:43:47 -07:00
Łukasz Magiera
f8669d4e95 Update chain-val and sector-storage 2020-06-15 21:21:40 +02:00
Łukasz Magiera
c832c0bf3f mod tidy 2020-06-15 18:31:59 +02:00
Łukasz Magiera
907364ce67 Update deps, fix more tests 2020-06-15 18:30:49 +02:00
Łukasz Magiera
464f6a6b08 Update specs-actors to v0.6 2020-06-15 14:49:18 +02:00
Jakub Sztandera
c3f23ddce8
Refactor ExecutionResult to ExecutionTrace 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-06-11 15:53:47 +02:00
Łukasz Magiera
6f501119bf
Merge pull request #1957 from filecoin-project/feat/v27 
v27 parameters
 2020-06-10 02:04:59 +02:00
Łukasz Magiera
a00df0da90 FFI v27 2020-06-10 01:44:14 +02:00
Jakub Sztandera
81bc8471e3
Merge pull request #1963 from filecoin-project/chore/upd-log 
Update go-log to master
 2020-06-09 23:27:02 +02:00
Jakub Sztandera
5feea2e0f8
Update go-log to master 
It restores line informations in log messages

Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-06-09 23:06:40 +02:00
Łukasz Magiera
28f895cec2 Update sector-storage with better post faults 2020-06-08 23:20:19 +02:00
Łukasz Magiera
baa69c3c81 Update specs-actors to v0.5.6 2020-06-06 19:51:10 +02:00
Jakub Sztandera
94da339622
Fix protobuf panic by updating protobuf to 1.4.2 
The panic is caused by usage of internal protobuf interface.
It was changed in protobuf 1.4.0 and reluctantly fixed in 1.4.2

Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-06-06 02:47:29 +02:00
Łukasz Magiera
163c2b2544 Merge remote-tracking branch 'origin/master' into next 2020-06-06 00:58:24 +02:00