cerc-io/lotus
15
0
Fork 0
Code Issues Pull Requests Packages Projects Releases 27 Wiki Activity
19,340 Commits 24 Branches 342 Tags 314 MiB
4b0ca30daf
Commit Graph

287 Commits

Author SHA1 Message Date
Łukasz Magiera
9bd312881d VMSys doesn't belong in chainstore 2021-07-27 15:30:23 +02:00
Łukasz Magiera
a5677d1b7a ffiwrapper: Separate Prover interface 2021-05-19 15:20:23 +02:00
Łukasz Magiera
6278bdc69a Make things build 2021-05-17 20:47:41 +02:00
Łukasz Magiera
506f39b294 WIP: Integrate FIP0013 2021-05-11 22:10:29 -04:00
Raúl Kripalani
3795cc2bd2 segregate chain and state blockstores. 
This paves the way for better object lifetime management.

Concretely, it makes it possible to:
- have different stores backing chain and state data.
- having the same datastore library, but using different parameters.
- attach different caching layers/policies to each class of data, e.g.
  sizing caches differently.
- specifying different retention policies for chain and state data.

This separation is important because:
- access patterns/frequency of chain and state data are different.
- state is derivable from chain, so one could never expunge the chain
  store, and only retain state objects reachable from the last finality
  in the state store.
 2021-02-28 22:49:44 +00:00
Raúl Kripalani
7f0f7d0b36 Merge branch 'master' into refactor/lib/blockstore 2021-02-28 19:55:23 +00:00
Łukasz Magiera
b1dfd41c19
Merge pull request #4950 from zgfzgf/feat-bench-policy 
delete bench policy
 2021-01-30 12:34:40 +01:00
Raúl Kripalani
b0cbc932bd consolidate all blockstores in blockstore package. 2021-01-29 20:01:00 +00:00
Frank
fdc46ad5df update json format 2021-01-06 12:20:33 +08:00
Frank
f24d401b61 add bench env print 2020-12-18 17:57:32 +08:00
zgfzgf
e197038b9f delete policy useless code 2020-11-21 10:14:13 +08:00
zgfzgf
549afbaa5f add policy 8m and 512m 2020-11-21 10:04:07 +08:00
zgfzgf
d033042d6b update code 2020-11-20 23:20:26 +08:00
zgfzgf
7d4bc90d42 solve merge conflicts 2020-11-20 22:34:15 +08:00
Aayush Rajasekaran
68a16afeda Merge branch 'master' into release/v1.2.0 2020-11-17 19:40:05 -05:00
Raúl Kripalani
0c6072a1a0 chainstore lifecycle: close via Close() instead of context. 2020-11-16 22:28:59 +00:00
Łukasz Magiera
915c5e0fdd Get most tests to pass 2020-11-16 19:03:30 +01:00
Raúl Kripalani
d7b4f92f1f add context to ChainStore. 2020-11-16 15:52:19 +00:00
Raúl Kripalani
3577300aee Merge branch 'master' into badger-viewable 2020-11-06 19:34:25 +00:00
Raúl Kripalani
8befc0c1f5 export metrics from bench. 2020-11-05 19:09:47 +00:00
Raúl Kripalani
a411342f0c export more metrics. 2020-11-04 17:09:01 +00:00
Raúl Kripalani
370ef93db6 chainstore: new ForceHeadSilent to support benchmarks. 2020-11-04 14:39:01 +00:00
Raúl Kripalani
fd1439f284 fix lint. 2020-11-03 22:49:55 +00:00
Łukasz Magiera
a1e1b03ca4 Optionally allow bitswap for chainstore 2020-11-03 23:44:44 +01:00
Raúl Kripalani
87ce2f774d lotus-bench: write separate profiles for import and validation. 2020-11-03 22:40:21 +00:00
Raúl Kripalani
5487356370 fix lint errors. 2020-11-03 21:23:41 +00:00
Raúl Kripalani
18418128c3 lotus-bench: make start tipset walkback start from end tipset. 2020-11-03 18:15:59 +00:00
Raúl Kripalani
581ac5b019 lotus-bench: add ability to specify tipsets. 2020-11-03 18:11:43 +00:00
Raúl Kripalani
842c8ca056 improve lotus-bench; support running validation on a store without a CAR. 2020-11-03 17:35:31 +00:00
zgfzgf
3e7efad0fd modify lint error 2020-11-03 21:28:01 +08:00
zgfzgf
3c2cd506ec modify merge lotus-bench 2020-11-03 19:56:04 +08:00
Raúl Kripalani
f4e13ffd80 actually register prometheus gauge. 2020-11-01 20:01:57 +00:00
Raúl Kripalani
44e34d9606 lotus-bench: native badger SyncWrites=false. 2020-11-01 19:54:47 +00:00
Raúl Kripalani
35ccd73a86 lotus-bench: improve for observability. 2020-11-01 19:52:53 +00:00
Raúl Kripalani
aece624d1c lotus-bench: add support for native badger blockstore. 2020-11-01 18:54:35 +00:00
Raúl Kripalani
c2355b18f9 write heap and allocs profile in lotus-bench. 2020-11-01 18:00:08 +00:00
Łukasz Magiera
660236b224 Merge remote-tracking branch 'origin/master' into feat/async-restartable-workers 2020-10-23 23:25:35 +02:00
Łukasz Magiera
041762a34f
Merge pull request #4383 from filecoin-project/steb/actor-v2-imports 
Remove most v0 actor imports
 2020-10-22 17:17:56 +02:00
Łukasz Magiera
0832d5a7d5 bench: Fix lint warnings 2020-10-22 15:00:31 +02:00
whyrusleeping
602d2b8ad5 record datastore metrics after successful run 2020-10-22 14:57:06 +02:00
Jakub Sztandera
0341944350 Inject prometheus 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-10-22 14:57:05 +02:00
whyrusleeping
00d1e6b549 add measure datastore wrapper around bench chain datastore 2020-10-22 14:57:04 +02:00
Steven Allen
4e730b5ec8 port to v2 imports 2020-10-21 12:16:23 -07:00
Łukasz Magiera
71b3b9075d Merge remote-tracking branch 'origin/master' into feat/async-restartable-workers 2020-10-13 21:33:21 +02:00
zgfzgf
bc1f18b73a lotus bench optimize 2020-10-11 18:55:12 +08:00
zgfzgf
c3a405eac7 add lotus bench print 2020-10-11 18:26:27 +08:00
zgfzgf
e4209d86f6 lotus bench add ticket-preimage 2020-10-11 17:20:55 +08:00
zgfzgf
fcb9dea501 add sum sealing time 2020-10-11 16:31:39 +08:00
zgfzgf
c810b157cf lotus bench delete ix 2020-10-11 11:39:27 +08:00
zgfzgf
c458f6e826 lotus bench replace abi.SectorID with sid 2020-10-11 11:25:19 +08:00
zgfzgf
c99e223cb1 lotus bench change and add print 2020-10-11 10:48:09 +08:00
zgfzgf
5c27d6aeee lotus-bench UnsealPiece SectorID.Number error 2020-10-11 10:12:06 +08:00
Steven Allen
748d2e82a7 unshare the journal 
Motivation:

* Run lotus with the race detector enabled (primary motivation).
* Allow multiple lotus nodes in a process (not a high priority).

Previously, the journal was shared between all lotus instances, but it was
initialized for every new node. This caused safety problems in tests (at a
minimum).

This patch explicitly passes the journal to all services that need it.
 2020-10-09 13:23:07 -07:00
Łukasz Magiera
2cfe22d4e5 Merge remote-tracking branch 'origin/master' into feat/async-restartable-workers 2020-09-30 20:48:16 +02:00
Jakub Sztandera
7e8c6e5070
Remove statediff, fix lint, go mod tidy 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-09-29 14:49:47 +02:00
Jakub Sztandera
0d914ac1d4
Switch to badger 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-09-29 14:49:47 +02:00
Jakub Sztandera
76db65b1af
Update pebble 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-09-29 14:49:47 +02:00
Jakub Sztandera
ff8c0af8c8
Add only-import option 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-09-29 14:49:47 +02:00
Jakub Sztandera
55c6b88537
Add toggle for badger, flag out gas tracing 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-09-29 14:49:46 +02:00
Jakub Sztandera
0771c23fb0
Use pebble 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-09-29 14:49:46 +02:00
Jakub Sztandera
242a77b391
go mod tidy 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-09-29 14:49:18 +02:00
Jakub Sztandera
35cf69ae64
Disable bloomcache 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-09-29 14:49:18 +02:00
Jakub Sztandera
ebc8489ff1
Add global-profile option 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-09-29 14:49:18 +02:00
Jakub Sztandera
f21c5cbbe2
Add start-at 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-09-29 14:49:18 +02:00
Jakub Sztandera
01386a206c
Update options 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-09-29 14:49:18 +02:00
Jakub Sztandera
3858309368
Add http to import bench 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-09-29 14:49:17 +02:00
Jakub Sztandera
782717948a
Add logs 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-09-29 14:49:17 +02:00
Jakub Sztandera
108fe7823c
Add command to trigger gc 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-09-29 14:49:17 +02:00
Jakub Sztandera
12a0dd3d0a
<3 to linter 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-09-29 14:49:17 +02:00
Jakub Sztandera
1f4d1dcc58
Do not sync 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-09-29 14:49:17 +02:00
Jakub Sztandera
53ab17cf50
Add no import to import-bench 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-09-29 14:49:17 +02:00
Jakub Sztandera
79ba4598d6
Implement cache 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-09-29 14:49:17 +02:00
Jakub Sztandera
96193c2044
Implement bench-cache 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-09-29 14:49:11 +02:00
Łukasz Magiera
cf71f034dc Merge remote-tracking branch 'origin/dev' into feat/async-restartable-workers 2020-09-26 12:35:32 +02:00
Jakub Sztandera
4eec4a0141
Move policy change to seal bench 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-09-25 23:28:12 +02:00
Steven Allen
32a699d6a3 Add some actors policy setters for testing 
Addresses:
* a307e4593a (r491966115)
* a307e4593a (r491966634)

Note: This puts everything into a policy package to avoid a dependency cycle
between the build package, the miner package, and the types package. This is
also why I introduced a GetPreCommitChallengeDelay function and removed the
variable.
 2020-09-23 15:00:52 -07:00
Łukasz Magiera
aa5bd7bc17 Merge remote-tracking branch 'origin/master' into feat/async-restartable-workers 2020-09-21 22:36:16 +02:00
jennijuju
5c69249ba3 Use window post for window PoSt related log messages. 2020-09-15 21:22:29 -04:00
whyrusleeping
24756ac056 allow specification of repo directory in lotus-bench 2020-09-15 11:55:54 -07:00
Łukasz Magiera
5f08fe7ead Merge remote-tracking branch 'origin/master' into feat/async-restartable-workers 2020-09-10 17:30:54 +02:00
Aayush Rajasekaran
d678fe4bfa Fix tests 2020-09-07 15:48:42 -04:00
Aayush Rajasekaran
39755a294a Update to specs v0.9.6 2020-09-07 15:48:41 -04:00
Łukasz Magiera
5d73943929 storage: Fix import cycle 2020-09-06 18:54:00 +02:00
Steven Allen
5733c71c50 Lint everything 
We were ignoring quite a few error cases, and had one case where we weren't
actually updating state where we wanted to. Unfortunately, if the linter doesn't
pass, nobody has any reason to actually check lint failures in CI.

There are three remaining XXXs marked in the code for lint.
 2020-08-20 20:46:36 -07:00
Raúl Kripalani
efdc428d5d keep storage-fsm (renamed to storage-sealing) and sector-storage in extern. 2020-08-17 14:26:18 +01:00
Raúl Kripalani
3c17cd655e integrate extern/sector-storage into lotus proper. 2020-08-16 11:09:58 +01:00
Steven Allen
3ef3f570fb Fix lint errors an broken tests 2020-08-12 23:16:44 +02:00
Aayush Rajasekaran
d2e203c1ce Fix import 2020-08-04 00:45:02 -04:00
Aayush Rajasekaran
5e485a085a
Merge pull request #2637 from filecoin-project/gas/tag-verify-post 
Use scaling VerifyPost cost
 2020-07-28 21:22:23 -04:00
Jakub Sztandera
b488012d5f
Add warn 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-07-28 22:31:43 +02:00
Jakub Sztandera
da4bc44032
Discard initial very long OnVerifyPost from analisys 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-07-28 22:31:43 +02:00
Steven Allen
b7a4dbb07f Support inline CIDs 
And use the new CidBuilder from the spec actors.

This patch does not switch over to inline CIDs by default, but paves the way.
 2020-07-23 23:12:32 -07:00
Frank
c38b8b1265 close file 2020-07-23 18:21:13 +08:00
Jakub Sztandera
610ed0dc13
Change OnIpldGet 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-07-15 21:40:49 +02:00
Jakub Sztandera
c0eb4b39ac
Reorg some gas charges 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-07-15 20:01:56 +02:00
Łukasz Magiera
8e0d33a1fd Updates for sectors-storge next 2020-07-08 17:23:27 +02:00
Jakub Sztandera
3429941639
Add info about OnActorExecDone 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-07-02 18:47:34 +02:00
Jakub Sztandera
41b775fdd4
Compute time spent in actors 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-07-02 18:47:34 +02:00
Jakub Sztandera
e9d2a3edd9
Limit float print precision 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-07-02 18:47:34 +02:00
Jakub Sztandera
42696372ee
Progress to stderr 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-07-02 18:47:34 +02:00