Commit Graph

18870 Commits

Author SHA1 Message Date
Fridrik Asmundsson
b515f14970 Use TipSetKey as key in cache and return copies 2023-03-29 22:16:26 +02:00
Fridrik Asmundsson
5caf0bd394 feat: Add small cache to execution traces
This PR adds a small cache to calls to ExecutionTrace which helps
 improve performance for node operators like exchanges and block
explorers.

If items is in cache calls to this function will be 2-3x faster.

Fixes: https://github.com/filecoin-project/lotus/issues/10504
2023-03-29 22:16:26 +02:00
Fridrik Asmundsson
d9fbafe110 Address review comments 2023-03-29 22:15:57 +02:00
Fridrik Asmundsson
d2f9f258d9 Only populate message index if config EnableMsgIndex is set 2023-03-29 22:15:57 +02:00
Fridrik Asmundsson
9fdf87a160 Addressing lint errors 2023-03-29 22:15:57 +02:00
Fridrik Asmundsson
42f1760bb8 Delete existing message index when loading from snapshot 2023-03-29 22:15:57 +02:00
Fridrik Asmundsson
28fc74c3f8 Improve performance when populating message indax 2023-03-29 22:15:57 +02:00
Fridrik Asmundsson
62edba6884 Populate the index on snapshot import
Fixes: https://github.com/filecoin-project/lotus/issues/10537
2023-03-29 22:15:57 +02:00
vyzo
2985592bd0 add sanity check in SearchForIndexedMsg call site
Check that receipt is non nil, and the message was indeed found.
2023-03-29 22:13:26 +02:00
vyzo
6092f9cc14 add TODO for WaitForMessage to use the index 2023-03-29 22:13:26 +02:00
vyzo
b1ceb243e6 reword funny comment 2023-03-29 22:13:26 +02:00
vyzo
0de60a35cd second error variable name to avoid confusing they yushie. 2023-03-29 22:13:26 +02:00
vyzo
9a0ec84953 shut down the index if there is an error during head processing 2023-03-29 22:13:26 +02:00
vyzo
e11e0eb32a complain if head change processing is building backlog 2023-03-29 22:13:26 +02:00
vyzo
3d58ef1c21 fix typos 2023-03-29 22:13:26 +02:00
vyzo
42553dac6b chain errors in searchForIndexedMsg 2023-03-29 22:13:26 +02:00
vyzo
abdb12b450 add ON CONFLICT REPLACE clause in messages 2023-03-29 22:13:26 +02:00
vyzo
c04e0f4421 shed: expand homedir in repo path for msgindex tools 2023-03-29 22:13:26 +02:00
vyzo
427ff42063 increase coalesce delays for test to deflake on CI 2023-03-29 22:13:26 +02:00
vyzo
9c991751fb lint 2023-03-29 22:13:26 +02:00
vyzo
a4d9bde536 make gen 2023-03-29 22:13:26 +02:00
vyzo
343cadefc6 fix test for CI
test files are run individually...
2023-03-29 22:13:26 +02:00
vyzo
e365135cdd lotus-shed tools for msgindex 2023-03-29 22:13:26 +02:00
vyzo
d3cb4a1244 add optimization TODO comment 2023-03-29 22:13:26 +02:00
vyzo
0119aea492 make gen 2023-03-29 22:13:26 +02:00
vyzo
7aa72e4466 fix bug in searchForIndexedMsg
Need to use and return the execution tipset
2023-03-29 22:13:26 +02:00
vyzo
4f5e0a0fe4 basic msgindex itest 2023-03-29 22:13:26 +02:00
vyzo
22490bdea9 add confidence check for indexed message epoch 2023-03-29 22:13:26 +02:00
vyzo
1151cb3754 more gen 2023-03-29 22:13:26 +02:00
vyzo
e718857b2f enhance comment about lookup cid semantics 2023-03-29 22:13:26 +02:00
vyzo
47c810942d make gen 2023-03-29 22:13:26 +02:00
vyzo
cc823daf44 make MsgIndex configurable, disabled by default. 2023-03-29 22:13:26 +02:00
vyzo
cfeedc81e4 no need to return error from DummyMsgIndex DI constructor 2023-03-29 22:13:26 +02:00
vyzo
682eb90654 adjust coalescer delays 2023-03-29 22:13:26 +02:00
vyzo
50d15e32c0 log rollback errors 2023-03-29 22:13:26 +02:00
vyzo
64a380fce3 wire in lifecycle context 2023-03-29 22:13:26 +02:00
vyzo
8735f69fc7 fix comment typo 2023-03-29 22:13:26 +02:00
vyzo
5b54bcf7f9 cosmetics 2023-03-29 22:13:26 +02:00
vyzo
02797bb578 fix tests 2023-03-29 22:13:26 +02:00
vyzo
e682036cef refactor database
- drop the execution index; we don't need it
- it is inclusion tipset
- use MessagesForTipset
- hoist db sql stuffs on top for clarity
- add index for tipset on messages
2023-03-29 22:13:26 +02:00
vyzo
7219fae0a1 more lint 2023-03-29 22:13:26 +02:00
vyzo
bc75c53660 dummy index for itests 2023-03-29 22:13:26 +02:00
vyzo
0564663b7e lint
lint

lint
2023-03-29 22:13:26 +02:00
vyzo
f82a94220d make gen 2023-03-29 22:13:26 +02:00
vyzo
f76babceec hook the index into the rest of lotus 2023-03-29 22:13:26 +02:00
vyzo
d032e4f119 use the transaction Luke! 2023-03-29 22:13:26 +02:00
vyzo
dad3442500 test test test 2023-03-29 22:13:26 +02:00
vyzo
e6a0c5a406 implement Close 2023-03-29 22:13:26 +02:00
vyzo
c123fab1da implement reconciliation 2023-03-29 22:13:26 +02:00
vyzo
7a3af7bf0f more implementation 2023-03-29 22:13:26 +02:00