Fridrik Asmundsson
b515f14970
Use TipSetKey as key in cache and return copies
2023-03-29 22:16:26 +02:00
Fridrik Asmundsson
5caf0bd394
feat: Add small cache to execution traces
...
This PR adds a small cache to calls to ExecutionTrace which helps
improve performance for node operators like exchanges and block
explorers.
If items is in cache calls to this function will be 2-3x faster.
Fixes: https://github.com/filecoin-project/lotus/issues/10504
2023-03-29 22:16:26 +02:00
Fridrik Asmundsson
d9fbafe110
Address review comments
2023-03-29 22:15:57 +02:00
Fridrik Asmundsson
d2f9f258d9
Only populate message index if config EnableMsgIndex is set
2023-03-29 22:15:57 +02:00
Fridrik Asmundsson
9fdf87a160
Addressing lint errors
2023-03-29 22:15:57 +02:00
Fridrik Asmundsson
42f1760bb8
Delete existing message index when loading from snapshot
2023-03-29 22:15:57 +02:00
Fridrik Asmundsson
28fc74c3f8
Improve performance when populating message indax
2023-03-29 22:15:57 +02:00
Fridrik Asmundsson
62edba6884
Populate the index on snapshot import
...
Fixes: https://github.com/filecoin-project/lotus/issues/10537
2023-03-29 22:15:57 +02:00
vyzo
2985592bd0
add sanity check in SearchForIndexedMsg call site
...
Check that receipt is non nil, and the message was indeed found.
2023-03-29 22:13:26 +02:00
vyzo
6092f9cc14
add TODO for WaitForMessage to use the index
2023-03-29 22:13:26 +02:00
vyzo
b1ceb243e6
reword funny comment
2023-03-29 22:13:26 +02:00
vyzo
0de60a35cd
second error variable name to avoid confusing they yushie.
2023-03-29 22:13:26 +02:00
vyzo
9a0ec84953
shut down the index if there is an error during head processing
2023-03-29 22:13:26 +02:00
vyzo
e11e0eb32a
complain if head change processing is building backlog
2023-03-29 22:13:26 +02:00
vyzo
3d58ef1c21
fix typos
2023-03-29 22:13:26 +02:00
vyzo
42553dac6b
chain errors in searchForIndexedMsg
2023-03-29 22:13:26 +02:00
vyzo
abdb12b450
add ON CONFLICT REPLACE clause in messages
2023-03-29 22:13:26 +02:00
vyzo
c04e0f4421
shed: expand homedir in repo path for msgindex tools
2023-03-29 22:13:26 +02:00
vyzo
427ff42063
increase coalesce delays for test to deflake on CI
2023-03-29 22:13:26 +02:00
vyzo
9c991751fb
lint
2023-03-29 22:13:26 +02:00
vyzo
a4d9bde536
make gen
2023-03-29 22:13:26 +02:00
vyzo
343cadefc6
fix test for CI
...
test files are run individually...
2023-03-29 22:13:26 +02:00
vyzo
e365135cdd
lotus-shed tools for msgindex
2023-03-29 22:13:26 +02:00
vyzo
d3cb4a1244
add optimization TODO comment
2023-03-29 22:13:26 +02:00
vyzo
0119aea492
make gen
2023-03-29 22:13:26 +02:00
vyzo
7aa72e4466
fix bug in searchForIndexedMsg
...
Need to use and return the execution tipset
2023-03-29 22:13:26 +02:00
vyzo
4f5e0a0fe4
basic msgindex itest
2023-03-29 22:13:26 +02:00
vyzo
22490bdea9
add confidence check for indexed message epoch
2023-03-29 22:13:26 +02:00
vyzo
1151cb3754
more gen
2023-03-29 22:13:26 +02:00
vyzo
e718857b2f
enhance comment about lookup cid semantics
2023-03-29 22:13:26 +02:00
vyzo
47c810942d
make gen
2023-03-29 22:13:26 +02:00
vyzo
cc823daf44
make MsgIndex configurable, disabled by default.
2023-03-29 22:13:26 +02:00
vyzo
cfeedc81e4
no need to return error from DummyMsgIndex DI constructor
2023-03-29 22:13:26 +02:00
vyzo
682eb90654
adjust coalescer delays
2023-03-29 22:13:26 +02:00
vyzo
50d15e32c0
log rollback errors
2023-03-29 22:13:26 +02:00
vyzo
64a380fce3
wire in lifecycle context
2023-03-29 22:13:26 +02:00
vyzo
8735f69fc7
fix comment typo
2023-03-29 22:13:26 +02:00
vyzo
5b54bcf7f9
cosmetics
2023-03-29 22:13:26 +02:00
vyzo
02797bb578
fix tests
2023-03-29 22:13:26 +02:00
vyzo
e682036cef
refactor database
...
- drop the execution index; we don't need it
- it is inclusion tipset
- use MessagesForTipset
- hoist db sql stuffs on top for clarity
- add index for tipset on messages
2023-03-29 22:13:26 +02:00
vyzo
7219fae0a1
more lint
2023-03-29 22:13:26 +02:00
vyzo
bc75c53660
dummy index for itests
2023-03-29 22:13:26 +02:00
vyzo
0564663b7e
lint
...
lint
lint
2023-03-29 22:13:26 +02:00
vyzo
f82a94220d
make gen
2023-03-29 22:13:26 +02:00
vyzo
f76babceec
hook the index into the rest of lotus
2023-03-29 22:13:26 +02:00
vyzo
d032e4f119
use the transaction Luke!
2023-03-29 22:13:26 +02:00
vyzo
dad3442500
test test test
2023-03-29 22:13:26 +02:00
vyzo
e6a0c5a406
implement Close
2023-03-29 22:13:26 +02:00
vyzo
c123fab1da
implement reconciliation
2023-03-29 22:13:26 +02:00
vyzo
7a3af7bf0f
more implementation
2023-03-29 22:13:26 +02:00