cerc-io/ipld-eth-beacon-indexer
19
0
Fork 0
Code Issues 4 Pull Requests 2 Actions Packages Projects Releases 9 Wiki Activity
105 Commits 5 Branches 9 Tags 272 MiB
2f812fd2e2
Commit Graph

105 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Thomas E Lackey
2f812fd2e2 Link example to ipld-eth-beacon-config.json 2022-09-28 16:21:11 -05:00
Thomas E Lackey
756a4e3d4f blind attempt to fix docker compose error 2022-09-28 16:10:08 -05:00
Thomas E Lackey
8542f02d4d Use latest DB schema. 2022-09-28 15:47:06 -05:00
Thomas E Lackey
bfaf768d97 lint 2022-09-28 15:30:04 -05:00
Thomas E Lackey
36dd5d6331 use Slot rather than string or uint64 2022-09-28 13:52:13 -05:00
Thomas E Lackey
f0be9ef759 Update system tests. 2022-09-27 21:05:26 -05:00
Thomas E Lackey
8af61d2a2a Set minimum slot for historic and known-gaps processing. 2022-09-24 01:45:43 -05:00
Thomas E Lackey
6034679ec1 Helper tweaks. 2022-09-23 22:22:45 -05:00
Thomas E Lackey
9265265c37 Add config file support for toggling block and state processing. 2022-09-23 15:23:22 -05:00
Thomas E Lackey
6378bc9cde Replace the entire SseClient on timeout to avoid any internal races. 2022-09-22 22:14:27 -05:00
Thomas E Lackey
3626029c11 Update to latest SSE dependency. Add idle/reconnect logic for SSE. 2022-09-22 17:15:48 -05:00
Thomas E Lackey
a74df084c4 uint64 for slots, add ExecutionPayloadHeader validation test. 2022-09-21 18:12:12 -05:00
Thomas E Lackey
6f2de13426 Store the TransactionsRoot 2022-09-21 16:27:22 -05:00
Thomas E Lackey
6631ddbf96 ExecutionPayload support (needs tests). 2022-09-20 18:08:55 -05:00
Thomas E Lackey
cac8d041eb pre-payload 2022-09-20 17:35:01 -05:00
Thomas E Lackey
6b010bec73 Refactor the Eth1Data.block_hash DB column name as well. 2022-09-19 16:41:22 -05:00
Thomas E Lackey
c77b42fa95 Refactor Eth1BlockHash to the more specific Eth1DataBlockHash to avoid ambiguity. 2022-09-19 16:39:12 -05:00
Thomas E Lackey
f27944221d Typo 2022-09-19 16:13:06 -05:00
Thomas E Lackey
552b3cb682 Report slot errors 2022-09-19 16:12:21 -05:00
Thomas E Lackey
4790db493b Mostly working unit test 2022-09-15 20:55:11 -05:00
Thomas E Lackey
a0f5ec8d03 Make it possible to toggle off BeaconState or BeaconBlock processing selectively. 2022-09-15 16:17:59 -05:00
Thomas E Lackey
e42da813bd Restore default DB settings. 2022-09-08 12:37:29 -05:00
Thomas E Lackey
90cafc1e54 Minor refactor 2022-09-08 11:26:05 -05:00
Thomas E Lackey
a97a2f1b60 Minor refactor 2022-09-08 11:22:30 -05:00
Thomas E Lackey
765480b12c Minor refactor 2022-09-08 10:59:47 -05:00
Thomas E Lackey
dceb81866f Mask common types. 2022-09-08 00:03:37 -05:00
Thomas E Lackey
ecb5490b01 Switch to zrnt 2022-09-07 23:50:17 -05:00
Thomas E Lackey
2a426c260c Add wrapper types (tests mostly working). 2022-09-07 13:38:58 -05:00
Thomas E Lackey
38096af45c revert config 2022-09-02 23:31:35 -05:00
Thomas E Lackey
b49854884b Update deps and remove dependency on Prysm (note, tests still need de-prysmed). 2022-09-02 23:22:44 -05:00
erikdies
fbde7cd175
Create issues-notion-sync.yml 2022-06-29 09:28:30 -04:00
Abdul Rabbani
b3c2d5915c
Merge pull request #68 from vulcanize/develop 
Slight Performance improvements with Logging (#67)
 2022-06-15 11:51:38 -04:00
Abdul Rabbani
117a2deea9
Slight Performance improvements with Logging (#67) 
* Slight Performance improvements with Logging

* Use exec in docker container

* Update packages for dockerfile

* Add flakey test and boot command specific logic

* Remove excess logging and add config val
 2022-06-15 11:49:30 -04:00
Abdul Rabbani
bb8c861bfd
Merge pull request #63 from vulcanize/develop 
Improve entrypoint to be more helpful
 2022-06-14 09:36:38 -04:00
Abdul Rabbani
d5a9f999b3
Merge pull request #64 from vulcanize/feature/bug-remove-processed-slots 
Send slots to processedCh and remove
 2022-06-14 09:35:28 -04:00
Abdul Rabbani
cdeb43177c Send slots to processedCh and remove 2022-06-14 09:27:59 -04:00
Abdul Rabbani
67c937418e Improve entrypoint to be more helpful 2022-06-14 09:06:51 -04:00
Abdul Rabbani
802f80057b
Merge pull request #60 from vulcanize/develop 
Fix datarace condition
 2022-06-13 12:26:27 -04:00
Abdul Rabbani
64a89d8a46 Fix datarace condition 
By creating local variables within each goroutine.
 2022-06-13 12:15:18 -04:00
Abdul Rabbani
cfbad8092d
Merge pull request #59 from vulcanize/develop 
Include all changes needed for historical and knownGaps processing
 2022-06-10 09:45:42 -04:00
Abdul Rabbani
72eea46bab
Update README and condition for cleanup (#58) 
* Update README and condition for cleanup

* Utilize config file for ipld-eth-beacon

* Update CICD to use config file on container build.

* Add env file for build cp

* Add a sleep before running the test
 2022-06-10 09:30:52 -04:00
Abdul Rabbani
3c6a9787fd Merge branch 'main' of github.com:vulcanize/ipld-ethcl-indexer into develop 2022-06-09 17:37:30 -04:00
Abdul Rabbani
24fc6358d6
Testing for Batch Processing (#56) 
* Set starting slot and improve error gap capturing

* Set starting slot and improve error gap capturing

* Tests + Significant Refactor

The code for historical processing has been significantly refactored to use a context to signify a shutdown.

There have also been many tests added for historical and knownGaps processing.

* Update MhKeys in test

* Update correct values

* Update Max Retry

Genesis is not working as expected.

* Ensure we release locks properly

* Add ordered testing

* Include system tests

* Update workflow calls

* Add secrets

* Add required secrets

* update path

* Try using the absolute path

* Remove volumes at the end.

* Update system-tests.yml

* Update system-tests.yml

* Update test err

* Update and test the shutdown

* rename ethcl --> eth-beacon

* Try forcing /bin/bash for docker-compose

* Update system-tests.yml

* Update system-tests.yml

* Update system-tests.yml

* Update system-tests.yml

* Update system-tests.yml

* Update system-tests.yml

* Use single quote cron

* Dont run generic on schedule
 2022-06-09 17:32:46 -04:00
Abdul Rabbani
d674df1ef0
Merge pull request #55 from vulcanize/ian/update_multihash_prefix 
update multihash prefix
 2022-06-06 15:52:12 -04:00
i-norden
87aa87cb51 update multihash prefix 2022-06-06 13:10:09 -05:00
Abdul Rabbani
4d7781e2b0
Use a transaction for writing, knowngaps, and reorgs (#53) 
* Use a transaction for writing, knowngaps, and reorgs

* Checkpoint - Check the DB before writing

* Ensure an error exists when writing a transaction to knowngaps

* Update unneccesary parameter
 2022-06-06 09:02:43 -04:00
Abdul Rabbani
e3b4fad3c7
Capture the unique identifier everywhere its needed. (#51) 
* Capture the unique identifier everywhere its needed.

* Handle graceful shutdown for historical processing

* Update flags and minor shutdown updates

* Update checkout statement for historic

* update cicd pipeline

* Add secret

* Use deploy-key instead of personal PAT

* update variables
 2022-06-03 12:47:13 -04:00
Abdul Rabbani
9160dded11
Add Prometheus Metrics (#49) 
* Add Prometheus Metrics

* Fix Prometheus duplicate error

* Handle duplicate registrations
 2022-05-25 10:19:29 -04:00
Abdul Rabbani
347984a547
Feature/44 read write historic slots (#46) 
* Update boot to set processing type.

* Handle entries from the historic_process table.

* Update on-pr.yml

* Fix head processing Error

* Update names and debug

* Seperate checking for new entries and locking them

* Application can process historic and known gaps

Untested

* Handle genesis

* Update remove entry for knownGaps, viper

* Disregard unused code from linter
 2022-05-24 16:18:55 -04:00
Abdul Rabbani
041276da81
Update the boot process (#45) 
* Update the boot process

* Update the CI/CD reference for stack-orchestrator
 2022-05-19 09:46:38 -04:00