cerc-io/ipld-eth-beacon-indexer
19
0
Fork 0
Code Issues 4 Pull Requests 2 Actions Packages Projects Releases 9 Wiki Activity

[Feature] Database Write Efficiency #52

New Issue
Closed
opened 2022-06-03 16:23:00 +00:00 by abdulrabbani00 · 0 comments
abdulrabbani00 commented 2022-06-03 16:23:00 +00:00 (Migrated from github.com)
Copy Link

Table of contents generated with markdown-toc

Overview

Request

  1. Use a transaction to write slots. In case of a shutdown, we don't want to have only written to some tables and not others.
  2. Check the DB to see if a slot exists prior to processing it. This can be a configurable flag.

Potential Solution

  1. Integrate a transaction.
  2. Query the DB to check the entry within the ethcl.slots, ethcl.signed_beacon_block, and ethcl.signed_beacon_state table.
    a. If the entry exists in all tables, then we don't need to reprocess it.

Alternative Solutions

Additional Context

- [Overview](#overview) - [Request](#request) - [Potential Solution](#potential-solution) - [Alternative Solutions](#alternative-solutions) - [Additional Context](#additional-context) <small><i><a href='http://ecotrust-canada.github.io/markdown-toc/'>Table of contents generated with markdown-toc</a></i></small> # Overview - **Requester**: @abdulrabbani00 - **Epic Link**: https://github.com/vulcanize/ipld-ethcl-indexer/issues/42 ## Request <!--- Explain what you want and why. If this feature is related to a problem please highlight it here.** ---> 1. Use a transaction to write slots. In case of a shutdown, we don't want to have only written to some tables and not others. 2. Check the DB to see if a slot exists prior to processing it. This can be a configurable flag. # Potential Solution 1. Integrate a transaction. 2. Query the DB to check the entry within the `ethcl.slots`, `ethcl.signed_beacon_block`, and `ethcl.signed_beacon_state` table. a. If the entry exists in all tables, then we don't need to reprocess it. <!---Provide any details for a potential solution. ---> ## Alternative Solutions <!---Provide any alternative solutions. ---> # Additional Context <!---Provide Additional Context. --->
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels   
backlog

We will work on this at a later time.

  
beacon

   
bug

Something isn't working

  
critical

   
documentation

Improvements or additions to documentation

  
duplicate

This issue or pull request already exists

  
enhancement

New feature or request

  
epic

An Epic

  
feature

We need a new feature

  
good first issue

Good for newcomers

  
help wanted

Extra attention is needed

  
in review

   
invalid

This doesn't seem right

  
question

Further information is requested

  
test

We need to add test

  
wontfix

This will not be worked on

  
Copied from Github

An issue or PR manually copied from GitHub.

  
Kind/Breaking

Breaking change that won't be backward compatible

  
Kind/Bug

Something is not working

  
Kind/Documentation

Documentation changes

  
Kind/Enhancement

Improve existing functionality

  
Kind/Feature

New functionality

  
Kind/Security

This is security issue

  
Kind/Testing

Issue or pull request related to testing

  
Priority
Critical
The priority is critical

  
Priority
High
The priority is high

  
Priority
Low
The priority is low

  
Priority
Medium
The priority is medium

  
Reviewed
Confirmed
Issue has been confirmed

  
Reviewed
Duplicate
This issue or pull request already exists

  
Reviewed
Invalid
Invalid issue

  
Reviewed
Won't Fix
This issue won't be fixed

  
Status
Abandoned
Somebody has started to work on this but abandoned work

  
Status
Blocked
Something is blocking this issue or pull request

  
Status
Need More Info
Feedback is required to reproduce issue or to continue work

No Label
backlog
beacon
bug
critical
documentation
duplicate
enhancement
epic
feature
good first issue
help wanted
in review
invalid
question
test
wontfix
Copied from Github
Kind/Breaking
Kind/Bug
Kind/Documentation
Kind/Enhancement
Kind/Feature
Kind/Security
Kind/Testing
Priority
Critical
Priority
High
Priority
Low
Priority
Medium
Reviewed
Confirmed
Reviewed
Duplicate
Reviewed
Invalid
Reviewed
Won't Fix
Status
Abandoned
Status
Blocked
Status
Need More Info
Milestone
Clear milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
No Assignees
1 Participants
Notifications
Due Date
The due date is invalid or out of range. Please use the format 'yyyy-mm-dd'.

No due date set.

Dependencies

No dependencies set.

Reference: cerc-io/ipld-eth-beacon-indexer#52
No description provided.
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?