Commit Graph

80 Commits

Author SHA1 Message Date
Paul Hauner
bcffe42712
Bulk signature verification (#507)
* Add basic block processing benches

* Start reviving state processing benches

* Fix old block builders

* Add optimization for faster pubkey add

* Tidy benches, add another

* Add extra block processing bench

* Start working on faster BLS scheme

* Add partially complete sig verify optimization

* Add .gitignore to state processing

* Add progress on faster signature verification

* Fix SignatureSet for fake_crypto

* Tidy attester slashings sig set

* Tidy bulk signature verifier

* Refactor signature sets to be cleaner

* Start threading SignatureStrategy through code

* Add (empty) test dir

* Move BenchingBlockBuilder

* Add initial block signature verification tests

* Add tests for bulk signature verification

* Start threading SignatureStrategy in block proc.

* Refactor per_block_processing errors

* Use sig set tuples instead of lists of two

* Remove dead code

* Thread VerifySignatures through per_block_processing

* Add bulk signature verification

* Introduce parallel bulk signature verification

* Expand state processing benches

* Fix additional compile errors

* Fix issue where par iter chunks is 0

* Update milagro_bls dep

* Remove debugs, code fragment in beacon chain

* Tidy, add comments to block sig verifier

* Fix various PR comments

* Add block_root option to per_block_processing

* Fix comment in block signature verifier

* Fix comments from PR review

* Remove old comment

* Fix comment
2019-08-29 11:34:25 +10:00
Paul Hauner
8cfa36fedd
Publish ssz_types (and deps) to crates.io (#468)
* Rename `hashing` crate to `eth2_hashing`

* Add license, desc to eth2_hashing Cargo.toml

* Remove merkle root from eth2 hashing

* Remove old benches folder (zombied from old branch)

* Add docs to eth2_hashing

* Prepare tree_hash for publishing on crates.io

* Update deps to use crates.io instead of paths

* Update all crates to pull ssz from crates.io

* Remove cached_tree_hash, add patches to manifest

* Fix compile error in benches

* Remove unused code

* Fix fake_crypto compile error
2019-08-08 11:39:47 +10:00
Pawan Dhananjay
88e89f9ab2 Update ethereum types (#489)
* Update ethereum-types to version 0.6

* Fix tests

* Run rustfmt
2019-08-06 14:41:42 +10:00
Paul Hauner
845f336a59
Interop chain start strategies (#479)
* Implement more flexible beacon chain genesis

* Fix compile issues from rebase on master

* Rename CLI flag

* Adds initial documentation for TOML files

* Update docs readme

* Add first version of cli_util

* Dont write cache fields in serde

* Tidy cli_util

* Add code to load genesis YAML file

* Move serde_utils out of tests in `types`

* Update logging text

* Fix serde YAML for Fork

* Make yaml hex decoding more strict

* Update deterministic key generate for interop

* Set deposit count on testing genesis state

* Make some fixes for deposit count

* Remove code fragements

* Large restructure of docs

* Tidy docs

* Fix readme link

* Add interop docs

* Tidy README
2019-08-06 13:29:27 +10:00
Michael Sproul
eb669ab40f
Add v0.8 genesis tests (#466)
Closes #452
2019-07-30 17:02:38 +10:00
Michael Sproul
a236003a7b Update to frozen spec ❄️ (v0.8.1) (#444)
* types: first updates for v0.8

* state_processing: epoch processing v0.8.0

* state_processing: block processing v0.8.0

* tree_hash_derive: support generics in SignedRoot

* types v0.8: update to use ssz_types

* state_processing v0.8: use ssz_types

* ssz_types: add bitwise methods and from_elem

* types: fix v0.8 FIXMEs

* ssz_types: add bitfield shift_up

* ssz_types: iterators and DerefMut for VariableList

* types,state_processing: use VariableList

* ssz_types: fix BitVector Decode impl

Fixed a typo in the implementation of ssz::Decode for BitVector, which caused it
to be considered variable length!

* types: fix test modules for v0.8 update

* types: remove slow type-level arithmetic

* state_processing: fix tests for v0.8

* op_pool: update for v0.8

* ssz_types: Bitfield difference length-independent

Allow computing the difference of two bitfields of different lengths.

* Implement compact committee support

* epoch_processing: committee & active index roots

* state_processing: genesis state builder v0.8

* state_processing: implement v0.8.1

* Further improve tree_hash

* Strip examples, tests from cached_tree_hash

* Update TreeHash, un-impl CachedTreeHash

* Update bitfield TreeHash, un-impl CachedTreeHash

* Update FixedLenVec TreeHash, unimpl CachedTreeHash

* Update update tree_hash_derive for new TreeHash

* Fix TreeHash, un-impl CachedTreeHash for ssz_types

* Remove fixed_len_vec, ssz benches

SSZ benches relied upon fixed_len_vec -- it is easier to just delete
them and rebuild them later (when necessary)

* Remove boolean_bitfield crate

* Fix fake_crypto BLS compile errors

* Update ef_tests for new v.8 type params

* Update ef_tests submodule to v0.8.1 tag

* Make fixes to support parsing ssz ef_tests

* `compact_committee...` to `compact_committees...`

* Derive more traits for `CompactCommittee`

* Flip bitfield byte-endianness

* Fix tree_hash for bitfields

* Modify CLI output for ef_tests

* Bump ssz crate version

* Update ssz_types doc comment

* Del cached tree hash tests from ssz_static tests

* Tidy SSZ dependencies

* Rename ssz_types crate to eth2_ssz_types

* validator_client: update for v0.8

* ssz_types: update union/difference for bit order swap

* beacon_node: update for v0.8, EthSpec

* types: disable cached tree hash, update min spec

* state_processing: fix slot bug in committee update

* tests: temporarily disable fork choice harness test

See #447

* committee cache: prevent out-of-bounds access

In the case where we tried to access the committee of a shard that didn't have a committee in the
current epoch, we were accessing elements beyond the end of the shuffling vector and panicking! This
commit adds a check to make the failure safe and explicit.

* fix bug in get_indexed_attestation and simplify

There was a bug in our implementation of get_indexed_attestation whereby
incorrect "committee indices" were used to index into the custody bitfield. The
bug was only observable in the case where some bits of the custody bitfield were
set to 1. The implementation has been simplified to remove the bug, and a test
added.

* state_proc: workaround for compact committees bug

https://github.com/ethereum/eth2.0-specs/issues/1315

* v0.8: updates to make the EF tests pass

* Remove redundant max operation checks.
* Always supply both messages when checking attestation signatures -- allowing
  verification of an attestation with no signatures.
* Swap the order of the fork and domain constant in `get_domain`, to match
  the spec.

* rustfmt

* ef_tests: add new epoch processing tests

* Integrate v0.8 into master (compiles)

* Remove unused crates, fix clippy lints

* Replace v0.6.3 tags w/ v0.8.1

* Remove old comment

* Ensure lmd ghost tests only run in release

* Update readme
2019-07-30 12:44:51 +10:00
Pawan Dhananjay
db094022b9 Remove unused dependencies (#456) 2019-07-29 09:55:57 +10:00
John Adler
fec7168512
Fix lots of typos. 2019-07-26 15:26:06 -04:00
Paul Hauner
027f0a539d
Prepare ssz for publishing on crates.io 2019-07-03 16:06:20 +10:00
Paul Hauner
7115961d84
Ensure current epoch committee is built in test 2019-06-24 09:34:56 +10:00
Michael Sproul
660a35991f
update minimal spec, fix all tests 2019-06-17 15:21:03 +10:00
Paul Hauner
cf3d8b0688
Run cargo fmt --all 2019-06-13 12:21:09 -04:00
Paul Hauner
4f43a67caf
Add should_panic to incomplete ef_tests 2019-06-13 11:05:22 -04:00
Paul Hauner
6099824cae
Ignore clippy lint in ef_tests
As it's just testing code, memory efficiency is not a priority
2019-06-13 11:00:47 -04:00
Paul Hauner
a71f05066b
Merge branch 'docker-env' into v0.6.1 2019-06-13 10:37:35 -04:00
Michael Sproul
8a9f7ff32b
ef_tests: use BlsSetting in operations_deposit 2019-06-12 16:30:18 +10:00
Michael Sproul
9887f43047
ef_tests: v0.6.3 passing, modulo known failures 2019-06-12 15:47:32 +10:00
Michael Sproul
c649988189
ef_tests: skipped tests and bls_setting support 2019-06-11 18:06:15 +10:00
Michael Sproul
4024a400c8
ef_tests: sanity block tests 2019-06-11 18:05:44 +10:00
Paul Hauner
e550c0218f
Add various fixes to clippy lints
Thou shalt appease clippy
2019-06-10 11:01:25 -04:00
Paul Hauner
749f2fcb5f
Unify EthSpecs in Mainnet and Minimal 2019-06-08 08:49:04 -04:00
Paul Hauner
e74d49fc8a
Remove dupe info between ChainSpec and EthSpec 2019-06-08 07:57:25 -04:00
Michael Sproul
c05cf6c256
ef_tests: sanity slot tests + block headers 2019-06-04 16:35:33 +10:00
Michael Sproul
cf62ea090b
ef_test v0.6.3 2019-06-04 12:12:14 +10:00
Michael Sproul
5020028bbc
ef_tests: attestation tests 2019-06-04 11:05:35 +10:00
Michael Sproul
2d943e6792
ef deposit tests: parse bls_setting and skip appropriately 2019-05-29 17:20:43 +10:00
Michael Sproul
beacf42aaf
v0.6.2: update test infrastructure 2019-05-29 15:31:34 +10:00
Michael Sproul
706f850c9e
ef_tests: runners for epoch processing tests 2019-05-28 16:03:26 +10:00
Paul Hauner
07931d1f5a
Add (failing) attester_slashing tests 2019-05-24 14:08:19 +10:00
Paul Hauner
686963bd34
Update ef_tests for new compare_fields API 2019-05-24 14:08:19 +10:00
Paul Hauner
67f890ae48
Add proposer_slashing EF tests 2019-05-24 14:08:19 +10:00
Paul Hauner
5ed3c8bec3
Add shuffling ef_tests 2019-05-23 23:27:28 +10:00
Paul Hauner
92610b4fd3
Improve error messages for ef_tests 2019-05-23 16:55:50 +10:00
Paul Hauner
13f78342c3
Add passing exit tests 2019-05-23 10:11:15 +10:00
Paul Hauner
4db6a8a058
Add transfer ef tests 2019-05-23 08:48:09 +10:00
Paul Hauner
733c202417
Remove unused functions from ef_tests 2019-05-22 18:55:11 +10:00
Paul Hauner
e760afbc1a
Tidy presentation of errors for ef_tests 2019-05-22 18:55:00 +10:00
Paul Hauner
14d879d75f
Pass case_index through Case trait 2019-05-22 18:13:22 +10:00
Paul Hauner
b2666d700c
Implemented detailed state eqs in ef_tests 2019-05-22 18:00:21 +10:00
Paul Hauner
30d582f40d
Enable operations tests, start testing 2019-05-22 16:46:50 +10:00
Paul Hauner
6fada99905
Refactor ef_tests for less code duplication 2019-05-22 16:15:52 +10:00
Paul Hauner
95b0df7087
Add parsing (not executing) of deposit tests 2019-05-22 15:34:12 +10:00
Paul Hauner
edbb435f4f
Add assert to ensure test exist 2019-05-22 14:27:21 +10:00
Paul Hauner
f9f6161a7a
Ensure ef_tests run with the right fake_crypto cfg 2019-05-22 14:18:48 +10:00
Paul Hauner
ae3e459422
Merge branch 'ef-tests' of github.com:sigp/lighthouse into ef-tests 2019-05-22 13:59:54 +10:00
Kirk Baird
73c246854a
Add functionality to check ssz_static encoding as well as existing decoding 2019-05-21 15:31:31 +10:00
Kirk Baird
d0c674871d
Remove bls uncompressed hash test 2019-05-21 14:24:10 +10:00
Kirk Baird
7a96ad130e
Finalise bls spec tests 2019-05-21 12:46:22 +10:00
Kirk Baird
4f6447a62b
Begin working on bls test 2019-05-21 10:32:14 +10:00
Paul Hauner
c6fa1602de
Improve efficiency with manual YAML operations 2019-05-15 17:14:28 +10:00