gnosis/lighthouse
1
0
Fork 0
mirror of https://github.com/sigp/lighthouse.git synced 2026-04-17 21:08:32 +00:00
Code Issues Packages Projects Releases Wiki Activity

Update spec tests to v1.1.0-beta.4 (#2548)

Browse Source 
## Proposed Changes

Bump the spec tests to beta.4, including the new randomised tests (which all pass 🎉)
This commit is contained in:
Michael Sproul
2021-09-25 05:58:35 +00:00
parent 00a7ef0036
commit a844ce5ba9
22 changed files with 231 additions and 36 deletions
Download Patch File Download Diff File Expand all files Collapse all files

15
testing/ef_tests/check_all_files_accessed.py
View File

@@ -1,7 +1,7 @@
#!/usr/bin/env python3
# The purpose of this script is to compare a list of file names that were accessed during testing
# against all the file names in the eth2.0-spec-tests repository. It then checks to see which files
# against all the file names in the consensus-spec-tests repository. It then checks to see which files
# were not accessed and returns an error if any non-intentionally-ignored files are detected.
#
# The ultimate goal is to detect any accidentally-missed spec tests.
@@ -12,20 +12,13 @@ import sys
# First argument should the path to a file which contains a list of accessed file names.
accessed_files_filename = sys.argv[1]
# Second argument should be the path to the eth2.0-spec-tests directory.
# Second argument should be the path to the consensus-spec-tests directory.
tests_dir_filename = sys.argv[2]
# If any of the file names found in the eth2.0-spec-tests directory *starts with* one of the
# If any of the file names found in the consensus-spec-tests directory *starts with* one of the
# following strings, we will assume they are to be ignored (i.e., we are purposefully *not* running
# the spec tests).
excluded_paths = [
# Configs from future phases
"tests/mainnet/config/custody_game.yaml",
"tests/mainnet/config/sharding.yaml",
"tests/mainnet/config/merge.yaml",
"tests/minimal/config/custody_game.yaml",
"tests/minimal/config/sharding.yaml",
"tests/minimal/config/merge.yaml",
# Merge tests
"tests/minimal/merge",
"tests/mainnet/merge",
@@ -53,7 +46,7 @@ excluded_paths = [
]
def normalize_path(path):
return path.split("eth2.0-spec-tests/", )[1]
return path.split("consensus-spec-tests/", )[1]
# Determine the list of filenames which were accessed during tests.
passed = set()