gnosis/lighthouse
1
0
Fork 0
mirror of https://github.com/sigp/lighthouse.git synced 2026-03-22 22:34:45 +00:00
Code Issues Packages Projects Releases Wiki Activity
6,566 Commits 46 Branches 141 Tags
a6de0d5e12a29982b62d18e128d118b5ee6cd3b2
Commit Graph

6566 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Michael Sproul
a6de0d5e12 Merge remote-tracking branch 'origin/stable' into back-merge-6.0.1 2024-12-16 15:37:52 +11:00
Lion - dapplion
c92c07ff49 Track beacon processor import result metrics (#6541) 
* Track beacon processor import result metrics

* Update metric name
 2024-12-16 04:33:33 +00:00
Michael Sproul
0d90135047 Release v6.0.1 (#6659) 
* Release v6.0.1
v6.0.1 		2024-12-16 03:03:22 +00:00
Age Manning
c3a0757ad2 Correct /nat API for libp2p (#6677) 
* Fix nat API
 2024-12-15 23:16:53 +00:00
Michael Sproul
f3b78889e5 Compact more when pruning states (#6667) 
* Compact more when pruning states

* Merge branch 'release-v6.0.1' into compact-more
 2024-12-14 08:43:00 +00:00
Michael Sproul
d49e1be35d Remove heading that isn't rendered correctly (#6650) 
* Remove heading that isn't rendered correctly
 2024-12-13 05:44:41 +00:00
Shayan Eskandari
943716b9a2 Fix for blank line in graffiti file (#6635) 
* Fix for blank line in graffiti file

Fix as described in https://github.com/sigp/lighthouse/issues/5880

* add graffiti new line tests

* cargo fmt
 2024-12-13 05:07:01 +00:00
Lion - dapplion
775fa6730b Stuck lookup v6 (#6658) 
* Fix stuck lookups if no peers on v6

* Merge branch 'release-v6.0.1' into stuck-lookup-v6
 2024-12-13 05:02:10 +00:00
Povilas Liubauskas
4946343990 Fix subscribing to attestation subnets for aggregating (#6681) (#6682) 
* Fix subscribing to attestation subnets for aggregating (#6681)

* Prevent scheduled subnet subscriptions from being overwritten by other subscriptions from same subnet with additional scoping by slot
 2024-12-12 08:36:34 +00:00
Michael Sproul
fc0e0ae613 Prevent reconstruction starting prematurely (#6669) 
* Prevent reconstruction starting prematurely

* Simplify condition

* Merge remote-tracking branch 'origin/release-v6.0.1' into dont-start-reconstruction-early
 2024-12-12 01:58:41 +00:00
antondlr
b7ffcc8229 Fix: Docker CI to use org tokens (#6655) 
* update Dockerhub creds to new scheme

* Merge branch 'release-v6.0.1' into fix-docker-ci
 2024-12-12 00:24:58 +00:00
Daniel Knopik
a2b00090fd Remove ZeroizeString in favour of Zeroizing<String> (#6661) 
* Remove ZeroizeString in favour of Zeroizing<String>

* cargo fmt

* remove unrelated line that slipped in

* Update beacon_node/store/Cargo.toml

thanks michael!

Co-authored-by: Michael Sproul <micsproul@gmail.com>

* Merge branch 'unstable' into remove-zeroizedstring
 2024-12-11 23:51:20 +00:00
Michael Sproul
b2590bcb37 Tweak reconstruction batch size (#6668) 
* Tweak reconstruction batch size

* Merge branch 'release-v6.0.1' into reconstruction-batch-size
 2024-12-11 22:51:46 +00:00
Michael Sproul
c5a48a9dff Merge remote-tracking branch 'origin/release-v6.0.1' into unstable 2024-12-10 15:53:35 +11:00
Age Manning
3b8254a8ec Correct flakey CI tests (#6646) 
* Correct flakey CI tests

* Correct clippy

* Extend timeout for events
 2024-12-10 04:24:55 +00:00
Michael Sproul
e9ec67e78a Fix Kurtosis, web3signer and cargo-audit for CI (#6671) 
* Update kurtosis-cli

* Fix name of Kurtosis artefact used in doppelganger tests

* Ignore idna vuln

* Set Java Version to 21 (required since Web3Signer 24.12.0).
 2024-12-10 02:14:13 +00:00
hopinheimer
fec502db9f Deprecate futures ticker (#6630) 
* deprecate futures-ticker

* Merge branch 'unstable' of github.com:sigp/lighthouse into deprecate-futures-timer

* Merge branch 'unstable' into deprecate-futures-timer

* making the linter happy

* remove unrequired #[allow(unused_imports)]

* fixing minor issues

* merge commit

* minor fix

* clippy changes
 2024-12-03 08:56:43 +00:00
Michael Sproul
1fd86f8b59 Add a security section to the book (#6581) 
* Add a security section to the book

* Update book/src/security.md

Co-authored-by: chonghe <44791194+chong-he@users.noreply.github.com>

* Update book/src/security.md

Co-authored-by: chonghe <44791194+chong-he@users.noreply.github.com>
 2024-12-03 00:08:53 +00:00
Michael Sproul
c042dc14d7 Release v6.0.0 (#6605) 
* Release v6.0.0
v6.0.0 		2024-12-02 04:00:51 +00:00
Michael Sproul
e9354a807d Merge remote-tracking branch 'origin/stable' into unstable 2024-12-02 12:51:20 +11:00
Age Manning
770d677a4e Increase idle connection timeout (#6604) 
* Increase idle connection timeout

* Update beacon_node/lighthouse_network/src/service/mod.rs

Co-authored-by: João Oliveira <hello@jxs.pt>
 2024-12-02 01:44:58 +00:00
Pawan Dhananjay
f8e31f6272 Increase rpc rate limits (#6626) 
* Increase rate limits for byrange requests

* Merge branch 'unstable' into reduce-blob-limits

* Update limits
 2024-12-01 23:31:10 +00:00
Michael Sproul
1c8161f92b Fetch blobs from EL prior to block verification (#6600) 
* Fetch blobs from EL prior to block verification

* Run fetch blobs in parallel with block import

* Merge branch 'unstable' into fetch-blobs-earlier

* Merge branch 'unstable' into fetch-blobs-earlier
 2024-11-29 02:58:19 +00:00
Michael Sproul
fa6c4c02a3 Fix Rust 1.83 Clippy lints (#6629) 
* Fix Rust 1.83 Clippy lints

* Cargo fmt
 2024-11-29 02:23:54 +00:00
Eitan Seri-Levi
38f5f665e1 Remove error-chain dependency (#6628) 
* remove error-chain dependency

* rerun CI

* rerun CI
 2024-11-28 02:39:50 +00:00
Michael Sproul
720f596021 Pin rust_eth_kzg to 0.5.1 (#6608) 
* Pin rust_eth_kzg to 0.5.1

* Pin crate_crypto transitive deps
 2024-11-26 07:17:18 +00:00
Michael Sproul
79de61b624 Update DB migrations in book (#6611) 
* Update DB migrations in book

* Merge branch 'unstable' into db-migrations-v22
 2024-11-26 05:08:24 +00:00
Age Manning
08e8b92e50 Simple Subnet Management (#6146) 
* Initial temp commit

* Merge latest unstable

* First draft without tests

* Update tests for new version

* Correct comments and reviewers comments

* Merge latest unstable

* Fix errors

* Missed a comment, corrected it

* Fix lints

* Merge latest unstable

* Fix tests

* Merge latest unstable

* Reviewers comments

* Remove sync subnets from ENR on unsubscribe

* Merge branch 'unstable' into simple-peer-mapping

* Merge branch 'unstable' into simple-peer-mapping

* Merge branch 'unstable' into simple-peer-mapping

* Merge latest unstable

* Prevent clash with pin of rust_eth_kzg
 2024-11-26 01:48:07 +00:00
Paul Hauner
6329042628 Add filecoin address to FUNDING.json (#6602) 
* Add filecoin address to drips FUNDING.json

* Add newline
 2024-11-22 11:30:57 +11:00
Pawan Dhananjay
6e1945fc5d Avoid computing rpc_blob_limits multiple times (#6595) 
* Compute blob rpc limits in static block

* Fix min size

* Use MainnetEthSpec in rpc tests

* Revert MainnetEthSpec; add another constant for blob size minimal
 2024-11-20 23:04:45 +00:00
Pawan Dhananjay
94311c6516 Add additional metrics for idontwant (#6578) 
* Add additional metrics for idontwant

* Resolve issues from review

* Fix tests

* Don't exceed capacity

* Apply suggestions from code review

Co-authored-by: João Oliveira <hello@jxs.pt>

* Return early on failure

* Add comment
 2024-11-20 22:27:13 +00:00
Michael Sproul
b1e9f69460 Fix v22 schema upgrade (#6591) 
* Fix v22 schema upgrade

* Ownership
 2024-11-19 22:43:18 +00:00
Age Manning
8cebc87d95 Update to latest discovery (#6486) 
* Upgrade discv5 to v0.8

* Rename some logs

* Improve the NAT reporting with new discv5 metrics

* Merge branch 'unstable' into discv5-v8

* Limited Cargo.lock update

* Update yanked futures-* crates
 2024-11-18 22:52:23 +00:00
Michael Sproul
c5007eaa1c Deprecate eth1 and dummy-eth1 flags (#6566) 
* Deprecate eth1/dummy-eth1 flags

* Update book

* Simplify + make staking conflict with disable-deposit-contract
 2024-11-18 08:36:01 +00:00
Michael Sproul
9fdd53df56 Hierarchical state diffs (#5978) 
* Start extracting freezer changes for tree-states

* Remove unused config args

* Add comments

* Remove unwraps

* Subjective more clear implementation

* Clean up hdiff

* Update xdelta3

* Tree states archive metrics (#6040)

* Add store cache size metrics

* Add compress timer metrics

* Add diff apply compute timer metrics

* Add diff buffer cache hit metrics

* Add hdiff buffer load times

* Add blocks replayed metric

* Move metrics to store

* Future proof some metrics

---------

Co-authored-by: Michael Sproul <michael@sigmaprime.io>

* Port and clean up forwards iterator changes

* Add and polish hierarchy-config flag

* Merge remote-tracking branch 'origin/unstable' into tree-states-archive

* Cleaner errors

* Fix beacon_chain test compilation

* Merge remote-tracking branch 'origin/unstable' into tree-states-archive

* Patch a few more freezer block roots

* Fix genesis block root bug

* Fix test failing due to pending updates

* Beacon chain tests passing

* Merge remote-tracking branch 'origin/unstable' into tree-states-archive

* Merge remote-tracking branch 'origin/unstable' into tree-states-archive

* Fix doc lint

* Implement DB schema upgrade for hierarchical state diffs (#6193)

* DB upgrade

* Add flag

* Delete RestorePointHash

* Update docs

* Update docs

* Implement hierarchical state diffs config migration (#6245)

* Implement hierarchical state diffs config migration

* Review PR

* Remove TODO

* Set CURRENT_SCHEMA_VERSION correctly

* Fix genesis state loading

* Re-delete some PartialBeaconState stuff

---------

Co-authored-by: Michael Sproul <michael@sigmaprime.io>

* Merge remote-tracking branch 'origin/unstable' into tree-states-archive

* Fix test compilation

* Update schema downgrade test

* Fix tests

* Fix null anchor migration

* Merge remote-tracking branch 'origin/unstable' into tree-states-archive

* Fix tree states upgrade migration (#6328)

* Towards crash safety

* Fix compilation

* Move cold summaries and state roots to new columns

* Rename StateRoots chunked field

* Update prune states

* Clean hdiff CLI flag and metrics

* Fix "staged reconstruction"

* Merge remote-tracking branch 'origin/unstable' into tree-states-archive

* Fix alloy issues

* Fix staged reconstruction logic

* Prevent weird slot drift

* Remove "allow" flag

* Update CLI help

* Remove FIXME about downgrade

* Merge remote-tracking branch 'origin/unstable' into tree-states-archive

* Remove some unnecessary error variants

* Fix new test

* Tree states archive - review comments and metrics (#6386)

* Review PR comments and metrics

* Comments

* Add anchor metrics

* drop prev comment

* Update metadata.rs

* Apply suggestions from code review

---------

Co-authored-by: Michael Sproul <micsproul@gmail.com>

* Update beacon_node/store/src/hot_cold_store.rs

Co-authored-by: Lion - dapplion <35266934+dapplion@users.noreply.github.com>

* Merge remote-tracking branch 'origin/unstable' into tree-states-archive

* Clarify comment and remove anchor_slot garbage

* Simplify database anchor (#6397)

* Simplify database anchor

* Update beacon_node/store/src/reconstruct.rs

* Add migration for anchor

* Fix and simplify light_client store tests

* Fix incompatible config test

* Merge remote-tracking branch 'origin/unstable' into tree-states-archive

* Merge remote-tracking branch 'origin/unstable' into tree-states-archive

* More metrics

* Merge remote-tracking branch 'origin/unstable' into tree-states-archive

* New historic state cache (#6475)

* New historic state cache

* Add more metrics

* State cache hit rate metrics

* Fix store metrics

* More logs and metrics

* Fix logger

* Ensure cached states have built caches :O

* Replay blocks in preference to diffing

* Two separate caches

* Distribute cache build time to next slot

* Re-plumb historic-state-cache flag

* Clean up metrics

* Update book

* Update beacon_node/store/src/hdiff.rs

Co-authored-by: Lion - dapplion <35266934+dapplion@users.noreply.github.com>

* Update beacon_node/store/src/historic_state_cache.rs

Co-authored-by: Lion - dapplion <35266934+dapplion@users.noreply.github.com>

---------

Co-authored-by: Lion - dapplion <35266934+dapplion@users.noreply.github.com>

* Update database docs

* Update diagram

* Merge remote-tracking branch 'origin/unstable' into tree-states-archive

* Update lockbud to work with bindgen/etc

* Correct pkg name for Debian

* Remove vestigial epochs_per_state_diff

* Merge remote-tracking branch 'origin/unstable' into tree-states-archive

* Markdown lint

* Merge remote-tracking branch 'origin/unstable' into tree-states-archive

* Address Jimmy's review comments

* Simplify ReplayFrom case

* Fix and document genesis_state_root

* Typo

Co-authored-by: Jimmy Chen <jchen.tc@gmail.com>

* Merge branch 'unstable' into tree-states-archive

* Compute diff of validators list manually (#6556)

* Split hdiff computation

* Dedicated logic for historical roots and summaries

* Benchmark against real states

* Mutated source?

* Version the hdiff

* Add lighthouse DB config for hierarchy exponents

* Tidy up hierarchy exponents flag

* Apply suggestions from code review

Co-authored-by: Michael Sproul <micsproul@gmail.com>

* Address PR review

* Remove hardcoded paths in benchmarks

* Delete unused function in benches

* lint

---------

Co-authored-by: Michael Sproul <michael@sigmaprime.io>

* Test hdiff binary format stability (#6585)

* Merge remote-tracking branch 'origin/unstable' into tree-states-archive

* Add deprecation warning for SPRP

* Update xdelta to get rid of duplicate deps

* Document test
 2024-11-18 01:51:44 +00:00
Eitan Seri-Levi
654fc6acdc Additional light client metrics (#6545) 
* Fix db query and add some additional metrics

* fmt

* Update beacon_node/beacon_chain/src/metrics.rs

Co-authored-by: Jimmy Chen <jchen.tc@gmail.com>

* Update beacon_node/beacon_chain/src/metrics.rs

Co-authored-by: Jimmy Chen <jchen.tc@gmail.com>
 2024-11-15 07:09:54 +00:00
Jimmy Chen
5f053b0b6d Improving blob propagation post-PeerDAS with Decentralized Blob Building (#6268) 
* Get blobs from EL.

Co-authored-by: Michael Sproul <michael@sigmaprime.io>

* Avoid cloning blobs after fetching blobs.

* Address review comments and refactor code.

* Fix lint.

* Move blob computation metric to the right spot.

* Merge branch 'unstable' into das-fetch-blobs

* Merge branch 'unstable' into das-fetch-blobs

# Conflicts:
#	beacon_node/beacon_chain/src/beacon_chain.rs
#	beacon_node/beacon_chain/src/block_verification.rs
#	beacon_node/beacon_chain/src/data_availability_checker/overflow_lru_cache.rs

* Merge branch 'unstable' into das-fetch-blobs

# Conflicts:
#	beacon_node/beacon_chain/src/beacon_chain.rs

* Gradual publication of data columns for supernodes.

* Recompute head after importing block with blobs from the EL.

* Fix lint

* Merge branch 'unstable' into das-fetch-blobs

* Use blocking task instead of async when computing cells.

* Merge branch 'das-fetch-blobs' of github.com:jimmygchen/lighthouse into das-fetch-blobs

* Merge remote-tracking branch 'origin/unstable' into das-fetch-blobs

* Fix semantic conflicts

* Downgrade error log.

* Merge branch 'unstable' into das-fetch-blobs

# Conflicts:
#	beacon_node/beacon_chain/src/data_availability_checker.rs
#	beacon_node/beacon_chain/src/data_availability_checker/overflow_lru_cache.rs
#	beacon_node/execution_layer/src/engine_api.rs
#	beacon_node/execution_layer/src/engine_api/json_structures.rs
#	beacon_node/network/src/network_beacon_processor/gossip_methods.rs
#	beacon_node/network/src/network_beacon_processor/mod.rs
#	beacon_node/network/src/network_beacon_processor/sync_methods.rs

* Merge branch 'unstable' into das-fetch-blobs

* Publish block without waiting for blob and column proof computation.

* Address review comments and refactor.

* Merge branch 'unstable' into das-fetch-blobs

* Fix test and docs.

* Comment cleanups.

* Merge branch 'unstable' into das-fetch-blobs

* Address review comments and cleanup

* Address review comments and cleanup

* Refactor to de-duplicate gradual publication logic.

* Add more logging.

* Merge remote-tracking branch 'origin/unstable' into das-fetch-blobs

# Conflicts:
#	Cargo.lock

* Fix incorrect comparison on `num_fetched_blobs`.

* Implement gradual blob publication.

* Merge branch 'unstable' into das-fetch-blobs

* Inline `publish_fn`.

* Merge branch 'das-fetch-blobs' of github.com:jimmygchen/lighthouse into das-fetch-blobs

* Gossip verify blobs before publishing

* Avoid queries for 0 blobs and error for duplicates

* Gossip verified engine blob before processing them, and use observe cache to detect duplicates before publishing.

* Merge branch 'das-fetch-blobs' of github.com:jimmygchen/lighthouse into das-fetch-blobs

# Conflicts:
#	beacon_node/network/src/network_beacon_processor/mod.rs

* Merge branch 'unstable' into das-fetch-blobs

* Fix invalid commitment inclusion proofs in blob sidecars created from EL blobs.

* Only publish EL blobs triggered from gossip block, and not RPC block.

* Downgrade gossip blob log to `debug`.

* Merge branch 'unstable' into das-fetch-blobs

* Merge branch 'unstable' into das-fetch-blobs

* Grammar
 2024-11-15 03:34:13 +00:00
Age Manning
8e95024945 Split the VC into crates making it more modular (#6453) 
* Starting to modularize the VC

* Revert changes to eth2

* More progress

* More progress

* Compiles

* Merge latest unstable and make it compile

* Fix some lints

* Tests compile

* Merge latest unstable

* Remove unnecessary deps

* Merge latest unstable

* Correct release tests

* Merge latest unstable

* Merge remote-tracking branch 'origin/unstable' into modularize-vc

* Merge branch 'unstable' into modularize-vc

* Revert unnecessary cargo lock changes

* Update validator_client/beacon_node_fallback/Cargo.toml

* Update validator_client/http_metrics/Cargo.toml

* Update validator_client/http_metrics/src/lib.rs

* Update validator_client/initialized_validators/Cargo.toml

* Update validator_client/signing_method/Cargo.toml

* Update validator_client/validator_metrics/Cargo.toml

* Update validator_client/validator_services/Cargo.toml

* Update validator_client/validator_store/Cargo.toml

* Update validator_client/validator_store/src/lib.rs

* Merge remote-tracking branch 'origin/unstable' into modularize-vc

* Fix format string

* Rename doppelganger trait

* Don't drop the tempdir

* Cargo fmt
 2024-11-08 01:01:46 +00:00
Jimmy Chen
ae160ebf07 Remove yq installation on CI (#6574) 
* Use `snap` to install `yq` on CI.

* Remove yq install.
 2024-11-07 22:19:43 +00:00
Pawan Dhananjay
9c42b12d06 Fix rpc decoding for blobs by range/root (#6569) 
* Fix rpc decoding for blobs by range/root
 2024-11-07 04:59:39 +00:00
Lion - dapplion
d8dbda319d Resolve some PeerDAS todos (#6434) 
* Resolve some PeerDAS todos
 2024-11-05 07:39:58 +00:00
Lion - dapplion
38388979db Strict match of errors in backfill sync (#6520) 
* Strict match of errors in backfill sync

* Fix tests
 2024-11-05 01:00:10 +00:00
Jimmy Chen
6a8d13e8a9 Send IDONTWANT on publish to avoid downloading data we already have (#6513) 
* Send `IDONTWANT` on publish to avoid downloading data we already have.

* Merge branch 'unstable' into send-idontwant-on-publish

* Move broadcast of `IDONTWANT` to after publishing.
 2024-11-05 01:00:07 +00:00
Mac L
9f657b0f07 Fix doc-test in consensus crate (#6561) 
* Use correct crate name in doc-test
 2024-11-04 22:15:29 +00:00
Jimmy Chen
4f86d950e9 Add error message for duration subtraction overflow in sim tests (#6558) 
* Add error message for duration subtraction overflow.
 2024-11-03 22:46:25 +00:00
zhiqiangxu
16693b0bd7 make execution-endpoint required (#5165) 
* make `execution-endpoint` mandatory

* use parse_required instead

* make test pass

* Merge branch 'unstable' into make_ee_required

* fix test

* Merge branch 'unstable' into make_ee_required

* Fix cli help text

* Fix tests

* Merge branch 'unstable' into make_ee_required

* Add comment

* Clarification

* Merge remote-tracking branch 'origin/unstable' into make_ee_required
 2024-11-01 06:06:53 +00:00
Jimmy Chen
11260585d7 Pin kurtosis-cli version (#6555) 
* Test old version of kurtosis.
 2024-10-31 07:35:53 +00:00
João Oliveira
7105442840 Remove manual poll of the libp2p Swarm (#6550) 
* remove manual poll for libp2p Swarm,

use tokio::select! instead
 2024-10-30 11:26:26 +00:00
Age Manning
8d7b3ddac7 Correct gossipsub mesh and connected peer inconsistencies (#6244) 
* Handle gossipsub promises gracefully

* Apply a forgotten patch which sync the fanout with unsubscriptions

* Merge remote-tracking branch 'network/unstable' into supress-invalid-gossipsub-error

* Update beacon_node/lighthouse_network/gossipsub/src/behaviour.rs

Co-authored-by: João Oliveira <hello@jxs.pt>

* Add changelog entry

* Merge latest unstable

* Merge branch 'unstable' into supress-invalid-gossipsub-error

* Merge branch 'unstable' into supress-invalid-gossipsub-error
 2024-10-30 05:31:28 +00:00
João Oliveira
48aa35313c lower ListenerError log level (#6544) 
* lower log level of ListenerError
 2024-10-29 05:26:06 +00:00