Commit Graph

6413 Commits

Author SHA1 Message Date
Lion - dapplion
d957161740 Drop null_logger (#6013)
* Drop null_logger
2024-08-19 09:21:10 +00:00
Michael Sproul
6faa9c678e Prevent fd leak in random slasher tests (#6254)
* Prevent fd leak in random slasher tests

* Clippy
2024-08-19 09:21:07 +00:00
Eitan Seri-Levi
042915859d add missing fields to get blob sidecars request (#5987)
* add missing fields to get blob sidecars request

* add fork versioned  response impl

* only compute the block root once

* Merge branch 'unstable' of https://github.com/sigp/lighthouse into add-missing-fields-get-blob-sidecars

* Merge branch 'unstable' of https://github.com/sigp/lighthouse into add-missing-fields-get-blob-sidecars

* fetch root first

fetch from cache if its a head block

* fmt

* always load from db
2024-08-19 08:28:45 +00:00
chonghe
b6d15bc299 Make portable the default in Lighthouse book and Makefile, update workflows (#6247)
* Remove portable in book

* Add back modern in docker.md

* Update Makefile

* Update release.yml

* Update docker.yml

* Update book

* Minor revision

* delete portable tarballs

* delete portable in Make command

* Fix link in book

* mdlint

* Remove modernity in docker

* Merge branch 'unstable' into update-book-portable

* Merge branch 'unstable' into update-book-portable

* Remove `-dev` docker images

* Merge remote-tracking branch 'origin/unstable' into update-book-portable
2024-08-19 07:56:33 +00:00
Lion - dapplion
9bc5643319 Add metrics inside fork-choice crate (#6205)
* Add metrics inside fork-choice crate
2024-08-19 07:56:31 +00:00
Lion - dapplion
6566705505 Implement PeerDAS RPC handlers (#6237)
* Implement PeerDAS RPC handlers

* use terminate_response_stream

* Merge branch 'unstable' of https://github.com/sigp/lighthouse into peerdas-network-rpc-handler

* cargo fmt
2024-08-15 21:15:09 +00:00
Lion - dapplion
9fc0a662c3 Add sync lookup custody request state (#6257)
* Add sync lookup custody request state

* Review PR

* clippy

* Merge branch 'unstable' of https://github.com/sigp/lighthouse into peerdas-network-lookup
2024-08-15 16:26:39 +00:00
Lion - dapplion
5169e03721 Add PeerDAS RPC import boilerplate (#6238)
* Add PeerDAS RPC import boilerplate

* revert refactor

* Remove allow
2024-08-15 15:59:58 +00:00
Braqzen
a91f432a3e Add Reth to execution clients suggested for installation (#6172)
* Added Reth among execution clients

* Update book/src/run_a_node.md

Co-authored-by: chonghe <44791194+chong-he@users.noreply.github.com>

* Merge branch 'unstable' into braqzen-6171
2024-08-15 12:36:09 +00:00
Jimmy Chen
18df7010c3 Persist data columns to store (#6255)
* Persist data columns (from das PR #5196)
2024-08-14 04:36:24 +00:00
Michael Sproul
3a996fbbee Merge remote-tracking branch 'origin/stable' into unstable 2024-08-13 11:10:32 +10:00
Pawan Dhananjay
22ccdb6c23 Reuse password option prompts again on a wrong password (#4380)
* Prompt for password if incorrect in import

* lint and fmt

* Use if instead of match

* Fix issue raised by @chong-he

* Merge branch 'unstable' into reuse-pw-break

* Remove unused function
2024-08-13 00:16:21 +00:00
Jimmy Chen
6dc614fede Add PeerDAS KZG lib integration (construction & KZG verification) (#6212)
* Add peerdas KZG library and use it for data column construction and cell kzg verification (#5701, #5941, #6118, #6179)

Co-authored-by: kevaundray <kevtheappdev@gmail.com>

* Update `rust_eth_kzg` crate to published version.

* Update kzg metrics buckets.

* Merge branch 'unstable' into peerdas-kzg

* Update KZG version to fix windows mem allocation.

* Refactor common logic from build sidecar and reconstruction. Remove unnecessary `needless_lifetimes`.

Co-authored-by: realbigsean <sean@sigmaprime.io>

* Copy existing trusted setup into `PeerDASTrustedSetup` for consistency and maintain `--trusted-setup` functionality.

* Merge branch 'unstable' into peerdas-kzg

* Merge branch 'peerdas-kzg' of github.com:jimmygchen/lighthouse into peerdas-kzg

* Merge branch 'unstable' into peerdas-kzg

* Merge branch 'unstable' into peerdas-kzg

* Load PeerDAS KZG only if PeerDAS is enabled.
2024-08-13 00:16:17 +00:00
Lion - dapplion
ff15c78ced Implement data columns by network boilerplate (#6224)
* Implement data columns by network boilerplate

* Use correct quota values

* Address PR review

* Update currently_supported

* Merge remote-tracking branch 'sigp/unstable' into peerdas-network-boilerplate

* PR reviews

* Fix data column rpc request not being sent due to incorrect limits set. (#6000)
2024-08-13 00:16:14 +00:00
Jimmy Chen
f2fdbe7fbe Add plumbing for PeerDAS supernodes (#5050, #5409, #5570, #5966) (#6216)
* Add plumbing for peerdas supernodes (#5050, #5409, #5570, #5966)
- add cli option `--subscribe-to-all-data-columns`
- add custody subnet count to ENR, only if PeerDAS is scheduled
- subscribe to data column topics, only if PeerDAS is scheduled

Co-authored-by: Jacob Kaufmann <jacobkaufmann18@gmail.com>

* Merge branch 'unstable' into das-supernode

* Update CLI docs.

* Merge branch 'unstable' into das-supernode

* Fix fork epoch comparison with `FAR_FUTURE_EPOCH`.

* Merge branch 'unstable' into das-supernode

* Hide `--subscribe-all-data-column-subnets` flag and update help.

* Fix docs only

* Merge branch 'unstable' into das-supernode
2024-08-12 02:31:21 +00:00
Michael Sproul
781c5ecb1f Add lcli command for manual rescue sync (#5458)
* Rescue CLI

* Allow tweaking start block

* More caching

* Merge branch 'unstable' into rescue-cli

# Conflicts:
#	lcli/src/main.rs

* Add `--known–common-ancestor` flag to optimise for download speed.

* Rename rescue command to `http-sync`

* Add logging

* Add optional `--block-cache-dir` cli arg and create directory if it doesn't already exist.

* Lint fix.

* Merge branch 'unstable' into rescue-cli
2024-08-12 02:31:18 +00:00
Eitan Seri-Levi
3913ea44c6 Persist light client updates (#5545)
* persist light client updates

* update beacon chain to serve light client updates

* resolve todos

* cache best update

* extend cache parts

* is better light client update

* resolve merge conflict

* initial api changes

* add lc update db column

* fmt

* added tests

* add sim

* Merge branch 'unstable' of https://github.com/sigp/lighthouse into persist-light-client-updates

* fix some weird issues with the simulator

* tests

* Merge branch 'unstable' of https://github.com/sigp/lighthouse into persist-light-client-updates

* test changes

* merge conflict

* testing

* started work on ef tests and some code clean up

* update tests

* linting

* noop pre altair, were still failing on electra though

* allow for zeroed light client header

* Merge branch 'unstable' of https://github.com/sigp/lighthouse into persist-light-client-updates

* merge unstable

* remove unwraps

* remove unwraps

* Update light_client_update.rs

* merge unstable

* move functionality to helper methods

* refactor is best update fn

* refactor is best update fn

* improve organization of light client server cache logic

* fork diget calc, and only spawn as many blcoks as we need for the lc update test

* fetch lc update from the cache if it exists

* fmt

* Fix beacon_chain tests

* Add debug code to update ranking_order ef test

* Fix compare code

* merge conflicts

* fix test

* Merge branch 'persist-light-client-updates' of https://github.com/eserilev/lighthouse into persist-light-client-updates

* Use blinded blocks for light client proofs

* fix ef test

* merge conflicts

* fix lc update check

* Lint

* resolve merge conflict

* Merge branch 'persist-light-client-updates' of https://github.com/eserilev/lighthouse into persist-light-client-updates

* revert basic sim

* small fix

* revert sim

* Review PR

* resolve merge conflicts

* Merge branch 'unstable' into persist-light-client-updates
2024-08-09 07:36:20 +00:00
João Oliveira
aad8727f52 add missing use std::sync::Lazylock to malloc_utils::glibc (#6234)
* add missing use std::sync::Lazylock
2024-08-08 05:55:47 +00:00
Michael Sproul
d6ba8c3975 Release v5.3.0 (#6194)
* Release v5.3.0
v5.3.0
2024-08-08 02:17:03 +00:00
Michael Sproul
a68f34a014 Broadcast VC requests in parallel and fix subscription error (#6223)
* Broadcast VC requests in parallel

* Remove outdated comment

* Try some things

* Fix subscription error

* Remove junk logging
2024-08-07 23:31:35 +00:00
Michael Sproul
42a1cd81fb Don't expect DAS config in HTTP spec response (#6221)
* Don't expect DAS config in HTTP spec response
2024-08-06 06:11:00 +00:00
Michael Sproul
f126a42b7e Remove double-locking in eth/v1/node/syncing (#6202)
* Remove double-locking in `eth/v1/node/syncing`
2024-08-06 02:32:58 +00:00
Lion - dapplion
f7f0bfc9f2 Skip recursive discovery query if no useful ENRs (#6207)
* Skip recursive discovery query if no useful ENRs
2024-08-06 02:32:56 +00:00
Michael Sproul
612946b273 Downgrade re-org log to INFO (#6220)
* Downgrade re-org log to INFO

* Update book

Co-authored-by: chonghe <44791194+chong-he@users.noreply.github.com>
2024-08-05 11:30:48 +00:00
João Oliveira
05bc99e67b patch quick-protobuf (#6217)
* patch quick-protobuf
2024-08-03 04:49:09 +00:00
Jimmy Chen
acd3151184 Import gossip data column into data availability checker (#6197)
* Import gossip data column into data availability checker
2024-08-02 12:42:11 +00:00
Jimmy Chen
0e96d4f105 Store changes to persist data columns (#6073)
* Store changes to persist data columns.

Co-authored-by: dapplion <35266934+dapplion@users.noreply.github.com>

* Update to use `eip7594_fork_epoch` for data column slot in Store.

* Fix formatting.

* Merge branch 'unstable' into data-columns-store

# Conflicts:
#	beacon_node/store/src/lib.rs
#	consensus/types/src/chain_spec.rs

* Minor refactor.

* Merge branch 'unstable' into data-columns-store

# Conflicts:
#	beacon_node/store/src/metrics.rs

* Init data colum info at PeerDAS epoch instead of Deneb fork epoch. Address review comments.

* Remove Deneb-related comments
2024-08-02 06:58:37 +00:00
Michael Sproul
0bb2386ff5 Work around UB in LMDB bindings (#6211)
* Work around UB in LMDB bindings
2024-08-01 06:46:37 +00:00
João Oliveira
d9f8b13e36 remove no longer required #[allow(clippy::mutable_key_type)] (#6210)
* remove no longer required clippy::mutable_key_type lint
2024-08-01 00:26:26 +00:00
Jimmy Chen
9b3b730159 Avoid acquiring another read lock while holding one to avoid potential deadlock (#6200)
* Avoid acquiring another read lock to avoid potential deadlock.
2024-07-30 13:48:28 +00:00
Michael Sproul
c7ded10870 Use blinded blocks for light client proofs (#6201)
* Use blinded blocks for light client proofs
2024-07-30 13:25:55 +00:00
Age Manning
75e934842e Swap finalized chains based on processed batches (#6203)
* Shift from validated to processed
2024-07-30 05:43:34 +00:00
Jimmy Chen
96b00ef66c Replace lazy_static! with LazyLock (#6189)
* Replace `lazy_static` with `LazyLock`.

* Merge branch 'unstable' into remove-lazy-static

# Conflicts:
#	beacon_node/lighthouse_network/src/peer_manager/mod.rs

* Lint fixes.

* Merge branch 'unstable' into remove-lazy-static

# Conflicts:
#	beacon_node/beacon_chain/src/metrics.rs

* Moar lint fixes.

* Update rust version to 1.80.0.

* Merge branch 'unstable' into remove-lazy-static
2024-07-29 11:42:31 +00:00
Michael Sproul
00038dae81 Update database migration docs for 5.3 (#6195)
* Update database migration docs for 5.3
2024-07-29 05:52:13 +00:00
Jimmy Chen
19b3ab39ee Data column gossip validation and error handling (#6181)
* Add gossip verification and error handling.

* Merge branch 'unstable' into das-gossip-validation

* Add inclusion proof verification and some renames for consistency
2024-07-29 05:52:10 +00:00
Age Manning
a3b1ef3129 Visualisation logging for sync batch states (#6034)
* Add visualization for batch states

* Replace icons with emojis

* Reviewers comments

* Change empty emoji and improve docs comments

* Fix lints

* Move to letters rather than emojis

* Replace 'V' with 'v'. Cargo update

* Merge latest unstable

* Improve docs around visualisation

* Merge branch 'unstable' into sync-batch-state
2024-07-29 05:52:07 +00:00
Michael Sproul
f4ddc45914 Use upgradable read lock for pubkey cache (#6190)
* Use upgradable read for pubkey cache
2024-07-26 05:53:21 +00:00
Eitan Seri-Levi
f60503cd40 default vc to block v3 endpoint and deprecate block-v3 flag (#5292)
* default vc to block v3 endpoint and deprecate block-v3 flag

* kick off ci

* Merge branch 'unstable' of https://github.com/sigp/lighthouse into default-vc-to-block-v3-endpoint

* fix formatting in cli docs

* Merge branch 'unstable' of https://github.com/sigp/lighthouse into default-vc-to-block-v3-endpoint

* Resolve merge conflicts

* resolve conflicts

* merge

* merge

* revert

* retry

* fix

* Merge branch 'unstable' into default-vc-to-block-v3-endpoint

* Merge branch 'unstable' of https://github.com/sigp/lighthouse into default-vc-to-block-v3-endpoint

* fix issues w/ fallback sim
2024-07-26 05:53:18 +00:00
Lion - dapplion
b949db0a8b Remove timeout locks (#6048)
* Remove locks with timeouts

* Readd test

* Update docs

* Merge remote-tracking branch 'origin/unstable' into pk-cache-timeout
2024-07-26 02:01:40 +00:00
João Oliveira
28e3b86bee limit dial concurrency on Swarm (#6184)
* limit dial concurrency on Swarm

* Merge branch 'unstable' into set-dial-concurrency
2024-07-26 01:21:07 +00:00
chonghe
8d175f6779 Fix lighthouse account validator subcommands help text (#6091)
* create

* import, exit and list

* validator the rest

* FIx

* wallet subcommands

* Fix white spaces

* Revert "create"

This reverts commit 2eac633a58.

* Add global

* Merge remote-tracking branch 'origin/unstable' into cli-help
2024-07-26 01:21:05 +00:00
Lion - dapplion
24169b2faa Iterate expired components from the da_checker (#5895)
* Iterate expired components from the da_checker

* Fix rebase
2024-07-25 19:01:16 +00:00
Mac L
cc55e610b9 Rust 1.80.0 lints (#6183)
* Fix lints
2024-07-25 15:56:22 +00:00
Akihito Nakano
62a39af19e Fix unexpected Marking peer disconnected in DHT (#6140)
* Don't disconnect peer in DHT if there's an active connection

* Merge branch 'unstable' into dont-disconnect-if-active-connection
2024-07-25 12:08:59 +00:00
Jimmy Chen
4e5a363a4f Add DataColumnSidecar gossip topic and message handling (#6147)
* Add `DataColumnSidecar` gossip topic and verification (#5050 and #5783).

* Remove gossip verification changes (#5783).

* Merge branch 'unstable' into data-column-gossip

# Conflicts:
#	beacon_node/beacon_chain/src/data_column_verification.rs
#	beacon_node/beacon_chain/src/lib.rs

* Add gossip cache timeout for data columns. Rename data column metrics for consistency.

* Remove usage of `unimplemented!` and address review comments.

* Remove unnused `GossipDataColumnError` variants and address review comments.

* Merge branch 'unstable' into data-column-gossip

* Update Cargo.lock

* Arc `ChainSpec` in discovery to avoid performance regression when needing to clone it repeatedly.
2024-07-25 06:05:18 +00:00
dknopik
a2ab26c327 Use then instead of then_some when checking upnp_enabled to avoid useless UPnP query (#6170)
* Use `then` instead of `then_some` when checking `upnp_enabled` to avoid useless UPnP query
2024-07-25 03:39:02 +00:00
Mac L
a3f44c674b Remove backwards compatibility for el_offline and is_optimstic (#6168)
* Remove Option around is_optimistic and el_offline
2024-07-25 00:10:46 +00:00
dknopik
b4a7560c0e Show correct total validator count during validator recovery (#6153)
* Show correct total count during validator recovery

* Start current recovery count at one

Co-authored-by: chonghe <44791194+chong-he@users.noreply.github.com>
2024-07-25 00:10:43 +00:00
Age Manning
4e8e80b7f4 Update msrv to 1.78.0 (#6159)
* Cargo update and msrv 1.78
2024-07-24 07:23:56 +00:00
Jimmy Chen
b36f77ef75 Revert --image-download always flag to avoid CI getting rate limited (#6163)
* Revert --image-download always flag to avoid CI getting rate limited by Docker Hub
2024-07-24 06:49:12 +00:00