Lion - dapplion
f35213ebe7
Sync active request byrange ids logs ( #6914 )
...
- Re-opened PR from https://github.com/sigp/lighthouse/pull/6869
Writing and running tests I noted that the sync RPC requests are very verbose now.
`DataColumnsByRootRequestId { id: 123, requester: Custody(CustodyId { requester: CustodyRequester(SingleLookupReqId { req_id: 121, lookup_id: 101 }) }) }`
Since this Id is logged rather often I believe there's value in
1. Making them more succinct for log verbosity
2. Make them a string that's easy to copy and work with elastic
Write custom `Display` implementations to render Ids in a more DX format
_ DataColumnsByRootRequestId with a block lookup_
```
123/Custody/121/Lookup/101
```
_DataColumnsByRangeRequestId_
```
123/122/RangeSync/0/5492900659401505034
```
- This one will be shorter after https://github.com/sigp/lighthouse/pull/6868
Also made the logs format and text consistent across all methods
2025-02-10 01:27:05 +00:00
Eitan Seri-Levi
afdda83798
Enable Light Client server by default ( #6950 )
2025-02-10 01:27:03 +00:00
Lion - dapplion
2193f6a4d4
Add individual by_range sync requests ( #6497 )
...
Part of
- https://github.com/sigp/lighthouse/issues/6258
To address PeerDAS sync issues we need to make individual by_range requests within a batch retriable. We should adopt the same pattern for lookup sync where each request (block/blobs/columns) is tracked individually within a "meta" request that group them all and handles retry logic.
- Building on https://github.com/sigp/lighthouse/pull/6398
second step is to add individual request accumulators for `blocks_by_range`, `blobs_by_range`, and `data_columns_by_range`. This will allow each request to progress independently and be retried separately.
Most of the logic is just piping, excuse the large diff. This PR does not change the logic of how requests are handled or retried. This will be done in a future PR changing the logic of `RangeBlockComponentsRequest`.
### Before
- Sync manager receives block with `SyncRequestId::RangeBlockAndBlobs`
- Insert block into `SyncNetworkContext::range_block_components_requests`
- (If received stream terminators of all requests)
- Return `Vec<RpcBlock>`, and insert into `range_sync`
### Now
- Sync manager receives block with `SyncRequestId::RangeBlockAndBlobs`
- Insert block into `SyncNetworkContext:: blocks_by_range_requests`
- (If received stream terminator of this request)
- Return `Vec<SignedBlock>`, and insert into `SyncNetworkContext::components_by_range_requests `
- (If received a result for all requests)
- Return `Vec<RpcBlock>`, and insert into `range_sync`
2025-02-05 07:08:28 +00:00
Lion - dapplion
55d1e754b4
Subscribe to PeerDAS topics on Fulu fork ( #6849 )
...
`TODO(das)` now that PeerDAS is scheduled in a hard fork we can subscribe to its topics on the fork activation. In current stable we subscribe to PeerDAS topics as soon as the node starts if PeerDAS is scheduled.
This PR adds another todo to unsubscribe to blob topics at the fork. This other PR included solution for that, but I can include it in a separate PR
- https://github.com/sigp/lighthouse/pull/5899/files
Include PeerDAS topics as part of Fulu fork in `fork_core_topics`.
2025-02-03 06:07:39 +00:00
João Oliveira
ddb845d503
update libp2p to 0.55 ( #6889 )
...
Updates libp2p to `0.55`.
Will address the deprecations in a subsequent PR
2025-01-31 12:21:06 +00:00
Jimmy Chen
70194dfc6a
Implement PeerDAS Fulu fork activation ( #6795 )
...
Addresses #6706
This PR activates PeerDAS at the Fulu fork epoch instead of `EIP_7594_FORK_EPOCH`. This means we no longer support testing PeerDAS with Deneb / Electrs, as it's now part of a hard fork.
2025-01-30 07:01:34 +00:00
Pawan Dhananjay
4a07c08c4f
Fork aware max values in rpc ( #6847 )
...
N/A
In https://github.com/sigp/lighthouse/pull/6329 we changed `max_blobs_per_block` from a preset to a config value.
We weren't using the right value based on fork in that PR. This is a follow up PR to use the fork dependent values.
In the proces, I also updated other places where we weren't using fork dependent values from the ChainSpec.
Note to reviewer: easier to go through by commit
2025-01-29 19:42:13 +00:00
Pawan Dhananjay
e7ea69647a
More gossipsub metrics ( #6873 )
...
N/A
Add metrics that tell us if a duplicate message that we received was from a mesh peer or from a non mesh peer that we requested with iwant message.
2025-01-29 19:42:10 +00:00
JKinc
33c1648022
Add EIP-7636 support ( #6793 )
...
* Add eip7636 support
* Add `version()` to the `lighthouse_version` crate and make the `enr.rs` file use it.
* Hardcode version, Add `client_name()`, remove unneeded flag.
* Make it use the new function.
* Make cargo fmt zip it
2025-01-21 00:24:14 +00:00
Eitan Seri-Levi
06329ec2d1
SingleAttestation implementation (#6488 )
...
* First pass
* Add restrictions to RuntimeVariableList api
* Use empty_uninitialized and fix warnings
* Fix some todos
* Merge branch 'unstable' into max-blobs-preset
* Fix take impl on RuntimeFixedList
* cleanup
* Fix test compilations
* Fix some more tests
* Fix test from unstable
* Merge branch 'unstable' into max-blobs-preset
* SingleAttestation
* Add post attestation v2 endpoint logic to attestation service
* Merge branch 'unstable' of https://github.com/sigp/lighthouse into single_attestation
* Implement "Bugfix and more withdrawal tests"
* Implement "Add missed exit checks to consolidation processing"
* Implement "Update initial earliest_exit_epoch calculation"
* Implement "Limit consolidating balance by validator.effective_balance"
* Implement "Use 16-bit random value in validator filter"
* Implement "Do not change creds type on consolidation"
* some tests and fixed attestqtion calc
* Merge branch 'unstable' of https://github.com/sigp/lighthouse into single_attestation
* Rename PendingPartialWithdraw index field to validator_index
* Skip slots to get test to pass and add TODO
* Implement "Synchronously check all transactions to have non-zero length"
* Merge remote-tracking branch 'origin/unstable' into max-blobs-preset
* Remove footgun function
* Minor simplifications
* Move from preset to config
* Fix typo
* Revert "Remove footgun function"
This reverts commit de01f923c7https://github.com/sigp/lighthouse into single_attestation
* Added more test coverage, simplified Attestation conversion, and other minor refactors
* Removed unusued codepaths
* Fix failing test
* Implement "Remove post-altair `initialize_beacon_state_from_eth1` from specs"
* Update preset YAML
* Remove empty RuntimeVarList awefullness
* Make max_blobs_per_block a config parameter (#6329 )
Squashed commit of the following:
commit 04b3743ec1michael@sigmaprime.io >
Date: Mon Jan 6 17:36:58 2025 +1100
Add test
commit 440e854199michael@sigmaprime.io >
Date: Mon Jan 6 17:24:50 2025 +1100
Move RuntimeFixedVector into module and rename
commit f66e179a40michael@sigmaprime.io >
Date: Mon Jan 6 17:17:17 2025 +1100
Fix release tests
commit e4bfe71cd1michael@sigmaprime.io >
Date: Mon Jan 6 17:05:30 2025 +1100
Thread through ChainSpec
commit 063b79c16amichael@sigmaprime.io >
Date: Mon Jan 6 15:32:16 2025 +1100
Try fixing tests
commit 88bedf09bcmichael@sigmaprime.io >
Date: Mon Jan 6 15:04:37 2025 +1100
Revert "Remove footgun function"
This reverts commit de01f923c732483d385bmichael@sigmaprime.io >
Date: Mon Jan 6 15:04:32 2025 +1100
Fix typo
commit 2e86585b47michael@sigmaprime.io >
Date: Mon Jan 6 15:04:15 2025 +1100
Move from preset to config
commit 1095d60a40michael@sigmaprime.io >
Date: Mon Jan 6 14:38:40 2025 +1100
Minor simplifications
commit de01f923c7michael@sigmaprime.io >
Date: Mon Jan 6 14:06:57 2025 +1100
Remove footgun function
commit 0c2c8c422421ecb58fff51a292f7michael@sigmaprime.io >
Date: Mon Jan 6 14:02:50 2025 +1100
Merge remote-tracking branch 'origin/unstable' into max-blobs-preset
commit f51a292f77107140945+dknopik@users.noreply.github.com >
Date: Fri Jan 3 20:27:21 2025 +0100
fully lint only explicitly to avoid unnecessary rebuilds (#6753 )
* fully lint only explicitly to avoid unnecessary rebuilds
commit 7e0cddef32sora.akatsuki@gmail.com >
Date: Tue Dec 24 10:38:56 2024 +0900
Make sure we have fanout peers when publish (#6738 )
* Ensure that `fanout_peers` is always non-empty if it's `Some`
commit 21ecb58ff82fcb2935e9aefb5539pawandhananjay@gmail.com >
Date: Mon Oct 21 14:46:00 2024 -0700
Merge branch 'unstable' into max-blobs-preset
commit 2fcb2935ecpawandhananjay@gmail.com >
Date: Fri Sep 6 18:28:31 2024 -0700
Fix test from unstable
commit 12c6ef118apawandhananjay@gmail.com >
Date: Wed Sep 4 16:16:36 2024 -0700
Fix some more tests
commit d37733b846pawandhananjay@gmail.com >
Date: Wed Sep 4 12:47:36 2024 -0700
Fix test compilations
commit 52bb581e07pawandhananjay@gmail.com >
Date: Tue Sep 3 18:38:19 2024 -0700
cleanup
commit e71020e3e6pawandhananjay@gmail.com >
Date: Tue Sep 3 17:16:10 2024 -0700
Fix take impl on RuntimeFixedList
commit 13f9bba64760100fc6b4e675cf5dpawandhananjay@gmail.com >
Date: Tue Sep 3 16:08:59 2024 -0700
Merge branch 'unstable' into max-blobs-preset
commit 60100fc6bepawandhananjay@gmail.com >
Date: Fri Aug 30 16:04:11 2024 -0700
Fix some todos
commit a9cb329a22pawandhananjay@gmail.com >
Date: Fri Aug 30 15:54:00 2024 -0700
Use empty_uninitialized and fix warnings
commit 4dc6e6515epawandhananjay@gmail.com >
Date: Fri Aug 30 15:53:18 2024 -0700
Add restrictions to RuntimeVariableList api
commit 25feedfde3pawandhananjay@gmail.com >
Date: Thu Aug 29 16:11:19 2024 -0700
First pass
* Fix tests
* Implement max_blobs_per_block_electra
* Fix config issues
* Simplify BlobSidecarListFromRoot
* Disable PeerDAS tests
* Cleanup single attestation imports
* Fix some single attestation network plumbing
* Merge remote-tracking branch 'origin/unstable' into max-blobs-preset
* Bump quota to account for new target (6)
* Remove clone
* Fix issue from review
* Try to remove ugliness
* Merge branch 'unstable' into max-blobs-preset
* Merge remote-tracking branch 'origin/unstable' into electra-alpha10
* Merge commit '04b3743ec1e0b650269dd8e58b540c02430d1c0d' into electra-alpha10
* Merge remote-tracking branch 'pawan/max-blobs-preset' into electra-alpha10
* Update tests to v1.5.0-beta.0
* Merge remote-tracking branch 'origin/electra-alpha10' into single_attestation
* Fix some tests
* Cargo fmt
* lint
* fmt
* Resolve merge conflicts
* Merge branch 'electra-alpha10' of https://github.com/sigp/lighthouse into single_attestation
* lint
* Linting
* fmt
* Merge branch 'electra-alpha10' of https://github.com/sigp/lighthouse into single_attestation
* Fmt
* Fix test and add TODO
* Gracefully handle slashed proposers in fork choice tests
* Merge remote-tracking branch 'origin/unstable' into electra-alpha10
* Keep latest changes from max_blobs_per_block PR in codec.rs
* Revert a few more regressions and add a comment
* Merge branch 'electra-alpha10' of https://github.com/sigp/lighthouse into single_attestation
* Disable more DAS tests
* Improve validator monitor test a little
* Make test more robust
* Fix sync test that didn't understand blobs
* Fill out cropped comment
* Merge remote-tracking branch 'origin/electra-alpha10' into single_attestation
* Merge remote-tracking branch 'origin/unstable' into single_attestation
* Merge remote-tracking branch 'origin/unstable' into single_attestation
* Merge branch 'unstable' of https://github.com/sigp/lighthouse into single_attestation
* publish_attestations should accept Either<Attestation,SingleAttestation>
* log an error when failing to convert to SingleAttestation
* Use Cow to avoid clone
* Avoid reconverting to SingleAttestation
* Tweak VC error message
* update comments
* update comments
* pass in single attestation as ref to subnetid calculation method
* Improved API, new error variants and other minor tweaks
* Fix single_attestation event topic boilerplate
* fix sse event failure
* Add single_attestation event topic test coverage
2025-01-16 18:27:08 +00:00
Lion - dapplion
b1a19a8b20
Remove ineffectual block RPC limits post merge ( #6798 )
...
* Remove ineffectual block RPC limits post merge
* Remove more things
2025-01-15 12:43:00 +00:00
Jimmy Chen
e98209d118
Implement PeerDAS subnet decoupling (aka custody groups) ( #6736 )
...
* Implement PeerDAS subnet decoupling (aka custody groups).
* Merge branch 'unstable' into decouple-subnets
* Refactor feature testing for spec tests (#6737 )
Squashed commit of the following:
commit 898d05ee17ffbd25e2b7e0cddef3jchen.tc@gmail.com >
Date: Tue Dec 24 14:41:19 2024 +1100
Merge branch 'unstable' into refactor-ef-tests-features
commit ffbd25e2bejchen.tc@gmail.com >
Date: Tue Dec 24 14:40:38 2024 +1100
Fix `SszStatic` tests for PeerDAS: exclude eip7594 test vectors when testing Electra types.
commit aa593cf35cjchen.tc@gmail.com >
Date: Fri Dec 20 12:08:54 2024 +1100
Refactor spec testing for features and simplify usage.
* Fix build.
* Add input validation and improve arithmetic handling when calculating custody groups.
* Address review comments re code style consistency.
* Merge branch 'unstable' into decouple-subnets
# Conflicts:
# beacon_node/beacon_chain/src/kzg_utils.rs
# beacon_node/beacon_chain/src/observed_data_sidecars.rs
# beacon_node/lighthouse_network/src/discovery/subnet_predicate.rs
# common/eth2_network_config/built_in_network_configs/chiado/config.yaml
# common/eth2_network_config/built_in_network_configs/gnosis/config.yaml
# common/eth2_network_config/built_in_network_configs/holesky/config.yaml
# common/eth2_network_config/built_in_network_configs/mainnet/config.yaml
# common/eth2_network_config/built_in_network_configs/sepolia/config.yaml
# consensus/types/src/chain_spec.rs
* Update consensus/types/src/chain_spec.rs
Co-authored-by: Lion - dapplion <35266934+dapplion@users.noreply.github.com >
* Merge remote-tracking branch 'origin/unstable' into decouple-subnets
* Update error handling.
* Address review comment.
* Merge remote-tracking branch 'origin/unstable' into decouple-subnets
# Conflicts:
# consensus/types/src/chain_spec.rs
* Update PeerDAS spec tests to `1.5.0-beta.0` and fix failing unit tests.
* Merge remote-tracking branch 'origin/unstable' into decouple-subnets
# Conflicts:
# beacon_node/lighthouse_network/src/peer_manager/mod.rs
2025-01-15 07:40:26 +00:00
jking-aus
4fd8e521a4
Use existing peer count metrics loop to check for open_nat toggle ( #6800 )
...
* implement update_nat_open function in network_behaviour for tracking incoming peers below a given threshold count
* implement update_nat_open function in network_behaviour for tracking incoming peers below a given threshold count
* tidy logic and comments
* move logic to existing metrics loop
* revert change to network_behaviour protocol check
* clippy
* clippy matches! macro
* pull nat_open check outside of peercounting loop
* missing close bracket
* make threshold const
2025-01-15 03:53:40 +00:00
Pawan Dhananjay
587c3e2b8c
Implement changes for EIP 7691 ( #6803 )
...
* Add new config options
* Use electra_enabled
2025-01-14 06:22:30 +00:00
Michael Sproul
06e4d22d49
Electra spec changes for v1.5.0-beta.0 ( #6731 )
...
* First pass
* Add restrictions to RuntimeVariableList api
* Use empty_uninitialized and fix warnings
* Fix some todos
* Merge branch 'unstable' into max-blobs-preset
* Fix take impl on RuntimeFixedList
* cleanup
* Fix test compilations
* Fix some more tests
* Fix test from unstable
* Merge branch 'unstable' into max-blobs-preset
* Implement "Bugfix and more withdrawal tests"
* Implement "Add missed exit checks to consolidation processing"
* Implement "Update initial earliest_exit_epoch calculation"
* Implement "Limit consolidating balance by validator.effective_balance"
* Implement "Use 16-bit random value in validator filter"
* Implement "Do not change creds type on consolidation"
* Rename PendingPartialWithdraw index field to validator_index
* Skip slots to get test to pass and add TODO
* Implement "Synchronously check all transactions to have non-zero length"
* Merge remote-tracking branch 'origin/unstable' into max-blobs-preset
* Remove footgun function
* Minor simplifications
* Move from preset to config
* Fix typo
* Revert "Remove footgun function"
This reverts commit de01f923c7#6329 )
Squashed commit of the following:
commit 04b3743ec1michael@sigmaprime.io >
Date: Mon Jan 6 17:36:58 2025 +1100
Add test
commit 440e854199michael@sigmaprime.io >
Date: Mon Jan 6 17:24:50 2025 +1100
Move RuntimeFixedVector into module and rename
commit f66e179a40michael@sigmaprime.io >
Date: Mon Jan 6 17:17:17 2025 +1100
Fix release tests
commit e4bfe71cd1michael@sigmaprime.io >
Date: Mon Jan 6 17:05:30 2025 +1100
Thread through ChainSpec
commit 063b79c16amichael@sigmaprime.io >
Date: Mon Jan 6 15:32:16 2025 +1100
Try fixing tests
commit 88bedf09bcmichael@sigmaprime.io >
Date: Mon Jan 6 15:04:37 2025 +1100
Revert "Remove footgun function"
This reverts commit de01f923c732483d385bmichael@sigmaprime.io >
Date: Mon Jan 6 15:04:32 2025 +1100
Fix typo
commit 2e86585b47michael@sigmaprime.io >
Date: Mon Jan 6 15:04:15 2025 +1100
Move from preset to config
commit 1095d60a40michael@sigmaprime.io >
Date: Mon Jan 6 14:38:40 2025 +1100
Minor simplifications
commit de01f923c7michael@sigmaprime.io >
Date: Mon Jan 6 14:06:57 2025 +1100
Remove footgun function
commit 0c2c8c422421ecb58fff51a292f7michael@sigmaprime.io >
Date: Mon Jan 6 14:02:50 2025 +1100
Merge remote-tracking branch 'origin/unstable' into max-blobs-preset
commit f51a292f77107140945+dknopik@users.noreply.github.com >
Date: Fri Jan 3 20:27:21 2025 +0100
fully lint only explicitly to avoid unnecessary rebuilds (#6753 )
* fully lint only explicitly to avoid unnecessary rebuilds
commit 7e0cddef32sora.akatsuki@gmail.com >
Date: Tue Dec 24 10:38:56 2024 +0900
Make sure we have fanout peers when publish (#6738 )
* Ensure that `fanout_peers` is always non-empty if it's `Some`
commit 21ecb58ff82fcb2935e9aefb5539pawandhananjay@gmail.com >
Date: Mon Oct 21 14:46:00 2024 -0700
Merge branch 'unstable' into max-blobs-preset
commit 2fcb2935ecpawandhananjay@gmail.com >
Date: Fri Sep 6 18:28:31 2024 -0700
Fix test from unstable
commit 12c6ef118apawandhananjay@gmail.com >
Date: Wed Sep 4 16:16:36 2024 -0700
Fix some more tests
commit d37733b846pawandhananjay@gmail.com >
Date: Wed Sep 4 12:47:36 2024 -0700
Fix test compilations
commit 52bb581e07pawandhananjay@gmail.com >
Date: Tue Sep 3 18:38:19 2024 -0700
cleanup
commit e71020e3e6pawandhananjay@gmail.com >
Date: Tue Sep 3 17:16:10 2024 -0700
Fix take impl on RuntimeFixedList
commit 13f9bba64760100fc6b4e675cf5dpawandhananjay@gmail.com >
Date: Tue Sep 3 16:08:59 2024 -0700
Merge branch 'unstable' into max-blobs-preset
commit 60100fc6bepawandhananjay@gmail.com >
Date: Fri Aug 30 16:04:11 2024 -0700
Fix some todos
commit a9cb329a22pawandhananjay@gmail.com >
Date: Fri Aug 30 15:54:00 2024 -0700
Use empty_uninitialized and fix warnings
commit 4dc6e6515epawandhananjay@gmail.com >
Date: Fri Aug 30 15:53:18 2024 -0700
Add restrictions to RuntimeVariableList api
commit 25feedfde3pawandhananjay@gmail.com >
Date: Thu Aug 29 16:11:19 2024 -0700
First pass
* Fix tests
* Implement max_blobs_per_block_electra
* Fix config issues
* Simplify BlobSidecarListFromRoot
* Disable PeerDAS tests
* Merge remote-tracking branch 'origin/unstable' into max-blobs-preset
* Bump quota to account for new target (6)
* Remove clone
* Fix issue from review
* Try to remove ugliness
* Merge branch 'unstable' into max-blobs-preset
* Merge remote-tracking branch 'origin/unstable' into electra-alpha10
* Merge commit '04b3743ec1e0b650269dd8e58b540c02430d1c0d' into electra-alpha10
* Merge remote-tracking branch 'pawan/max-blobs-preset' into electra-alpha10
* Update tests to v1.5.0-beta.0
* Resolve merge conflicts
* Linting
* fmt
* Fix test and add TODO
* Gracefully handle slashed proposers in fork choice tests
* Merge remote-tracking branch 'origin/unstable' into electra-alpha10
* Keep latest changes from max_blobs_per_block PR in codec.rs
* Revert a few more regressions and add a comment
* Disable more DAS tests
* Improve validator monitor test a little
* Make test more robust
* Fix sync test that didn't understand blobs
* Fill out cropped comment
2025-01-13 23:17:00 +00:00
Pawan Dhananjay
05727290fb
Make max_blobs_per_block a config parameter ( #6329 )
...
* First pass
* Add restrictions to RuntimeVariableList api
* Use empty_uninitialized and fix warnings
* Fix some todos
* Merge branch 'unstable' into max-blobs-preset
* Fix take impl on RuntimeFixedList
* cleanup
* Fix test compilations
* Fix some more tests
* Fix test from unstable
* Merge branch 'unstable' into max-blobs-preset
* Merge remote-tracking branch 'origin/unstable' into max-blobs-preset
* Remove footgun function
* Minor simplifications
* Move from preset to config
* Fix typo
* Revert "Remove footgun function"
This reverts commit de01f923c7
2025-01-10 06:34:58 +00:00
Mac L
ecdf2d891f
Add Fulu boilerplate ( #6695 )
...
* Add Fulu boilerplate
* Add more boilerplate
* Change fulu_time to osaka_time
* Merge branch 'unstable' into fulu-boilerplate
* Fix tests
* Merge branch 'unstable' into fulu-boilerplate
* More test fixes
* Apply suggestions
* Remove `get_payload` boilerplate
* Add lightclient fulu types and fix beacon-chain-tests
* Disable Fulu in ef-tests
* Reduce boilerplate for future forks
* Small fixes
* One more fix
* Apply suggestions
* Merge branch 'unstable' into fulu-boilerplate
* Fix lints
2025-01-10 05:25:23 +00:00
Pawan Dhananjay
1f6850fae2
Rust 1.84 lints ( #6781 )
...
* Fix few lints
* Fix remaining lints
* Use fully qualified syntax
2025-01-10 01:13:29 +00:00
Akihito Nakano
7e0cddef32
Make sure we have fanout peers when publish ( #6738 )
...
* Ensure that `fanout_peers` is always non-empty if it's `Some`
2024-12-24 01:38:56 +00:00
Mac L
b2b1faad4e
Enforce alphabetically ordered cargo deps ( #6678 )
...
* Enforce alphabetically ordered cargo deps
* Fix test-suite
* Another CI fix
* Merge branch 'unstable' into cargo-sort
* Fix conflicts
* Merge remote-tracking branch 'origin/unstable' into cargo-sort
2024-12-19 05:46:03 +00:00
Age Manning
1315c94adb
Unsaturate dial negotiation queue ( #6711 )
...
* Unsaturate dial-negotiation count
2024-12-17 20:10:53 +00:00
Daniel Knopik
02cb2d68ff
Enable lints for tests only running optimized ( #6664 )
...
* enable linting optimized-only tests
* fix automatically fixable or obvious lints
* fix suspicious_open_options by removing manual options
* fix `await_holding_lock`s
* avoid failing lint due to now disabled `#[cfg(debug_assertions)]`
* reduce future sizes in tests
* fix accidently flipped assert logic
* restore holding lock for web3signer download
* Merge branch 'unstable' into lint-opt-tests
2024-12-17 00:40:35 +00:00
Akihito Nakano
75d90795be
Remove req_id from CustodyId ( #6589 )
...
* Remove req_id from CustodyId because it's not used
2024-12-16 05:44:06 +00:00
Michael Sproul
a6de0d5e12
Merge remote-tracking branch 'origin/stable' into back-merge-6.0.1
2024-12-16 15:37:52 +11:00
Age Manning
c3a0757ad2
Correct /nat API for libp2p ( #6677 )
...
* Fix nat API
2024-12-15 23:16:53 +00:00
hopinheimer
fec502db9f
Deprecate futures ticker ( #6630 )
...
* deprecate futures-ticker
* Merge branch 'unstable' of github.com:sigp/lighthouse into deprecate-futures-timer
* Merge branch 'unstable' into deprecate-futures-timer
* making the linter happy
* remove unrequired #[allow(unused_imports)]
* fixing minor issues
* merge commit
* minor fix
* clippy changes
2024-12-03 08:56:43 +00:00
Age Manning
770d677a4e
Increase idle connection timeout ( #6604 )
...
* Increase idle connection timeout
* Update beacon_node/lighthouse_network/src/service/mod.rs
Co-authored-by: João Oliveira <hello@jxs.pt >
2024-12-02 01:44:58 +00:00
Pawan Dhananjay
f8e31f6272
Increase rpc rate limits ( #6626 )
...
* Increase rate limits for byrange requests
* Merge branch 'unstable' into reduce-blob-limits
* Update limits
2024-12-01 23:31:10 +00:00
Michael Sproul
fa6c4c02a3
Fix Rust 1.83 Clippy lints ( #6629 )
...
* Fix Rust 1.83 Clippy lints
* Cargo fmt
2024-11-29 02:23:54 +00:00
Eitan Seri-Levi
38f5f665e1
Remove error-chain dependency ( #6628 )
...
* remove error-chain dependency
* rerun CI
* rerun CI
2024-11-28 02:39:50 +00:00
Pawan Dhananjay
6e1945fc5d
Avoid computing rpc_blob_limits multiple times ( #6595 )
...
* Compute blob rpc limits in static block
* Fix min size
* Use MainnetEthSpec in rpc tests
* Revert MainnetEthSpec; add another constant for blob size minimal
2024-11-20 23:04:45 +00:00
Pawan Dhananjay
94311c6516
Add additional metrics for idontwant ( #6578 )
...
* Add additional metrics for idontwant
* Resolve issues from review
* Fix tests
* Don't exceed capacity
* Apply suggestions from code review
Co-authored-by: João Oliveira <hello@jxs.pt >
* Return early on failure
* Add comment
2024-11-20 22:27:13 +00:00
Age Manning
8cebc87d95
Update to latest discovery ( #6486 )
...
* Upgrade discv5 to v0.8
* Rename some logs
* Improve the NAT reporting with new discv5 metrics
* Merge branch 'unstable' into discv5-v8
* Limited Cargo.lock update
* Update yanked futures-* crates
2024-11-18 22:52:23 +00:00
Michael Sproul
9fdd53df56
Hierarchical state diffs ( #5978 )
...
* Start extracting freezer changes for tree-states
* Remove unused config args
* Add comments
* Remove unwraps
* Subjective more clear implementation
* Clean up hdiff
* Update xdelta3
* Tree states archive metrics (#6040 )
* Add store cache size metrics
* Add compress timer metrics
* Add diff apply compute timer metrics
* Add diff buffer cache hit metrics
* Add hdiff buffer load times
* Add blocks replayed metric
* Move metrics to store
* Future proof some metrics
---------
Co-authored-by: Michael Sproul <michael@sigmaprime.io >
* Port and clean up forwards iterator changes
* Add and polish hierarchy-config flag
* Merge remote-tracking branch 'origin/unstable' into tree-states-archive
* Cleaner errors
* Fix beacon_chain test compilation
* Merge remote-tracking branch 'origin/unstable' into tree-states-archive
* Patch a few more freezer block roots
* Fix genesis block root bug
* Fix test failing due to pending updates
* Beacon chain tests passing
* Merge remote-tracking branch 'origin/unstable' into tree-states-archive
* Merge remote-tracking branch 'origin/unstable' into tree-states-archive
* Fix doc lint
* Implement DB schema upgrade for hierarchical state diffs (#6193 )
* DB upgrade
* Add flag
* Delete RestorePointHash
* Update docs
* Update docs
* Implement hierarchical state diffs config migration (#6245 )
* Implement hierarchical state diffs config migration
* Review PR
* Remove TODO
* Set CURRENT_SCHEMA_VERSION correctly
* Fix genesis state loading
* Re-delete some PartialBeaconState stuff
---------
Co-authored-by: Michael Sproul <michael@sigmaprime.io >
* Merge remote-tracking branch 'origin/unstable' into tree-states-archive
* Fix test compilation
* Update schema downgrade test
* Fix tests
* Fix null anchor migration
* Merge remote-tracking branch 'origin/unstable' into tree-states-archive
* Fix tree states upgrade migration (#6328 )
* Towards crash safety
* Fix compilation
* Move cold summaries and state roots to new columns
* Rename StateRoots chunked field
* Update prune states
* Clean hdiff CLI flag and metrics
* Fix "staged reconstruction"
* Merge remote-tracking branch 'origin/unstable' into tree-states-archive
* Fix alloy issues
* Fix staged reconstruction logic
* Prevent weird slot drift
* Remove "allow" flag
* Update CLI help
* Remove FIXME about downgrade
* Merge remote-tracking branch 'origin/unstable' into tree-states-archive
* Remove some unnecessary error variants
* Fix new test
* Tree states archive - review comments and metrics (#6386 )
* Review PR comments and metrics
* Comments
* Add anchor metrics
* drop prev comment
* Update metadata.rs
* Apply suggestions from code review
---------
Co-authored-by: Michael Sproul <micsproul@gmail.com >
* Update beacon_node/store/src/hot_cold_store.rs
Co-authored-by: Lion - dapplion <35266934+dapplion@users.noreply.github.com >
* Merge remote-tracking branch 'origin/unstable' into tree-states-archive
* Clarify comment and remove anchor_slot garbage
* Simplify database anchor (#6397 )
* Simplify database anchor
* Update beacon_node/store/src/reconstruct.rs
* Add migration for anchor
* Fix and simplify light_client store tests
* Fix incompatible config test
* Merge remote-tracking branch 'origin/unstable' into tree-states-archive
* Merge remote-tracking branch 'origin/unstable' into tree-states-archive
* More metrics
* Merge remote-tracking branch 'origin/unstable' into tree-states-archive
* New historic state cache (#6475 )
* New historic state cache
* Add more metrics
* State cache hit rate metrics
* Fix store metrics
* More logs and metrics
* Fix logger
* Ensure cached states have built caches :O
* Replay blocks in preference to diffing
* Two separate caches
* Distribute cache build time to next slot
* Re-plumb historic-state-cache flag
* Clean up metrics
* Update book
* Update beacon_node/store/src/hdiff.rs
Co-authored-by: Lion - dapplion <35266934+dapplion@users.noreply.github.com >
* Update beacon_node/store/src/historic_state_cache.rs
Co-authored-by: Lion - dapplion <35266934+dapplion@users.noreply.github.com >
---------
Co-authored-by: Lion - dapplion <35266934+dapplion@users.noreply.github.com >
* Update database docs
* Update diagram
* Merge remote-tracking branch 'origin/unstable' into tree-states-archive
* Update lockbud to work with bindgen/etc
* Correct pkg name for Debian
* Remove vestigial epochs_per_state_diff
* Merge remote-tracking branch 'origin/unstable' into tree-states-archive
* Markdown lint
* Merge remote-tracking branch 'origin/unstable' into tree-states-archive
* Address Jimmy's review comments
* Simplify ReplayFrom case
* Fix and document genesis_state_root
* Typo
Co-authored-by: Jimmy Chen <jchen.tc@gmail.com >
* Merge branch 'unstable' into tree-states-archive
* Compute diff of validators list manually (#6556 )
* Split hdiff computation
* Dedicated logic for historical roots and summaries
* Benchmark against real states
* Mutated source?
* Version the hdiff
* Add lighthouse DB config for hierarchy exponents
* Tidy up hierarchy exponents flag
* Apply suggestions from code review
Co-authored-by: Michael Sproul <micsproul@gmail.com >
* Address PR review
* Remove hardcoded paths in benchmarks
* Delete unused function in benches
* lint
---------
Co-authored-by: Michael Sproul <michael@sigmaprime.io >
* Test hdiff binary format stability (#6585 )
* Merge remote-tracking branch 'origin/unstable' into tree-states-archive
* Add deprecation warning for SPRP
* Update xdelta to get rid of duplicate deps
* Document test
2024-11-18 01:51:44 +00:00
Pawan Dhananjay
9c42b12d06
Fix rpc decoding for blobs by range/root ( #6569 )
...
* Fix rpc decoding for blobs by range/root
2024-11-07 04:59:39 +00:00
Jimmy Chen
6a8d13e8a9
Send IDONTWANT on publish to avoid downloading data we already have ( #6513 )
...
* Send `IDONTWANT` on publish to avoid downloading data we already have.
* Merge branch 'unstable' into send-idontwant-on-publish
* Move broadcast of `IDONTWANT` to after publishing.
2024-11-05 01:00:07 +00:00
João Oliveira
7105442840
Remove manual poll of the libp2p Swarm ( #6550 )
...
* remove manual poll for libp2p Swarm,
use tokio::select! instead
2024-10-30 11:26:26 +00:00
Age Manning
8d7b3ddac7
Correct gossipsub mesh and connected peer inconsistencies ( #6244 )
...
* Handle gossipsub promises gracefully
* Apply a forgotten patch which sync the fanout with unsubscriptions
* Merge remote-tracking branch 'network/unstable' into supress-invalid-gossipsub-error
* Update beacon_node/lighthouse_network/gossipsub/src/behaviour.rs
Co-authored-by: João Oliveira <hello@jxs.pt >
* Add changelog entry
* Merge latest unstable
* Merge branch 'unstable' into supress-invalid-gossipsub-error
* Merge branch 'unstable' into supress-invalid-gossipsub-error
2024-10-30 05:31:28 +00:00
João Oliveira
48aa35313c
lower ListenerError log level ( #6544 )
...
* lower log level of ListenerError
2024-10-29 05:26:06 +00:00
Age Manning
e31ac508d4
Modularize tracing executor and metrics rename ( #6424 )
...
* Tracing executor and metrics rename
* Appease clippy
* Merge branch 'unstable' into modularise-task-executor
2024-10-28 09:41:45 +00:00
Akihito Nakano
40d3423193
RequestType::max_responses for LightClientUpdatesByRange ( #6534 )
...
* return the actual number of instances the request requires
2024-10-22 23:47:18 +00:00
Michael Sproul
9aefb5539b
Fix BlobsByRange by reverting PR6462 ( #6526 )
...
* Revert "Remove generic E from RequestId (#6462 )"
This reverts commit 772929fae2
2024-10-21 12:42:51 +00:00
Eitan Seri-Levi
d1fda938a3
Light client updates by range RPC ( #6383 )
...
* enable lc update over rpc
* resolve TODOs
* resolve merge conflicts
* move max light client updates to eth spec
* Merge branch 'unstable' of https://github.com/sigp/lighthouse into light-client-updates-by-range-rpc
* remove ethspec dependency
* Update beacon_node/network/src/network_beacon_processor/rpc_methods.rs
Co-authored-by: Michael Sproul <micsproul@gmail.com >
* Update beacon_node/lighthouse_network/src/rpc/methods.rs
Co-authored-by: Michael Sproul <micsproul@gmail.com >
2024-10-18 02:50:51 +00:00
Lion - dapplion
a074e9eb33
Generalize sync ActiveRequests ( #6398 )
...
* Generalize sync ActiveRequests
* Remove impossible to hit test
* Update beacon_node/lighthouse_network/src/service/api_types.rs
Co-authored-by: realbigsean <sean@sigmaprime.io >
* Update beacon_node/network/src/sync/network_context.rs
Co-authored-by: realbigsean <sean@sigmaprime.io >
* Update beacon_node/network/src/sync/network_context.rs
Co-authored-by: realbigsean <sean@sigmaprime.io >
* Simplify match
* Fix display
* Merge remote-tracking branch 'sigp/unstable' into sync-active-request-generalize
* Sampling requests should not expect all responses
* Merge remote-tracking branch 'sigp/unstable' into sync-active-request-generalize
* Fix sampling_batch_requests_not_enough_responses_returned test
* Merge remote-tracking branch 'sigp/unstable' into sync-active-request-generalize
* Merge branch 'unstable' of https://github.com/sigp/lighthouse into sync-active-request-generalize
2024-10-17 18:14:13 +00:00
hopinheimer
606a113cff
IDONTWANT message optimisation to cutoff for smaller messages ( #6456 )
...
* idontwant message opitmising
* requested changes and linter appeasing
* added the config cli flag
* Merge branch 'unstable' into fix/idontwant-optimise
* cli docs generated
* const declaration
* Hide extra technical cli flag
* passing ci
* Merge branch 'unstable' into fix/idontwant-optimise
2024-10-17 08:27:56 +00:00
João Oliveira
772929fae2
Remove generic E from RequestId ( #6462 )
...
* remove Ethspec from types where it's possible to do so
* remove generic E from RequestType
2024-10-16 23:05:59 +00:00
João Oliveira
17711b720e
Remove duplicated connection limits checks ( #6156 )
...
* move main Behaviour to mod.rs for better readibility
and remove connection limits checks after connection has been established,
as those checks have already been done by connection limits Behaviour.
* improve logging wording wrt dial logic
when we call dial_peer we are not yet dialing but just adding the peer to the dial queue
* do not use a constant for MAX_CONNECTIONS_PER_PEER
we only use it at one place, and the function call is explicit.
* address review and re-instate connection limits checks,
but do it before the connection has been established.
* Merge branch 'unstable' of github.com:sigp/lighthouse into remove-dial-error-denied
* Merge branch 'unstable' of github.com:sigp/lighthouse into remove-dial-error-denied
2024-10-11 16:33:49 +00:00
Jimmy Chen
f3a5e256da
Implement Subnet Sampling for PeerDAS ( #6410 )
...
* Add `SAMPLES_PER_SLOT` config.
* Rename `sampling` module to `peer_sampling`
* Implement subnet sampling.
* Update lookup test.
* Merge branch 'unstable' into subnet-sampling
* Merge branch 'unstable' into subnet-sampling
# Conflicts:
# beacon_node/beacon_chain/src/data_availability_checker.rs
# beacon_node/http_api/src/publish_blocks.rs
# beacon_node/lighthouse_network/src/types/globals.rs
# beacon_node/network/src/sync/manager.rs
* Merge branch 'unstable' into subnet-sampling
2024-10-04 00:27:30 +00:00
Eitan Seri-Levi
82faf975b3
Add {fork_name}_enabled functions ( #5951 )
...
* add fork_name_enabled fn to Forkname impl
* refactor codebase to use new fork_enabled fn
* fmt
* Merge branch 'unstable' of https://github.com/sigp/lighthouse into fork-ord-impl
* small code cleanup
* resolve merge conflicts
* fix beacon chain test
* merge conflicts
* fix ef test issue
* resolve merge conflicts
2024-10-03 02:00:52 +00:00
João Oliveira
4a62b2418c
estimate the total inbound bandwidth of IDONTWANT messages in bytes ( #6438 )
...
* estimate the total inbound bandwidth of IDONTWANT messages
2024-10-01 02:13:51 +00:00
