Pawan Dhananjay
05727290fb
Make max_blobs_per_block a config parameter ( #6329 )
...
* First pass
* Add restrictions to RuntimeVariableList api
* Use empty_uninitialized and fix warnings
* Fix some todos
* Merge branch 'unstable' into max-blobs-preset
* Fix take impl on RuntimeFixedList
* cleanup
* Fix test compilations
* Fix some more tests
* Fix test from unstable
* Merge branch 'unstable' into max-blobs-preset
* Merge remote-tracking branch 'origin/unstable' into max-blobs-preset
* Remove footgun function
* Minor simplifications
* Move from preset to config
* Fix typo
* Revert "Remove footgun function"
This reverts commit de01f923c7
2025-01-10 06:34:58 +00:00
Mac L
ecdf2d891f
Add Fulu boilerplate ( #6695 )
...
* Add Fulu boilerplate
* Add more boilerplate
* Change fulu_time to osaka_time
* Merge branch 'unstable' into fulu-boilerplate
* Fix tests
* Merge branch 'unstable' into fulu-boilerplate
* More test fixes
* Apply suggestions
* Remove `get_payload` boilerplate
* Add lightclient fulu types and fix beacon-chain-tests
* Disable Fulu in ef-tests
* Reduce boilerplate for future forks
* Small fixes
* One more fix
* Apply suggestions
* Merge branch 'unstable' into fulu-boilerplate
* Fix lints
2025-01-10 05:25:23 +00:00
Pawan Dhananjay
1f6850fae2
Rust 1.84 lints ( #6781 )
...
* Fix few lints
* Fix remaining lints
* Use fully qualified syntax
2025-01-10 01:13:29 +00:00
Akihito Nakano
7e0cddef32
Make sure we have fanout peers when publish ( #6738 )
...
* Ensure that `fanout_peers` is always non-empty if it's `Some`
2024-12-24 01:38:56 +00:00
Mac L
b2b1faad4e
Enforce alphabetically ordered cargo deps ( #6678 )
...
* Enforce alphabetically ordered cargo deps
* Fix test-suite
* Another CI fix
* Merge branch 'unstable' into cargo-sort
* Fix conflicts
* Merge remote-tracking branch 'origin/unstable' into cargo-sort
2024-12-19 05:46:03 +00:00
Age Manning
1315c94adb
Unsaturate dial negotiation queue ( #6711 )
...
* Unsaturate dial-negotiation count
2024-12-17 20:10:53 +00:00
Daniel Knopik
02cb2d68ff
Enable lints for tests only running optimized ( #6664 )
...
* enable linting optimized-only tests
* fix automatically fixable or obvious lints
* fix suspicious_open_options by removing manual options
* fix `await_holding_lock`s
* avoid failing lint due to now disabled `#[cfg(debug_assertions)]`
* reduce future sizes in tests
* fix accidently flipped assert logic
* restore holding lock for web3signer download
* Merge branch 'unstable' into lint-opt-tests
2024-12-17 00:40:35 +00:00
Akihito Nakano
75d90795be
Remove req_id from CustodyId ( #6589 )
...
* Remove req_id from CustodyId because it's not used
2024-12-16 05:44:06 +00:00
Michael Sproul
a6de0d5e12
Merge remote-tracking branch 'origin/stable' into back-merge-6.0.1
2024-12-16 15:37:52 +11:00
Age Manning
c3a0757ad2
Correct /nat API for libp2p ( #6677 )
...
* Fix nat API
2024-12-15 23:16:53 +00:00
hopinheimer
fec502db9f
Deprecate futures ticker ( #6630 )
...
* deprecate futures-ticker
* Merge branch 'unstable' of github.com:sigp/lighthouse into deprecate-futures-timer
* Merge branch 'unstable' into deprecate-futures-timer
* making the linter happy
* remove unrequired #[allow(unused_imports)]
* fixing minor issues
* merge commit
* minor fix
* clippy changes
2024-12-03 08:56:43 +00:00
Age Manning
770d677a4e
Increase idle connection timeout ( #6604 )
...
* Increase idle connection timeout
* Update beacon_node/lighthouse_network/src/service/mod.rs
Co-authored-by: João Oliveira <hello@jxs.pt >
2024-12-02 01:44:58 +00:00
Pawan Dhananjay
f8e31f6272
Increase rpc rate limits ( #6626 )
...
* Increase rate limits for byrange requests
* Merge branch 'unstable' into reduce-blob-limits
* Update limits
2024-12-01 23:31:10 +00:00
Michael Sproul
fa6c4c02a3
Fix Rust 1.83 Clippy lints ( #6629 )
...
* Fix Rust 1.83 Clippy lints
* Cargo fmt
2024-11-29 02:23:54 +00:00
Eitan Seri-Levi
38f5f665e1
Remove error-chain dependency ( #6628 )
...
* remove error-chain dependency
* rerun CI
* rerun CI
2024-11-28 02:39:50 +00:00
Pawan Dhananjay
6e1945fc5d
Avoid computing rpc_blob_limits multiple times ( #6595 )
...
* Compute blob rpc limits in static block
* Fix min size
* Use MainnetEthSpec in rpc tests
* Revert MainnetEthSpec; add another constant for blob size minimal
2024-11-20 23:04:45 +00:00
Pawan Dhananjay
94311c6516
Add additional metrics for idontwant ( #6578 )
...
* Add additional metrics for idontwant
* Resolve issues from review
* Fix tests
* Don't exceed capacity
* Apply suggestions from code review
Co-authored-by: João Oliveira <hello@jxs.pt >
* Return early on failure
* Add comment
2024-11-20 22:27:13 +00:00
Age Manning
8cebc87d95
Update to latest discovery ( #6486 )
...
* Upgrade discv5 to v0.8
* Rename some logs
* Improve the NAT reporting with new discv5 metrics
* Merge branch 'unstable' into discv5-v8
* Limited Cargo.lock update
* Update yanked futures-* crates
2024-11-18 22:52:23 +00:00
Michael Sproul
9fdd53df56
Hierarchical state diffs ( #5978 )
...
* Start extracting freezer changes for tree-states
* Remove unused config args
* Add comments
* Remove unwraps
* Subjective more clear implementation
* Clean up hdiff
* Update xdelta3
* Tree states archive metrics (#6040 )
* Add store cache size metrics
* Add compress timer metrics
* Add diff apply compute timer metrics
* Add diff buffer cache hit metrics
* Add hdiff buffer load times
* Add blocks replayed metric
* Move metrics to store
* Future proof some metrics
---------
Co-authored-by: Michael Sproul <michael@sigmaprime.io >
* Port and clean up forwards iterator changes
* Add and polish hierarchy-config flag
* Merge remote-tracking branch 'origin/unstable' into tree-states-archive
* Cleaner errors
* Fix beacon_chain test compilation
* Merge remote-tracking branch 'origin/unstable' into tree-states-archive
* Patch a few more freezer block roots
* Fix genesis block root bug
* Fix test failing due to pending updates
* Beacon chain tests passing
* Merge remote-tracking branch 'origin/unstable' into tree-states-archive
* Merge remote-tracking branch 'origin/unstable' into tree-states-archive
* Fix doc lint
* Implement DB schema upgrade for hierarchical state diffs (#6193 )
* DB upgrade
* Add flag
* Delete RestorePointHash
* Update docs
* Update docs
* Implement hierarchical state diffs config migration (#6245 )
* Implement hierarchical state diffs config migration
* Review PR
* Remove TODO
* Set CURRENT_SCHEMA_VERSION correctly
* Fix genesis state loading
* Re-delete some PartialBeaconState stuff
---------
Co-authored-by: Michael Sproul <michael@sigmaprime.io >
* Merge remote-tracking branch 'origin/unstable' into tree-states-archive
* Fix test compilation
* Update schema downgrade test
* Fix tests
* Fix null anchor migration
* Merge remote-tracking branch 'origin/unstable' into tree-states-archive
* Fix tree states upgrade migration (#6328 )
* Towards crash safety
* Fix compilation
* Move cold summaries and state roots to new columns
* Rename StateRoots chunked field
* Update prune states
* Clean hdiff CLI flag and metrics
* Fix "staged reconstruction"
* Merge remote-tracking branch 'origin/unstable' into tree-states-archive
* Fix alloy issues
* Fix staged reconstruction logic
* Prevent weird slot drift
* Remove "allow" flag
* Update CLI help
* Remove FIXME about downgrade
* Merge remote-tracking branch 'origin/unstable' into tree-states-archive
* Remove some unnecessary error variants
* Fix new test
* Tree states archive - review comments and metrics (#6386 )
* Review PR comments and metrics
* Comments
* Add anchor metrics
* drop prev comment
* Update metadata.rs
* Apply suggestions from code review
---------
Co-authored-by: Michael Sproul <micsproul@gmail.com >
* Update beacon_node/store/src/hot_cold_store.rs
Co-authored-by: Lion - dapplion <35266934+dapplion@users.noreply.github.com >
* Merge remote-tracking branch 'origin/unstable' into tree-states-archive
* Clarify comment and remove anchor_slot garbage
* Simplify database anchor (#6397 )
* Simplify database anchor
* Update beacon_node/store/src/reconstruct.rs
* Add migration for anchor
* Fix and simplify light_client store tests
* Fix incompatible config test
* Merge remote-tracking branch 'origin/unstable' into tree-states-archive
* Merge remote-tracking branch 'origin/unstable' into tree-states-archive
* More metrics
* Merge remote-tracking branch 'origin/unstable' into tree-states-archive
* New historic state cache (#6475 )
* New historic state cache
* Add more metrics
* State cache hit rate metrics
* Fix store metrics
* More logs and metrics
* Fix logger
* Ensure cached states have built caches :O
* Replay blocks in preference to diffing
* Two separate caches
* Distribute cache build time to next slot
* Re-plumb historic-state-cache flag
* Clean up metrics
* Update book
* Update beacon_node/store/src/hdiff.rs
Co-authored-by: Lion - dapplion <35266934+dapplion@users.noreply.github.com >
* Update beacon_node/store/src/historic_state_cache.rs
Co-authored-by: Lion - dapplion <35266934+dapplion@users.noreply.github.com >
---------
Co-authored-by: Lion - dapplion <35266934+dapplion@users.noreply.github.com >
* Update database docs
* Update diagram
* Merge remote-tracking branch 'origin/unstable' into tree-states-archive
* Update lockbud to work with bindgen/etc
* Correct pkg name for Debian
* Remove vestigial epochs_per_state_diff
* Merge remote-tracking branch 'origin/unstable' into tree-states-archive
* Markdown lint
* Merge remote-tracking branch 'origin/unstable' into tree-states-archive
* Address Jimmy's review comments
* Simplify ReplayFrom case
* Fix and document genesis_state_root
* Typo
Co-authored-by: Jimmy Chen <jchen.tc@gmail.com >
* Merge branch 'unstable' into tree-states-archive
* Compute diff of validators list manually (#6556 )
* Split hdiff computation
* Dedicated logic for historical roots and summaries
* Benchmark against real states
* Mutated source?
* Version the hdiff
* Add lighthouse DB config for hierarchy exponents
* Tidy up hierarchy exponents flag
* Apply suggestions from code review
Co-authored-by: Michael Sproul <micsproul@gmail.com >
* Address PR review
* Remove hardcoded paths in benchmarks
* Delete unused function in benches
* lint
---------
Co-authored-by: Michael Sproul <michael@sigmaprime.io >
* Test hdiff binary format stability (#6585 )
* Merge remote-tracking branch 'origin/unstable' into tree-states-archive
* Add deprecation warning for SPRP
* Update xdelta to get rid of duplicate deps
* Document test
2024-11-18 01:51:44 +00:00
Pawan Dhananjay
9c42b12d06
Fix rpc decoding for blobs by range/root ( #6569 )
...
* Fix rpc decoding for blobs by range/root
2024-11-07 04:59:39 +00:00
Jimmy Chen
6a8d13e8a9
Send IDONTWANT on publish to avoid downloading data we already have ( #6513 )
...
* Send `IDONTWANT` on publish to avoid downloading data we already have.
* Merge branch 'unstable' into send-idontwant-on-publish
* Move broadcast of `IDONTWANT` to after publishing.
2024-11-05 01:00:07 +00:00
João Oliveira
7105442840
Remove manual poll of the libp2p Swarm ( #6550 )
...
* remove manual poll for libp2p Swarm,
use tokio::select! instead
2024-10-30 11:26:26 +00:00
Age Manning
8d7b3ddac7
Correct gossipsub mesh and connected peer inconsistencies ( #6244 )
...
* Handle gossipsub promises gracefully
* Apply a forgotten patch which sync the fanout with unsubscriptions
* Merge remote-tracking branch 'network/unstable' into supress-invalid-gossipsub-error
* Update beacon_node/lighthouse_network/gossipsub/src/behaviour.rs
Co-authored-by: João Oliveira <hello@jxs.pt >
* Add changelog entry
* Merge latest unstable
* Merge branch 'unstable' into supress-invalid-gossipsub-error
* Merge branch 'unstable' into supress-invalid-gossipsub-error
2024-10-30 05:31:28 +00:00
João Oliveira
48aa35313c
lower ListenerError log level ( #6544 )
...
* lower log level of ListenerError
2024-10-29 05:26:06 +00:00
Age Manning
e31ac508d4
Modularize tracing executor and metrics rename ( #6424 )
...
* Tracing executor and metrics rename
* Appease clippy
* Merge branch 'unstable' into modularise-task-executor
2024-10-28 09:41:45 +00:00
Akihito Nakano
40d3423193
RequestType::max_responses for LightClientUpdatesByRange ( #6534 )
...
* return the actual number of instances the request requires
2024-10-22 23:47:18 +00:00
Michael Sproul
9aefb5539b
Fix BlobsByRange by reverting PR6462 ( #6526 )
...
* Revert "Remove generic E from RequestId (#6462 )"
This reverts commit 772929fae2
2024-10-21 12:42:51 +00:00
Eitan Seri-Levi
d1fda938a3
Light client updates by range RPC ( #6383 )
...
* enable lc update over rpc
* resolve TODOs
* resolve merge conflicts
* move max light client updates to eth spec
* Merge branch 'unstable' of https://github.com/sigp/lighthouse into light-client-updates-by-range-rpc
* remove ethspec dependency
* Update beacon_node/network/src/network_beacon_processor/rpc_methods.rs
Co-authored-by: Michael Sproul <micsproul@gmail.com >
* Update beacon_node/lighthouse_network/src/rpc/methods.rs
Co-authored-by: Michael Sproul <micsproul@gmail.com >
2024-10-18 02:50:51 +00:00
Lion - dapplion
a074e9eb33
Generalize sync ActiveRequests ( #6398 )
...
* Generalize sync ActiveRequests
* Remove impossible to hit test
* Update beacon_node/lighthouse_network/src/service/api_types.rs
Co-authored-by: realbigsean <sean@sigmaprime.io >
* Update beacon_node/network/src/sync/network_context.rs
Co-authored-by: realbigsean <sean@sigmaprime.io >
* Update beacon_node/network/src/sync/network_context.rs
Co-authored-by: realbigsean <sean@sigmaprime.io >
* Simplify match
* Fix display
* Merge remote-tracking branch 'sigp/unstable' into sync-active-request-generalize
* Sampling requests should not expect all responses
* Merge remote-tracking branch 'sigp/unstable' into sync-active-request-generalize
* Fix sampling_batch_requests_not_enough_responses_returned test
* Merge remote-tracking branch 'sigp/unstable' into sync-active-request-generalize
* Merge branch 'unstable' of https://github.com/sigp/lighthouse into sync-active-request-generalize
2024-10-17 18:14:13 +00:00
hopinheimer
606a113cff
IDONTWANT message optimisation to cutoff for smaller messages ( #6456 )
...
* idontwant message opitmising
* requested changes and linter appeasing
* added the config cli flag
* Merge branch 'unstable' into fix/idontwant-optimise
* cli docs generated
* const declaration
* Hide extra technical cli flag
* passing ci
* Merge branch 'unstable' into fix/idontwant-optimise
2024-10-17 08:27:56 +00:00
João Oliveira
772929fae2
Remove generic E from RequestId ( #6462 )
...
* remove Ethspec from types where it's possible to do so
* remove generic E from RequestType
2024-10-16 23:05:59 +00:00
João Oliveira
17711b720e
Remove duplicated connection limits checks ( #6156 )
...
* move main Behaviour to mod.rs for better readibility
and remove connection limits checks after connection has been established,
as those checks have already been done by connection limits Behaviour.
* improve logging wording wrt dial logic
when we call dial_peer we are not yet dialing but just adding the peer to the dial queue
* do not use a constant for MAX_CONNECTIONS_PER_PEER
we only use it at one place, and the function call is explicit.
* address review and re-instate connection limits checks,
but do it before the connection has been established.
* Merge branch 'unstable' of github.com:sigp/lighthouse into remove-dial-error-denied
* Merge branch 'unstable' of github.com:sigp/lighthouse into remove-dial-error-denied
2024-10-11 16:33:49 +00:00
Jimmy Chen
f3a5e256da
Implement Subnet Sampling for PeerDAS ( #6410 )
...
* Add `SAMPLES_PER_SLOT` config.
* Rename `sampling` module to `peer_sampling`
* Implement subnet sampling.
* Update lookup test.
* Merge branch 'unstable' into subnet-sampling
* Merge branch 'unstable' into subnet-sampling
# Conflicts:
# beacon_node/beacon_chain/src/data_availability_checker.rs
# beacon_node/http_api/src/publish_blocks.rs
# beacon_node/lighthouse_network/src/types/globals.rs
# beacon_node/network/src/sync/manager.rs
* Merge branch 'unstable' into subnet-sampling
2024-10-04 00:27:30 +00:00
Eitan Seri-Levi
82faf975b3
Add {fork_name}_enabled functions ( #5951 )
...
* add fork_name_enabled fn to Forkname impl
* refactor codebase to use new fork_enabled fn
* fmt
* Merge branch 'unstable' of https://github.com/sigp/lighthouse into fork-ord-impl
* small code cleanup
* resolve merge conflicts
* fix beacon chain test
* merge conflicts
* fix ef test issue
* resolve merge conflicts
2024-10-03 02:00:52 +00:00
João Oliveira
4a62b2418c
estimate the total inbound bandwidth of IDONTWANT messages in bytes ( #6438 )
...
* estimate the total inbound bandwidth of IDONTWANT messages
2024-10-01 02:13:51 +00:00
João Oliveira
82098e1ef7
add a unique integer id to Rpc requests ( #6444 )
...
* add id to rpc requests
* rename rpc request and response types for more accurate meaning
* remove unrequired build_request function
* remove unirequired Request wrapper types and unify Outbound and Inbound Request
* add RequestId to NetworkMessage::SendResponse
,NetworkMessage::SendErrorResponse to be passed to Rpc::send_response
2024-10-01 01:36:17 +00:00
João Oliveira
5d1ff7c6f8
fix Rpc Ping sequence number ( #6408 )
...
* fix Rpc Ping sequence number
* bubble up Outbound Err's and Responses even if the peer disconnected
* send pings via Rpc from main network
* add comment to connected check
* Merge branch 'unstable' into fix-ping-seq-number
2024-09-26 14:52:03 +00:00
João Oliveira
50d8375d46
Remove Score Ord, PartialOrd, Eq and PartialEq impls ( #6420 )
...
* drop score Ord, PartialOrd, Eq and PartialEq impls
and impl total_cmp instead
* Revert "Fix test failure on Rust v1.81 (#6407 )"
This reverts commit 8a085fc828
2024-09-25 13:45:35 +00:00
Michael Sproul
1447eeb40b
Improve single-node testnet support and Arc NetworkConfig/ChainSpec ( #6396 )
...
* Arc ChainSpec and NetworkConfig
* Fix release tests
* Fix lint
* Merge remote-tracking branch 'origin/unstable' into single-node-testnet
2024-09-24 00:16:18 +00:00
Age Manning
a97d77c147
Correct ENR decoding on extension trait ( #6402 )
...
* Correct enr extension encodings
* Clippy my ol friend
* Correct all encoding and comparisons
* Found some more encodings
* Fix remaining tests
2024-09-20 12:14:57 +00:00
Eitan Seri-Levi
8a085fc828
Fix test failure on Rust v1.81 ( #6407 )
...
* generate rand f64 instead of arbitrary to prevent NaN vals
* reintroduce quickcheck arbitrary but prevet NaN
2024-09-19 03:12:25 +00:00
João Oliveira
2f6ad34795
Improve rpc logic ( #6400 )
...
* update rpc imports to be explicit
* avoid exposing HandlerEvent outside RPC
it's unnecessary.
* handle Pongs at RPC handler level
2024-09-17 06:12:21 +00:00
Akihito Nakano
351dd6cb80
Set custody subnets on tests ( #6382 )
...
* Set custody subnets on tests
* Enable sampling_with_retries test
* Add another supernode to ensure the node can retry
2024-09-12 06:29:26 +00:00
Age Manning
e5a40fb73b
Upgrade to discv5 0.7.0 ( #6385 )
...
* Upgrade to discv5 v0.7.0
2024-09-12 00:26:20 +00:00
João Oliveira
873748d2c3
simplify rpc codec logic ( #6304 )
...
* simplify rpc codec logic
* Merge branch 'unstable' of github.com:sigp/lighthouse into simplify-rpc-codec
* Merge branch 'unstable' of github.com:sigp/lighthouse into simplify-rpc-codec
* Merge branch 'unstable' of github.com:sigp/lighthouse into simply-rpc-codec
* Merge branch 'unstable' into simplify-rpc-codec
* Merge branch 'unstable' into simplify-rpc-codec
2024-09-06 09:42:34 +00:00
Jimmy Chen
c0b4f01cf3
Improve get_custody_columns validation, caching and error handling ( #6308 )
...
* Improve `get_custody_columns` validation, caching and error handling.
* Merge branch 'unstable' into get-custody-columns-error-handing
* Fix failing test and add more test.
* Fix failing test and add more test.
* Merge branch 'unstable' into get-custody-columns-error-handing
# Conflicts:
# beacon_node/lighthouse_network/src/discovery/subnet_predicate.rs
# beacon_node/lighthouse_network/src/peer_manager/peerdb.rs
# beacon_node/lighthouse_network/src/peer_manager/peerdb/peer_info.rs
# beacon_node/lighthouse_network/src/types/globals.rs
# beacon_node/network/src/service.rs
# consensus/types/src/data_column_subnet_id.rs
* Add unit test to make sure the default specs won't panic on the `compute_custody_requirement_subnets` function.
* Add condition when calling `compute_custody_subnets_from_metadata` and update logs.
* Validate `csc` when returning from enr. Remove `csc` computation on connection since we get them on metadata anyway.
* Add `peers_per_custody_subnet_count` to track peer csc and supernodes.
* Disconnect peers with invalid metadata and find other peers instead.
* Fix sampling tests.
* Merge branch 'unstable' into get-custody-columns-error-handing
* Merge branch 'unstable' into get-custody-columns-error-handing
2024-09-06 07:39:16 +00:00
Age Manning
df19b6220a
Remove beta tag from gossipsub 1.2 ( #6344 )
...
* Remove the beta tag from gossipsub v1.2
* fix clippy
* Merge branch 'unstable' into remove-beta-tag
2024-09-05 16:19:07 +00:00
Pawan Dhananjay
0fb4a2046c
Metadata request ordering ( #6336 )
...
* Send metadata request ordering
* Merge branch 'unstable' into metadata-order
2024-09-05 05:39:03 +00:00
Michael Sproul
672dcbd868
Ignore Rust 1.82 warnings about void patterns ( #6357 )
...
* Ignore Rust 1.82 warnings about void patterns
2024-09-05 02:41:19 +00:00
João Oliveira
a685dde4ad
update libp2p to version 0.54 ( #6249 )
...
* update libp2p to version 0.54.0
* address review
* Merge branch 'unstable' of github.com:sigp/lighthouse into update-libp2p
* Merge branch 'update-libp2p' of github.com:sigp/lighthouse into update-libp2p
2024-09-02 16:52:18 +00:00
