Jimmy Chen ee7fca3ebd Refactor data column reconstruction and avoid blocking processing (#6403) ...

* Move reconstruction logic out of `overflow_lru_cache` to simplify the code and avoids having to pass `DataColumnsToPublish` around and blocking other processing.

* Publish reconstructed cells before recomputing head. Remove duplicate functions.

* Merge branch 'unstable' into non-blocking-reconstruction

* Merge branch 'unstable' into non-blocking-reconstruction

# Conflicts:
#	beacon_node/beacon_chain/src/beacon_chain.rs
#	beacon_node/beacon_chain/src/data_availability_checker.rs
#	beacon_node/beacon_chain/src/data_availability_checker/overflow_lru_cache.rs
#	beacon_node/network/src/network_beacon_processor/sync_methods.rs

* Spawn a blocking task for reconstruction.

* Merge branch 'unstable' into non-blocking-reconstruction

# Conflicts:
#	beacon_node/network/src/network_beacon_processor/mod.rs

* Fix fmt

* Merge branch 'unstable' into non-blocking-reconstruction

# Conflicts:
#	beacon_node/beacon_chain/src/data_availability_checker/overflow_lru_cache.rs

* Fix race condition by making check and mutation atomic as suggested by Lion. Also added error handling to reconstruction failure.

* Add reconstruction reason metric and more debug logging to da checker.

* Add comment and logging.

* Rename `NotRequired` to `NotStarted`.

* Remove extra character added.

2024-10-17 04:56:25 +00:00

..

attestation_verification

Remove timeout locks (#6048)

2024-07-26 02:01:40 +00:00

data_availability_checker

Refactor data column reconstruction and avoid blocking processing (#6403)

2024-10-17 04:56:25 +00:00

schema_change

Migrate from ethereum-types to alloy-primitives (#6078)

2024-09-02 08:03:24 +00:00

attestation_rewards.rs

Fix phase0 block reward in rewards API (#5101)

2024-09-17 06:45:02 +00:00

attestation_simulator.rs

Electra: Remaining Consensus Data Structures (#5712)

2024-06-24 21:08:07 +00:00

attestation_verification.rs

Add {fork_name}_enabled functions (#5951)

2024-10-03 02:00:52 +00:00

attester_cache.rs

Migrate from ethereum-types to alloy-primitives (#6078)

2024-09-02 08:03:24 +00:00

beacon_block_reward.rs

Fix phase0 block reward in rewards API (#5101)

2024-09-17 06:45:02 +00:00

beacon_block_streamer.rs

Electra updates for v1.5.0-alpha.6 (#6445)

2024-10-15 17:38:43 +00:00

beacon_chain.rs

Refactor data column reconstruction and avoid blocking processing (#6403)

2024-10-17 04:56:25 +00:00

beacon_fork_choice_store.rs

Migrate from ethereum-types to alloy-primitives (#6078)

2024-09-02 08:03:24 +00:00

beacon_proposer_cache.rs

In-memory tree states (#5533)

2024-04-24 01:22:36 +00:00

beacon_snapshot.rs

In-memory tree states (#5533)

2024-04-24 01:22:36 +00:00

bellatrix_readiness.rs

Delete legacy payload reconstruction (#6213)

2024-09-06 08:10:55 +00:00

blob_verification.rs

Make BeaconChain::kzg field mandatory (#6267)

2024-09-23 04:54:32 +00:00

block_reward.rs

Electra: Remaining Consensus Data Structures (#5712)

2024-06-24 21:08:07 +00:00

block_times_cache.rs

Migrate from ethereum-types to alloy-primitives (#6078)

2024-09-02 08:03:24 +00:00

block_verification_types.rs

Lenient duplicate checks on HTTP API for block publication (#5574)

2024-09-24 04:52:44 +00:00

block_verification.rs

Lenient duplicate checks on HTTP API for block publication (#5574)

2024-09-24 04:52:44 +00:00

builder.rs

Refactor data column reconstruction and avoid blocking processing (#6403)

2024-10-17 04:56:25 +00:00

canonical_head.rs

Add time metrics to aquire fork-choice lock (#6204)

2024-08-20 02:03:43 +00:00

capella_readiness.rs

Rename Merge to Bellatrix (#5601)

2024-04-25 20:19:41 +00:00

chain_config.rs

PeerDAS implementation (#5683)

2024-08-27 04:10:22 +00:00

data_availability_checker.rs

Refactor data column reconstruction and avoid blocking processing (#6403)

2024-10-17 04:56:25 +00:00

data_column_verification.rs

Refactor data column reconstruction and avoid blocking processing (#6403)

2024-10-17 04:56:25 +00:00

deneb_readiness.rs

Rename Merge to Bellatrix (#5601)

2024-04-25 20:19:41 +00:00

early_attester_cache.rs

Import gossip data column into data availability checker (#6197)

2024-08-02 12:42:11 +00:00

electra_readiness.rs

Electra engine api (#5743)

2024-07-01 16:33:55 +00:00

errors.rs

Electra updates for v1.5.0-alpha.6 (#6445)

2024-10-15 17:38:43 +00:00

eth1_chain.rs

Improve single-node testnet support and Arc NetworkConfig/ChainSpec (#6396)

2024-09-24 00:16:18 +00:00

eth1_finalization_cache.rs

Address Clippy 1.73 lints on Deneb branch (#4810)

2023-10-06 12:23:57 +05:30

events.rs

Add block_gossip Beacon API events (#5864)

2024-07-16 04:39:55 +00:00

execution_payload.rs

Drop block data from BlockError and BlobError (#5735)

2024-09-03 01:07:07 +00:00

fork_choice_signal.rs

Clippy 1.67 (#3916)

2023-01-27 09:48:42 +00:00

fork_revert.rs

In-memory tree states (#5533)

2024-04-24 01:22:36 +00:00

graffiti_calculator.rs

Improve single-node testnet support and Arc NetworkConfig/ChainSpec (#6396)

2024-09-24 00:16:18 +00:00

head_tracker.rs

Migrate from ethereum-types to alloy-primitives (#6078)

2024-09-02 08:03:24 +00:00

historical_blocks.rs

Implement Subnet Sampling for PeerDAS (#6410)

2024-10-04 00:27:30 +00:00

kzg_utils.rs

Make BeaconChain::kzg field mandatory (#6267)

2024-09-23 04:54:32 +00:00

lib.rs

Lenient duplicate checks on HTTP API for block publication (#5574)

2024-09-24 04:52:44 +00:00

light_client_finality_update_verification.rs

Add Capella & Deneb light client support (#4946)

2024-03-25 11:01:56 +00:00

light_client_optimistic_update_verification.rs

Add Capella & Deneb light client support (#4946)

2024-03-25 11:01:56 +00:00

light_client_server_cache.rs

Persist light client bootstrap (#5915)

2024-09-10 00:27:49 +00:00

metrics.rs

Refactor data column reconstruction and avoid blocking processing (#6403)

2024-10-17 04:56:25 +00:00

migrate.rs

Persist light client bootstrap (#5915)

2024-09-10 00:27:49 +00:00

naive_aggregation_pool.rs

Migrate from ethereum-types to alloy-primitives (#6078)

2024-09-02 08:03:24 +00:00

observed_aggregates.rs

Migrate from ethereum-types to alloy-primitives (#6078)

2024-09-02 08:03:24 +00:00

observed_attesters.rs

Migrate from ethereum-types to alloy-primitives (#6078)

2024-09-02 08:03:24 +00:00

observed_block_producers.rs

suppress error on duplicate blobs (#4995)

2023-12-18 12:15:12 -05:00

observed_data_sidecars.rs

Improve single-node testnet support and Arc NetworkConfig/ChainSpec (#6396)

2024-09-24 00:16:18 +00:00

observed_operations.rs

Electra: Remaining Consensus Data Structures (#5712)

2024-06-24 21:08:07 +00:00

observed_slashable.rs

create unified slashing cache (#5033)

2024-01-08 10:30:57 -05:00

otb_verification_service.rs

Migrate from ethereum-types to alloy-primitives (#6078)

2024-09-02 08:03:24 +00:00

persisted_beacon_chain.rs

…

persisted_fork_choice.rs

Delete old database schemas (#6051)

2024-07-09 00:24:49 +00:00

pre_finalization_cache.rs

Update dependencies to get rid of the yanked deps (#4994)

2023-12-15 18:31:59 +11:00

proposer_prep_service.rs

Enable proposer boost re-orging (#2860)

2022-12-13 09:57:26 +00:00

schema_change.rs

Delete old database schemas (#6051)

2024-07-09 00:24:49 +00:00

shuffling_cache.rs

Drop null_logger (#6013)

2024-08-19 09:21:10 +00:00

state_advance_timer.rs

Remove timeout locks (#6048)

2024-07-26 02:01:40 +00:00

sync_committee_rewards.rs

In-memory tree states (#5533)

2024-04-24 01:22:36 +00:00

sync_committee_verification.rs

Remove timeout locks (#6048)

2024-07-26 02:01:40 +00:00

test_utils.rs

Transition block lookup sync to range sync (#6122)

2024-10-08 21:18:41 +00:00

validator_monitor.rs

Clarify validator monitor block log (#6342)

2024-09-05 05:39:05 +00:00

validator_pubkey_cache.rs

Improve single-node testnet support and Arc NetworkConfig/ChainSpec (#6396)

2024-09-24 00:16:18 +00:00