Emilia Hane
00ca21e84c
Make implementation of BlobInfo more coder friendly
2023-02-08 11:44:43 +01:00
Emilia Hane
8f137df02e
fixup! Allow user to set an epoch margin for pruning
2023-02-08 11:44:43 +01:00
Emilia Hane
a2eda76291
Correct comment
2023-02-08 11:44:43 +01:00
Emilia Hane
9ee9b6df76
Remove unused stuff
2023-02-08 11:44:42 +01:00
Emilia Hane
6dff69bde9
Atomically update blob info with pruned blobs
2023-02-08 11:44:42 +01:00
Emilia Hane
5d2480c762
Improve naming
2023-02-08 11:44:42 +01:00
Emilia Hane
43c3c74a48
fixup! Fix blobs store bug
2023-02-08 11:44:41 +01:00
Emilia Hane
c50f83116e
Fix wording
...
Co-authored-by: Michael Sproul <micsproul@gmail.com >
2023-02-08 11:44:41 +01:00
Emilia Hane
4de523fb75
fixup! Allow user to set an epoch margin for pruning
2023-02-08 11:44:40 +01:00
Emilia Hane
1812301c9c
Allow user to set an epoch margin for pruning
2023-02-08 11:44:40 +01:00
Emilia Hane
d7fc24a9d5
Plug in running blob pruning in migrator, related bug fixes and add todos
2023-02-08 11:44:40 +01:00
Emilia Hane
a875bec5f2
Fix blobs store bug
2023-02-08 11:44:39 +01:00
Emilia Hane
3bede06c9b
Fix typo
2023-02-08 11:44:38 +01:00
Emilia Hane
54699f808c
fixup! Clarify hybrid blob prune solution and fix error handling
2023-02-08 11:44:38 +01:00
Emilia Hane
83a9520761
Clarify hybrid blob prune solution and fix error handling
2023-02-08 11:44:38 +01:00
Emilia Hane
3d93dad0e2
Fix type bug
...
Co-authored-by: realbigsean <seananderson33@GMAIL.com >
2023-02-08 11:44:37 +01:00
Emilia Hane
44ec331452
fixup! Simplify conceptual design
2023-02-08 11:44:37 +01:00
Emilia Hane
20567750c1
fixup! Simplify conceptual design
2023-02-08 11:44:37 +01:00
Emilia Hane
7103a257ce
Simplify conceptual design
2023-02-08 11:44:37 +01:00
Emilia Hane
0d13932663
Fix epoch constructor misconception
2023-02-08 11:44:37 +01:00
Emilia Hane
b5abfe620a
Convert epochs_per_blob_prune to Epoch once
2023-02-08 11:44:36 +01:00
Emilia Hane
d58a30b3de
fixup! Store orphan block roots
2023-02-08 11:44:36 +01:00
Emilia Hane
6346c30158
Enable skipping blob pruning at each epoch
2023-02-08 11:44:35 +01:00
Emilia Hane
8752deeced
Store orphan block roots
2023-02-08 11:44:35 +01:00
Emilia Hane
94aa2cef67
Log info loaded from disk
2023-02-08 11:44:34 +01:00
Emilia Hane
a2b8c6ee69
Save fetching state for blobs pruning
2023-02-08 11:44:33 +01:00
Emilia Hane
6f5ca02ac9
Improve syntax
...
Co-authored-by: Michael Sproul <micsproul@gmail.com >
2023-02-08 11:44:33 +01:00
Emilia Hane
667cca5cf2
Fix try_prune_blobs to use state root
2023-02-08 11:44:33 +01:00
Emilia Hane
d67468d737
Prune blobs on migration in addition to start-up
2023-02-08 11:44:32 +01:00
Emilia Hane
ce2db355de
Fix rebase conflict
2023-02-08 11:44:32 +01:00
Emilia Hane
a211e6afee
Fix rebase conflict
2023-02-08 11:44:31 +01:00
Emilia Hane
d3b94d8617
fixup! Prune blobs before data availability breakpoint
2023-02-08 11:44:31 +01:00
Emilia Hane
934f3ab587
Remove inaccurate guess for db index
2023-02-08 11:44:31 +01:00
Emilia Hane
d21c66ddf4
fixup! Plug in pruning of blobs into app
2023-02-08 11:44:31 +01:00
Emilia Hane
b88d888145
fixup! Plug in pruning of blobs into app
2023-02-08 11:44:30 +01:00
Emilia Hane
2a41f25d68
fixup! Prune blobs before data availability breakpoint
2023-02-08 11:44:30 +01:00
Emilia Hane
7bf88c2336
Prune blobs before data availability breakpoint
2023-02-08 11:44:30 +01:00
Emilia Hane
e2a6da4274
Boiler plate code for blobs pruning
2023-02-08 11:44:20 +01:00
realbigsean
438126f19a
merge upstream, fix compile errors
2023-01-11 13:52:58 -05:00
realbigsean
98b11bbd3f
add historical summaries ( #3865 )
...
* add historical summaries
* fix tree hash caching, disable the sanity slots test with fake crypto
* add ssz static HistoricalSummary
* only store historical summaries after capella
* Teach `UpdatePattern` about Capella
* Tidy EF tests
* Clippy
Co-authored-by: Michael Sproul <michael@sigmaprime.io >
2023-01-11 12:40:21 +11:00
realbigsean
33d01a7911
miscelaneous fixes on syncing, rpc and responding to peer's sync related requests ( #3827 )
...
- there was a bug in responding range blob requests where we would incorrectly label the first slot of an epoch as a non-skipped slot if it were skipped. this bug did not exist in the code for responding to block range request because the logic error was mitigated by defensive coding elsewhere
- there was a bug where a block received during range sync without a corresponding blob (and vice versa) was incorrectly interpreted as a stream termination
- RPC size limit fixes.
- Our blob cache was dead locking so I removed use of it for now.
- Because of our change in finalized sync batch size from 2 to 1 and our transition to using exact epoch boundaries for batches (rather than one slot past the epoch boundary), we need to sync finalized sync to 2 epochs + 1 slot past our peer's finalized slot in order to finalize the chain locally.
- use fork context bytes in rpc methods on both the server and client side
2022-12-21 15:50:51 -05:00
realbigsean
6c8b1b323b
merge upstream
2022-12-07 12:27:21 -05:00
ethDreamer
5282e200be
Merge 'upstream/unstable' into capella ( #3773 )
...
* Add API endpoint to count statuses of all validators (#3756 )
* Delete DB schema migrations for v11 and earlier (#3761 )
Co-authored-by: Mac L <mjladson@pm.me >
Co-authored-by: Michael Sproul <michael@sigmaprime.io >
2022-12-03 14:05:25 -06:00
realbigsean
8102a01085
merge with upstream
2022-12-01 11:13:07 -05:00
ethDreamer
342489a0c3
Fixed Payload Deserialization in DB ( #3758 )
2022-11-30 10:27:13 +11:00
realbigsean
e962e80bb4
fix compile errors
2022-11-28 12:16:45 -05:00
realbigsean
92cae14409
add blob info
2022-11-28 11:26:46 -05:00
Michael Sproul
0cdd049da9
Fixes to make EF Capella tests pass ( #3719 )
...
* Fixes to make EF Capella tests pass
* Clippy for state_processing
2022-11-14 13:14:31 -06:00
Pawan Dhananjay
29f2ec46d3
Couple blocks and blobs in gossip ( #3670 )
...
* Revert "Add more gossip verification conditions"
This reverts commit 1430b561c3 .
* Revert "Add todos"
This reverts commit 91efb9d4c7 .
* Revert "Reprocess blob sidecar messages"
This reverts commit 21bf3d37cd .
* Add the coupled topic
* Decode SignedBeaconBlockAndBlobsSidecar correctly
* Process Block and Blobs in beacon processor
* Remove extra blob publishing logic from vc
* Remove blob signing in vc
* Ugly hack to compile
2022-11-01 10:28:21 -04:00
ethDreamer
221c433d62
Fixed a ton of state_processing stuff ( #3642 )
...
FIXME's:
* consensus/fork_choice/src/fork_choice.rs
* consensus/state_processing/src/per_epoch_processing/capella.rs
* consensus/types/src/execution_payload_header.rs
TODO's:
* consensus/state_processing/src/per_epoch_processing/capella/partial_withdrawals.rs
* consensus/state_processing/src/per_epoch_processing/capella/full_withdrawals.rs
2022-10-14 17:35:10 -05:00