add warp_sync_params (#1909)

* wait for relay chain to sync then get parachain header

* Spawn new thread to wait for the target block

* second round of comments from the PR on substrate

* third round of pr comments

* add zombienet tests

* rebase issues

* refactor tests based on pr comments

* rebase issues

* pr comments

* passing zombienet test

* cargo +nightly fmt

* Update client/network/src/lib.rs

Co-authored-by: Bastian Köcher <[email protected]>

* Update client/service/src/lib.rs

Co-authored-by: Bastian Köcher <[email protected]>

* Update client/service/src/lib.rs

Co-authored-by: Bastian Köcher <[email protected]>

* Update client/service/src/lib.rs

Co-authored-by: Bastian Köcher <[email protected]>

* Update client/service/src/lib.rs

Co-authored-by: Bastian Köcher <[email protected]>

* Update client/network/src/lib.rs

Co-authored-by: Bastian Köcher <[email protected]>

* Update client/network/src/lib.rs

Co-authored-by: Bastian Köcher <[email protected]>

* Update client/network/src/lib.rs

Co-authored-by: Bastian Köcher <[email protected]>

* Update client/network/src/lib.rs

Co-authored-by: Bastian Köcher <[email protected]>

* use cargo lock from master

* pr comments

* cargo fmt

* use finalised block instead of best block

* use import notification stream

* rebase changes

* Update client/network/src/lib.rs

Co-authored-by: Bastian Köcher <[email protected]>

* Update client/network/src/lib.rs

Co-authored-by: Bastian Köcher <[email protected]>

* Update client/network/src/lib.rs

Co-authored-by: Bastian Köcher <[email protected]>

* Update client/network/src/lib.rs

Co-authored-by: Bastian Köcher <[email protected]>

* Update client/network/src/lib.rs

Co-authored-by: Bastian Köcher <[email protected]>

* Update client/service/src/lib.rs

Co-authored-by: Bastian Köcher <[email protected]>

* Update client/relay-chain-interface/src/lib.rs

Co-authored-by: Bastian Köcher <[email protected]>

* Update client/relay-chain-interface/src/lib.rs

Co-authored-by: Bastian Köcher <[email protected]>

* pr comments

* use new file names

* db snaphots moved to google cloud storage

* Update client/network/src/lib.rs

Co-authored-by: Bastian Köcher <[email protected]>

* Update client/service/src/lib.rs

Co-authored-by: Bastian Köcher <[email protected]>

* Update client/service/src/lib.rs

Co-authored-by: Bastian Köcher <[email protected]>

* Update client/service/src/lib.rs

Co-authored-by: Bastian Köcher <[email protected]>

* Update client/service/src/lib.rs

Co-authored-by: Bastian Köcher <[email protected]>

* Update client/service/src/lib.rs

Co-authored-by: Bastian Köcher <[email protected]>

* Update client/service/src/lib.rs

Co-authored-by: Bastian Köcher <[email protected]>

* Update client/service/src/lib.rs

Co-authored-by: Bastian Köcher <[email protected]>

* Update client/service/src/lib.rs

Co-authored-by: Bastian Köcher <[email protected]>

* Update client/service/src/lib.rs

Co-authored-by: Sebastian Kunert <[email protected]>

* pr comments

* Update zombienet/tests/0007-full_node_warp_sync.toml

Co-authored-by: Sebastian Kunert <[email protected]>

* Update zombienet/tests/0007-full_node_warp_sync.toml

Co-authored-by: Sebastian Kunert <[email protected]>

* Scenario 1

Parachain node and in-node relay chain both start with --sync warp. This ensures that the waiting logic works as expected.

Scenario 2
Parachain node starts with warp sync, relay chain points to a node already synced up

scenario 3
Parachain node starts with warp sync, relay chain points to a node that uses warp sync

* Use test-parachain

* use test-parachain chainspecs

* remove relay chain spec as it is no longer required

* add back relaychain spec file

* pr comments

* Upload snapshots to google cloud

* Update zombienet/tests/0007-prepare-warp-sync-db-snapshot.md

Co-authored-by: Sebastian Kunert <[email protected]>

* update documentation

* Fix snapshot URLs

* use master lock file

* add finalized_block_hash

* Patch diener for CI

* Bump Zombienet

* Add 0007 zombienet test

* Bump zombienet

* Revert "Patch diener for CI"

This reverts commit 9ece6c9fc9b17058b61cd7e9dee29d3a9af87841.

* merge fixes

* use master lock file

* Update Substrate & Polkadot

---------

Co-authored-by: Bastian Köcher <[email protected]>
Co-authored-by: Michal Kucharczyk <[email protected]>
Co-authored-by: Sebastian Kunert <[email protected]>
Co-authored-by: Bastian Köcher <[email protected]>