* update dashboards

* cargo fmt --all

* Update deployments/rialto/dashboard/prometheus/prometheus.yml

Co-authored-by: Tomasz Drwięga <[email protected]>

Co-authored-by: Tomasz Drwięga <[email protected]>

* auto exchange tx relay dashboard

* cargo fmt --all

* single metrics startup fn

* make receipts part of tx proof

* is_successful_raw_receipt_with_empty_data

* cargo fmt --all

* clippy

* fix everything

* Correctly resolve project in Dockerfile entrypoint

* Improve instruction for running local Docker containers

* Rename bridge entrypoint script

* Add Instance type parameter to pallet

* Sketch out what the runtime could look like

* Allow runtime to compile with multiple bridge pallets

* Cargo Fmt

* Allow an instance of a PoA chain to be used with currency-exchange

I specify that it's only _an instance_ instead of _instances_ since the currency-exchange
pallet does not support multiple instances itself. What this commit does is make it so
that the different instances of the PoA chains we currently have are compatible with the
currency-exchange pallet through the implementation of the PeerBlockchain trait.

* Add Instance type parameter to Currency Exchange pallet

* Wire up currency exchange intances in runtime

* Rust Fmt

* Show sccache

* Allow Eth pallet to use a default instance

* Use a default instance in Eth pallet tests

* Remove Rialto and Kovan feature flags

Through some discussions it has been decided that the `bridge-node` should, like
Substrate's `node-template`, be a showcase of the different pallets available in
a project. Because of this I've removed the feature flags for the Rialto and Kovan
networks in favour of having both of them included in the runtime.

* Update the chain_spec to use both Rialto and Kovan configs

* Update pallet level calls used by Substrate client

Allows the project to compile. However, it should be noted that in reality
we shouldn't be hardcoding the pallet we're calling.

* Allow currency-exchange pallet to use a default instance

* Support benchmarking an instance of the Eth pallet

* Update currency exchange benchmarks to work with instances

* Fix test helpers which now need a PoA instance

* Remove Actions for checking Rialto and Kovan features

* Add missing comments

* Update Runtime API string constants

* Add issue number for generic chain support in relay

* Add Runtime APIs for instances of the currency-exchange pallet

* Rust Fmt

Co-authored-by: Denis S. Soldatov aka General-Beck <[email protected]>

* Expose grafana & prometheus.

* Add grafana notifications.

* Don't expose prometheus, add brucke.link

* Add block difference graph.

* Fix dashboard.

* Add matrix notifications.

* Change the channel.

* Relay healthcheck (#228)

* Add Relay healthcheck.

* Use built-in healthcheck.

* Update to full URL.

* Fix URL and increase timeout.

* Fix default.

* show sccache

Co-authored-by: Denis S. Soldatov aka General-Beck <[email protected]>

* Disable alerts on no data.

* Tune external URL.

* Reduce scraping.

* Update access token during update.

* Add notification if there is no source blocks.

Co-authored-by: Denis S. Soldatov aka General-Beck <[email protected]>

* auto relay exchange transactions

* docker + auto-relay-tx

* clippy

* jsonrpsee in Cargo.lock ???

* fix tests compilation

* Show sccache

* mute clippy

* move

* Update relays/ethereum/src/exchange.rs

Co-authored-by: Hernando Castano <[email protected]>

* finish comment

* (bool, String) -> StringifiedMaybeConnectionError

* Update deployments/rialto/docker-compose.yml

Co-authored-by: Hernando Castano <[email protected]>

Co-authored-by: Denis S. Soldatov aka General-Beck <[email protected]>
Co-authored-by: Hernando Castano <[email protected]>

* Speed up build by splitting it into two steps.

* Faster re-builds of images.

* Re-build images with latest hash.

* fetch before checkout.

* Add Relay healthcheck.

* Use built-in healthcheck.

* Update to full URL.

* Fix URL and increase timeout.

* Fix default.

* show sccache

Co-authored-by: Denis S. Soldatov aka General-Beck <[email protected]>

* Add Prometheus and Grafana to Docker Compose

* Expose relay's Prometheus metrics port

* Use Docker network references intead of localhost

When you have containers on the same network they don't communicate
over localhost, they instead refer to their container names

* Move dashboard components into deployment folder

* Update folder structure for Grafana and Prometheus config files

The new folder structure more closely matches the expected defaults
by Grafana and Prometheus, which allows us to clean up the paths
in our docker-compose file a bit.

* Add documentation about Prometheus and Grafana

* Refer to Prometheus server instead of node

* Fix clippy errors.

* Cargo fmt.

* Enable clippy checks.

* Create if does not exist.

* Fix warnings and enable sccache for clippy.

* chmod +x

* Revert and ignore errors.

* Update cancel-workflow-action.

* Fixes.

* Clippy fixes.

* Fix compilation.

* Fix new clippy warnings.

* fmt --all

* Fix the rest.

* fmt --all

* Conditional.

* Bump smallvec.

* Use separate cache dir for clippy to prevent races.

* Remove unused imports in tests

* Remove "useless conversion"

* Move clippy to main worfklow to avoid clashes.

* Fix clippy error.

* Fix remaning clippy errors.

* cargo fmt --all

Co-authored-by: Hernando Castano <[email protected]>

* expose metrics for Prometheus

* added preconfigured configs for Prometheus and Grafana

* metrics-related cli args

* fix compilation

* Dockerfile for OpenEth.

* Add relayer dockerfile.

* Add docker-compose.

* Working on the relay.

* Bump a bunch of deps.

* Change relay branch.

* Running a 3-validators poa network.

* Add bridge nodes.

* Conditional compilation of bridge configs.

* Fix genesis hash.

* Disable features build.

* Disable empty steps.

* Work on sub2eth

* Add some logs.

* More logs.

* Fix compilation.

* Add chain-id parameter to relay.

* Unify bridge-hash.

* Update the hash.

* Ditch sub2eth for now.

* Add some docs & proxy configuration.

* Fixes.

* Fix remaining issues.

* Increase health timeout.

* Make sure to install curl for health monitoring.

* Fix kovan.

* Fix build.

* Create if does not exist.

* Fix benches.

* Revert CLI params requirements.

* cargo fmt --all

* Apply suggestions from code review

Co-authored-by: Hernando Castano <[email protected]>

* Add some docs.

* Update BRIDGE_HASH to master

* Duplicate compose file.

* Rename testpoa to Rialto.

* Fix borked merge.

* Fix entrypoints to take arguments.

Co-authored-by: Hernando Castano <[email protected]>

* [WIP] Fix cleanup cache 3

* check sccache idle

* check cache

* remove sccache stats

* Revert "[WIP] Fix cleanup cache (#190)"

This reverts commit f2d29ced.

* move Cleanup stage to merged.yml

* Fix cleanup cache

* echo github.env

* Cleanup always

* exchange benchmarks: framework

* updated comment about tx size

Co-authored-by: Tomasz Drwięga <[email protected]>

* fixed best_ethereum_block() params encoding

* updated versions

* relay exchange transaction(s)

* fixed Ethereum::get_block_by_hash

* added exchange trace

* fixed method name

* update for new web3

* svyatonik/rust-web3 -> tomusdrw/rust-web3

* if let Some() -> .expect()

* extracted loops in separate functions

* use yaml references (TIL)

* get eth header with transactions

* cargo fmt --all

* Update primitives/ethereum-poa/src/lib.rs

Co-authored-by: Hernando Castano <[email protected]>

* Update relays/ethereum/src/ethereum_exchange.rs

Co-authored-by: Hernando Castano <[email protected]>

* Update relays/ethereum/src/rpc_errors.rs

Co-authored-by: Hernando Castano <[email protected]>

* Update relays/ethereum/src/exchange.rs

Co-authored-by: Hernando Castano <[email protected]>

* removed comment

* Update relays/ethereum/src/ethereum_exchange.rs

Co-authored-by: Hernando Castano <[email protected]>

* Update relays/ethereum/src/ethereum_exchange.rs

Co-authored-by: Hernando Castano <[email protected]>

* module-level comments

* updated readme

* use web3 from crates.io

* added missing fields info in error description

* cargo fmt --all

Co-authored-by: Hernando Castano <[email protected]>

* basic sync loop tests

* cargo ftm --all

* SyncLoopTestParams

* move sync loop tests to sync_loop_tests.rs

* cargo fmt --all

* If the cache is missing, copy it from the master

* make target dir

* cp -> rsync

* install rsync

* disable verbose out from rsync

* rsync --info=progress2

* rsync quiet

* add cleanup stage

* cleanup

* todo for rsync

* Run fmt on stable.

* remove toolchain

in the case of stable there is no need to explicitly specify the toolchain

* Run fmt on gh-actions runners.

* run on github runner

Co-authored-by: Denis S. Soldatov aka General-Beck <[email protected]>

* Cancel Workflow Action

* check cancel and remove cpu option

* Clean up build a little.

* Create if does not exist.

* Remove clippy for now cause it's super slow.

* Create if does not exist.

* Remove less maintenance friendly deny.

* Run always on PRs.

* Create if does not exist.

* Add cargo deny

* deny - master

* Copy deny.toml to .

* cargo deny check

* upload artifacts

* install cargo deny

* typo

* up install cargo deny

* update archive

* typo

* path's

* allow failure cargo deny

* allew failure log

* cargo deny init

* Build stage

* rm deny from build PR

* lint

* Use correct name for Ethereum bridge node crate

* add clippy to test

* clippy -nightly

* add release

* Style stage

* add doc-book

* disable doc

* add cache to clippy

* test macos & windows build

* cargo clean

* move build stage after test, add nightly
remove windows and macos targets

* remove install steps

* move check style to rust.yml

* cache fixes

* Test needs check

* clippy -> nightly toolchain

* build needs test

* clippy -- -D warnings

* disable needs test for build

* latest build before rest
fix runs-on in build section

* whitespace

* atrtifacts list

* enable self-hosted

* remove target/sccache

* global env

* check self-hosted

* test cache on selfhosted

* all-in one stage

* lint

* new cache

* check new cache

* disable cache

* add docker volume

* lint

* fix yml

* fix volumes

* change target dir

* switch volumes path

* echo refs

* change mount point

* head ref to cargo home

* add CARGO_TARGET_DIR

* fix artifact path

* path

* $CARGO_TARGET_DIR/

* test 2

* test 3

* test 4

* update deny

* test 5

* deny

* remove deny actions

* move clippy to new workflow, only nightly check

* rename lint workflow

* Update .github/workflows/rust.yml

Co-authored-by: Hernando Castano <[email protected]>

* Update .github/workflows/lint.yml

Co-authored-by: Hernando Castano <[email protected]>

* Update .github/workflows/rust.yml

Co-authored-by: Hernando Castano <[email protected]>

* Update .github/workflows/rust.yml

Co-authored-by: Hernando Castano <[email protected]>

* rustfmt in every job
nightly build -> weekly

* check nightly Rus and clean cache

* check nightly Rus and clean cache 2

* check nightly Rus and clean cache 3

* check nightly Rus and clean cache 4

* check nightly Rus and clean cache 5

* Split clippy and fmt

* Run build only on master.

* Don't fail if nightly file does not exist.

Co-authored-by: Hernando Castano <[email protected]>
Co-authored-by: Hernando Castano <[email protected]>
Co-authored-by: Tomasz Drwięga <[email protected]>

* Bump Substrate to rc4

* Add BaseCallFilter type

* Add DenyUnsafe to SystemApi extension

* Use new ServiceBuilder build functions

* Add BaseCallFilter to test runtimes

* Remove old comments

* Add `rev` and `git` fields back

Turns out that if you don't have these future release candidates will
be used if available. For instance, once `rc5` is released a fresh pull
would use that instead of `rc4` which is what we want.

* Use tag release instead of specific commit

Will make scripted updates easier in the future

* Add short script to update between `rc` versions

* Update scripts/update_rc.sh

Co-authored-by: Tomasz Drwięga <[email protected]>

* Add skeleton for worst case import_unsigned_header

* Fix a typo

* Add benchmark test for best case unsigned header import

* Add finality verification to worst case bench

* Move `insert_header()` from mock to test_utils

Allows the benchmarking code to use this without having to pull it in from the mock.

* Add a rough bench to test a finalizing a "long" chain

* Try to use complexity parameter for finality bench

* Improve long finality bench

* Remove stray dot file

* Remove old "worst" case bench

* Scribble some ideas down for pruning bench

* Prune headers during benchmarking

* Clean up some comments

* Make finality bench work for entire range of complexity parameter

* Place initialization code into a function

* Add bench for block finalization with caching

* First attempt at bench with receipts

* Try and trigger validator set change

* Perform a validator set change during benchmarking

* Move `validators_change_receipt()` to shared location

Allows unit tests and benchmarks to access the same helper function
and const

* Extract a test receipt root into a constant

* Clean up description of pruning bench

* Fix cache and pruning tests

* Remove unecessary `build_custom_header` usage

* Get rid of warnings

* Remove code duplication comment

I don't think its entirely worth it to split out so few lines of code.
The benches aren't particularly hard to read anyways.

* Increase the range of the complexity parameter

* Use dynamic number of receipts while benchmarking

As part of this change we have removed the hardcoded TEST_RECEIPT_ROOT
and instead chose to calculate the receipt root on the fly. This will
make tests and benches less fragile.

* Prune a dynamic number of headers