When testing `zombienet-sdk` with cross-chain calls with Asset Hub, we
found that the hrmp channels passed to the chainspec caused the
following issue:

`Error: "Invalid JSON blob: invalid type: map, expected a tuple of size
4 at line 1 column 2794"`

This is because the values of `HrmpChannelConfig` serialise to a map
instead of a tuple, as expected by
https://github.com/paritytech/polkadot-sdk/blob/fc906d5d0fb7796ef54ba670101cf37b0aad6794/polkadot/runtime/parachains/src/hrmp.rs#L492.
Tests were updated accordingly to facilitate this fix.

Additional commits were also added to enable some of Asset Hub on
Polkadot functionality observed in the classic Zombienet repo, so that
we are able to launch a local Polkadot network with Asset Hub should
anyone require. Example configuration files can be found at the bottom
of https://github.com/r0gue-io/pop-cli/pull/278/files for anyone
interested, although that PR is still a work in progre...

WIP

---------

Co-authored-by: Javier Viola <363911+pepoviola@users.noreply.github.com>

Couple of fixes for docker provider and to use an external tool to build
the chain-spec.

docker support 

---------

Co-authored-by: Javier Viola <javier@parity.io>

Fix https://github.com/paritytech/zombienet-sdk/issues/169

- Add logic to retrieve available args from node before spawning the
full network using the output of the command with --help

Add:
 - Logic to use db_snapshot in both native/k8s providers
 - Small fix on chain_spec_path (for both native/k8s)
 - New example `db_snapshot`

Add: Manual variant to `RegistrationStrategy`, allow to deploy the
collators _but_ not register the para.
Fix: `created_paths` in native provider
Fix: Use `rpc` port for ws connections (orchestrator)

This PR introduces the Kubernetes Provider for the SDK, with the use of
kube.rs for common operation and a custom file server using axum to
transfer files back and forth the nodes.

https://github.com/paritytech/zombienet-sdk/issues/35

This also includes the refacto of the native provider to reflect changes
to the provider structure with weak references and simplifying the use
of abstractions

---------

Co-authored-by: Javier Viola <pepoviola@gmail.com>
Co-authored-by: Javier Viola <javier@parity.io>
Co-authored-by: Javier Viola <363911+pepoviola@users.noreply.github.com>

Fix parachain spec filename (local) to use when we spawn collators.
Also, adding `Context` to spawner to improve error reporting.

cc @pgherveou



---------

Co-authored-by: PG Herveou <pgherveou@gmail.com>

Adding `tracing` and replace all the `println`. We should add more info
in a followup pr.
Thx!

just wanted to throw a quick implementation that exposes the
OnclineClient on the node.
This would make the sdk super useful to enable cross chain e2e tests in
ink!

---------

Co-authored-by: Javier Viola <pepoviola@gmail.com>

* wip, refactor provider trait

* fmt

* wip

* wip, add from_config to NetworkSpec

* config reorgs

* add logic for create NetworkSpec

* feat: refactored FileSystem trait and errors

* chore: removed unused local_file, stdout will be hardcoded in provider at the moment

* feat: moved MockFileSystem to InMemoryFileSystem, files too, and added mirror implementation of tokio::fs with tests

* feat: added new method append to FileSystem trait

* feat: implemented new append method on InMemoryFileSystem

* feat: added anyhow dependencies to support crate

* feat: refactored FileSystem trait to expose only a single wrapped error

* feat: refacto InMemoryFileSystem following FileSystem trait refacto

* feat: added conversion between io::Error and FileSystemError

* feat: added implementation of LocalFileSystem using tokio::fs

* feat: added nix crate dependency to workspace and provider crate

* feat: added uuid with v4 as dev-dependencies for testing in support crate

* feat: added unit tests for LocalFileSystem

* feat: updated Provider, ProviderNamespace and ProviderNode traits and related DTO

* feat: added anyhow as dependency to provider crate

* feat: updated ProviderError

* feat: work on NativeProvider with individual Node, Namespace and Provider struct threadsafe using RwLock and Arc, added implementation logic of resume/restart/pause, destroy and helpers for logs

* feat: rename some provider constants

* wip

* feat: added uuid with v4 features as normal dependency

* feat: added new set_mode method on FileSystem trait to modify permissions bits, added implementations and tests

* feat: added builder for options types used in provider traits methods, moved error next to provider traits

* feat: added modified implementation of run_script/run_command/copy_from_node in NativeProvider, removed unused comments

* feat: moved filesystem, capabilities and tmp_dir out of NativeProviderInner

* wip on network spec creation

* move chain_spec to generators

* change defaults for validator/invulnerable settings

* Add test and clean-ups

* nits and clean

* fmt

* fmt

* fix docs/clippy

* fixes from clippy

* add TODO and allow dead_code for now

* fmt

* more nits

* fmt

* feat: make constructors and fields public for testing on InMemoryFileSystem

* feat: removed unused types atm and added TransferedFile

* feat: updated types for Provider methods output, updated non needed async methods

* feat: added generate_files implementation on namespace using temporary nodes, moved some non mutable fields out of inners

* feat: removed comment

* feat: refactored provider types and added builders

* feat(orchestrator) add generators

* feat(orchestrator) add logic to compute the network spec

* small changes in provider trait and native impl

* wip, example to drive exec

* make paras working, first design draft of network public api

* cleanups

* add spawner

* add logic to add new nodes to running network and methods on nodes

* modify example

* fmt

* allow to add collators to a running network

* modify example

* move Network related structs

* reorg code

* fmt

* fixes and clean-up

* removed commented code

* clippy

* fmt

* clippy

* fmt

* clippy in example

* fix validator/invulnerable true as default

* fmt

* fix base_dir for mac/linux compat

* fix, allow generate files with fullpaths (encapsualate as part of the ns)

* Add todos

* fix p2p port for full_node in collator

* fix p2p port for full_node in collator

* clippy

* fmt

* Update crates/orchestrator/src/network_spec/node.rs

Co-authored-by: Loris Moulin <45130584+l0r1s@users.noreply.github.com>

* Update crates/orchestrator/src/network_spec/relaychain.rs

Co-authored-by: Loris Moulin <45130584+l0r1s@users.noreply.github.com>

* Update crates/orchestrator/src/generators/chain_spec.rs

Co-authored-by: Nikos Kontakis <wirednkod@gmail.com>

* Update crates/examples/examples/small_network_with_default.rs

Co-authored-by: Loris Moulin <45130584+l0r1s@users.noreply.github.com>

* Update crates/orchestrator/src/generators/bootnode_addr.rs

Co-authored-by: Loris Moulin <45130584+l0r1s@users.noreply.github.com>

* Update crates/orchestrator/src/network_spec/node.rs

Co-authored-by: Loris Moulin <45130584+l0r1s@users.noreply.github.com>

* Update crates/orchestrator/src/network_spec/node.rs

Co-authored-by: Loris Moulin <45130584+l0r1s@users.noreply.github.com>

* Update crates/orchestrator/src/network_spec/relaychain.rs

Co-authored-by: Loris Moulin <45130584+l0r1s@users.noreply.github.com>

* changes from feedback

* reorg deps

* clippy/fmt

* reorg generators and add some unittest

* more unittest and cleans

* fmt/clippy

* fmt/clippy

* add TODOs from feedback

---------

Co-authored-by: l0r1s <contact@lorismoulin.com>
Co-authored-by: Loris Moulin <45130584+l0r1s@users.noreply.github.com>
Co-authored-by: Nikos Kontakis <wirednkod@gmail.com>