Skip to content
  1. Nov 24, 2020
    • Bastian Köcher's avatar
      Wasm-builder 3.0 (#7532) · 923cb8ee
      Bastian Köcher authored
      
      
      * Build every wasm crate in its own project with wasm-builder
      
      Building all wasm crates in one workspace was a nice idea, however it
      just introduced problems:
      
      1. We needed to prune old members, but this didn't worked for old git
      deps.
      2. We locked the whole wasm workspace while building one crate. This
      could lead to infinitely locking the workspace on a crash.
      
      Now we just build every crate in its own project, this means we will
      build the dependencies multiple times. While building the dependencies
      multiple times, we still decrease the build time by around 30 seconds
      for Polkadot and Substrate because of the new parallelism ;)
      
      * Remove the requirement on wasm-builder-runner
      
      This removes the requirement on wasm-builder-runner by using the new
      `build_dep` feature of cargo. We use nightly anyway and that enables us
      to use this feature. This solves the problem of not mixing
      build/proc-macro deps with normal deps. By doing this we get rid off
      this complicated project structure and can depend directly on
      `wasm-builder`. This also removes all the code from wasm-builder-runner
      and mentions that it is deprecated.
      
      * Copy the `Cargo.lock` to the correct folder
      
      * Remove wasm-builder-runner
      
      * Update docs
      
      * Fix deterministic check
      
      Modified-by: default avatarBastian Köcher <[email protected]>
      
      * Try to make the ui test happy
      
      * Switch to `SKIP_WASM_BUILD`
      
      * Rename `SKIP_WASM_BINARY` to the correct name...
      
      * Update utils/wasm-builder/src/builder.rs
      
      Co-authored-by: default avatarAndré Silva <[email protected]>
      
      * Update utils/wasm-builder/src/builder.rs
      
      Co-authored-by: default avatarAndré Silva <[email protected]>
      
      Co-authored-by: default avatarAndré Silva <[email protected]>
      923cb8ee
  2. Nov 22, 2020
  3. Nov 20, 2020
  4. Nov 16, 2020
  5. Nov 04, 2020
    • Web3 Philosopher's avatar
      Allow BabeConsensusDataProvider fork existing chain (#7078) · 6328f874
      Web3 Philosopher authored
      * parent affbc38a
      
      
      author Seun Lanlege <[email protected]> 1599568164 +0100
      committer Seun Lanlege <[email protected]> 1604321289 +0100
      gpgsig -----BEGIN PGP SIGNATURE-----
      
       iQGzBAABCgAdFiEECvQ02MnjnssnSbjr3HzzEhjN254FAl+gAAkACgkQ3HzzEhjN
       254soAv+KO5JA0HXSe0R0XS5TnwA3IxYsW+UvdF5dXFeC3jFdGTMvor818uoBePD
       dxzYEsUK6gjsNcM9+hpFhoy5JnUrUPInd2BZ7pmZiDuXmYJrHi0s7K5qL0EYDoe0
       m1egPNNyRR125ozJ24M+09c3OQsi3bvTx1TJaV9Aov8hK4So8UmlJTHWpkLw97ku
       HuTre2IPSFbV4GwJE40V+KNuDVHxaKL7zrInYScqbr6/hOTqBCvFn4ib3CjpF5HG
       zDAA5S2PrcbL9NQOothVcVB/TZr3IkhglCFqEjVyCX80IL0JkNZkw8jAh0B8uqXx
       Ug/c1/Mssa8F1jLZMmW45Cway60txqVbcWntPJAymGJbrRErOO/++oUrV0u1C65u
       LW7gXAaIJWQTX9KnX0SEyejNod7ubZktBz7n5WfkJAPIzdw5wtJalhLa673YTgQ9
       zyTPKiWjJj2myCq1AYrJvlK8hSsIBqbBFcUf1zX4SzZWKS+5mtp51o4gfVzcCRPd
       z/6/iPbB
       =g5tx
       -----END PGP SIGNATURE-----
      
      BabeConsensusDataProvider works with existing chains
      
      Co-authored-by: default avatarBastian Köcher <[email protected]>
      
      Co-authored-by: default avatarBastian Köcher <[email protected]>
      6328f874
  6. Oct 30, 2020
  7. Oct 28, 2020
    • thiolliere's avatar
      Fix benchmarks template whitespaces (#7447) · 16799198
      thiolliere authored
      
      
      * fix
      
      * actual fix
      
      * cargo run --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_democracy --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/democracy/src/weights.rs --template=./.maintain/frame-weight-template.hbs
      
      * cargo run --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=frame_system --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/system/src/weights.rs --template=./.maintain/frame-weight-template.hbs
      
      * Update frame/system/src/weights.rs
      
      Co-authored-by: default avatarParity Benchmarking Bot <[email protected]>
      Co-authored-by: default avatarShawn Tabrizi <[email protected]>
      16799198
  8. Oct 27, 2020
    • Shawn Tabrizi's avatar
      New Weight Template + Organization (#7391) · e4cfb255
      Shawn Tabrizi authored
      
      
      * add_handlebar_template_to_benchmark
      
      - add benchmark-cli arg to take in a handlebar-template file
      
      * update to always use template
      
      * rewrite writer for handlebars
      
      * polish
      
      * pass cmd data
      
      * update docs
      
      * new weight layout
      
      * separate templates
      
      * support custom filename output
      
      * Update command.rs
      
      * Create frame-weight-template.hbs
      
      * use a vector to maintain benchmark order
      
      * bring back ()
      
      * fix tests
      
      * fix build
      
      * Custom string serializer, remove feature flag
      
      * temp
      
      * rename
      
      * nit
      
      * update docs
      
      * docs on public objects
      
      * small fix
      
      * cargo run --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_balances --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/balances/src/weights.rs --template=./.maintain/frame-weight-template.hbs
      
      * remove long line
      
      * cargo run --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_balances --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/balances/src/weights.rs --template=./.maintain/frame-weight-template.hbs
      
      * cargo run --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=frame_system --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/system/src/weights.rs --template=./.maintain/frame-weight-template.hbs
      
      * update for system
      
      * cargo run --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_staking --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/staking/src/weights.rs --template=./.maintain/frame-weight-template.hbs
      
      * update for staking
      
      * cargo run --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_identity --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/identity/src/weights.rs --template=./.maintain/frame-weight-template.hbs
      
      * update for identity and staking
      
      * cargo run --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_collective --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/collective/src/weights.rs --template=./.maintain/frame-weight-template.hbs
      
      * update for collective
      
      * cargo run --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_democracy --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/democracy/src/weights.rs --template=./.maintain/frame-weight-template.hbs
      
      * update for democracy
      
      * clean up zeros
      
      * cargo run --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_elections_phragmen --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/elections-phragmen/src/weights.rs --template=./.maintain/frame-weight-template.hbs
      
      * update for elections phragmen
      
      * cargo run --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_im_online --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/im-online/src/weights.rs --template=./.maintain/frame-weight-template.hbs
      
      * update for im online
      
      * cargo run --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_indices --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/indices/src/weights.rs --template=./.maintain/frame-weight-template.hbs
      
      * update for indices
      
      * cargo run --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_multisig --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/multisig/src/weights.rs --template=./.maintain/frame-weight-template.hbs
      
      * update for multisig
      
      * cargo run --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_proxy --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/proxy/src/weights.rs --template=./.maintain/frame-weight-template.hbs
      
      * update for proxy
      
      * cargo run --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_scheduler --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/scheduler/src/weights.rs --template=./.maintain/frame-weight-template.hbs
      
      * update for scheduler
      
      * cargo run --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_session --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/session/src/weights.rs --template=./.maintain/frame-weight-template.hbs
      
      * update for session
      
      * cargo run --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_timestamp --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/timestamp/src/weights.rs --template=./.maintain/frame-weight-template.hbs
      
      * update for timestamp
      
      * cargo run --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_treasury --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/treasury/src/weights.rs --template=./.maintain/frame-weight-template.hbs
      
      * update for treasury
      
      * cargo run --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_utility --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/utility/src/weights.rs --template=./.maintain/frame-weight-template.hbs
      
      * update for utility
      
      * cargo run --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_vesting --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/vesting/src/weights.rs --template=./.maintain/frame-weight-template.hbs
      
      * update for vesting
      
      * temp update
      
      * cargo run --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_utility --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/utility/src/weights.rs --template=./.maintain/frame-weight-template.hbs
      
      Co-authored-by: default avatarEzadkiel Marbella <[email protected]>
      Co-authored-by: default avatarParity Benchmarking Bot <[email protected]>
      e4cfb255
    • Shawn Tabrizi's avatar
      Use Handlebars Template for Benchmark CLI Output (#7390) · 3ac070b6
      Shawn Tabrizi authored
      
      
      * add_handlebar_template_to_benchmark
      
      - add benchmark-cli arg to take in a handlebar-template file
      
      * update to always use template
      
      * rewrite writer for handlebars
      
      * polish
      
      * pass cmd data
      
      * update docs
      
      * support custom filename output
      
      * Update command.rs
      
      * Create frame-weight-template.hbs
      
      * use a vector to maintain benchmark order
      
      * fix tests
      
      * Custom string serializer, remove feature flag
      
      * update docs
      
      * docs on public objects
      
      * small fix
      
      Co-authored-by: default avatarEzadkiel Marbella <[email protected]>
      3ac070b6
  9. Oct 26, 2020
    • Andrew Plaza's avatar
      WASM Local-blob override (#7317) · 74910c48
      Andrew Plaza authored
      
      
      * Provide WASM overwrite functionality in LocalCallExecutor
      
      - add a new module `wasm_overwrite.rs` in client
        - scrapes given folder for runtimes
      - add two new CLI Options `wasm-overwrite` and `wasm_overwrite_path`
      
      * formatting
      
      * Make comment clearer
      
      remove sc-runtime-test from dev-dependencies
      
      * comments
      
      * Update client/service/src/client/wasm_overwrite.rs
      
      Co-authored-by: default avatarBastian Köcher <[email protected]>
      
      * Update client/service/src/client/wasm_overwrite.rs
      
      Co-authored-by: default avatarBastian Köcher <[email protected]>
      
      * Fix spaces, remove call into backend for 'heap_pages' in 'try_replace'
      
      * Error if path is not a directory, Comments,
      
      Doc Comment for WasmOverwrite
      
      * make WasmOverwrite Option<>
      
      * Change to one CLI argument for overwrites
      
      - move getting runtime version into LocalCallExecutor
      
      * change unwrap() to expect()
      
      * comment
      
      * Remove `check_overwrites`
      
      * Encapsulate checking for overwrites in LocalCallExecutor
      
      * move duplicate code into function
      
      * Update client/cli/src/params/import_params.rs
      
      Co-authored-by: default avatarBastian Köcher <[email protected]>
      
      * comma
      
      * Update client/service/src/client/wasm_overwrite.rs
      
      Co-authored-by: default avatarBastian Köcher <[email protected]>
      
      * Update client/service/src/client/wasm_overwrite.rs
      
      Co-authored-by: default avatarBastian Köcher <[email protected]>
      
      * cache hash in WasmBlob
      
      * Update client/service/src/client/wasm_overwrite.rs
      
      Co-authored-by: default avatarBastian Köcher <[email protected]>
      
      * Update client/service/src/client/client.rs
      
      Co-authored-by: default avatarBastian Köcher <[email protected]>
      
      * move getting overwrite into its own function
      
      * fix error when directory is not a directory
      
      * Error on duplicate WASM runtimes
      
      * better comment, grammar
      
      * docs
      
      * Revert StateBackend back to _
      
      * Update client/service/src/client/wasm_overwrite.rs
      
      Co-authored-by: default avatarBastian Köcher <[email protected]>
      
      * Update client/service/src/client/wasm_overwrite.rs
      
      Co-authored-by: default avatarBastian Köcher <[email protected]>
      
      * Update client/service/src/client/call_executor.rs
      
      Co-authored-by: default avatarBastian Köcher <[email protected]>
      
      * Add two tests, fix doc comments
      
      Add a test for the runtime_version method of WasmOverwrite
      Add a test for check_overwrite method of LocalCallExecutor
      
      * remove redundant `Return` from expect msg
      
      * Update client/cli/src/params/import_params.rs
      
      Co-authored-by: default avatarDavid <[email protected]>
      
      * Update client/service/src/client/call_executor.rs
      
      Co-authored-by: default avatarDavid <[email protected]>
      
      * Update client/service/src/client/wasm_overwrite.rs
      
      Co-authored-by: default avatarDavid <[email protected]>
      
      * Update client/service/src/config.rs
      
      Co-authored-by: default avatarDavid <[email protected]>
      
      * Update client/service/src/client/wasm_overwrite.rs
      
      Co-authored-by: default avatarDavid <[email protected]>
      
      * Add Module Documentation, match on '.wasm' extension
      
      * Add test for scraping WASM blob
      
      * fix expect
      
      * remove creating another block in LocalCallExecutor test
      
      * remove unused import
      
      * add tests for duplicates and scraping wasm
      
      * make tests a bit nicer
      
      * add test for ignoring non-.wasm files
      
      * check error message in test
      
      * Update client/service/src/client/wasm_overwrite.rs
      
      Co-authored-by: default avatarBastian Köcher <[email protected]>
      
      * remove println
      
      * Update client/service/src/client/wasm_overwrite.rs
      
      Co-authored-by: default avatarBastian Köcher <[email protected]>
      
      * make tests prettier
      
      * Update client/service/src/client/wasm_overwrite.rs
      
      Co-authored-by: default avatarBastian Köcher <[email protected]>
      
      * comment for seemingly random client
      
      * locally-built -> custom
      
      * remove unused import
      
      * fix comment
      
      * rename all references to overwrite with override
      
      * fix cli flag in module documentation
      
      Co-authored-by: default avatarBastian Köcher <[email protected]>
      Co-authored-by: default avatarDavid <[email protected]>
      74910c48
  10. Oct 21, 2020
    • Cecile Tonglet's avatar
      Add node name to the log lines (#7328) · 8cebbd14
      Cecile Tonglet authored
      * Initial commit
      
      Forked at: 601e2fa1
      Parent branch: origin/master
      
      * WIP
      
      Forked at: 601e2fa1
      Parent branch: origin/master
      
      * WIP
      
      Forked at: 601e2fa1
      Parent branch: origin/master
      
      * WIP
      
      Forked at: 601e2fa1
      Parent branch: origin/master
      
      * WIP
      
      Forked at: 601e2fa1
      Parent branch: origin/master
      
      * WIP
      
      Forked at: 601e2fa1
      Parent branch: origin/master
      
      * CLEANUP
      
      Forked at: 601e2fa1
      Parent branch: origin/master
      
      * Add notes to original source code
      
      * CLEANUP
      
      Forked at: 601e2fa1
      Parent branch: origin/master
      
      * CLEANUP
      
      Forked at: 601e2fa1
      Parent branch: origin/master
      
      * WIP
      
      Forked at: 601e2fa1
      Parent branch: origin/master
      
      * WIP
      
      Forked at: 601e2fa1
      Parent branch: origin/master
      
      * WIP
      
      Forked at: 601e2fa1
      Parent branch: origin/master
      
      * CLEANUP
      
      Forked at: 601e2fa1
      Parent branch: origin/master
      
      * WIP
      
      Forked at: 601e2fa1
      Parent branch: origin/master
      
      * Some doc
      
      * Test with trybuild
      
      * Revert "Test with trybuild" (issue with trybuild atm)
      
      This reverts commit 9055ec2206808ba3ddce6e3d87eb358907fa5e42.
      
      https://github.com/dtolnay/trybuild/issues/53
      
      * Apply suggestions
      
      * Rename derive to proc-macro
      
      * Remove "prefix" feature from informant
      
      * Blocking task should use SpawnHandle::spawn_blocking
      
      * Improve doc as suggested
      
      * Fixes
      
      Forked at: 601e2fa1
      
      
      Parent branch: origin/master
      
      * Apply suggestion
      
      * Update client/cli/proc-macro/src/lib.rs
      
      Co-authored-by: default avatarBastian Köcher <[email protected]>
      
      * More suggestions
      
      * CLEANUP
      
      Forked at: 601e2fa1
      Parent branch: origin/master
      
      * Improve error message
      
      * CLEANUP
      
      Forked at: 601e2fa1
      Parent branch: origin/master
      
      * Fix async issue
      
      * CLEANUP
      
      Forked at: 601e2fa1
      Parent branch: origin/master
      
      * CLEANUP
      
      Forked at: 601e2fa1
      
      
      Parent branch: origin/master
      
      * Add test
      
      * fix doc test
      
      * Update client/cli/src/logging.rs
      
      Co-authored-by: default avatarBastian Köcher <[email protected]>
      
      * Update client/basic-authorship/src/basic_authorship.rs
      
      Co-authored-by: default avatarBastian Köcher <[email protected]>
      
      * Update client/basic-authorship/src/basic_authorship.rs
      
      Co-authored-by: default avatarBastian Köcher <[email protected]>
      
      * Apply suggestions
      
      * Suggestions
      
      * Clarify doc
      
      * WIP
      
      Forked at: 601e2fa1
      
      
      Parent branch: origin/master
      
      Co-authored-by: default avatarBastian Köcher <[email protected]>
      8cebbd14
  11. Oct 20, 2020
    • Max Inden's avatar
      *: Bump async-std to v1.6.5 (#7306) · 918a0c80
      Max Inden authored
      * *: Bump async-std to v1.6.5
      
      Prevent users from using v1.6.4 which faces issues receiving incoming
      TCP connections. See https://github.com/async-rs/async-std/issues/888
      for details.
      
      * client/network/src/gossip: Use channel instead of condvar
      
      `async_std::sync::Condvar::wait_timeout` uses
      `gloo_timers::callback::Timeout` when compiled for
      `wasm32-unknown-unknown`. This timeout implementation does not fulfill
      the requirement of being `Send`.
      
      Instead of using a `Condvar` use a `futures::channel::mpsc` to signal
      progress from the `QueuedSender` to the background `Future`.
      
      * client/network/Cargo.toml: Remove async-std unstable feature
      
      * client/network/src/gossip: Forward all queued messages
      
      * client/network/gossip: Have QueuedSender methods take &mut self
      
      * client/network/gossip: Move queue_size_limit into QueuedSender
      
      The `queue_size_limit` field is only accessed by `QueuedSender`, thus
      there is no need to share it between the background future and the
      `QueuedSender`.
      
      * client/network/gossip: Rename background task to future
      
      To be a bit picky the background task is not a task in the sense of an
      asynchonous task, but rather a background future in the sense of
      `futures::future::Future`.
      918a0c80
  12. Oct 19, 2020
    • Max Inden's avatar
      client/network: Remove option to disable yamux flow control (#7358) · bd2dbc05
      Max Inden authored
      With the `OnRead` flow control option yamux "send[s] window updates only
      when data is read on the receiving end" and not as soon as "a Stream's
      receive window drops to 0".
      
      Yamux flow control has proven itself. This commit removes the feature
      flag. Yamux flow control is now always enabled.
      bd2dbc05
    • Bastian Köcher's avatar
      Make `wasm-builder` print the rustc version (#7351) · 23382db1
      Bastian Köcher authored
      * Make `wasm-builder` print the rustc version
      
      This makes `wasm-builder` print the rustc version that is being used to
      compile the project. This is rather useful, because people can check
      faster if the used rustc version is maybe known for being broken with
      Substrate.
      
      * Apply suggestions from code review
      
      * Add some comments
      23382db1
  13. Oct 17, 2020
    • Shawn Tabrizi's avatar
      Constant Weight Signature in Benchmarking CLI (#7233) · 13be04e0
      Shawn Tabrizi authored
      * Don't remove unused components
      
      * add more metadata to generated file
      
      * unused code
      
      * proposed format
      
      * Revert "proposed format"
      
      This reverts commit ce522c3480157ab6670bcbd9b17e1398168cabf4.
      
      * Update weight signatures and unused components in benchmarks
      
      * Keep timestamp constant time
      
      * remove component from as_derivative
      13be04e0
  14. Oct 15, 2020
    • Ashley's avatar
      Add missing fields to the light sync state (#7225) · d1ef8507
      Ashley authored
      * Initial draft
      
      * Add an iterator that helps us get most items
      
      * Revert changes to grandpa
      
      * Change fields to just be the grandpa authority set and babe epoch changes
      
      * Only use the fields we need from the shared authority set
      
      * Switch to RPC call
      
      * Revert "Only use the fields we need from the shared authority set"
      
      This reverts commit 6ede87b0c5fe53f251d7cb45951006a7dc8f9b83.
      
      * Add babe_finalized_block_weight from `ashley-improve-sync-state-WIP-loading`
      
      * Fix rpc test
      
      * Move sync state rpc stuff into sc-sync-state-rpc
      
      * Remove as_json_value and remove unwraps from sc-sync-state-rpc
      
      * Add clone_inner to SharedAuthoritySet
      d1ef8507
  15. Oct 12, 2020
  16. Oct 09, 2020
  17. Oct 08, 2020
    • Rakan Alhneiti's avatar
      Async keystore + Authority-Discovery async/await (#7000) · 3aa4bfac
      Rakan Alhneiti authored
      
      
      * Asyncify sign_with
      
      * Asyncify generate/get keys
      
      * Complete BareCryptoStore asyncification
      
      * Cleanup
      
      * Rebase
      
      * Add Proxy
      
      * Inject keystore proxy into extensions
      
      * Implement some methods
      
      * Await on send
      
      * Cleanup
      
      * Send result over the oneshot channel sender
      
      * Process one future at a time
      
      * Fix cargo stuff
      
      * Asyncify sr25519_vrf_sign
      
      * Cherry-pick and fix changes
      
      * Introduce SyncCryptoStore
      
      * SQUASH ME WITH THE first commit
      
      * Implement into SyncCryptoStore
      
      * Implement BareCryptoStore for KeystoreProxyAdapter
      
      * authority-discovery
      
      * AURA
      
      * BABE
      
      * finality-grandpa
      
      * offchain-workers
      
      * benchmarking-cli
      
      * sp_io
      
      * test-utils
      
      * application-crypto
      
      * Extensions and RPC
      
      * Client Service
      
      * bin
      
      * Update cargo.lock
      
      * Implement BareCryptoStore on proxy directly
      
      * Simplify proxy setup
      
      * Fix authority-discover
      
      * Pass async keystore to authority-discovery
      
      * Fix tests
      
      * Use async keystore in authority-discovery
      
      * Rename BareCryptoStore to CryptoStore
      
      * WIP
      
      * Remote mutable borrow in CryptoStore trait
      
      * Implement Keystore with backends
      
      * Remove Proxy implementation
      
      * Fix service builder and keystore user-crates
      
      * Fix tests
      
      * Rework authority-discovery after refactoring
      
      * futures::select!
      
      * Fix multiple mut borrows in authority-discovery
      
      * Merge fixes
      
      * Require sync
      
      * Restore Cargo.lock
      
      * PR feedback - round 1
      
      * Remove Keystore and use LocalKeystore directly
      
      Also renamed KeystoreParams to KeystoreContainer
      
      * Join
      
      * Remove sync requirement
      
      * Fix keystore tests
      
      * Fix tests
      
      * client/authority-discovery: Remove event stream dynamic dispatching
      
      With authority-discovery moving from a poll based future to an `async`
      future Rust has difficulties propagating the `Sync` trade through the
      generated state machine.
      
      Instead of using dynamic dispatching, use a trait parameter to specify
      the DHT event stream.
      
      * Make it compile
      
      * Fix submit_transaction
      
      * Fix block_on issue
      
      * Use await in async context
      
      * Fix manual seal keystore
      
      * Fix authoring_blocks test
      
      * fix aura authoring_blocks
      
      * Try to fix tests for auth-discovery
      
      * client/authority-discovery: Fix lookup_throttling test
      
      * client/authority-discovery: Fix triggers_dht_get_query test
      
      * Fix epoch_authorship_works
      
      * client/authority-discovery: Remove timing assumption in unit test
      
      * client/authority-discovery: Revert changes to termination test
      
      * PR feedback
      
      * Remove deadcode and mark test code
      
      * Fix test_sync
      
      * Use the correct keyring type
      
      * Return when from_service stream is closed
      
      * Convert SyncCryptoStore to a trait
      
      * Fix line width
      
      * Fix line width - take 2
      
      * Remove unused import
      
      * Fix keystore instantiation
      
      * PR feedback
      
      * Remove KeystoreContainer
      
      * Revert "Remove KeystoreContainer"
      
      This reverts commit ea4a37c7d74f9772b93d974e05e4498af6192730.
      
      * Take a ref of keystore
      
      * Move keystore to dev-dependencies
      
      * Address some PR feedback
      
      * Missed one
      
      * Pass keystore reference - take 2
      
      * client/finality-grandpa: Use `Arc<dyn CryptoStore>` instead of SyncXXX
      
      Instead of using `SyncCryptoStorePtr` within `client/finality-grandpa`,
      which is a type alias for `Arc<dyn SyncCryptoStore>`, use `Arc<dyn
      CryptoStore>`. Benefits are:
      
      1. No additional mental overhead of a `SyncCryptoStorePtr`.
      
      2. Ability for new code to use the asynchronous methods of `CryptoStore`
      instead of the synchronous `SyncCryptoStore` methods within
      `client/finality-granpa` without the need for larger refactorings.
      
      Note: This commit uses `Arc<dyn CryptoStore>` instead of
      `CryptoStorePtr`, as I find the type signature more descriptive. This is
      subjective and in no way required.
      
      * Remove SyncCryptoStorePtr
      
      * Remove KeystoreContainer & SyncCryptoStorePtr
      
      * PR feedback
      
      * *: Use CryptoStorePtr whereever possible
      
      * *: Define SyncCryptoStore as a pure extension trait of CryptoStore
      
      * Follow up to SyncCryptoStore extension trait
      
      * Adjust docs for SyncCryptoStore as Ben suggested
      
      * Cleanup unnecessary requirements
      
      * sp-keystore
      
      * Use async_std::task::block_on in keystore
      
      * Fix block_on std requirement
      
      * Update primitives/keystore/src/lib.rs
      
      Co-authored-by: default avatarMax Inden <[email protected]>
      
      * Fix wasm build
      
      * Remove unused var
      
      * Fix wasm compilation - take 2
      
      * Revert async-std in keystore
      
      * Fix indent
      
      * Fix version and copyright
      
      * Cleanup feature = "std"
      
      * Auth Discovery: Ignore if from_service is cloed
      
      * Max's suggestion
      
      * Revert async-std usage for block_on
      
      * Address PR feedback
      
      * Fix example offchain worker build
      
      * Address PR feedback
      
      * Update Cargo.lock
      
      * Move unused methods to test helper functions
      
      * Restore accidentally deleted cargo.lock files
      
      * Fix unused imports
      
      Co-authored-by: default avatarMax Inden <[email protected]>
      Co-authored-by: default avatarShawn Tabrizi <[email protected]>
      3aa4bfac
  18. Sep 24, 2020
  19. Sep 23, 2020
  20. Sep 22, 2020
    • Benjamin Kampmann's avatar
      Releasing 2.0 – two dot 😮 (#7182) · ecdc9442
      Benjamin Kampmann authored
      Tagging the release of substrate 2.0
      
      
      [ci: skip-checks]
      ecdc9442
    • Steve Degosserie's avatar
      Update READMEs, fix links (#7176) · 22632efc
      Steve Degosserie authored
      * Re-generate READMEs to fix doc links; set readme field in package manifests
      
      * Re-generate READMEs to fix doc links; set readme field in package manifests
      
      * Re-generate READMEs to fix doc links; set readme field in package manifests
      
      * Re-generate READMEs to fix doc links; set readme field in package manifests
      
      * Revert stuff that shouldn't have been committed
      
      * Revert stuff that shouldn't have been committed
      
      * Fix parent relative link generation
      
      * Manually remove this incorrect link for now.
      22632efc
  21. Sep 21, 2020
  22. Sep 17, 2020
    • Shawn Tabrizi's avatar
      WeightInfo for Identity Pallet (#7107) · f089cb42
      Shawn Tabrizi authored
      * update benchmarks
      
      * add automated weights
      
      * Update benchmarking.rs
      
      * use underscores for file out
      
      * update some weights
      
      * more weights
      
      * finish weights
      
      * add basic verification to benchmarks
      
      * patch benchmarks
      
      * Update benchmarking.rs
      
      * final weights
      
      * update for new type
      
      * add weightinfo to node
      f089cb42
    • Wei Tang's avatar
      Use tracing-based subscriber logging (#6825) · 9fdd4672
      Wei Tang authored
      
      
      * init_logger: switch from log-based to tracing-based and add compatibility layer
      
      * Move tracing profiling subscriber related config realization
      
      * sp-tracing: change profiling to be a layer instead of a subscriber
      
      * Enable profiling layer in cli
      
      * Change all test env_logger init to sp_tracing::try_init_simple
      
      * Remove all local env_logger dependency
      
      * Add missing tracing-subscriber dependency
      
      * frame-sudo: fix tests
      
      * frame-support: fix tests
      
      * Fix frame/pallet and executor tests
      
      * Fix the remaining tests
      
      * Use subscriber's try_init as recommended by @davidbarsky
      
      * Be explict that the tracing-log feature is needed
      
      * Set subscriber writer to stderr
      
      * Shorter line width
      
      * Update cargo lock tracing version
      
      * Fix sc_tracing crate compile
      
      * Fix sc_authority_discovery crate test
      
      * unremove default-features
      
      * Leave enabled to default true
      
      * Warn if global default cannot be set
      
      * Fix unused import
      
      * Remove unused PROXY_TARGET
      
      * Change all reference from rc5 to rc6
      
      * Change all reference of rc2 to rc6
      
      * Fix styling
      
      * Fix typo
      
      * make logger init error'ing
      
      * re-fixing the test issue
      
      Co-authored-by: default avatarBenjamin Kampmann <[email protected]>
      9fdd4672
  23. Sep 15, 2020
    • Bastian Köcher's avatar
      Improve error output of wasm-builder when wasm ins't installed (#7105) · 9dd5812e
      Bastian Köcher authored
      This improves the error message of wasm-builder when the wasm toolchain
      isn't installed. Currently we print that the wasm toolchain is not
      installed, but the actual problem is that there is a bug in the
      packaging in rust. This will now be much easier to debug, by printing
      the full error message of the compiler.
      9dd5812e
  24. Sep 14, 2020
  25. Sep 10, 2020
  26. Sep 08, 2020
  27. Sep 01, 2020
  28. Aug 24, 2020
    • Shawn Tabrizi's avatar
      Enable verification logic when executing benchmarks (#6929) · 4462f715
      Shawn Tabrizi authored
      * Add `--verify` flag to benchmark execution
      
      * make it so `--verify` can be used for getting the actual benchmarks
      
      * undo manual testing
      
      * oops
      
      * use benchmark config struct
      
      * verify is default on, docs update
      
      * remove clone
      
      * improve formatting
      
      * fix test
      
      * bump impl for ci
      4462f715
  29. Aug 22, 2020
  30. Aug 21, 2020
    • Max Inden's avatar
      *: Update to next libp2p version 0.24.0 (#6891) · 69e349bd
      Max Inden authored
      * *: Update to next libp2p version (likely v0.24.0)
      
      * Revert "*: Update to next libp2p version (likely v0.24.0)"
      
      This reverts commit ffe1545aba6c2557a2843579de331f3fc1c60743.
      
      * */Cargo.toml: Update to libp2p v0.24.0
      
      * client/network/src/service: Handle ConnectionClosed returning Option
      
      * Cargo.*: Test kad usize conversion
      
      * Revert "Cargo.*: Test kad usize conversion"
      
      This reverts commit ad317879782f982cb4a4c76029a72b5b97e82bec.
      
      * Cargo.lock: Update to libp2p-kad v0.22.1
      
      * client/cli/Cargo.toml: Update to libp2p 0.24.0
      69e349bd
  31. Aug 20, 2020
    • Benjamin Kampmann's avatar
      prepping for releasing rc6 (#6922) · 2416aa79
      Benjamin Kampmann authored
      * Bump version
      
      * update test-utils crates to be ready for publishing
      
      * adding changelog
      
      * Adding automaticly generated READMEs
      
      * fixing versions
      
      * another version mishap
      2416aa79
    • Web3 Philosopher's avatar
      Merge Subkey into sc-cli (#4954) · 69632724
      Web3 Philosopher authored
      * draft
      
      * revert
      
      * WIP
      
      * all that remains is tests
      
      * update Cargo.lock
      
      * tests WIP
      
      * WIP refactor node-template-runtime and node-runtime
      
      * implments sc_cli::RuntimeAdapter for node_template_runtime::Runtime
      
      * final draft
      
      * fix update_config for subcommands
      
      * proper AccountId decoding
      
      * test-runtime tests
      
      * revert
      
      * move RuntimeAdapter to cli-utils
      
      * use &'static str for TryFrom::<&'a str>::Error for Ss58AddressFormat
      
      * tests
      
      * add frame-system to sc-cli dev-dependencies
      
      * add frame-system to sc-cli dev-dependencies
      
      * fix ui test
      
      * wip
      
      * fixed inspect test
      
      * bump impl version
      
      * bump impl version, fixx spaces remove todos
      
      * pallet-balances-cli, rustc for some reason cannot resolve pallet_balances_cli in node-cli 😩
      
      * wip
      
      * Subcommand::run takes &self
      
      * can't believe i missed that 🤦🏾‍♂️
      
      * bump wasm-bindgen for some reason
      
      * adds key subcommand, rename generate-node-key to generate-node-id
      
      * cargo update and crossed fingers 🤞🏽
      
      
      
      * update ui test
      
      * update more ui tests
      
      * should be all good now
      
      * revert subkey change
      
      * revert subkey change
      
      * adds frame-utilities-cli
      
      * Apply suggestions from code review
      
      Co-authored-by: default avatarBenjamin Kampmann <[email protected]>
      
      * removes frame from sc-cli, fix license
      
      * my editor and ci disagrees on line width
      
      * bump spec version
      
      * turn off default features for parity-scale-codec
      
      * enable full_crypto feature for sp-core in cli-utils
      
      * merge frame-utilities-cli with pallet-balances-cli
      
      * remove full_crypto feature from sp_core in cli-utils
      
      * bump Cargo.lock
      
      * cli-utils -> frame-utils
      
      * rename BlockNumber to GenericNumber, fix spaces
      
      * fix spaces
      
      * construct additional_signed manually
      
      * sign test
      
      * remove unused vars
      
      * implement subkey with frame-utilities-cli and sc_cli
      
      * fix moduleid test
      
      * CI and clion disagree on line widths
      
      * adds associated Params type to SignedExtensionProvider
      
      * Apply suggestions from code review
      
      Co-authored-by: default avatarBenjamin Kampmann <[email protected]>
      
      * move some code around
      
      * removes unneccesary generic params
      
      * moves module_id back to frame_utilities_cli
      
      * Apply suggestions from code review
      
      Co-authored-by: default avatarBenjamin Kampmann <[email protected]>
      Co-authored-by: default avatarBastian Köcher <[email protected]>
      
      * remove print_ext
      
      * remove MaybeDisplay from pallet_balances::Trait::Balance
      
      * a lot of stuff tbh
      
      * adds ExtrasParamsBuilder
      
      * remove tests for ModuleIdCmd
      
      * address comments from PR
      
      * bump Cargo.lock
      
      * manually insert key into keystore
      
      * remove unnecessary SharedParams
      
      * add validation to vanity pattern, remove unused arg
      
      * remove SharedParams from Sign, Vanity, Verify
      
      * remove SharedParams from ModuleIdCmd, remove expect from Verify, new line to Cargo.toml
      
      * remove SharedParams from InsertCmd
      
      * 🤦🏾
      
      ‍♂️
      
      * deleted prometheus.yml
      
      * move a few things around
      
      * fix vanity test
      
      Co-authored-by: default avatarBenjamin Kampmann <[email protected]>
      Co-authored-by: default avatarBastian Köcher <[email protected]>
      Co-authored-by: default avatarBenjamin Kampmann <[email protected]>
      69632724
  32. Aug 18, 2020
    • Roman Borschel's avatar
      Add support for sourced metrics. (#6895) · 807329dd
      Roman Borschel authored
      
      
      * Add support for sourced metrics.
      
      A sourced metric is a metric that obtains its values
      from an existing source, rather than the values being
      independently recorded. It thus allows collecting
      metrics from existing counters or gauges without
      having to duplicate them in a dedicated prometheus
      counter or gauge (and hence another atomic value).
      
      The first use-case is to feed the bandwidth counters
      from libp2p directly into prometheus.
      
      * Tabs, not spaces.
      
      * Tweak bandwidth counter registration.
      
      * Add debug assertion for variable labels and values.
      
      * Document monotonicity requirement for sourced counters.
      
      * CI
      
      * Update client/network/src/service.rs
      
      Co-authored-by: default avatarMax Inden <[email protected]>
      
      Co-authored-by: default avatarMax Inden <[email protected]>
      807329dd
  33. Aug 17, 2020
    • Shawn Tabrizi's avatar
      WeightInfo for System, Timestamp, and Utility (#6868) · 74a583d1
      Shawn Tabrizi authored
      * initial updates to system
      
      * fix compile
      
      * Update writer.rs
      
      * update weights
      
      * finish system weights
      
      * timestamp weights
      
      * utility weight
      
      * Fix overflow in weight calculations
      
      * add back weight notes
      
      * Update for whitelisted benchmarks
      
      * add trait bounds
      
      * Revert "add trait bounds"
      
      This reverts commit 12b08b7189aa3969f96fa19b211a370860fdb240.
      
      * Update weights for unaccounted for read
      74a583d1
  34. Aug 15, 2020
  35. Aug 03, 2020