1. 09 Jun, 2021 3 commits
  2. 08 Jun, 2021 1 commit
    • Lldenaurois's avatar
      Remove candidate selection (#3148) · a4dfdf16
      Lldenaurois authored
      * Create validator_side module
      
      * Subsume Candidate Selection
      
      * Add test to ensure candidate backing logic is correct
      
      * Ensure secondings are adequately cleaned up and address test flakyness
      
      * Address Feedback
      a4dfdf16
  3. 04 Jun, 2021 1 commit
  4. 01 Jun, 2021 1 commit
  5. 31 May, 2021 1 commit
    • asynchronous rob's avatar
      Reversion Safety tools for overseer and subsystems (#3104) · d8d8e926
      asynchronous rob authored
      * guide: reversion safety
      
      * guide: manage reversion safety in subsystems
      
      * add leaf status to ActivatedLeaf
      
      * add an LRU-cache to overseer for staleness detection
      
      * update ActivatedLeaf usages in tests to contain status field
      
      * add variant where missed accidentally
      
      * add some helpers to LeafStatus
      
      * address grumbles
      d8d8e926
  6. 27 May, 2021 1 commit
  7. 24 May, 2021 1 commit
  8. 22 May, 2021 2 commits
  9. 21 May, 2021 1 commit
  10. 19 May, 2021 1 commit
  11. 15 May, 2021 1 commit
  12. 13 May, 2021 1 commit
  13. 03 May, 2021 2 commits
    • Robert Klotzner's avatar
      More secure `Signed` implementation (#2963) · e9a29ecc
      Robert Klotzner authored
      * Remove signature verification in backing.
      
      `SignedFullStatement` now signals that the signature has already been
      checked.
      
      * Remove unused check_payload function.
      
      * Introduced unchecked signed variants.
      
      * Fix inclusion to use unchecked variant.
      
      * More unchecked variants.
      
      * Use unchecked variants in protocols.
      
      * Start fixing statement-distribution.
      
      * Fixup statement distribution.
      
      * Fix inclusion.
      
      * Fix warning.
      
      * Fix backing properly.
      
      * Fix bitfield distribution.
      
      * Make crypto store optional for `RuntimeInfo`.
      
      * Factor out utility functions.
      
      * get_group_rotation_info
      
      * WIP: Collator cleanup + check signatures.
      
      * Convenience signature checking functions.
      
      * Check signature on collator-side.
      
      * Fix warnings.
      
      * Fix collator side tests.
      
      * Get rid of warnings.
      
      * Better Signed/UncheckedSigned implementation.
      
      Also get rid of Encode/Decode for Signed! *party*
      
      * Get rid of dead code.
      
      * Move Signed in its own module.
      
      * into_checked -> try_into_checked
      
      * Fix merge.
      e9a29ecc
    • Bastian Köcher's avatar
      Companion for Substrate#8526 (#2845) · 75cebe9b
      Bastian Köcher authored
      * Update branch
      
      * Make it compile
      
      * Compile
      
      * gate approval-checking logic (#2470)
      
      * Fix build
      
      * Updates
      
      * Fix merge
      
      * Adds missing crate
      
      * Companion for Substrate#8386
      
      https://github.com/paritytech/substrate/pull/8386
      
      
      
      * Fix fix fix
      
      * Fix
      
      * Fix compilation
      
      * Rewrite to `ParachainsInherentDataProvider`
      
      * Make it compile
      
      * Renamings
      
      * Revert stuff
      
      * Remove stale file
      
      * Guide updates
      
      * Update node/core/parachains-inherent/src/lib.rs
      
      Co-authored-by: Andronik Ordian's avatarAndronik Ordian <write@reusable.software>
      
      * Update node/core/parachains-inherent/src/lib.rs
      
      Co-authored-by: Andronik Ordian's avatarAndronik Ordian <write@reusable.software>
      
      * Apply suggestions from code review
      
      * Reset accidental changes
      
      * More
      
      * Remove stale file
      
      * update Substrate
      
      Co-authored-by: asynchronous rob's avatarRobert Habermeier <rphmeier@gmail.com>
      Co-authored-by: Andronik Ordian's avatarAndronik Ordian <write@reusable.software>
      Co-authored-by: parity-processbot <>
      75cebe9b
  14. 25 Apr, 2021 1 commit
  15. 16 Apr, 2021 1 commit
    • Robert Klotzner's avatar
      Infrastructure improvements (#2897) · fff63cb5
      Robert Klotzner authored
      * Factor out runtime module into utils.
      
      * Add maybe_authority information to `PeerConnected` event.
      
      We already gather this information in authority discovery, so we might
      as well share it with others.
      
      This opens up an easy path to trigger validators differently from normal
      nodes, e.g. for prioritization. This change has become more important
      now, that we just connect to all validators and therefore just have a
      long peer list without any information about those nodes.
      
      * Test fix.
      fff63cb5
  16. 14 Apr, 2021 1 commit
  17. 09 Apr, 2021 2 commits
    • Robert Klotzner's avatar
      Req/res optimization for statement distribution (#2803) · 48d5b143
      Robert Klotzner authored
      * Wip
      
      * Increase proposer timeout.
      
      * WIP.
      
      * Better timeout values now that we are going to be connected to all nodes. (#2778)
      
      * Better timeout values.
      
      * Fix typo.
      
      * Fix validator bandwidth.
      
      * Fix compilation.
      
      * Better and more consistent sizes.
      
      Most importantly code size is now 5 Meg, which is the limit we currently
      want to support in statement distribution.
      
      * Introduce statement fetching request.
      
      * WIP
      
      * Statement cache retrieval logic.
      
      * Review remarks by @rphmeier
      
      * Fixes.
      
      * Better requester logic.
      
      * WIP: Handle requester messages.
      
      * Missing dep.
      
      * Fix request launching logic.
      
      * Finish fetching logic.
      
      * Sending logic.
      
      * Redo code size calculations.
      
      Now that max code size is compressed size.
      
      * Update Cargo.lock (new dep)
      
      * Get request receiver to statement distribution.
      
      * Expose new functionality for responding to requests.
      
      * Cleanup.
      
      * Responder logic.
      
      * Fixes + Cleanup.
      
      * Cargo.lock
      
      * Whitespace.
      
      * Add lost copyright.
      
      * Launch responder task.
      
      * Typo.
      
      * info -> warn
      
      * Typo.
      
      * Fix.
      
      * Fix.
      
      * Update comment.
      
      * Doc fix.
      
      * Better large statement heuristics.
      
      * Fix tests.
      
      * Fix network bridge tests.
      
      * Add test for size estimate.
      
      * Very simple tests that checks we get LargeStatement.
      
      * Basic check, that fetching of large candidates is performed.
      
      * More tests.
      
      * Basic metrics for responder.
      
      * More metrics.
      
      * Use Encode::encoded_size().
      
      * Some useful spans.
      
      * Get rid of redundant metrics.
      
      * Don't add peer on duplicate.
      
      * Properly check hash
      
      instead of relying on signatures alone.
      
      * Preserve ordering + better flood protection.
      
      * Get rid of redundant clone.
      
      * Don't shutdown responder on failed query.
      
      And add test for this.
      
      * Smaller fixes.
      
      * Quotes.
      
      * Better queue size calculation.
      
      * A bit saner response sizes.
      
      * Fixes.
      48d5b143
    • asynchronous rob's avatar
      set groups correctly even if not validator (#2863) · cf87cbe6
      asynchronous rob authored
      shows what I get for being hasty last time. i added a test this time, which would have caught this issue last time.
      cf87cbe6
  18. 08 Apr, 2021 4 commits
    • asynchronous rob's avatar
      no backing job early exit if not validator (#2860) · 37e1ab8b
      asynchronous rob authored
      with the MaxValidators parameter set, this meant that only validators participating in parachain consensus would be able to author relay-chain blocks containing backed candidates
      37e1ab8b
    • Andronik Ordian's avatar
      silence some parachain warnings (#2859) · 0cc275d6
      Andronik Ordian authored
      * silence some parachain warnings
      
      * that was actually a bug that Rob is fixing
      0cc275d6
    • Sergey Pepyakin's avatar
      New PVF validation host (#2710) · 0eb7905a
      Sergey Pepyakin authored
      
      
      * Implement PVF validation host
      
      * WIP: Diener
      
      * Increase the alloted compilation time
      
      * Add more comments
      
      * Minor clean up
      
      * Apply suggestions from code review
      
      Co-authored-by: default avatarBastian Köcher <bkchr@users.noreply.github.com>
      
      * Fix pruning artifact removal
      
      * Fix formatting and newlines
      
      * Fix the thread pool
      
      * Update node/core/pvf/src/executor_intf.rs
      
      Co-authored-by: default avatarBastian Köcher <bkchr@users.noreply.github.com>
      
      * Remove redundant test declaration
      
      * Don't convert the path into an intermediate string
      
      * Try to workaround the test failure
      
      * Use the puppet_worker trick again
      
      * Fix a blip
      
      * Move `ensure_wasmtime_version` under the tests mod
      
      * Add a macro for puppet_workers
      
      * fix build for not real-overseer
      
      * Rename the puppet worker for adder collator
      
      * play it safe with the name of adder puppet worker
      
      * Typo: triggered
      
      * Add more comments
      
      * Do not kill exec worker on every error
      
      * Plumb Duration for timeouts
      
      * typo: critical
      
      * Add proofs
      
      * Clean unused imports
      
      * Revert "WIP: Diener"
      
      This reverts commit ff2d3ff2
      
      .
      
      * Sync version of wasmtime
      
      * Update cargo.lock
      
      * Update Substrate
      
      * Merge fixes still
      
      * Update wasmtime version in test
      
      * bastifmt
      
      Co-authored-by: default avatarBastian Köcher <bkchr@users.noreply.github.com>
      
      * Squash spaces
      
      * Trailing new line for testing.rs
      
      * Remove controversial code
      
      * comment about biasing
      
      * Fix suggestion
      
      * Add comments
      
      * make it more clear why unwrap_err
      
      * tmpfile retry
      
      * proper proofs for claim_idle
      
      * Remove mutex from ValidationHost
      
      * Add some more logging
      
      * Extract exec timeout into a constant
      
      * Add some clarifying logging
      
      * Use blake2_256
      
      * Clean up the merge
      
      Specifically the leftovers after removing real-overseer
      
      * Update parachain/test-parachains/adder/collator/Cargo.toml
      
      Co-authored-by: Andronik Ordian's avatarAndronik Ordian <write@reusable.software>
      
      Co-authored-by: default avatarBastian Köcher <bkchr@users.noreply.github.com>
      Co-authored-by: Andronik Ordian's avatarAndronik Ordian <write@reusable.software>
      0eb7905a
    • asynchronous rob's avatar
      Code, PoV compression and remove `CompressedPoV` struct (#2852) · e5bab572
      asynchronous rob authored
      * use compressed blob in candidate-validation
      
      * add some tests for compressed code blobs
      
      * remove CompressedPoV and apply compression in collation-generation
      
      * decompress BlockData before executing
      
      * don't produce oversized collations
      
      * add test for PoV decompression failure
      
      * fix tests and clean up
      
      * fix test
      
      * address review and fix CI
      
      * take this )
      e5bab572
  19. 07 Apr, 2021 1 commit
  20. 05 Apr, 2021 2 commits
  21. 03 Apr, 2021 1 commit
    • asynchronous rob's avatar
      Collation protocol: stricter validators (#2810) · 54e18e65
      asynchronous rob authored
      
      
      * guide: declare one para as a collator
      
      * add ParaId to Declare messages and clean up
      
      * fix build
      
      * fix the testerinos
      
      * begin adding keystore to collator-protocol
      
      * remove request_x_ctx
      
      * add core_for_group
      
      * add bump_rotation
      
      * add some more helpers to subsystem-util
      
      * change signing_key API to take ref
      
      * determine current and next para assignments
      
      * disconnect collators who are not on current or next para
      
      * add collator peer count metric
      
      * notes for later
      
      * some fixes
      
      * add data & keystore to test state
      
      * add a test utility for answering runtime API requests
      
      * fix existing collator tests
      
      * add new tests
      
      * remove sc_keystore
      
      * update cargo lock
      
      Co-authored-by: Andronik Ordian's avatarAndronik Ordian <write@reusable.software>
      54e18e65
  22. 01 Apr, 2021 5 commits
    • thiolliere's avatar
      Ease parachain candidate code fetching (#2593) · 96dc1f7a
      thiolliere authored
      
      
      * code stored in para + modify CandidateDescriptor.
      
      * WIP: digest + some more impl
      
      * validation_code_hash in payload + check in inclusion
      
      * check in client + refator
      
      * tests
      
      * fix encoding indices
      
      * remove old todos
      
      * fix test
      
      * fix test
      
      * add test
      
      * fetch validation code inside collation-generation from the relay-chain
      
      * HashMismatch -> PoVHashMismatch + miscompilation
      
      * refactor, store hash when needed
      
      * storage rename: more specific but slightly too verbose
      
      * do not hash on candidate validation, fetch hash instead
      
      * better test
      
      * fix test
      
      * guide updates
      
      * don't panic in runtime
      
      Co-authored-by: asynchronous rob's avatarRobert Habermeier <rphmeier@gmail.com>
      96dc1f7a
    • Andronik Ordian's avatar
    • asynchronous rob's avatar
      Approval Voting improvements (#2781) · 9b700da0
      asynchronous rob authored
      
      
      * extract database from av-store itself
      
      * generalize approval-voting over database type
      
      * modes (without handling) and pruning old wakeups
      
      * rework approval importing
      
      * add our_approval_sig to ApprovalEntry
      
      * import assignment
      
      * guide updates for check-full-approval changes
      
      * some aux functions
      
      * send messages when becoming active.
      
      * guide: network bridge sends view updates only when done syncing
      
      * network bridge: send view updates only when done syncing
      
      * tests for new network-bridge behavior
      
      * add a test for updating approval entry with sig
      
      * fix some warnings
      
      * test load-all-blocks
      
      * instantiate new parachains DB
      
      * fix network-bridge empty view updates
      
      * tweak
      
      * fix wasm build, i think
      
      * Update node/core/approval-voting/src/lib.rs
      
      Co-authored-by: Andronik Ordian's avatarAndronik Ordian <write@reusable.software>
      
      * add some versioning to parachains_db
      
      * warnings
      
      * fix merge changes
      
      * remove versioning again
      
      Co-authored-by: Andronik Ordian's avatarAndronik Ordian <write@reusable.software>
      9b700da0
    • asynchronous rob's avatar
      Add dispute types and change InclusionInherent to ParasInherent (#2791) · abc63637
      asynchronous rob authored
      * dispute types
      
      * add Debug to dispute primitives in std and InherentData
      
      * use ParachainsInherentData on node-side
      
      * change inclusion_inherent to paras_inherent
      
      * RuntimeDebug
      
      * add type parameter to PersistedValidationData users
      
      * fix test client
      
      * spaces
      
      * fix collation-generation test
      
      * fix provisioner tests
      
      * remove references to inclusion inherent
      abc63637
    • asynchronous rob's avatar
      Avoid querying the local validator in availability recovery (#2792) · 5b5bf207
      asynchronous rob authored
      * guide: don't request availability data from ourselves
      
      * add QueryAllChunks message
      
      * implement QueryAllChunks
      
      * remove unused relay_parent from StoreChunk
      
      * test QueryAllChunks
      
      * fast paths make short roads
      
      * test early exit behavior
      5b5bf207
  23. 30 Mar, 2021 1 commit
  24. 29 Mar, 2021 4 commits