fix!: update polkadot-js, and adjust for breaking changes (`/accounts/{accountId}/balance-info`) (#1255)

* chore(deps): update polkadot-js

* Fix polkadot primitive candidate type cast in paras headers endpoint

* Update polkadot-js

* fix the accounts endpoint

* Fix tests, and cleanup responses

* Update polkadot historical e2e-tests

* Update kusama historical e2e-tests

* Update westend historical e2e-tests

* Update statemine historical e2e tests

* Add inline docs

* Update docs

* lint

* Update docs/src/openapi-v1.yaml

Co-authored-by: Cameron Marshall <[email protected]>

* rebuild docs

---------

Co-authored-by: Cameron Marshall <[email protected]>

* test pallet dispatch call

* update fetchDispatchables service

* add e2e tests for dispatchables endpoint
update docs

* update getDispatchablesItemMeta

* update dispatchables unit tests

* update abstractpalletservice

* update docs, fix mispells

* update docs and remove log

* add endpoint for pallet constants
add unit and e2e tests

* update docs for consts endpoint

* merged master
added statemint consts e2e tests

* update abstractpalletservice

* add newline in response mocks

* yarn lint

* update docs

* chore: add e2e-tests to linting

* cleanup package.json

* add events pallet events endpoint
add unit tests
add e2e test

* update docs for pallet events endpoint

* add statemint e2e tests for pallet events endpoint

* update events references

* remove duplicate IPalletEventsParam reference

* lint

* add events check to getPalletMetadataType
add unhappy path check to fetchEventItem unit tests

* merge master

* update abstratpalletservice types
refactored events items assignment

* update error message to reflect more accurately when the pallet metadata has no items to query of a specific field type

* debug historicApi pallets

* update check for isValidPalletName to use the pallet meta data instead of the historicApi

* update error log for when a pallet id is not recognized

* yarn lint

* tests: fix e2e tests, add kusama westend, and remove ws check

* remove grumble

* fix fmt

* Added the `validators` endpoint
- Controller, service, response type
- Returns all validators addresses and their corresponding status (active / waiting)

* Validators Info per block
- Added the `at` query param
- Modified the Service accordingly

* yarn lint

* Changes `array` to `Set` (James Super Tip)
- Changed the data structure used to save the validators in the active set from an `array` to a `Set` (based on James suggestion)
- Changed also the used functions accordingly.
- Merged in one loop the check of which validator is in the active set and the population of the returned array.

* Lint & Update docs
- yarn lint
- Added validators endpoint to the docs
- Corrected other parts of the docs mentioned by the swagger as errors.

* Added in latest e2e tests the validators endpoint

* Changes from Tarik s comments

* Adjustments in the docstring

* Update src/services/pallets/PalletsStakingValidatorsService.ts

Co-authored-by: Tarik Gul <[email protected]>

* yarn lint:fix

Co-authored-by: Tarik Gul <[email protected]>

* add controller and service for errors

* add pallet errors endpoint

* removed unused error query param

* fix newline in response json

* add abstract pallet service

* add AbstractPallerService

* remove dev log

* change access modifier in abstract pallets

* change fn name

* add errors pallet to kusama

* remove unused import
remove newline

* remove lower casing of pallet name in fetchErrors
update latest polkadot e2e tests with PhragmentElection Pallet

* update parsedPalletName

* nomination pools

* chore(deps): updated polkadot-js deps

* feat: support for nomination pools

* update tests

* update nomination pool service

* update test

* remove historicApi as param

* removed historicApi param from nomination pool info service

* lint

* update param info

* update metadata arg, remove legacy docs

* update open-api yml

* update open api refs

* add nomination pools controller to kusama and polkadot controllers

* add comments to nomination pool service fns

* add nomination pool latest e2e test

* feat: add /paras/head

* backed candidates endpoint

* finalize the backed-candidate logic

* fix grumble with return type

* fix types and complete /paras/head logic

* cleanup

* add test for parasHead, and add at field for responses

* add test for backed candidates

* add docs

* add inline docs

* rework the endpoints

* update docs

* remove mute mock data

* update endpoint descriptions

* leases to heads

* adjust inline comment

* add the endpoints to the latest e2e tests

* fix spacing

* test(e2e-tests): outline errors for the process

* add correct error code when sidecar fails to build

* reorg the tsconfig in e2e tests and where the entry file exists

* add endpoints

* change yarn script names to historical for init

* change request format to return statusCode as well as data

* add working script

* some cleanup

* organize naming

* cleanup

* fix tiny grumble

* add license to file

* add script to startup the e2e tests

* fix small blunders, and add scripts to package.json

* set runE2eTests to runHistoricalE2eTests

* add --local to historical e2e tests

* get local working, and fix resolving errors

* fix is local to fail when a chain is not specified

* DRY up code

* update docs in scripts

* docs in e2e-tests

* cleanup

* add all statemint end points

* make `--local` take in an input

* update release notes

* add latest to readme

* new lint

test(e2e-tests): reorg the e2e-tests to be under a historic folder to prepare for current tests (#1147)

* test: optimize jest performance

* add test:ci

* feat: include balance-info support for statemine and statemint

* add newline char to json

* remove spaces between test endpoints

* fix test endpoint spacing

* test(e2e): cleanup timeout ms

* remove comments

* fix: add TransactionPayment::TransactionPaidFee support

* add e2e-tests for kusama

* add e2e tests to polkadot

* add `fromEvent` dispatchFeeType

* update @substrate/calc

* remove feeByEvent query param

* integrate calc_partial_fee

* update e2e-tests for kusama

* update polkadot e2e tests

* update westend e2e tests

* fix ss58 field in runtime/spec for statemint

* update the docs

* add apiAt.call.transactionPaymentApi

* add queryFeeErrCache

* fix tests

* stop using call and use the RPC

* fix tests, and remove consoles

* add QueryFeeDetailsCache

* fix kusama chain config for fees

* lint

* fix grumbles

* fix naming for QueryFeeCache

* fix QueryFeeDetailsCache, and write tests

* Update src/services/blocks/BlocksService.ts

Co-authored-by: James Wilson <[email protected]>

* Update docs/src/openapi-v1.yaml

Co-authored-by: James Wilson <[email protected]>

* Update src/services/blocks/BlocksService.ts

Co-authored-by: James Wilson <[email protected]>

* Update src/types/chains-config/ControllerConfig.ts

Co-authored-by: James Wilson <[email protected]>

* fix conflct

* fix _versionWithCall when null check

* change if to else if in QueryFeeDetailsCache

* complete unfinished comment

* set subtrate/calc back to 0.3.0

* rename QueryFeeCache methods and instance vars

* isQueryFeeDetailsAvail -> hasQueryFeeDetails

* change to hasQueryFeeApi

* add notes

Co-authored-by: James Wilson <[email protected]>

* test(e2e): update /accounts/{address}/validate for kusama

* test(e2e): update /accounts/{address}/validate for polkadot

* test(e2e): update /accounts/{address}/validate for westend

* remove calcFee

* remove all calcFee tests

* remove all calcFee associated types

* remove export for MetadataConsts

* adjust mock response to reflect api.rpc.payment.queryInfo

* remove ICalcFee

* handle minCalcFeeRuntime

* adjust minCalcFeeRuntime error message

* fix e2e tests for kusama

* adjust polkadot e2e-tests

* add a check for rpc.payment

* chore(license): append the license to the top of each file

* lint

* add licensing to calc

* fix(e2e-tests): update kusama with 9150, 9151, 9160, 9170

* fix: add polkadot account e2e-tests

* fix: update polkadot with 9140, 9151, and 9170

* update statemine with e2e-tests

* update e2e tests for statemint

* fix serializing wrapperkeepopaque and wrapperopaque

* add e2e test for v9151 which contains an WrapperKeepOpaque<Call>

* cleanup comments

* refactor code

* fix: change /experimental to /paras in description

* statemint account assets e2e boilerplate

* fix(temporary): change min calc fee runtime version to 601

* statemint block e2e tests

* add runtime spec for statmint e2e tests

* update e2e tests for statemint configuration

* add v9122, and v9140 blocks for polkadot

* add polkadot 9122 and 9140 tests for accounts

* fix: comments on runtime version

* revert min calc fee statemint

* update kusama 9130 accounts

* update blocks 9130

* updates paras/* for 9130 and cleanup

* update paras paras e2e 9130

* fix comment grumble

* add statemint script

* lint

* docs: update readme for e2e-tests

* Update e2e-tests/README.md

Co-authored-by: Niklas Adolfsson <[email protected]>

Co-authored-by: Niklas Adolfsson <[email protected]>

* preserve the eperimental route, add /paras

* fix: remove /experimental from e2e tests

* docs

* remove warnings

* paras e2e tests for kusama

* lint

* eslint disable next lint

* update blocks e2e for kusama

* update blocks e2e for polkadot

* add westend e2e block

* e2e tests for staking info

* lint

* add ValidateAddressService

* add ValidateAddressController

* add AccountsValidate to polkadot, westend, and kusama

* imports

* add kusama chain config

* fix response

* fix networkInfo bug

* lint

* get tests started

* change the name of the service

* cleanup, lint, fix build, test boilerplate

* update the tests

* more tests

* use hexToU8a for hex conversion

* add tests for hex values

* cleanup

* docs

* e2e tests for validate

* update e2e responses

* update docs

* Update docs/src/openapi-v1.yaml

Co-authored-by: David <[email protected]>

* docs

Co-authored-by: David <[email protected]>

* switch asset service to historicApi

* fix: bug

* throw appropriate error for missing pallet

* lint

* asset-balance e2e tests for statemint

* add more tests for asset balances

* e2e for statemine

* lint

* Update src/services/accounts/AccountsAssetsService.ts

Co-authored-by: David <[email protected]>

* adjust the returned error when assets pallets doesnt exist

* fix comment

Co-authored-by: David <[email protected]>

* polkadot e2e-vesting-info

* update tests for vesting info

* refactor balance-info

* lint

* return error when vesting info pallet doesnt exist

* kusama e2e tests for vesting info, adjust polkadot ones

* add westend and lint

* cleanup

fix(BlocksService): refactor api.derive for performance, and add historicApi to BlocksService (#699)

* fix: refactor api.derive.chain in /blocks

* add historicApi

* remove bench test

* tests: adjust tests to accept historicalApi

* refactor blocks to use historicApi

* fix: fetchevents bug

* fix: update historic kusama blocks e2e tests

* put back --silent

* fix: lint

* fix: tests for pallets staking progress

* cleanup

* optimize getWeights, remove expandMetadata

* fix: nexttFeeMultiplier get by parent hash

* add ? to nextFeeMultiplier

* lint

* fix: add eraInfo as a field in extrinsics response

* docs: update docs with GenericExtrinsicEra

* fix: switch eraInfo to era

* docs: update docs

* fix: refactor

* fix: lint

* fix: update mock data, and adjust unit tests

* docs: update GenericExtrinsicEra description

* Update docs/src/openapi-v1.yaml

Co-authored-by: David <[email protected]>

* docs: adjust docs

* tests(e2e): update kusama e2e test responses for /blocks

* tests(e2e): update the polkadot e2e tests for /blocks

* tests(e2e): update westend e2e responses for /blocks

* fix: space at end of file

Co-authored-by: David <[email protected]>

* fix: add e2e for kusama

* fix: add runtime for polkadot endpoints

* fix: grumbles

* fix: add runtime response types

* fix: add RuntimeResponse type (typecast)

* boilerplate for westend

* add runtime endpoints for westend

* lint

* fix: refactor e2e structure