Commit graph

14224 commits

Author SHA1 Message Date
Alex
b5ff754b70 updated default txArrivalWait value to 500ms. updated commented lines to indicate the new default value. updated tx_fetcher_test to test using the new default value 2023-02-09 00:18:39 -08:00
Pratik Patil
9795a287d0
added 2 flags to enable parallel EVM and set the number of speculative processes (#727) 2023-02-09 13:34:06 +05:30
Evgeny Danilenko
c46aae23da
add check for empty lists in txpool (#704)
* add check

* linters
2023-02-09 10:07:44 +03:00
SHIVAM SHARMA
a4f1ac1500
consensus/bor : add : devFakeAuthor flag (#697) 2023-02-09 12:10:32 +05:30
Evgeny Danilenko
22fa4033e8
Event based pprof (#732)
* feature

* Save pprof to /tmp

---------

Co-authored-by: Jerry <jerrycgh@gmail.com>
2023-02-08 13:41:09 -08:00
Alex
5496007cba updated type conversion point to simplify - tested flag and no-flag (default) settings 2023-02-07 20:43:03 -08:00
ephess
c6d7f59c8b
Revert "Reduce txArriveTimeout to 100ms" (#707)
This reverts commit 243d231fe4.
2023-02-07 14:54:21 +05:30
Pratik Patil
9880d754c6
Added flag in Status to wait for backend, and fixed panic issue. (#708)
* checking if backend is available during status call, and added a flag to wait if backend is not available

* added test for status command (does not cover the whole code)
2023-02-07 09:05:34 +05:30
Alex
f6903b4f57 added flags, carried flag var through p2p config to backend start func to handler to fetcher. TODO verify default, expose var to api 2023-02-04 18:15:54 -08:00
Arpit Temani
67843e17ec
version change (#721) 2023-02-03 18:30:08 +05:30
Arpit Temani
9fa20a7da8
Arpit/add execution pool 2 (#719)
* initial

* linters

* linters

* remove timeout

* update pool

* change pool size function

* check nil

* check nil

* fix tests

* Use execution pool from server in all handlers

* simplify things

* test fix

* add support for cli, config

* add to cli and config

* merge base branch

* debug statements

* fix bug

* atomic pointer timeout

* add apis

* update workerpool

* fix issues

* change params

* fix issues

* fix ipc issue

* remove execution pool from IPC

* revert

* fix tests

* mutex

* refactor flag and value names

* ordering fix

* refactor flag and value names

* update default ep size to 40

* fix bor start issues

* revert file changes

* debug statements

* fix bug

* update workerpool

* atomic pointer timeout

* add apis

* Merge branch 'add-execution-pool' of github.com:maticnetwork/bor into arpit/add-execution-pool

* fix issues

* change params

* fix issues

* fix ipc issue

* remove execution pool from IPC

* revert

* merge base branch

* Merge branch 'add-execution-pool' of github.com:maticnetwork/bor into arpit/add-execution-pool

* mutex

* fix tests

* Merge branch 'arpit/add-execution-pool' of github.com:maticnetwork/bor into arpit/add-execution-pool

* Change default size of execution pool to 40

* refactor flag and value names

* fix merge conflicts

* ordering fix

* refactor flag and value names

* update default ep size to 40

* fix bor start issues

* revert file changes

* fix linters

* fix go.mod

* change sec to ms

* change default value for ep timeout

* fix node api calls

* comment setter for ep timeout

---------

Co-authored-by: Evgeny Danienko <6655321@bk.ru>
Co-authored-by: Jerry <jerrycgh@gmail.com>
Co-authored-by: Manav Darji <manavdarji.india@gmail.com>
2023-02-03 18:22:57 +05:30
Manav Darji
fe1034e5e1
Revert "chg : trieTimeout from 60 to 10 mins (#692)" (#720)
This reverts commit 241843c7e7.
2023-02-03 15:42:38 +05:30
Arpit Temani
2be6ae43a1
Arpit/temp bor sync (#701)
* Increase grpc message size limit in pprof

* ReadBorReceipts improvements

* use internal function

* fix tests

* fetch geth upstread for ReadBorReceiptRLP

* Only query bor receipt when the query index is equal to # tx in block body

This change reduces the frequency of calling ReadBorReceipt and
ReadBorTransaction, which are CPU and db intensive.

* Revert "fetch geth upstread for ReadBorReceiptRLP"

This reverts commit 2e838a6b1313d26674f3a8df4b044e35dcbf35a0.

* Restore ReadBorReceiptRLP

* fix bor receipts

* remove unused

* fix lints

---------

Co-authored-by: Jerry <jerrycgh@gmail.com>
Co-authored-by: Manav Darji <manavdarji.india@gmail.com>
Co-authored-by: Evgeny Danienko <6655321@bk.ru>
2023-02-03 15:42:12 +05:30
Manav Darji
a1871ad22c
internal/cli: add skiptrace flag for profiling (#715)
* internal/cli: add skiptrace flag

* docs: update docs for skiptrace flag
2023-02-03 00:16:43 +05:30
Manav Darji
a533ffb289
core, tests/bor: add more tests for state-sync validation (#710)
* core: add get state sync function for tests

* tests/bor: add validation for state sync events post consensus
2023-02-02 14:21:45 +05:30
Raneet Debnath
cb973283bc core,eth,internal/cli,internal/ethapi: add --rpc.allow-unprotected-txs flag to allow txs to get replayed (for shadow node) 2023-01-27 16:05:37 +05:30
Manav Darji
cbbc27c27a
fix nil state-sync issue, increase grpc limit (#695)
* Increase grpc message size limit in pprof

* consensus/bor/bor.go : stateSyncs init fixed [Fix #686]

* eth/filters: handle nil state-sync before notify

* eth/filters: update check

Co-authored-by: Jerry <jerrycgh@gmail.com>
Co-authored-by: Daniil <daniil.melnik@chainstack.com>
2023-01-25 17:13:16 +05:30
Jerry
d25aa76447 Minor fix in statedb test 2023-01-24 12:08:08 -08:00
Shivam Sharma
2ad6dcf53b consensus/bor : add : devFakeAuthor flag 2023-01-20 17:13:36 +05:30
Pratik Patil
168ec6e8b0
changed version from 0.3.0 to 0.3.4-beta (#693) 2023-01-19 14:51:20 +05:30
SHIVAM SHARMA
38145fae21
internal/cli/server : fix : added triesInMemory in config (#691) 2023-01-19 14:41:38 +05:30
SHIVAM SHARMA
241843c7e7
chg : trieTimeout from 60 to 10 mins (#692)
* chg : trieTimeout from 60 to 10 mins

* chg : cache.timout to 10m from 1h in configs
2023-01-19 14:41:11 +05:30
Pratik Patil
e4dd2ee1ac
Added checks to RPC requests and introduced new flags to customise the parameters (#657)
* added a check to reject rpc requests with batch size > the one set using a newly added flag (rpcbatchlimit)

* added a check to reject rpc requests whose result size > the one set using a newly added flag (rpcreturndatalimit)

* updated the config files and docs
2023-01-19 14:40:24 +05:30
Didi
d6899d79ea
update requirements in README (#681) 2023-01-19 11:57:37 +05:30
Pratik Patil
4968c08246
added hardfork checks (#666) 2023-01-19 10:52:01 +05:30
SHIVAM SHARMA
a671c9eddd
internal/cli/server : fix : added triesInMemory in config (#677) 2023-01-18 21:41:52 +05:30
Raneet Debnath
e06376cd28
Merge pull request #674 from maticnetwork/raneet10/pos-1029
CI: Update matic-cli branch in integration tests
2023-01-16 14:31:19 +05:30
Raneet Debnath
af5d882473 trigger ci 2023-01-16 12:12:09 +05:30
Raneet Debnath
213d0cd56d CI: use matic-cli master branch 2023-01-16 09:11:02 +05:30
SHIVAM SHARMA
9aeaf03f05
Merge branch 'qa' and 'master' into develop (#663)
* Adding in Mumbai/Mainnet precursor deb packaging for tests to use during upgrade(iterations to come)

* Added changes per discussion in PR, more changes may be necessary

* Adding prerelease true

* Disabling goreleaser

* Removing README swap file

* change bor_dir and add bor user for v0.3.0 release

* rollback bor user and use root

* metrics: handle equal to separated config flag (#596)

* metrics: handle  based config path

* internal/cli/server: add more context to logs

* use space separated flag and value in bor.service

* fixed static-nodes related buf (os independent) (#598)

* fixed static-nodes related buf (os independent)

* taking static-nodes as input if default not present

* Update default flags (#600)

* internal/cli/server: use geth's default for txpool.pricelimit and add comments

* builder/files: update config.toml for mainnet

* packaging/templates: update defaults for mainnet and mumbai

* internal/cli/server: skip overriding cache

* packaging/templates: update cache value for mainnet

* packaging/templates: update gcmode for archive mumbai node

* metrics: handle nil telemetry config (#601)

* resolve merge conflicts

* update go version in release.yml

* update goversion in makefile

* update Docker login for goreleaser-cross v1.19

* Cleanup for the packager to use git tag in the package profile naming. Added conditional check for directory structure, this is in prep for v0.3.1, as this will create a failure on upgrade path in package due to file exist

* added a toml configuration file with comments describing each flag (#607)

* added a toml configuration file with comments describing each flag

* internal/cli/server: update flag description

* docs/cli: update example config and description of flags

* docs: update new-cli docs

Co-authored-by: Manav Darji <manavdarji.india@gmail.com>

* Adding of 0.3.0 package changes, control file updates, postinst changes, and packager update

* added ancient datadir flag and toml field, need to decide on default value and update the conversion script

* updated toml files with ancient field

* Add support for new flags in new config.toml, which were present in old config.toml (#612)

* added HTTPTimeouts, and TrieTimeout flag in new tol, from old toml

* added RAW fields for these time.Duration flags

* updated the conversion script to support these extra 4 flags

* removed hcl and json config tests as we are only supporting toml config files

* updated toml files with cache.timeout field

* updated toml files with jsonrpc.timeouts field

* tests/bor: expect a call for latest checkpoint

* tests/bor: expect a call for latest checkpoint

* packaging/templates: update cache values for archive nodes

Co-authored-by: Manav Darji <manavdarji.india@gmail.com>

* remove unwanted code

* Fix docker publish authentication issue

In gorelease-cross 1.19+, dockerhub authentication will require docker
logion action followed by mounting docker config file. See
https://github.com/goreleaser/goreleaser-cross#github-actions.

* Revert "update Docker login for goreleaser-cross v1.19"

This reverts commit 4d19cf5342.

* Bump version to stable

* Revert "Merge pull request #435 from maticnetwork/POS-553"

This reverts commit 657d262def, reversing
changes made to 88dbfa1c13.

* revert change for release for go1.19

* Add default values to CLI helper and docs

This commit adds default values to CLI helper and docs. When the default value of a string flag, slice string flag, or map string flag is empty, its helper message won't show any default value.

* Add a summary of new CLI in docs

* Updating packager as binutils changed version so that apt-get installs current versions

* Add state pruning to new CLI

* Minor wording fix in prune state description

* Bumping control file versions

* Mainnet Delhi fork

* Set version to stable

* change delhi hardfork block number

* handle future chain import and skip peer drop (#650)

* handle future chain import and skip peer drop

* add block import metric

* params: bump version to v0.3.3-stable

* Bump bor version in control files for v0.3.3 mainnet release

Co-authored-by: Daniel Jones <djones@polygon.technology>
Co-authored-by: Will Button <wbutton@polygon.technology>
Co-authored-by: Will Button <will@willbutton.com>
Co-authored-by: Manav Darji <manavdarji.india@gmail.com>
Co-authored-by: Daniel Jones <105369507+djpolygon@users.noreply.github.com>
Co-authored-by: Pratik Patil <pratikspatil024@gmail.com>
Co-authored-by: Arpit Temani <temaniarpit27@gmail.com>
Co-authored-by: Jerry <jerrycgh@gmail.com>
2023-01-13 14:47:14 +05:30
SHIVAM SHARMA
66c23d1eeb
Merge pull request #664 from maticnetwork/master
Merge 'master' into qa
2023-01-13 13:42:23 +05:30
marcello33
a323b5bc3e
sonarqube integration (#658)
* dev: add: sonarqube integration into security-ci

* dev: add: exclude java files from sonarqube analysis
2023-01-11 17:33:53 +01:00
Jerry
56d3058561
Merge pull request #655 from maticnetwork/manav/bump-control-files
packaging: bump bor version in control files
2023-01-09 10:41:17 -08:00
Manav Darji
dcdac12c44 Bump bor version in control files for v0.3.3 mainnet release 2023-01-09 23:00:49 +05:30
marcello33
5ae1b16970
dev: chg: update PR template to include nodes audience check (#641)
* dev: chg: update PR template to include nodes audience check

* dev: chg: better description

* dev: chg: add entry to changes too
2023-01-09 09:37:49 +01:00
Manav Darji
b480db16e8
handle future chain import and skip peer drop (#650)
* handle future chain import and skip peer drop

* add block import metric

* params: bump version to v0.3.3-stable
2023-01-07 11:58:03 +05:30
Arpit Temani
3eb234cd9a
Merge pull request #647 from cffls/qa
Merge qa to master for v0.3.2
2023-01-05 12:03:50 +05:30
Arpit Temani
db7eb29d88 change delhi hardfork block number 2023-01-05 10:41:27 +05:30
Jerry
c12e8f2aa8 Set version to stable 2023-01-04 12:20:15 -08:00
Jerry
59bdbef42a Mainnet Delhi fork 2023-01-04 12:20:15 -08:00
Krishna Upadhyaya
ad69ccd0ba
Added flags to run heimdall as a child process (#597)
* Added flags to run heimdall as a child process

* Fix: Lint

* Fix btcd package dependency for CI

* Update btcd package version

* Try removing ambigious importts

* dev: fix: lint fix for parallel tests

* remove delete for ambigious import

* Remove unwanted space

* go mod tidy

* try replace

* try replace

* use vendor

* rename vendor

* tidy

* vendor btcec

* clean up

* remove submodule

* remove submodule

* remove submodule

* remove submodule

* remove vendor & added replacer in test

* go mod tidy

* added replacer

* Update replacer

* Update replacer

* Merge branch 'develop' into run-heimdall-flags

* Skip TestGolangBindings

* Typo fix

* Remove unwanted changes

Co-authored-by: marcello33 <marcelloardizzone@hotmail.it>
Co-authored-by: Evgeny Danienko <6655321@bk.ru>
2022-12-23 23:15:46 +05:30
Pratik Patil
6f16d006fd Merge branch 'develop' of https://github.com/maticnetwork/bor into block-stm 2022-12-23 09:41:30 +05:30
Pratik Patil
d53c2e7902
Block stm miner dependency (#561)
* added support for dependencies (executor_tests)

* added a function to get dependency map

* getting all dependencies in the GetDep function

* updated GetDep function

* changed the type of AllDeps

* added a function to get dependency map

* updated GetDep function

* generate and get dependencies from block producer

* optimized getDep function

* bug fix regarding txn index and dep structure

* fixed gas bug

* optimized getDep function

* tests updated/added

* few updates regarding dependencies

* added channel to calculate the dependencies in a separate go routine

* minor changes in the executor which uses latest changes of dependecies + removed metadata flag/argument

* Use channel when metadata is available

* small bug fix

* getting reads and writes only when the transaction succeeds

* fixed bug in adding dependencies

* updated logic for delay/not delay

* bug fix (shouldDelayFeeCal) in parallel state processor

* lint fix

* using EnableMVHashMap flag

* fixed worker and stateProcessor and removed SetMVHashMapNil fumction from stateDB

* addredded few comments and fixed bug in executor tests

* commented executor tests with metadata (panic: test timed out after 5m0s)

* added a check to check len(mvReadMapList) > 0 in miner

* addressed comments, minor refactoring in dag.go

* moved blockContext out of Execute and adding it in execution task

* removed Author() from Settle() and added  in execution task

* not calling block.Header() again and again, using  instead

* removed EnableMVHashMap flag, and updated applyTransaction function

* addressed comments

* added unit test to check dependencies in the block header

Co-authored-by: Jerry <jerrycgh@gmail.com>
2022-12-23 09:14:09 +05:30
Arpit Temani
4aa56c543a
Merge pull request #627 from builder90210/faster_tx_fetch
Reduce txArriveTimeout to 100ms
2022-12-22 11:54:55 +05:30
SHIVAM SHARMA
d8fcda36f3
Merge pull request #640 from maticnetwork/shivam/POS-1041
Shivam/pos 1041
2022-12-20 17:49:01 +05:30
Shivam Sharma
7b52c93c1b chg : logging strings 2022-12-20 11:39:11 +05:30
Shivam Sharma
513127cd8f chg : use standard logging 2022-12-20 10:54:03 +05:30
Shivam Sharma
828801f9d8 lint : fix linters 2022-12-19 18:36:10 +05:30
Shivam Sharma
43cafc0415 add : multiple keystore tolerance 2022-12-19 18:08:18 +05:30
Shivam Sharma
9cba79edee init : remove exit on keystore err 2022-12-19 13:57:18 +05:30