Commit graph

14237 commits

Author SHA1 Message Date
Daniel Jones
7abbf23951
Merge pull request #811 from maticnetwork/djpolygon/18.04Updates
Djpolygon/18.04 updates
2023-04-05 12:15:03 -05:00
Daniel Jones
4522e5cfe4
Setting up bor to use hosted 18.04 runner as ubuntu provided 18.04 runner is end of life 2023-04-05 11:37:50 -05:00
Manav Darji
ac774c2695
Merge qa to master (#808)
* Added checks to RPC requests and introduced new flags to customise the parameters (#657)

* added a check to reject rpc requests with batch size > the one set using a newly added flag (rpcbatchlimit)

* added a check to reject rpc requests whose result size > the one set using a newly added flag (rpcreturndatalimit)

* updated the config files and docs

* chg : trieTimeout from 60 to 10 mins (#692)

* chg : trieTimeout from 60 to 10 mins

* chg : cache.timout to 10m from 1h in configs

* internal/cli/server : fix : added triesInMemory in config (#691)

* changed version from 0.3.0 to 0.3.4-beta (#693)

* fix nil state-sync issue, increase grpc limit (#695)

* Increase grpc message size limit in pprof

* consensus/bor/bor.go : stateSyncs init fixed [Fix #686]

* eth/filters: handle nil state-sync before notify

* eth/filters: update check

Co-authored-by: Jerry <jerrycgh@gmail.com>
Co-authored-by: Daniil <daniil.melnik@chainstack.com>

* core, tests/bor: add more tests for state-sync validation (#710)

* core: add get state sync function for tests

* tests/bor: add validation for state sync events post consensus

* Arpit/temp bor sync (#701)

* Increase grpc message size limit in pprof

* ReadBorReceipts improvements

* use internal function

* fix tests

* fetch geth upstread for ReadBorReceiptRLP

* Only query bor receipt when the query index is equal to # tx in block body

This change reduces the frequency of calling ReadBorReceipt and
ReadBorTransaction, which are CPU and db intensive.

* Revert "fetch geth upstread for ReadBorReceiptRLP"

This reverts commit 2e838a6b1313d26674f3a8df4b044e35dcbf35a0.

* Restore ReadBorReceiptRLP

* fix bor receipts

* remove unused

* fix lints

---------

Co-authored-by: Jerry <jerrycgh@gmail.com>
Co-authored-by: Manav Darji <manavdarji.india@gmail.com>
Co-authored-by: Evgeny Danienko <6655321@bk.ru>

* Revert "chg : trieTimeout from 60 to 10 mins (#692)" (#720)

This reverts commit 241843c7e7.

* Arpit/add execution pool 2 (#719)

* initial

* linters

* linters

* remove timeout

* update pool

* change pool size function

* check nil

* check nil

* fix tests

* Use execution pool from server in all handlers

* simplify things

* test fix

* add support for cli, config

* add to cli and config

* merge base branch

* debug statements

* fix bug

* atomic pointer timeout

* add apis

* update workerpool

* fix issues

* change params

* fix issues

* fix ipc issue

* remove execution pool from IPC

* revert

* fix tests

* mutex

* refactor flag and value names

* ordering fix

* refactor flag and value names

* update default ep size to 40

* fix bor start issues

* revert file changes

* debug statements

* fix bug

* update workerpool

* atomic pointer timeout

* add apis

* Merge branch 'add-execution-pool' of github.com:maticnetwork/bor into arpit/add-execution-pool

* fix issues

* change params

* fix issues

* fix ipc issue

* remove execution pool from IPC

* revert

* merge base branch

* Merge branch 'add-execution-pool' of github.com:maticnetwork/bor into arpit/add-execution-pool

* mutex

* fix tests

* Merge branch 'arpit/add-execution-pool' of github.com:maticnetwork/bor into arpit/add-execution-pool

* Change default size of execution pool to 40

* refactor flag and value names

* fix merge conflicts

* ordering fix

* refactor flag and value names

* update default ep size to 40

* fix bor start issues

* revert file changes

* fix linters

* fix go.mod

* change sec to ms

* change default value for ep timeout

* fix node api calls

* comment setter for ep timeout

---------

Co-authored-by: Evgeny Danienko <6655321@bk.ru>
Co-authored-by: Jerry <jerrycgh@gmail.com>
Co-authored-by: Manav Darji <manavdarji.india@gmail.com>

* version change (#721)

* Event based pprof (#732)

* feature

* Save pprof to /tmp

---------

Co-authored-by: Jerry <jerrycgh@gmail.com>

* Cherry-pick changes from develop (#738)

* Check if block is nil to prevent panic (#736)

* miner: use env for tracing instead of block object (#728)

---------

Co-authored-by: Dmitry <46797839+dkeysil@users.noreply.github.com>

* add max code init size check in txpool (#739)

* Revert "Event based pprof" and update version (#742)

* Revert "Event based pprof (#732)"

This reverts commit 22fa4033e8.

* params: update version to 0.3.4-beta3

* packaging/templates: update bor version

* internal/ethapi :: Fix : newRPCTransactionFromBlockIndex

* fix: remove assignment for bor receipt

---------

Co-authored-by: SHIVAM SHARMA <shivam691999@gmail.com>
Co-authored-by: Pratik Patil <pratikspatil024@gmail.com>
Co-authored-by: Jerry <jerrycgh@gmail.com>
Co-authored-by: Daniil <daniil.melnik@chainstack.com>
Co-authored-by: Arpit Temani <temaniarpit27@gmail.com>
Co-authored-by: Evgeny Danienko <6655321@bk.ru>
Co-authored-by: Dmitry <46797839+dkeysil@users.noreply.github.com>
2023-04-05 16:45:49 +05:30
Alex
1e926cfad9 merged in the current develop branch 2023-04-04 23:55:30 -07:00
Alex
a5b49c313f added a maxTxArrivalWait constant to the fetcher. config params with longer durations than maxTxArrivalWait will default to the maxTxArrivalWait duration 2023-04-04 23:20:07 -07:00
Pratik Patil
480ccf2aa8
Optimized the dependency metadata structure (#804)
* removed the first 2 element in TxDependency[i]

* addressed comments
2023-04-05 11:12:57 +05:30
Manav Darji
73f3c75aea
core: improve locks in txpool (#807)
* added a write lock to the txs.filter method and a read lock to the txs.reheap method - both of which are called by Filter during reorg adjustments to txpool

* txpool reorg locks

* more locks

* locks

* linters

* params, packaging: update version for v0.3.8-beta release

* core: add logs in reheap

---------

Co-authored-by: Alex <dalexwatts@gmail.com>
Co-authored-by: Evgeny Danienko <6655321@bk.ru>
2023-04-05 00:47:11 +05:30
Manav Darji
b39e64c335
eth/downloader/whitelist: skip future chain validation (#796)
* eth/downloader/whitelist: skip future chain validation

* eth/downloader/whitelist: fix tests for future chain import
2023-03-31 12:03:19 +05:30
Raneet Debnath
ef8f0abf78
Merge pull request #797 from maticnetwork/raneet10/revert-consensus-early-bailout
consensus/bor: revert "handle unauthorized signer in consensus.Prepare"
2023-03-30 10:20:52 +05:30
Raneet Debnath
7bd393fc68
Revert "consensus/bor: handle unauthorized signer in consensus.Prepare (#651)"
This reverts commit 9ce8c7de75a1b5021bb6f2b8086e813c8244b22c.
2023-03-30 08:33:31 +05:30
Raneet Debnath
bec3c39b73
consensus/bor: revert handle unauthorized signer in consensus.Prepare 2023-03-29 17:36:57 +05:30
marcello33
aaf5fe32f6
dev: chg: continue on error when uploading snyk results to GH (#795) 2023-03-28 13:43:17 +02:00
SHIVAM SHARMA
6f051513c2
add : testcase for CommitInterruptExperiment (#792)
* add : TestCommitInterruptExperimentBor

* lint : fix lint

* chg : add waitgroup
2023-03-28 13:31:37 +05:30
Raneet Debnath
b0ff49d373
Merge pull request #791 from maticnetwork/raneet10/pos-1345
internal/ethapi: set rpc gas cap as default gas limit when creating access list
2023-03-27 16:14:17 +05:30
Raneet Debnath
08a871c813
internal/ethapi: set rpc gas cap as default gas limit when creating access list 2023-03-27 14:59:47 +05:30
Jerry
72a222091c
v0.3.6 fix (#787)
* Fix get validator set in header verifier

* chg : commit tx logs from info to debug (#673)

* chg : commit tx logs from info to debug

* fix : minor changes

* chg : miner : commitTransactions-stats moved from info to debug

* lint : fix linters

* refactor logging

* miner : chg : UnauthorizedSignerError to debug

* lint : fix lint

* fix : log.Logger interface compatibility

---------

Co-authored-by: Evgeny Danienko <6655321@bk.ru>

* Remove unnecessary sorting of valset from header in verification

* dev: chg: version bump

---------

Co-authored-by: SHIVAM SHARMA <shivam691999@gmail.com>
Co-authored-by: Evgeny Danienko <6655321@bk.ru>
Co-authored-by: marcello33 <marcelloardizzone@hotmail.it>
2023-03-23 08:29:36 +01:00
Pratik Patil
584856b52d
internal/cli: added missing flags (#744)
* minor comment update

* added support for rpc.evmtimeout flag

* added support for vmdebug (EnablePreimageRecording) flag

* added support for jsonrpc.auth.(jwtsecret, addr, port, vhosts) flags

* added support for miner.recommit flag

* added support for gpo.maxheaderhistory and gpo.maxblockhistory flag

* Revert "added support for miner.recommit flag"

This reverts commit fcb722e4bf5bdda23d4c91da40ab95c9023a80c3.

* added pprof related flags (expect --pprof.cpuprofile - Write CPU profile to the given file)

* added support for --dev.gaslimit flag

* added support for --fdlimit flag

* added support for --netrestrict flag

* added support for --nodekey and --nodekeyhex flag

* added support for --vmodule, --log.json, --log.backtrace, and --log.debug flags

* fixed related lint errors

* fix lints from develop (few lints decided to appear from code that was untouched, weird)

* more weird lints from develop

* small precautionary fix

* small bug ;) fix in NetRestrict

* weird lints

* change vmdebug = true to vmdebug = false
2023-03-20 17:28:56 +05:30
Evgeny Danilenko
71eadd09ca
interrupting commit experiment (#556)
* initial

* delete

* linters

* big benchmark

* benchmark big ints

* delay

* fix generate

* remove debug

* miner : chg : remove noempty check

* fix lints

* consensus/bor: handle unauthorized signer in consensus.Prepare (#651)

* fix : break loop fix

* lint : fix

* lint : more lint fix

* fix : skip TestEmptyWorkEthash and TestEmptyWorkClique

* add : metrics commitInterruptCounter

---------

Co-authored-by: Shivam Sharma <shivam691999@gmail.com>
Co-authored-by: Arpit Temani <temaniarpit27@gmail.com>
Co-authored-by: Manav Darji <manavdarji.india@gmail.com>
2023-03-20 14:13:58 +05:30
Pratik Patil
238b4496d8
added support for miner.recommit flag (#743) 2023-03-17 16:13:23 +05:30
Raneet Debnath
c917e6fe68
Merge pull request #705 from maticnetwork/raneet10/pos-1126
core,eth,internal/cli,internal/ethapi: add --rpc.allow-unprotected-txs flag to allow txs to get replayed (for shadow node)
2023-03-16 15:00:28 +05:30
Raneet Debnath
92cd006df9
packaging,params: bump to v0.3.6 (#782) 2023-03-15 13:58:25 +01:00
marcello33
3ed22568fd
Hotfixes and deps bump (#776)
* dev: chg: bump deps

* internal/cli/server, rpc: lower down http readtimeout to 10s

* dev: chg: get p2p adapter

* dev: chg: lower down jsonrpc readtimeout to 10s

* cherry-pick txpool optimisation changes

* add check for empty lists in txpool (#704)

* add check

* linters

* core, miner: add empty instrumentation name for tracing

---------

Co-authored-by: Raneet Debnath <raneetdebnath10@gmail.com>
Co-authored-by: SHIVAM SHARMA <shivam691999@gmail.com>
Co-authored-by: Evgeny Danilenko <6655321@bk.ru>
Co-authored-by: Manav Darji <manavdarji.india@gmail.com>
2023-03-14 12:40:23 +01:00
Manav Darji
0d29c36734
core/txpool: implement DoS defenses from geth (#778) 2023-03-14 08:50:21 +01:00
Jerry
d0a9e0db2a
Verify validator set against local contract on receiving an end-of-sprint block (#768)
* Verify validator set against local contract on receiving an end-of-sprint block

* Fix tests

* Respect error returned by ParseValidators

* Keep going back until a parent block presents
2023-03-13 10:38:04 +01:00
SHIVAM SHARMA
f0d8a9d24d
bump dep : golang.org/x/net to v0.8.0 (#771) 2023-03-09 18:12:51 +01:00
marcello33
a96622e86e
mardizzone/pos-1313: bump crypto dependency (#772)
* dev: chg: bumd net dependency

* dev: chg: bump crypto dependency

* dev: chg: bump crypto dependency
2023-03-09 15:22:54 +01:00
SHIVAM SHARMA
fa489cab3f
bump dep : github.com/Masterminds/goutils to v1.1.1 (#769) 2023-03-09 19:51:38 +05:30
Arpit Temani
d817857e52
upgrade crypto lib version (#770) 2023-03-09 15:16:14 +05:30
Jerry
7db8c140fc
Merge pull request #767 from cffls/jerryc/v0.3.5
v0.3.5
2023-03-06 12:32:30 -08:00
Pratik Patil
318b7fadc9 fix lints from develop (few lints decided to appear from code that was untouched, weird) 2023-03-06 09:33:05 -08:00
Jerry
4671d97f31 Bump version to v0.3.5 2023-03-06 09:14:44 -08:00
Jerry
8698da045f Fix linter 2023-03-06 09:11:57 -08:00
Jerry
c7cc8c08ed Add holiman/big 2023-03-06 09:11:57 -08:00
Martin Holst Swende
7303e59f52 core/vm: use optimized bigint (#26021) 2023-03-06 09:11:57 -08:00
Jerry
a7bf4ba6bd Revert "bump : go version from 1.19 to 1.20.1 (#761)"
This reverts commit 4561012af9.
2023-03-06 09:08:46 -08:00
Krishna Upadhyaya
39b37b6f5c
Heimdall App implementation (#646) 2023-03-06 16:57:28 +05:30
SHIVAM SHARMA
4561012af9
bump : go version from 1.19 to 1.20.1 (#761) 2023-03-03 14:21:26 +05:30
Krishna Upadhyaya
4c68a7c6a1
Update wiki link (#762) 2023-03-02 17:41:18 +05:30
SHIVAM SHARMA
a85370115e
internal/ethapi :: Fix : newRPCTransactionFromBlockIndex 2023-02-27 15:38:34 +05:30
SHIVAM SHARMA
f973926ef0
core: add : impossible reorg block dump (#754)
* add : impossible reorg block dump

* chg : 3 seperate files for impossoble reorg dump

* add : use exportBlocks method and RLP blocks before writing

* chg : small changes
2023-02-26 21:28:12 +05:30
Manav Darji
4ca527255b
core: use internal context for sending traces (#755) 2023-02-24 12:52:45 +05:30
SHIVAM SHARMA
9e9efe48f1
Feat : SetMaxPeers (#726)
* init : add admin.setMaxPeers and getMaxPeers

* lint : fix lint

* add : some comments
2023-02-24 12:45:30 +05:30
Manav Darji
9859f2d43a
core, miner: add sub-spans for tracing (#753)
* core, miner: add sub-spans for tracing

* fix linters

* core: add logs for debugging

* core: add more logs to print tdd while reorg

* fix linters

* core: minor fix

* core: remove debug logs

* core: use different span for write block and set head
2023-02-23 18:20:03 +05:30
Manav Darji
c3d2c2689a
Merge qa to master (#750)
* Added checks to RPC requests and introduced new flags to customise the parameters (#657)

* added a check to reject rpc requests with batch size > the one set using a newly added flag (rpcbatchlimit)

* added a check to reject rpc requests whose result size > the one set using a newly added flag (rpcreturndatalimit)

* updated the config files and docs

* chg : trieTimeout from 60 to 10 mins (#692)

* chg : trieTimeout from 60 to 10 mins

* chg : cache.timout to 10m from 1h in configs

* internal/cli/server : fix : added triesInMemory in config (#691)

* changed version from 0.3.0 to 0.3.4-beta (#693)

* fix nil state-sync issue, increase grpc limit (#695)

* Increase grpc message size limit in pprof

* consensus/bor/bor.go : stateSyncs init fixed [Fix #686]

* eth/filters: handle nil state-sync before notify

* eth/filters: update check

Co-authored-by: Jerry <jerrycgh@gmail.com>
Co-authored-by: Daniil <daniil.melnik@chainstack.com>

* core, tests/bor: add more tests for state-sync validation (#710)

* core: add get state sync function for tests

* tests/bor: add validation for state sync events post consensus

* Arpit/temp bor sync (#701)

* Increase grpc message size limit in pprof

* ReadBorReceipts improvements

* use internal function

* fix tests

* fetch geth upstread for ReadBorReceiptRLP

* Only query bor receipt when the query index is equal to # tx in block body

This change reduces the frequency of calling ReadBorReceipt and
ReadBorTransaction, which are CPU and db intensive.

* Revert "fetch geth upstread for ReadBorReceiptRLP"

This reverts commit 2e838a6b1313d26674f3a8df4b044e35dcbf35a0.

* Restore ReadBorReceiptRLP

* fix bor receipts

* remove unused

* fix lints

---------

Co-authored-by: Jerry <jerrycgh@gmail.com>
Co-authored-by: Manav Darji <manavdarji.india@gmail.com>
Co-authored-by: Evgeny Danienko <6655321@bk.ru>

* Revert "chg : trieTimeout from 60 to 10 mins (#692)" (#720)

This reverts commit 241843c7e7.

* Arpit/add execution pool 2 (#719)

* initial

* linters

* linters

* remove timeout

* update pool

* change pool size function

* check nil

* check nil

* fix tests

* Use execution pool from server in all handlers

* simplify things

* test fix

* add support for cli, config

* add to cli and config

* merge base branch

* debug statements

* fix bug

* atomic pointer timeout

* add apis

* update workerpool

* fix issues

* change params

* fix issues

* fix ipc issue

* remove execution pool from IPC

* revert

* fix tests

* mutex

* refactor flag and value names

* ordering fix

* refactor flag and value names

* update default ep size to 40

* fix bor start issues

* revert file changes

* debug statements

* fix bug

* update workerpool

* atomic pointer timeout

* add apis

* Merge branch 'add-execution-pool' of github.com:maticnetwork/bor into arpit/add-execution-pool

* fix issues

* change params

* fix issues

* fix ipc issue

* remove execution pool from IPC

* revert

* merge base branch

* Merge branch 'add-execution-pool' of github.com:maticnetwork/bor into arpit/add-execution-pool

* mutex

* fix tests

* Merge branch 'arpit/add-execution-pool' of github.com:maticnetwork/bor into arpit/add-execution-pool

* Change default size of execution pool to 40

* refactor flag and value names

* fix merge conflicts

* ordering fix

* refactor flag and value names

* update default ep size to 40

* fix bor start issues

* revert file changes

* fix linters

* fix go.mod

* change sec to ms

* change default value for ep timeout

* fix node api calls

* comment setter for ep timeout

---------

Co-authored-by: Evgeny Danienko <6655321@bk.ru>
Co-authored-by: Jerry <jerrycgh@gmail.com>
Co-authored-by: Manav Darji <manavdarji.india@gmail.com>

* version change (#721)

* Event based pprof (#732)

* feature

* Save pprof to /tmp

---------

Co-authored-by: Jerry <jerrycgh@gmail.com>

* Cherry-pick changes from develop (#738)

* Check if block is nil to prevent panic (#736)

* miner: use env for tracing instead of block object (#728)

---------

Co-authored-by: Dmitry <46797839+dkeysil@users.noreply.github.com>

* add max code init size check in txpool (#739)

* Revert "Event based pprof" and update version (#742)

* Revert "Event based pprof (#732)"

This reverts commit 22fa4033e8.

* params: update version to 0.3.4-beta3

* packaging/templates: update bor version

* params, packaging/templates: update bor version

---------

Co-authored-by: SHIVAM SHARMA <shivam691999@gmail.com>
Co-authored-by: Pratik Patil <pratikspatil024@gmail.com>
Co-authored-by: Jerry <jerrycgh@gmail.com>
Co-authored-by: Daniil <daniil.melnik@chainstack.com>
Co-authored-by: Arpit Temani <temaniarpit27@gmail.com>
Co-authored-by: Evgeny Danienko <6655321@bk.ru>
Co-authored-by: Dmitry <46797839+dkeysil@users.noreply.github.com>
2023-02-20 18:37:21 +05:30
marcello33
808259b4dc
mardizzone/hotfix-snyk: remove vcs build when running snyk (#745) 2023-02-17 13:08:10 +01:00
Raneet Debnath
4917fde5be builder,docs/cli,packaging: update toml files 2023-02-16 09:59:22 +05:30
Raneet Debnath
2c35dcc5bb core,docs/cli,internal/cli/server: make docs 2023-02-15 20:06:15 +05:30
Manav Darji
79718d7445
Revert "Event based pprof" and update version (#742)
* Revert "Event based pprof (#732)"

This reverts commit 22fa4033e8.

* params: update version to 0.3.4-beta3

* packaging/templates: update bor version
2023-02-15 14:07:26 +05:30
Alex
070b13efbd added config.toml example values to different config setups, added TxArrivalWaitRaw string for toml and hcl value inputs 2023-02-14 22:03:42 -08:00
Jerry
55962e16c6 [Bug fix] Use parallel processor in unit test 2023-02-14 15:20:40 -08:00