Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Test #6661

Open
wants to merge 4 commits into
base: master
Choose a base branch
from
Open

Test #6661

wants to merge 4 commits into from

Conversation

kwxm
Copy link
Contributor

@kwxm kwxm commented Nov 13, 2024

Do not merge!

@kwxm kwxm added Do not merge EXPERIMENT Experiments that we probably don't want to merge No Changelog Required Add this to skip the Changelog Check labels Nov 13, 2024
@kwxm
Copy link
Contributor Author

kwxm commented Nov 13, 2024

/benchmark validation cap=9

@kwxm
Copy link
Contributor Author

kwxm commented Nov 13, 2024

/benchmark validation cap=8-12

@kwxm
Copy link
Contributor Author

kwxm commented Nov 14, 2024

/benchmark validation cap=9

Copy link
Contributor

Click here to check the status of your benchmark.

Copy link
Contributor

github-actions bot commented Nov 14, 2024

Comparing benchmark results of 'validation' on '01fdff8bad' (base) and '62739d7f11' (PR)

CPU 9

Results table
Script 01fdff8 62739d7 Change
auction_1-1 255.5 μs 255.4 μs -0.0%
auction_1-2 907.6 μs 912.2 μs +0.5%
auction_1-3 901.7 μs 903.8 μs +0.2%
auction_1-4 330.9 μs 331.3 μs +0.1%
auction_2-1 257.1 μs 256.4 μs -0.3%
auction_2-2 909.6 μs 912.6 μs +0.3%
auction_2-3 1.189 ms 1.191 ms +0.2%
auction_2-4 903.6 μs 904.1 μs +0.1%
auction_2-5 330.9 μs 330.9 μs 0.0%
crowdfunding-success-1 300.3 μs 301.6 μs +0.4%
crowdfunding-success-2 302.4 μs 303.4 μs +0.3%
crowdfunding-success-3 303.4 μs 302.5 μs -0.3%
currency-1 361.7 μs 359.3 μs -0.7%
escrow-redeem_1-1 500.1 μs 499.3 μs -0.2%
escrow-redeem_1-2 505.4 μs 502.2 μs -0.6%
escrow-redeem_2-1 587.5 μs 588.1 μs +0.1%
escrow-redeem_2-2 587.5 μs 585.1 μs -0.4%
escrow-redeem_2-3 587.2 μs 585.7 μs -0.3%
escrow-refund-1 225.5 μs 225.4 μs -0.0%
future-increase-margin-1 359.5 μs 360.2 μs +0.2%
future-increase-margin-2 774.6 μs 775.8 μs +0.2%
future-increase-margin-3 772.7 μs 768.5 μs -0.5%
future-increase-margin-4 696.6 μs 694.6 μs -0.3%
future-increase-margin-5 1.154 ms 1.153 ms -0.1%
future-pay-out-1 358.5 μs 356.0 μs -0.7%
future-pay-out-2 772.3 μs 770.6 μs -0.2%
future-pay-out-3 769.9 μs 769.8 μs -0.0%
future-pay-out-4 1.154 ms 1.152 ms -0.2%
future-settle-early-1 359.0 μs 359.5 μs +0.1%
future-settle-early-2 774.0 μs 771.2 μs -0.4%
future-settle-early-3 770.4 μs 769.5 μs -0.1%
future-settle-early-4 861.5 μs 861.3 μs -0.0%
game-sm-success_1-1 554.5 μs 555.9 μs +0.3%
game-sm-success_1-2 287.6 μs 287.1 μs -0.2%
game-sm-success_1-3 908.3 μs 910.5 μs +0.2%
game-sm-success_1-4 335.2 μs 336.8 μs +0.5%
game-sm-success_2-1 553.5 μs 555.7 μs +0.4%
game-sm-success_2-2 287.3 μs 286.8 μs -0.2%
game-sm-success_2-3 909.3 μs 909.2 μs -0.0%
game-sm-success_2-4 336.0 μs 335.7 μs -0.1%
game-sm-success_2-5 909.0 μs 908.5 μs -0.1%
game-sm-success_2-6 336.5 μs 335.6 μs -0.3%
multisig-sm-1 562.1 μs 562.2 μs +0.0%
multisig-sm-2 549.8 μs 546.9 μs -0.5%
multisig-sm-3 554.5 μs 552.1 μs -0.4%
multisig-sm-4 560.5 μs 562.2 μs +0.3%
multisig-sm-5 790.7 μs 792.3 μs +0.2%
multisig-sm-6 560.9 μs 559.9 μs -0.2%
multisig-sm-7 548.5 μs 548.6 μs +0.0%
multisig-sm-8 552.9 μs 553.3 μs +0.1%
multisig-sm-9 560.9 μs 561.6 μs +0.1%
multisig-sm-10 792.3 μs 792.7 μs +0.1%
ping-pong-1 465.4 μs 465.2 μs -0.0%
ping-pong-2 465.7 μs 465.9 μs +0.0%
ping-pong_2-1 286.7 μs 285.8 μs -0.3%
prism-1 242.6 μs 242.1 μs -0.2%
prism-2 587.5 μs 588.0 μs +0.1%
prism-3 529.8 μs 527.3 μs -0.5%
pubkey-1 203.5 μs 202.5 μs -0.5%
stablecoin_1-1 1.284 ms 1.282 ms -0.2%
stablecoin_1-2 281.1 μs 280.8 μs -0.1%
stablecoin_1-3 1.481 ms 1.485 ms +0.3%
stablecoin_1-4 299.4 μs 299.3 μs -0.0%
stablecoin_1-5 1.907 ms 1.910 ms +0.2%
stablecoin_1-6 368.0 μs 369.8 μs +0.5%
stablecoin_2-1 1.284 ms 1.286 ms +0.2%
stablecoin_2-2 281.4 μs 282.0 μs +0.2%
stablecoin_2-3 1.484 ms 1.479 ms -0.3%
stablecoin_2-4 299.6 μs 299.1 μs -0.2%
token-account-1 268.0 μs 268.3 μs +0.1%
token-account-2 476.8 μs 476.7 μs -0.0%
uniswap-1 586.5 μs 586.8 μs +0.1%
uniswap-2 316.7 μs 315.4 μs -0.4%
uniswap-3 2.510 ms 2.514 ms +0.2%
uniswap-4 483.3 μs 483.2 μs -0.0%
uniswap-5 1.648 ms 1.653 ms +0.3%
uniswap-6 457.5 μs 457.9 μs +0.1%
vesting-1 494.5 μs 494.4 μs -0.0%
01fdff8 62739d7 Change
TOTAL 50.27 ms 50.27 ms -0.0%

@kwxm
Copy link
Contributor Author

kwxm commented Nov 14, 2024

/benchmark validation cap=7

@kwxm
Copy link
Contributor Author

kwxm commented Nov 14, 2024

/benchmark validation cap=11

Copy link
Contributor

Click here to check the status of your benchmark.

Copy link
Contributor

github-actions bot commented Nov 15, 2024

Comparing benchmark results of 'validation' on '01fdff8bad' (base) and '62739d7f11' (PR)

CPU 7

Results table
Script 01fdff8 62739d7 Change
auction_1-1 185.7 μs 185.5 μs -0.1%
auction_1-2 664.3 μs 662.4 μs -0.3%
auction_1-3 667.2 μs 658.8 μs -1.3%
auction_1-4 239.4 μs 240.3 μs +0.4%
auction_2-1 185.7 μs 185.8 μs +0.1%
auction_2-2 661.7 μs 662.3 μs +0.1%
auction_2-3 861.2 μs 867.2 μs +0.7%
auction_2-4 653.5 μs 658.2 μs +0.7%
auction_2-5 240.1 μs 240.6 μs +0.2%
crowdfunding-success-1 219.8 μs 219.8 μs 0.0%
crowdfunding-success-2 220.7 μs 221.1 μs +0.2%
crowdfunding-success-3 219.2 μs 220.3 μs +0.5%
currency-1 260.6 μs 261.4 μs +0.3%
escrow-redeem_1-1 365.6 μs 362.4 μs -0.9%
escrow-redeem_1-2 363.7 μs 364.5 μs +0.2%
escrow-redeem_2-1 424.2 μs 424.9 μs +0.2%
escrow-redeem_2-2 424.4 μs 425.4 μs +0.2%
escrow-redeem_2-3 422.5 μs 425.3 μs +0.7%
escrow-refund-1 166.7 μs 162.2 μs -2.7%
future-increase-margin-1 259.5 μs 259.4 μs -0.0%
future-increase-margin-2 562.1 μs 564.5 μs +0.4%
future-increase-margin-3 561.4 μs 563.5 μs +0.4%
future-increase-margin-4 507.0 μs 507.0 μs 0.0%
future-increase-margin-5 840.2 μs 841.0 μs +0.1%
future-pay-out-1 258.9 μs 261.7 μs +1.1%
future-pay-out-2 559.0 μs 561.8 μs +0.5%
future-pay-out-3 562.4 μs 561.1 μs -0.2%
future-pay-out-4 837.5 μs 839.5 μs +0.2%
future-settle-early-1 259.2 μs 258.6 μs -0.2%
future-settle-early-2 567.0 μs 561.2 μs -1.0%
future-settle-early-3 561.2 μs 563.2 μs +0.4%
future-settle-early-4 626.6 μs 629.5 μs +0.5%
game-sm-success_1-1 404.0 μs 405.7 μs +0.4%
game-sm-success_1-2 208.0 μs 208.8 μs +0.4%
game-sm-success_1-3 660.0 μs 662.1 μs +0.3%
game-sm-success_1-4 244.2 μs 245.0 μs +0.3%
game-sm-success_2-1 403.2 μs 403.5 μs +0.1%
game-sm-success_2-2 208.5 μs 208.1 μs -0.2%
game-sm-success_2-3 661.0 μs 664.2 μs +0.5%
game-sm-success_2-4 242.8 μs 244.3 μs +0.6%
game-sm-success_2-5 660.2 μs 662.8 μs +0.4%
game-sm-success_2-6 243.4 μs 243.8 μs +0.2%
multisig-sm-1 409.0 μs 408.4 μs -0.1%
multisig-sm-2 398.5 μs 397.9 μs -0.2%
multisig-sm-3 401.1 μs 402.7 μs +0.4%
multisig-sm-4 407.3 μs 409.0 μs +0.4%
multisig-sm-5 573.9 μs 573.8 μs -0.0%
multisig-sm-6 408.2 μs 408.3 μs +0.0%
multisig-sm-7 396.9 μs 400.3 μs +0.9%
multisig-sm-8 402.6 μs 401.2 μs -0.3%
multisig-sm-9 406.9 μs 406.5 μs -0.1%
multisig-sm-10 575.1 μs 576.5 μs +0.2%
ping-pong-1 339.2 μs 340.3 μs +0.3%
ping-pong-2 338.4 μs 340.2 μs +0.5%
ping-pong_2-1 207.9 μs 207.7 μs -0.1%
prism-1 176.3 μs 176.3 μs 0.0%
prism-2 429.4 μs 427.6 μs -0.4%
prism-3 384.2 μs 383.9 μs -0.1%
pubkey-1 147.0 μs 147.4 μs +0.3%
stablecoin_1-1 934.3 μs 936.1 μs +0.2%
stablecoin_1-2 204.3 μs 204.2 μs -0.0%
stablecoin_1-3 1.077 ms 1.080 ms +0.3%
stablecoin_1-4 217.3 μs 217.2 μs -0.0%
stablecoin_1-5 1.390 ms 1.389 ms -0.1%
stablecoin_1-6 269.0 μs 269.4 μs +0.1%
stablecoin_2-1 934.5 μs 934.3 μs -0.0%
stablecoin_2-2 204.6 μs 204.4 μs -0.1%
stablecoin_2-3 1.078 ms 1.079 ms +0.1%
stablecoin_2-4 216.6 μs 217.8 μs +0.6%
token-account-1 195.4 μs 195.3 μs -0.1%
token-account-2 345.4 μs 346.2 μs +0.2%
uniswap-1 425.9 μs 426.5 μs +0.1%
uniswap-2 228.8 μs 229.8 μs +0.4%
uniswap-3 1.826 ms 1.825 ms -0.1%
uniswap-4 351.2 μs 353.5 μs +0.7%
uniswap-5 1.202 ms 1.204 ms +0.2%
uniswap-6 334.3 μs 333.5 μs -0.2%
vesting-1 359.9 μs 358.8 μs -0.3%
01fdff8 62739d7 Change
TOTAL 36.54 ms 36.58 ms +0.1%

Copy link
Contributor

Click here to check the status of your benchmark.

Copy link
Contributor

github-actions bot commented Nov 15, 2024

Comparing benchmark results of 'validation' on '01fdff8bad' (base) and '62739d7f11' (PR)

CPU 11

Results table
Script 01fdff8 62739d7 Change
auction_1-1 181.2 μs 178.6 μs -1.4%
auction_1-2 646.7 μs 643.5 μs -0.5%
auction_1-3 640.7 μs 635.4 μs -0.8%
auction_1-4 234.0 μs 231.0 μs -1.3%
auction_2-1 182.6 μs 180.1 μs -1.4%
auction_2-2 648.8 μs 640.3 μs -1.3%
auction_2-3 845.1 μs 834.7 μs -1.2%
auction_2-4 639.0 μs 635.5 μs -0.5%
auction_2-5 233.9 μs 231.6 μs -1.0%
crowdfunding-success-1 213.8 μs 210.9 μs -1.4%
crowdfunding-success-2 214.1 μs 211.1 μs -1.4%
crowdfunding-success-3 214.6 μs 211.2 μs -1.6%
currency-1 254.7 μs 251.9 μs -1.1%
escrow-redeem_1-1 356.6 μs 353.3 μs -0.9%
escrow-redeem_1-2 355.9 μs 350.4 μs -1.5%
escrow-redeem_2-1 413.6 μs 412.7 μs -0.2%
escrow-redeem_2-2 413.9 μs 410.4 μs -0.8%
escrow-redeem_2-3 414.2 μs 410.5 μs -0.9%
escrow-refund-1 158.7 μs 156.6 μs -1.3%
future-increase-margin-1 252.3 μs 249.5 μs -1.1%
future-increase-margin-2 547.2 μs 545.5 μs -0.3%
future-increase-margin-3 549.7 μs 540.1 μs -1.7%
future-increase-margin-4 492.4 μs 486.7 μs -1.2%
future-increase-margin-5 819.9 μs 812.1 μs -1.0%
future-pay-out-1 254.9 μs 250.4 μs -1.8%
future-pay-out-2 547.9 μs 542.8 μs -0.9%
future-pay-out-3 547.1 μs 543.1 μs -0.7%
future-pay-out-4 816.4 μs 812.0 μs -0.5%
future-settle-early-1 254.8 μs 249.7 μs -2.0%
future-settle-early-2 546.6 μs 542.0 μs -0.8%
future-settle-early-3 549.6 μs 539.5 μs -1.8%
future-settle-early-4 614.8 μs 607.5 μs -1.2%
game-sm-success_1-1 394.3 μs 390.2 μs -1.0%
game-sm-success_1-2 203.5 μs 200.6 μs -1.4%
game-sm-success_1-3 647.3 μs 638.6 μs -1.3%
game-sm-success_1-4 238.4 μs 234.8 μs -1.5%
game-sm-success_2-1 393.9 μs 388.9 μs -1.3%
game-sm-success_2-2 203.4 μs 201.0 μs -1.2%
game-sm-success_2-3 646.7 μs 640.3 μs -1.0%
game-sm-success_2-4 237.5 μs 235.5 μs -0.8%
game-sm-success_2-5 647.0 μs 641.4 μs -0.9%
game-sm-success_2-6 237.8 μs 234.1 μs -1.6%
multisig-sm-1 400.4 μs 396.3 μs -1.0%
multisig-sm-2 388.4 μs 384.0 μs -1.1%
multisig-sm-3 393.0 μs 388.5 μs -1.1%
multisig-sm-4 398.5 μs 394.9 μs -0.9%
multisig-sm-5 559.4 μs 556.3 μs -0.6%
multisig-sm-6 398.1 μs 396.9 μs -0.3%
multisig-sm-7 388.7 μs 385.7 μs -0.8%
multisig-sm-8 392.4 μs 390.2 μs -0.6%
multisig-sm-9 396.9 μs 395.6 μs -0.3%
multisig-sm-10 561.0 μs 555.1 μs -1.1%
ping-pong-1 331.0 μs 327.4 μs -1.1%
ping-pong-2 331.1 μs 327.8 μs -1.0%
ping-pong_2-1 202.6 μs 200.8 μs -0.9%
prism-1 172.1 μs 170.3 μs -1.0%
prism-2 418.2 μs 415.1 μs -0.7%
prism-3 374.6 μs 371.6 μs -0.8%
pubkey-1 143.6 μs 141.8 μs -1.3%
stablecoin_1-1 915.0 μs 905.2 μs -1.1%
stablecoin_1-2 199.1 μs 197.2 μs -1.0%
stablecoin_1-3 1.052 ms 1.046 ms -0.6%
stablecoin_1-4 212.3 μs 209.3 μs -1.4%
stablecoin_1-5 1.356 ms 1.344 ms -0.9%
stablecoin_1-6 261.7 μs 259.0 μs -1.0%
stablecoin_2-1 911.6 μs 903.9 μs -0.8%
stablecoin_2-2 200.0 μs 197.6 μs -1.2%
stablecoin_2-3 1.053 ms 1.047 ms -0.6%
stablecoin_2-4 212.1 μs 209.1 μs -1.4%
token-account-1 190.6 μs 189.4 μs -0.6%
token-account-2 338.5 μs 336.8 μs -0.5%
uniswap-1 416.3 μs 416.1 μs -0.0%
uniswap-2 222.9 μs 222.0 μs -0.4%
uniswap-3 1.777 ms 1.770 ms -0.4%
uniswap-4 343.1 μs 340.0 μs -0.9%
uniswap-5 1.169 ms 1.160 ms -0.8%
uniswap-6 324.1 μs 321.8 μs -0.7%
vesting-1 349.4 μs 348.2 μs -0.3%
01fdff8 62739d7 Change
TOTAL 35.66 ms 35.34 ms -0.9%

@kwxm
Copy link
Contributor Author

kwxm commented Nov 15, 2024

/benchmark validation cap=5

Copy link
Contributor

Click here to check the status of your benchmark.

Copy link
Contributor

github-actions bot commented Nov 15, 2024

Comparing benchmark results of 'validation' on '01fdff8bad' (base) and '62739d7f11' (PR)

CPU 5

Results table
Script 01fdff8 62739d7 Change
auction_1-1 181.7 μs 179.7 μs -1.1%
auction_1-2 647.4 μs 641.2 μs -1.0%
auction_1-3 640.3 μs 633.2 μs -1.1%
auction_1-4 234.1 μs 232.2 μs -0.8%
auction_2-1 181.7 μs 181.6 μs -0.1%
auction_2-2 644.6 μs 642.0 μs -0.4%
auction_2-3 843.4 μs 834.1 μs -1.1%
auction_2-4 641.6 μs 637.8 μs -0.6%
auction_2-5 234.8 μs 232.7 μs -0.9%
crowdfunding-success-1 214.9 μs 212.5 μs -1.1%
crowdfunding-success-2 215.0 μs 213.0 μs -0.9%
crowdfunding-success-3 214.4 μs 213.4 μs -0.5%
currency-1 255.9 μs 253.3 μs -1.0%
escrow-redeem_1-1 357.9 μs 351.4 μs -1.8%
escrow-redeem_1-2 354.7 μs 354.6 μs -0.0%
escrow-redeem_2-1 414.0 μs 414.4 μs +0.1%
escrow-redeem_2-2 414.6 μs 411.2 μs -0.8%
escrow-redeem_2-3 414.8 μs 410.8 μs -1.0%
escrow-refund-1 158.2 μs 157.1 μs -0.7%
future-increase-margin-1 253.6 μs 251.6 μs -0.8%
future-increase-margin-2 555.8 μs 544.7 μs -2.0%
future-increase-margin-3 550.6 μs 546.7 μs -0.7%
future-increase-margin-4 491.9 μs 488.6 μs -0.7%
future-increase-margin-5 820.4 μs 815.4 μs -0.6%
future-pay-out-1 254.0 μs 252.5 μs -0.6%
future-pay-out-2 549.1 μs 544.6 μs -0.8%
future-pay-out-3 549.0 μs 545.3 μs -0.7%
future-pay-out-4 818.5 μs 808.7 μs -1.2%
future-settle-early-1 254.0 μs 250.5 μs -1.4%
future-settle-early-2 548.1 μs 546.6 μs -0.3%
future-settle-early-3 546.6 μs 548.3 μs +0.3%
future-settle-early-4 610.3 μs 610.0 μs -0.0%
game-sm-success_1-1 394.3 μs 391.4 μs -0.7%
game-sm-success_1-2 203.3 μs 201.7 μs -0.8%
game-sm-success_1-3 645.0 μs 642.9 μs -0.3%
game-sm-success_1-4 237.4 μs 236.1 μs -0.5%
game-sm-success_2-1 392.3 μs 389.3 μs -0.8%
game-sm-success_2-2 203.7 μs 201.8 μs -0.9%
game-sm-success_2-3 649.0 μs 642.0 μs -1.1%
game-sm-success_2-4 238.0 μs 235.2 μs -1.2%
game-sm-success_2-5 644.3 μs 640.9 μs -0.5%
game-sm-success_2-6 237.8 μs 235.4 μs -1.0%
multisig-sm-1 399.0 μs 397.3 μs -0.4%
multisig-sm-2 388.5 μs 385.7 μs -0.7%
multisig-sm-3 390.9 μs 388.9 μs -0.5%
multisig-sm-4 398.2 μs 393.1 μs -1.3%
multisig-sm-5 562.9 μs 558.6 μs -0.8%
multisig-sm-6 398.9 μs 394.6 μs -1.1%
multisig-sm-7 389.9 μs 384.1 μs -1.5%
multisig-sm-8 392.0 μs 388.4 μs -0.9%
multisig-sm-9 396.5 μs 395.2 μs -0.3%
multisig-sm-10 562.4 μs 560.0 μs -0.4%
ping-pong-1 329.8 μs 329.5 μs -0.1%
ping-pong-2 332.0 μs 328.9 μs -0.9%
ping-pong_2-1 202.3 μs 201.6 μs -0.3%
prism-1 172.3 μs 171.1 μs -0.7%
prism-2 419.6 μs 415.1 μs -1.1%
prism-3 376.1 μs 371.7 μs -1.2%
pubkey-1 144.5 μs 143.0 μs -1.0%
stablecoin_1-1 913.4 μs 907.4 μs -0.7%
stablecoin_1-2 199.7 μs 197.8 μs -1.0%
stablecoin_1-3 1.053 ms 1.048 ms -0.5%
stablecoin_1-4 213.3 μs 209.9 μs -1.6%
stablecoin_1-5 1.356 ms 1.348 ms -0.6%
stablecoin_1-6 261.8 μs 259.6 μs -0.8%
stablecoin_2-1 911.0 μs 908.4 μs -0.3%
stablecoin_2-2 200.0 μs 198.1 μs -1.0%
stablecoin_2-3 1.054 ms 1.048 ms -0.6%
stablecoin_2-4 212.1 μs 210.4 μs -0.8%
token-account-1 190.5 μs 190.1 μs -0.2%
token-account-2 340.2 μs 335.5 μs -1.4%
uniswap-1 416.4 μs 415.0 μs -0.3%
uniswap-2 223.7 μs 221.7 μs -0.9%
uniswap-3 1.781 ms 1.774 ms -0.4%
uniswap-4 342.6 μs 339.9 μs -0.8%
uniswap-5 1.171 ms 1.164 ms -0.6%
uniswap-6 325.4 μs 324.0 μs -0.4%
vesting-1 350.9 μs 349.0 μs -0.5%
01fdff8 62739d7 Change
TOTAL 35.68 ms 35.43 ms -0.7%

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Do not merge EXPERIMENT Experiments that we probably don't want to merge No Changelog Required Add this to skip the Changelog Check
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants