Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Builtins] Make unlifting lazy again #6434

Open
wants to merge 7 commits into
base: master
Choose a base branch
from

Conversation

effectfully
Copy link
Contributor

This is technically a regression performance-wise, but we may already be charging for it (depends on how budgeting calibration works), so let's see, maybe it's not detectable regardless.

@effectfully
Copy link
Contributor Author

/benchmark validation

@effectfully
Copy link
Contributor Author

/benchmark nofib

@effectfully
Copy link
Contributor Author

/benchmark lists

@effectfully
Copy link
Contributor Author

Make your bets, is this going to happen again:

image

Copy link
Contributor

github-actions bot commented Sep 2, 2024

Click here to check the status of your benchmark.

Copy link
Contributor

github-actions bot commented Sep 2, 2024

Comparing benchmark results of 'validation' on '4b8e137e1' (base) and 'd63521331' (PR)

Results table
Script 4b8e137 d635213 Change
auction_1-1 186.1 μs 181.2 μs -2.6%
auction_1-2 654.3 μs 652.6 μs -0.3%
auction_1-3 658.0 μs 645.8 μs -1.9%
auction_1-4 240.7 μs 234.6 μs -2.5%
auction_2-1 188.9 μs 181.1 μs -4.1%
auction_2-2 662.8 μs 649.8 μs -2.0%
auction_2-3 866.2 μs 851.6 μs -1.7%
auction_2-4 657.6 μs 641.8 μs -2.4%
auction_2-5 240.3 μs 233.9 μs -2.7%
crowdfunding-success-1 218.5 μs 211.9 μs -3.0%
crowdfunding-success-2 218.5 μs 212.2 μs -2.9%
crowdfunding-success-3 218.9 μs 212.1 μs -3.1%
currency-1 256.4 μs 251.0 μs -2.1%
escrow-redeem_1-1 361.7 μs 351.9 μs -2.7%
escrow-redeem_1-2 363.6 μs 352.1 μs -3.2%
escrow-redeem_2-1 423.8 μs 408.7 μs -3.6%
escrow-redeem_2-2 423.6 μs 410.5 μs -3.1%
escrow-redeem_2-3 423.9 μs 409.8 μs -3.3%
escrow-refund-1 161.2 μs 156.3 μs -3.0%
future-increase-margin-1 255.9 μs 250.3 μs -2.2%
future-increase-margin-2 557.8 μs 543.4 μs -2.6%
future-increase-margin-3 555.9 μs 545.9 μs -1.8%
future-increase-margin-4 502.1 μs 495.8 μs -1.3%
future-increase-margin-5 834.0 μs 823.0 μs -1.3%
future-pay-out-1 254.7 μs 249.8 μs -1.9%
future-pay-out-2 556.1 μs 544.8 μs -2.0%
future-pay-out-3 554.7 μs 546.8 μs -1.4%
future-pay-out-4 834.8 μs 808.8 μs -3.1%
future-settle-early-1 254.4 μs 245.1 μs -3.7%
future-settle-early-2 556.1 μs 533.3 μs -4.1%
future-settle-early-3 555.0 μs 536.1 μs -3.4%
future-settle-early-4 624.5 μs 605.8 μs -3.0%
game-sm-success_1-1 403.4 μs 381.0 μs -5.6%
game-sm-success_1-2 206.2 μs 198.9 μs -3.5%
game-sm-success_1-3 661.1 μs 630.3 μs -4.7%
game-sm-success_1-4 234.9 μs 226.8 μs -3.4%
game-sm-success_2-1 402.6 μs 382.7 μs -4.9%
game-sm-success_2-2 206.9 μs 199.7 μs -3.5%
game-sm-success_2-3 660.7 μs 631.2 μs -4.5%
game-sm-success_2-4 234.1 μs 227.8 μs -2.7%
game-sm-success_2-5 661.1 μs 631.6 μs -4.5%
game-sm-success_2-6 233.9 μs 225.7 μs -3.5%
multisig-sm-1 409.6 μs 391.5 μs -4.4%
multisig-sm-2 399.3 μs 384.7 μs -3.7%
multisig-sm-3 403.0 μs 386.4 μs -4.1%
multisig-sm-4 406.0 μs 393.0 μs -3.2%
multisig-sm-5 572.8 μs 564.3 μs -1.5%
multisig-sm-6 410.1 μs 396.9 μs -3.2%
multisig-sm-7 393.8 μs 391.2 μs -0.7%
multisig-sm-8 396.4 μs 395.0 μs -0.4%
multisig-sm-9 401.7 μs 396.3 μs -1.3%
multisig-sm-10 566.1 μs 562.3 μs -0.7%
ping-pong-1 331.1 μs 328.1 μs -0.9%
ping-pong-2 331.1 μs 328.2 μs -0.9%
ping-pong_2-1 203.4 μs 200.4 μs -1.5%
prism-1 171.5 μs 169.3 μs -1.3%
prism-2 418.4 μs 416.3 μs -0.5%
prism-3 374.1 μs 376.2 μs +0.6%
pubkey-1 146.2 μs 144.6 μs -1.1%
stablecoin_1-1 930.0 μs 918.6 μs -1.2%
stablecoin_1-2 203.4 μs 197.4 μs -2.9%
stablecoin_1-3 1.084 ms 1.056 ms -2.6%
stablecoin_1-4 214.6 μs 210.4 μs -2.0%
stablecoin_1-5 1.378 ms 1.359 ms -1.4%
stablecoin_1-6 267.1 μs 260.9 μs -2.3%
stablecoin_2-1 938.1 μs 914.9 μs -2.5%
stablecoin_2-2 203.2 μs 198.2 μs -2.5%
stablecoin_2-3 1.084 ms 1.059 ms -2.3%
stablecoin_2-4 216.1 μs 210.5 μs -2.6%
token-account-1 197.7 μs 192.8 μs -2.5%
token-account-2 345.6 μs 341.4 μs -1.2%
uniswap-1 421.1 μs 416.9 μs -1.0%
uniswap-2 226.6 μs 223.6 μs -1.3%
uniswap-3 1.779 ms 1.761 ms -1.0%
uniswap-4 343.6 μs 339.4 μs -1.2%
uniswap-5 1.175 ms 1.160 ms -1.3%
uniswap-6 331.7 μs 323.6 μs -2.4%
vesting-1 357.7 μs 352.8 μs -1.4%
TOTAL 36.26 ms 35.43 ms -2.3%

Copy link
Contributor

github-actions bot commented Sep 2, 2024

Click here to check the status of your benchmark.

@effectfully
Copy link
Contributor Author

-2.3% in total. I don't trust it, probably just a glitch, let's see the next one.

Copy link
Contributor

github-actions bot commented Sep 2, 2024

Comparing benchmark results of 'nofib' on '4b8e137e1' (base) and 'd63521331' (PR)

Results table
Script 4b8e137 d635213 Change
clausify/formula1 3.129 ms 3.060 ms -2.2%
clausify/formula2 4.228 ms 4.087 ms -3.3%
clausify/formula3 11.59 ms 11.20 ms -3.4%
clausify/formula4 26.54 ms 26.13 ms -1.5%
clausify/formula5 56.19 ms 54.99 ms -2.1%
knights/4x4 17.96 ms 17.76 ms -1.1%
knights/6x6 47.43 ms 46.41 ms -2.2%
knights/8x8 83.40 ms 81.40 ms -2.4%
primetest/05digits 10.34 ms 10.47 ms +1.3%
primetest/10digits 20.19 ms 20.40 ms +1.0%
primetest/30digits 62.42 ms 62.47 ms +0.1%
primetest/50digits 102.5 ms 102.8 ms +0.3%
queens4x4/bt 5.497 ms 5.420 ms -1.4%
queens4x4/bm 6.960 ms 6.803 ms -2.3%
queens4x4/bjbt1 6.687 ms 6.566 ms -1.8%
queens4x4/bjbt2 6.247 ms 6.132 ms -1.8%
queens4x4/fc 14.12 ms 13.75 ms -2.6%
queens5x5/bt 74.47 ms 73.39 ms -1.5%
queens5x5/bm 77.84 ms 76.02 ms -2.3%
queens5x5/bjbt1 87.05 ms 85.52 ms -1.8%
queens5x5/bjbt2 84.47 ms 83.00 ms -1.7%
queens5x5/fc 178.8 ms 174.4 ms -2.5%
TOTAL 988.1 ms 972.2 ms -1.6%

Copy link
Contributor

github-actions bot commented Sep 2, 2024

Click here to check the status of your benchmark.

@effectfully
Copy link
Contributor Author

-1.6% in total and I still don't believe it. Also note how the primetest ones are (insignificant) regressions, those are the most sensitive to changes in the builtins code.

Copy link
Contributor

github-actions bot commented Sep 2, 2024

Comparing benchmark results of 'lists' on '4b8e137e1' (base) and 'd63521331' (PR)

Results table
Script 4b8e137 d635213 Change
sort/ghcSort/50 237.8 μs 235.9 μs -0.8%
sort/ghcSort/100 555.6 μs 546.4 μs -1.7%
sort/ghcSort/150 964.5 μs 951.1 μs -1.4%
sort/ghcSort/200 1.293 ms 1.289 ms -0.3%
sort/ghcSort/250 1.673 ms 1.682 ms +0.5%
sort/ghcSort/300 2.202 ms 2.209 ms +0.3%
sort/insertionSort/50 806.6 μs 812.8 μs +0.8%
sort/insertionSort/100 3.228 ms 3.253 ms +0.8%
sort/insertionSort/150 7.243 ms 7.318 ms +1.0%
sort/insertionSort/200 12.98 ms 13.08 ms +0.8%
sort/insertionSort/250 20.26 ms 20.51 ms +1.2%
sort/insertionSort/300 29.74 ms 29.69 ms -0.2%
sort/mergeSort/50 704.1 μs 699.5 μs -0.7%
sort/mergeSort/100 1.624 ms 1.608 ms -1.0%
sort/mergeSort/150 2.613 ms 2.577 ms -1.4%
sort/mergeSort/200 3.671 ms 3.639 ms -0.9%
sort/mergeSort/250 4.825 ms 4.767 ms -1.2%
sort/mergeSort/300 5.875 ms 5.814 ms -1.0%
sort/quickSort/50 1.974 ms 1.961 ms -0.7%
sort/quickSort/100 7.981 ms 7.937 ms -0.6%
sort/quickSort/150 17.99 ms 17.81 ms -1.0%
sort/quickSort/200 31.84 ms 31.62 ms -0.7%
sort/quickSort/250 49.87 ms 49.61 ms -0.5%
sort/quickSort/300 72.05 ms 71.58 ms -0.7%
sum/compiled-from-Haskell/sum-right-builtin/100 97.11 μs 98.18 μs +1.1%
sum/compiled-from-Haskell/sum-right-builtin/500 508.0 μs 516.3 μs +1.6%
sum/compiled-from-Haskell/sum-right-builtin/1000 1.099 ms 1.112 ms +1.2%
sum/compiled-from-Haskell/sum-right-builtin/2500 3.353 ms 3.394 ms +1.2%
sum/compiled-from-Haskell/sum-right-builtin/5000 7.190 ms 7.252 ms +0.9%
sum/compiled-from-Haskell/sum-right-Scott/100 64.63 μs 63.99 μs -1.0%
sum/compiled-from-Haskell/sum-right-Scott/500 336.5 μs 335.1 μs -0.4%
sum/compiled-from-Haskell/sum-right-Scott/1000 725.2 μs 722.5 μs -0.4%
sum/compiled-from-Haskell/sum-right-Scott/2500 2.421 ms 2.405 ms -0.7%
sum/compiled-from-Haskell/sum-right-Scott/5000 5.446 ms 5.419 ms -0.5%
sum/compiled-from-Haskell/sum-right-data/100 258.2 μs 262.6 μs +1.7%
sum/compiled-from-Haskell/sum-right-data/500 1.412 ms 1.398 ms -1.0%
sum/compiled-from-Haskell/sum-right-data/1000 3.165 ms 3.098 ms -2.1%
sum/compiled-from-Haskell/sum-right-data/2500 8.561 ms 8.305 ms -3.0%
sum/compiled-from-Haskell/sum-right-data/5000 17.73 ms 17.24 ms -2.8%
sum/compiled-from-Haskell/sum-left-builtin/100 95.14 μs 94.16 μs -1.0%
sum/compiled-from-Haskell/sum-left-builtin/500 495.7 μs 494.0 μs -0.3%
sum/compiled-from-Haskell/sum-left-builtin/1000 1.062 ms 1.052 ms -0.9%
sum/compiled-from-Haskell/sum-left-builtin/2500 3.248 ms 3.195 ms -1.6%
sum/compiled-from-Haskell/sum-left-builtin/5000 7.057 ms 6.907 ms -2.1%
sum/compiled-from-Haskell/sum-left-Scott/100 62.69 μs 60.69 μs -3.2%
sum/compiled-from-Haskell/sum-left-Scott/500 327.7 μs 317.7 μs -3.1%
sum/compiled-from-Haskell/sum-left-Scott/1000 709.5 μs 685.0 μs -3.5%
sum/compiled-from-Haskell/sum-left-Scott/2500 2.287 ms 2.220 ms -2.9%
sum/compiled-from-Haskell/sum-left-Scott/5000 5.157 ms 5.017 ms -2.7%
sum/compiled-from-Haskell/sum-left-data/100 260.2 μs 255.4 μs -1.8%
sum/compiled-from-Haskell/sum-left-data/500 1.416 ms 1.388 ms -2.0%
sum/compiled-from-Haskell/sum-left-data/1000 3.190 ms 3.114 ms -2.4%
sum/compiled-from-Haskell/sum-left-data/2500 8.563 ms 8.363 ms -2.3%
sum/compiled-from-Haskell/sum-left-data/5000 17.67 ms 17.26 ms -2.3%
sum/hand-written-PLC/sum-right-builtin/100 92.73 μs 94.96 μs +2.4%
sum/hand-written-PLC/sum-right-builtin/500 469.5 μs 479.6 μs +2.2%
sum/hand-written-PLC/sum-right-builtin/1000 970.8 μs 993.8 μs +2.4%
sum/hand-written-PLC/sum-right-builtin/2500 2.707 ms 2.760 ms +2.0%
sum/hand-written-PLC/sum-right-builtin/5000 5.692 ms 5.753 ms +1.1%
sum/hand-written-PLC/sum-right-Scott/100 52.29 μs 51.83 μs -0.9%
sum/hand-written-PLC/sum-right-Scott/500 268.5 μs 264.8 μs -1.4%
sum/hand-written-PLC/sum-right-Scott/1000 561.7 μs 550.0 μs -2.1%
sum/hand-written-PLC/sum-right-Scott/2500 1.713 ms 1.687 ms -1.5%
sum/hand-written-PLC/sum-right-Scott/5000 3.996 ms 3.991 ms -0.1%
sum/hand-written-PLC/sum-left-builtin/100 96.18 μs 98.62 μs +2.5%
sum/hand-written-PLC/sum-left-builtin/500 476.8 μs 484.3 μs +1.6%
sum/hand-written-PLC/sum-left-builtin/1000 950.0 μs 961.4 μs +1.2%
sum/hand-written-PLC/sum-left-builtin/2500 2.360 ms 2.394 ms +1.4%
sum/hand-written-PLC/sum-left-builtin/5000 4.703 ms 4.769 ms +1.4%
sum/hand-written-PLC/sum-left-Scott/100 57.14 μs 56.77 μs -0.6%
sum/hand-written-PLC/sum-left-Scott/500 284.8 μs 280.9 μs -1.4%
sum/hand-written-PLC/sum-left-Scott/1000 580.4 μs 576.0 μs -0.8%
sum/hand-written-PLC/sum-left-Scott/2500 1.624 ms 1.609 ms -0.9%
sum/hand-written-PLC/sum-left-Scott/5000 3.552 ms 3.521 ms -0.9%
TOTAL 417.4 ms 414.6 ms -0.7%

@effectfully
Copy link
Contributor Author

/benchmark lists

2 similar comments
@effectfully
Copy link
Contributor Author

/benchmark lists

@effectfully
Copy link
Contributor Author

/benchmark lists

Copy link
Contributor

github-actions bot commented Sep 3, 2024

Click here to check the status of your benchmark.

Copy link
Contributor

github-actions bot commented Sep 3, 2024

Comparing benchmark results of 'lists' on '4b8e137e1' (base) and 'd63521331' (PR)

Results table
Script 4b8e137 d635213 Change
sort/ghcSort/50 239.3 μs 230.4 μs -3.7%
sort/ghcSort/100 558.4 μs 532.8 μs -4.6%
sort/ghcSort/150 972.2 μs 927.5 μs -4.6%
sort/ghcSort/200 1.300 ms 1.247 ms -4.1%
sort/ghcSort/250 1.684 ms 1.614 ms -4.2%
sort/ghcSort/300 2.216 ms 2.115 ms -4.6%
sort/insertionSort/50 813.8 μs 780.0 μs -4.2%
sort/insertionSort/100 3.245 ms 3.108 ms -4.2%
sort/insertionSort/150 7.313 ms 7.013 ms -4.1%
sort/insertionSort/200 13.04 ms 12.54 ms -3.8%
sort/insertionSort/250 20.50 ms 19.68 ms -4.0%
sort/insertionSort/300 29.78 ms 28.55 ms -4.1%
sort/mergeSort/50 704.5 μs 672.1 μs -4.6%
sort/mergeSort/100 1.624 ms 1.545 ms -4.9%
sort/mergeSort/150 2.618 ms 2.492 ms -4.8%
sort/mergeSort/200 3.669 ms 3.510 ms -4.3%
sort/mergeSort/250 4.820 ms 4.613 ms -4.3%
sort/mergeSort/300 5.861 ms 5.608 ms -4.3%
sort/quickSort/50 1.968 ms 1.903 ms -3.3%
sort/quickSort/100 7.964 ms 7.692 ms -3.4%
sort/quickSort/150 17.88 ms 17.35 ms -3.0%
sort/quickSort/200 31.78 ms 30.74 ms -3.3%
sort/quickSort/250 49.82 ms 48.24 ms -3.2%
sort/quickSort/300 71.86 ms 69.56 ms -3.2%
sum/compiled-from-Haskell/sum-right-builtin/100 97.05 μs 95.24 μs -1.9%
sum/compiled-from-Haskell/sum-right-builtin/500 508.2 μs 502.5 μs -1.1%
sum/compiled-from-Haskell/sum-right-builtin/1000 1.095 ms 1.083 ms -1.1%
sum/compiled-from-Haskell/sum-right-builtin/2500 3.341 ms 3.306 ms -1.0%
sum/compiled-from-Haskell/sum-right-builtin/5000 7.142 ms 7.069 ms -1.0%
sum/compiled-from-Haskell/sum-right-Scott/100 64.50 μs 62.39 μs -3.3%
sum/compiled-from-Haskell/sum-right-Scott/500 336.6 μs 325.9 μs -3.2%
sum/compiled-from-Haskell/sum-right-Scott/1000 720.7 μs 701.5 μs -2.7%
sum/compiled-from-Haskell/sum-right-Scott/2500 2.412 ms 2.340 ms -3.0%
sum/compiled-from-Haskell/sum-right-Scott/5000 5.415 ms 5.272 ms -2.6%
sum/compiled-from-Haskell/sum-right-data/100 258.0 μs 250.8 μs -2.8%
sum/compiled-from-Haskell/sum-right-data/500 1.409 ms 1.376 ms -2.3%
sum/compiled-from-Haskell/sum-right-data/1000 3.162 ms 3.094 ms -2.2%
sum/compiled-from-Haskell/sum-right-data/2500 8.538 ms 8.343 ms -2.3%
sum/compiled-from-Haskell/sum-right-data/5000 17.69 ms 17.33 ms -2.0%
sum/compiled-from-Haskell/sum-left-builtin/100 94.85 μs 93.81 μs -1.1%
sum/compiled-from-Haskell/sum-left-builtin/500 493.7 μs 491.3 μs -0.5%
sum/compiled-from-Haskell/sum-left-builtin/1000 1.058 ms 1.046 ms -1.1%
sum/compiled-from-Haskell/sum-left-builtin/2500 3.241 ms 3.184 ms -1.8%
sum/compiled-from-Haskell/sum-left-builtin/5000 7.056 ms 6.938 ms -1.7%
sum/compiled-from-Haskell/sum-left-Scott/100 62.44 μs 60.83 μs -2.6%
sum/compiled-from-Haskell/sum-left-Scott/500 327.4 μs 320.2 μs -2.2%
sum/compiled-from-Haskell/sum-left-Scott/1000 705.1 μs 690.4 μs -2.1%
sum/compiled-from-Haskell/sum-left-Scott/2500 2.279 ms 2.231 ms -2.1%
sum/compiled-from-Haskell/sum-left-Scott/5000 5.143 ms 5.039 ms -2.0%
sum/compiled-from-Haskell/sum-left-data/100 260.3 μs 255.7 μs -1.8%
sum/compiled-from-Haskell/sum-left-data/500 1.416 ms 1.391 ms -1.8%
sum/compiled-from-Haskell/sum-left-data/1000 3.177 ms 3.128 ms -1.5%
sum/compiled-from-Haskell/sum-left-data/2500 8.552 ms 8.412 ms -1.6%
sum/compiled-from-Haskell/sum-left-data/5000 17.65 ms 17.40 ms -1.4%
sum/hand-written-PLC/sum-right-builtin/100 92.30 μs 95.45 μs +3.4%
sum/hand-written-PLC/sum-right-builtin/500 468.3 μs 482.5 μs +3.0%
sum/hand-written-PLC/sum-right-builtin/1000 968.0 μs 996.6 μs +3.0%
sum/hand-written-PLC/sum-right-builtin/2500 2.698 ms 2.760 ms +2.3%
sum/hand-written-PLC/sum-right-builtin/5000 5.664 ms 5.794 ms +2.3%
sum/hand-written-PLC/sum-right-Scott/100 52.04 μs 52.78 μs +1.4%
sum/hand-written-PLC/sum-right-Scott/500 267.8 μs 266.4 μs -0.5%
sum/hand-written-PLC/sum-right-Scott/1000 560.7 μs 558.3 μs -0.4%
sum/hand-written-PLC/sum-right-Scott/2500 1.704 ms 1.711 ms +0.4%
sum/hand-written-PLC/sum-right-Scott/5000 3.992 ms 3.991 ms -0.0%
sum/hand-written-PLC/sum-left-builtin/100 96.73 μs 98.42 μs +1.7%
sum/hand-written-PLC/sum-left-builtin/500 475.8 μs 485.0 μs +1.9%
sum/hand-written-PLC/sum-left-builtin/1000 948.9 μs 964.6 μs +1.7%
sum/hand-written-PLC/sum-left-builtin/2500 2.368 ms 2.403 ms +1.5%
sum/hand-written-PLC/sum-left-builtin/5000 4.716 ms 4.808 ms +2.0%
sum/hand-written-PLC/sum-left-Scott/100 56.86 μs 56.91 μs +0.1%
sum/hand-written-PLC/sum-left-Scott/500 284.0 μs 283.2 μs -0.3%
sum/hand-written-PLC/sum-left-Scott/1000 580.1 μs 578.6 μs -0.3%
sum/hand-written-PLC/sum-left-Scott/2500 1.621 ms 1.630 ms +0.6%
sum/hand-written-PLC/sum-left-Scott/5000 3.550 ms 3.557 ms +0.2%
TOTAL 417.1 ms 405.7 ms -2.7%

Copy link
Contributor

github-actions bot commented Sep 3, 2024

Click here to check the status of your benchmark.

Copy link
Contributor

github-actions bot commented Sep 3, 2024

Comparing benchmark results of 'lists' on '4b8e137e1' (base) and 'd63521331' (PR)

Results table
Script 4b8e137 d635213 Change
sort/ghcSort/50 237.9 μs 243.6 μs +2.4%
sort/ghcSort/100 556.2 μs 568.2 μs +2.2%
sort/ghcSort/150 967.4 μs 984.4 μs +1.8%
sort/ghcSort/200 1.297 ms 1.343 ms +3.5%
sort/ghcSort/250 1.678 ms 1.735 ms +3.4%
sort/ghcSort/300 2.213 ms 2.278 ms +2.9%
sort/insertionSort/50 810.3 μs 846.6 μs +4.5%
sort/insertionSort/100 3.249 ms 3.367 ms +3.6%
sort/insertionSort/150 7.288 ms 7.590 ms +4.1%
sort/insertionSort/200 12.99 ms 13.55 ms +4.3%
sort/insertionSort/250 20.40 ms 21.78 ms +6.8%
sort/insertionSort/300 29.52 ms 30.79 ms +4.3%
sort/mergeSort/50 701.6 μs 722.4 μs +3.0%
sort/mergeSort/100 1.626 ms 1.662 ms +2.2%
sort/mergeSort/150 2.600 ms 2.670 ms +2.7%
sort/mergeSort/200 3.657 ms 3.757 ms +2.7%
sort/mergeSort/250 4.710 ms 4.921 ms +4.5%
sort/mergeSort/300 5.742 ms 5.995 ms +4.4%
sort/quickSort/50 1.924 ms 2.028 ms +5.4%
sort/quickSort/100 7.806 ms 8.185 ms +4.9%
sort/quickSort/150 17.55 ms 18.43 ms +5.0%
sort/quickSort/200 31.08 ms 32.65 ms +5.1%
sort/quickSort/250 48.85 ms 51.16 ms +4.7%
sort/quickSort/300 70.27 ms 73.70 ms +4.9%
sum/compiled-from-Haskell/sum-right-builtin/100 94.68 μs 104.0 μs +9.8%
sum/compiled-from-Haskell/sum-right-builtin/500 496.8 μs 544.3 μs +9.6%
sum/compiled-from-Haskell/sum-right-builtin/1000 1.075 ms 1.165 ms +8.4%
sum/compiled-from-Haskell/sum-right-builtin/2500 3.281 ms 3.544 ms +8.0%
sum/compiled-from-Haskell/sum-right-builtin/5000 7.009 ms 7.533 ms +7.5%
sum/compiled-from-Haskell/sum-right-Scott/100 63.02 μs 65.11 μs +3.3%
sum/compiled-from-Haskell/sum-right-Scott/500 331.1 μs 340.8 μs +2.9%
sum/compiled-from-Haskell/sum-right-Scott/1000 711.7 μs 732.3 μs +2.9%
sum/compiled-from-Haskell/sum-right-Scott/2500 2.385 ms 2.431 ms +1.9%
sum/compiled-from-Haskell/sum-right-Scott/5000 5.347 ms 5.476 ms +2.4%
sum/compiled-from-Haskell/sum-right-data/100 255.5 μs 273.9 μs +7.2%
sum/compiled-from-Haskell/sum-right-data/500 1.394 ms 1.468 ms +5.3%
sum/compiled-from-Haskell/sum-right-data/1000 3.130 ms 3.285 ms +5.0%
sum/compiled-from-Haskell/sum-right-data/2500 8.584 ms 8.835 ms +2.9%
sum/compiled-from-Haskell/sum-right-data/5000 17.73 ms 18.30 ms +3.2%
sum/compiled-from-Haskell/sum-left-builtin/100 94.88 μs 101.8 μs +7.3%
sum/compiled-from-Haskell/sum-left-builtin/500 494.3 μs 532.2 μs +7.7%
sum/compiled-from-Haskell/sum-left-builtin/1000 1.063 ms 1.133 ms +6.6%
sum/compiled-from-Haskell/sum-left-builtin/2500 3.252 ms 3.401 ms +4.6%
sum/compiled-from-Haskell/sum-left-builtin/5000 7.063 ms 7.363 ms +4.2%
sum/compiled-from-Haskell/sum-left-Scott/100 62.78 μs 64.86 μs +3.3%
sum/compiled-from-Haskell/sum-left-Scott/500 327.9 μs 339.2 μs +3.4%
sum/compiled-from-Haskell/sum-left-Scott/1000 708.7 μs 729.6 μs +2.9%
sum/compiled-from-Haskell/sum-left-Scott/2500 2.284 ms 2.338 ms +2.4%
sum/compiled-from-Haskell/sum-left-Scott/5000 5.146 ms 5.262 ms +2.3%
sum/compiled-from-Haskell/sum-left-data/100 260.5 μs 275.0 μs +5.6%
sum/compiled-from-Haskell/sum-left-data/500 1.416 ms 1.485 ms +4.9%
sum/compiled-from-Haskell/sum-left-data/1000 3.180 ms 3.302 ms +3.8%
sum/compiled-from-Haskell/sum-left-data/2500 8.573 ms 8.855 ms +3.3%
sum/compiled-from-Haskell/sum-left-data/5000 17.66 ms 18.23 ms +3.2%
sum/hand-written-PLC/sum-right-builtin/100 92.52 μs 102.1 μs +10.4%
sum/hand-written-PLC/sum-right-builtin/500 470.0 μs 516.1 μs +9.8%
sum/hand-written-PLC/sum-right-builtin/1000 970.5 μs 1.058 ms +9.0%
sum/hand-written-PLC/sum-right-builtin/2500 2.706 ms 2.944 ms +8.8%
sum/hand-written-PLC/sum-right-builtin/5000 5.680 ms 6.152 ms +8.3%
sum/hand-written-PLC/sum-right-Scott/100 52.19 μs 53.86 μs +3.2%
sum/hand-written-PLC/sum-right-Scott/500 268.4 μs 269.8 μs +0.5%
sum/hand-written-PLC/sum-right-Scott/1000 559.9 μs 570.1 μs +1.8%
sum/hand-written-PLC/sum-right-Scott/2500 1.712 ms 1.728 ms +0.9%
sum/hand-written-PLC/sum-right-Scott/5000 4.015 ms 4.029 ms +0.3%
sum/hand-written-PLC/sum-left-builtin/100 96.49 μs 106.3 μs +10.2%
sum/hand-written-PLC/sum-left-builtin/500 477.1 μs 523.8 μs +9.8%
sum/hand-written-PLC/sum-left-builtin/1000 951.6 μs 1.040 ms +9.3%
sum/hand-written-PLC/sum-left-builtin/2500 2.369 ms 2.587 ms +9.2%
sum/hand-written-PLC/sum-left-builtin/5000 4.709 ms 5.150 ms +9.4%
sum/hand-written-PLC/sum-left-Scott/100 56.94 μs 58.66 μs +3.0%
sum/hand-written-PLC/sum-left-Scott/500 286.7 μs 290.5 μs +1.3%
sum/hand-written-PLC/sum-left-Scott/1000 582.0 μs 591.0 μs +1.5%
sum/hand-written-PLC/sum-left-Scott/2500 1.600 ms 1.649 ms +3.1%
sum/hand-written-PLC/sum-left-Scott/5000 3.501 ms 3.597 ms +2.7%
TOTAL 412.4 ms 431.5 ms +4.6%

Copy link
Contributor

github-actions bot commented Sep 3, 2024

Click here to check the status of your benchmark.

Copy link
Contributor

github-actions bot commented Sep 3, 2024

Comparing benchmark results of 'lists' on '4b8e137e1' (base) and 'd63521331' (PR)

Results table
Script 4b8e137 d635213 Change
sort/ghcSort/50 238.0 μs 236.3 μs -0.7%
sort/ghcSort/100 561.5 μs 549.8 μs -2.1%
sort/ghcSort/150 978.8 μs 954.6 μs -2.5%
sort/ghcSort/200 1.311 ms 1.288 ms -1.8%
sort/ghcSort/250 1.691 ms 1.662 ms -1.7%
sort/ghcSort/300 2.233 ms 2.184 ms -2.2%
sort/insertionSort/50 818.8 μs 802.6 μs -2.0%
sort/insertionSort/100 3.261 ms 3.206 ms -1.7%
sort/insertionSort/150 7.417 ms 7.232 ms -2.5%
sort/insertionSort/200 13.09 ms 12.92 ms -1.3%
sort/insertionSort/250 20.61 ms 20.20 ms -2.0%
sort/insertionSort/300 29.80 ms 29.21 ms -2.0%
sort/mergeSort/50 704.3 μs 690.9 μs -1.9%
sort/mergeSort/100 1.621 ms 1.584 ms -2.3%
sort/mergeSort/150 2.623 ms 2.555 ms -2.6%
sort/mergeSort/200 3.680 ms 3.582 ms -2.7%
sort/mergeSort/250 4.827 ms 4.707 ms -2.5%
sort/mergeSort/300 5.877 ms 5.721 ms -2.7%
sort/quickSort/50 1.972 ms 1.938 ms -1.7%
sort/quickSort/100 7.977 ms 7.819 ms -2.0%
sort/quickSort/150 17.99 ms 17.65 ms -1.9%
sort/quickSort/200 31.91 ms 31.18 ms -2.3%
sort/quickSort/250 50.03 ms 48.90 ms -2.3%
sort/quickSort/300 71.81 ms 70.36 ms -2.0%
sum/compiled-from-Haskell/sum-right-builtin/100 96.93 μs 96.72 μs -0.2%
sum/compiled-from-Haskell/sum-right-builtin/500 507.0 μs 508.3 μs +0.3%
sum/compiled-from-Haskell/sum-right-builtin/1000 1.097 ms 1.110 ms +1.2%
sum/compiled-from-Haskell/sum-right-builtin/2500 3.348 ms 3.379 ms +0.9%
sum/compiled-from-Haskell/sum-right-builtin/5000 7.157 ms 7.227 ms +1.0%
sum/compiled-from-Haskell/sum-right-Scott/100 64.66 μs 64.26 μs -0.6%
sum/compiled-from-Haskell/sum-right-Scott/500 337.0 μs 335.1 μs -0.6%
sum/compiled-from-Haskell/sum-right-Scott/1000 711.5 μs 720.1 μs +1.2%
sum/compiled-from-Haskell/sum-right-Scott/2500 2.408 ms 2.399 ms -0.4%
sum/compiled-from-Haskell/sum-right-Scott/5000 5.450 ms 5.412 ms -0.7%
sum/compiled-from-Haskell/sum-right-data/100 258.3 μs 255.3 μs -1.2%
sum/compiled-from-Haskell/sum-right-data/500 1.411 ms 1.393 ms -1.3%
sum/compiled-from-Haskell/sum-right-data/1000 3.165 ms 3.129 ms -1.1%
sum/compiled-from-Haskell/sum-right-data/2500 8.559 ms 8.453 ms -1.2%
sum/compiled-from-Haskell/sum-right-data/5000 17.76 ms 17.51 ms -1.4%
sum/compiled-from-Haskell/sum-left-builtin/100 94.97 μs 94.83 μs -0.1%
sum/compiled-from-Haskell/sum-left-builtin/500 494.7 μs 497.0 μs +0.5%
sum/compiled-from-Haskell/sum-left-builtin/1000 1.059 ms 1.062 ms +0.3%
sum/compiled-from-Haskell/sum-left-builtin/2500 3.254 ms 3.227 ms -0.8%
sum/compiled-from-Haskell/sum-left-builtin/5000 7.078 ms 7.025 ms -0.7%
sum/compiled-from-Haskell/sum-left-Scott/100 62.84 μs 61.73 μs -1.8%
sum/compiled-from-Haskell/sum-left-Scott/500 327.4 μs 323.5 μs -1.2%
sum/compiled-from-Haskell/sum-left-Scott/1000 707.6 μs 698.2 μs -1.3%
sum/compiled-from-Haskell/sum-left-Scott/2500 2.283 ms 2.254 ms -1.3%
sum/compiled-from-Haskell/sum-left-Scott/5000 5.166 ms 5.091 ms -1.5%
sum/compiled-from-Haskell/sum-left-data/100 260.8 μs 258.5 μs -0.9%
sum/compiled-from-Haskell/sum-left-data/500 1.418 ms 1.408 ms -0.7%
sum/compiled-from-Haskell/sum-left-data/1000 3.187 ms 3.152 ms -1.1%
sum/compiled-from-Haskell/sum-left-data/2500 8.578 ms 8.456 ms -1.4%
sum/compiled-from-Haskell/sum-left-data/5000 17.67 ms 17.47 ms -1.1%
sum/hand-written-PLC/sum-right-builtin/100 92.73 μs 96.08 μs +3.6%
sum/hand-written-PLC/sum-right-builtin/500 469.5 μs 487.7 μs +3.9%
sum/hand-written-PLC/sum-right-builtin/1000 970.8 μs 998.6 μs +2.9%
sum/hand-written-PLC/sum-right-builtin/2500 2.721 ms 2.796 ms +2.8%
sum/hand-written-PLC/sum-right-builtin/5000 5.679 ms 5.868 ms +3.3%
sum/hand-written-PLC/sum-right-Scott/100 52.16 μs 53.34 μs +2.3%
sum/hand-written-PLC/sum-right-Scott/500 268.1 μs 268.4 μs +0.1%
sum/hand-written-PLC/sum-right-Scott/1000 561.6 μs 560.0 μs -0.3%
sum/hand-written-PLC/sum-right-Scott/2500 1.707 ms 1.723 ms +0.9%
sum/hand-written-PLC/sum-right-Scott/5000 4.009 ms 4.027 ms +0.4%
sum/hand-written-PLC/sum-left-builtin/100 96.92 μs 98.72 μs +1.9%
sum/hand-written-PLC/sum-left-builtin/500 479.2 μs 490.9 μs +2.4%
sum/hand-written-PLC/sum-left-builtin/1000 955.7 μs 972.8 μs +1.8%
sum/hand-written-PLC/sum-left-builtin/2500 2.371 ms 2.419 ms +2.0%
sum/hand-written-PLC/sum-left-builtin/5000 4.733 ms 4.821 ms +1.9%
sum/hand-written-PLC/sum-left-Scott/100 57.21 μs 58.14 μs +1.6%
sum/hand-written-PLC/sum-left-Scott/500 285.7 μs 283.6 μs -0.7%
sum/hand-written-PLC/sum-left-Scott/1000 583.2 μs 571.0 μs -2.1%
sum/hand-written-PLC/sum-left-Scott/2500 1.626 ms 1.597 ms -1.8%
sum/hand-written-PLC/sum-left-Scott/5000 3.556 ms 3.493 ms -1.8%
TOTAL 418.3 ms 411.9 ms -1.5%

@effectfully effectfully added the No Changelog Required Add this to skip the Changelog Check label Sep 3, 2024
@kwxm
Copy link
Contributor

kwxm commented Sep 11, 2024

/benchmark validation

@kwxm
Copy link
Contributor

kwxm commented Sep 11, 2024

/benchmark lists

Copy link
Contributor

Click here to check the status of your benchmark.

Copy link
Contributor

Click here to check the status of your benchmark.

…to effectfully/builtins/make-unlifting-lazy-again
@effectfully
Copy link
Contributor Author

/benchmark validation

Copy link
Contributor

Click here to check the status of your benchmark.

Copy link
Contributor

Comparing benchmark results of 'validation' on 'ce72537391' (base) and '6478b97e0e' (PR)

Results table
Script ce72537 6478b97 Change
auction_1-1 255.9 μs 259.3 μs +1.3%
auction_1-2 917.8 μs 926.0 μs +0.9%
auction_1-3 910.5 μs 909.2 μs -0.1%
auction_1-4 332.2 μs 331.0 μs -0.4%
auction_2-1 256.8 μs 259.7 μs +1.1%
auction_2-2 916.8 μs 928.8 μs +1.3%
auction_2-3 1.194 ms 1.204 ms +0.8%
auction_2-4 911.2 μs 914.1 μs +0.3%
auction_2-5 331.9 μs 331.4 μs -0.2%
crowdfunding-success-1 300.2 μs 302.5 μs +0.8%
crowdfunding-success-2 300.2 μs 301.2 μs +0.3%
crowdfunding-success-3 300.2 μs 302.1 μs +0.6%
currency-1 358.2 μs 362.2 μs +1.1%
escrow-redeem_1-1 499.9 μs 506.6 μs +1.3%
escrow-redeem_1-2 500.5 μs 506.4 μs +1.2%
escrow-redeem_2-1 585.7 μs 585.4 μs -0.1%
escrow-redeem_2-2 584.6 μs 582.6 μs -0.3%
escrow-redeem_2-3 585.0 μs 584.0 μs -0.2%
escrow-refund-1 223.9 μs 223.9 μs 0.0%
future-increase-margin-1 359.1 μs 361.6 μs +0.7%
future-increase-margin-2 770.7 μs 777.5 μs +0.9%
future-increase-margin-3 770.9 μs 775.3 μs +0.6%
future-increase-margin-4 695.3 μs 700.7 μs +0.8%
future-increase-margin-5 1.156 ms 1.166 ms +0.9%
future-pay-out-1 359.1 μs 361.8 μs +0.8%
future-pay-out-2 767.9 μs 772.5 μs +0.6%
future-pay-out-3 769.9 μs 774.3 μs +0.6%
future-pay-out-4 1.152 ms 1.164 ms +1.0%
future-settle-early-1 359.2 μs 362.9 μs +1.0%
future-settle-early-2 769.0 μs 778.5 μs +1.2%
future-settle-early-3 771.0 μs 774.9 μs +0.5%
future-settle-early-4 870.8 μs 868.9 μs -0.2%
game-sm-success_1-1 552.7 μs 556.4 μs +0.7%
game-sm-success_1-2 288.7 μs 288.6 μs -0.0%
game-sm-success_1-3 912.1 μs 927.5 μs +1.7%
game-sm-success_1-4 336.4 μs 334.7 μs -0.5%
game-sm-success_2-1 552.3 μs 557.0 μs +0.9%
game-sm-success_2-2 288.0 μs 289.0 μs +0.3%
game-sm-success_2-3 909.7 μs 925.1 μs +1.7%
game-sm-success_2-4 336.4 μs 335.0 μs -0.4%
game-sm-success_2-5 911.2 μs 924.0 μs +1.4%
game-sm-success_2-6 335.2 μs 334.9 μs -0.1%
multisig-sm-1 561.5 μs 574.5 μs +2.3%
multisig-sm-2 547.6 μs 554.1 μs +1.2%
multisig-sm-3 553.3 μs 562.7 μs +1.7%
multisig-sm-4 558.1 μs 567.8 μs +1.7%
multisig-sm-5 791.8 μs 801.8 μs +1.3%
multisig-sm-6 558.5 μs 572.8 μs +2.6%
multisig-sm-7 547.8 μs 554.6 μs +1.2%
multisig-sm-8 552.0 μs 563.6 μs +2.1%
multisig-sm-9 557.6 μs 567.6 μs +1.8%
multisig-sm-10 792.3 μs 802.5 μs +1.3%
ping-pong-1 468.4 μs 471.7 μs +0.7%
ping-pong-2 467.4 μs 472.5 μs +1.1%
ping-pong_2-1 286.7 μs 285.5 μs -0.4%
prism-1 243.2 μs 243.4 μs +0.1%
prism-2 586.3 μs 595.7 μs +1.6%
prism-3 531.5 μs 531.3 μs -0.0%
pubkey-1 203.9 μs 203.0 μs -0.4%
stablecoin_1-1 1.287 ms 1.292 ms +0.4%
stablecoin_1-2 281.6 μs 284.2 μs +0.9%
stablecoin_1-3 1.498 ms 1.488 ms -0.7%
stablecoin_1-4 300.0 μs 300.8 μs +0.3%
stablecoin_1-5 1.924 ms 1.909 ms -0.8%
stablecoin_1-6 367.9 μs 366.7 μs -0.3%
stablecoin_2-1 1.282 ms 1.292 ms +0.8%
stablecoin_2-2 281.7 μs 283.2 μs +0.5%
stablecoin_2-3 1.506 ms 1.487 ms -1.3%
stablecoin_2-4 299.9 μs 301.6 μs +0.6%
token-account-1 269.6 μs 273.6 μs +1.5%
token-account-2 478.8 μs 481.8 μs +0.6%
uniswap-1 591.0 μs 599.3 μs +1.4%
uniswap-2 316.7 μs 317.4 μs +0.2%
uniswap-3 2.519 ms 2.525 ms +0.2%
uniswap-4 484.8 μs 485.3 μs +0.1%
uniswap-5 1.653 ms 1.663 ms +0.6%
uniswap-6 458.2 μs 467.2 μs +2.0%
vesting-1 496.4 μs 498.4 μs +0.4%
ce72537 6478b97 Change
TOTAL 50.36 ms 50.67 ms +0.6%

@effectfully
Copy link
Contributor Author

/benchmark validation

2 similar comments
@effectfully
Copy link
Contributor Author

/benchmark validation

@effectfully
Copy link
Contributor Author

/benchmark validation

Copy link
Contributor

Click here to check the status of your benchmark.

Copy link
Contributor

Comparing benchmark results of 'validation' on 'ce72537391' (base) and '6478b97e0e' (PR)

Results table
Script ce72537 6478b97 Change
auction_1-1 255.8 μs 259.5 μs +1.4%
auction_1-2 916.7 μs 926.3 μs +1.0%
auction_1-3 918.9 μs 914.6 μs -0.5%
auction_1-4 331.9 μs 332.4 μs +0.2%
auction_2-1 257.2 μs 260.5 μs +1.3%
auction_2-2 917.1 μs 927.3 μs +1.1%
auction_2-3 1.190 ms 1.205 ms +1.3%
auction_2-4 912.3 μs 914.6 μs +0.3%
auction_2-5 331.1 μs 332.0 μs +0.3%
crowdfunding-success-1 300.0 μs 302.2 μs +0.7%
crowdfunding-success-2 298.7 μs 303.3 μs +1.5%
crowdfunding-success-3 299.7 μs 308.7 μs +3.0%
currency-1 358.9 μs 363.1 μs +1.2%
escrow-redeem_1-1 499.5 μs 506.8 μs +1.5%
escrow-redeem_1-2 499.1 μs 508.3 μs +1.8%
escrow-redeem_2-1 585.2 μs 583.1 μs -0.4%
escrow-redeem_2-2 585.9 μs 583.7 μs -0.4%
escrow-redeem_2-3 583.6 μs 587.4 μs +0.7%
escrow-refund-1 222.6 μs 223.6 μs +0.4%
future-increase-margin-1 359.0 μs 362.6 μs +1.0%
future-increase-margin-2 769.7 μs 777.5 μs +1.0%
future-increase-margin-3 771.4 μs 775.5 μs +0.5%
future-increase-margin-4 692.1 μs 702.5 μs +1.5%
future-increase-margin-5 1.166 ms 1.164 ms -0.2%
future-pay-out-1 358.0 μs 363.4 μs +1.5%
future-pay-out-2 767.9 μs 773.4 μs +0.7%
future-pay-out-3 770.0 μs 775.5 μs +0.7%
future-pay-out-4 1.158 ms 1.167 ms +0.8%
future-settle-early-1 358.4 μs 362.4 μs +1.1%
future-settle-early-2 769.8 μs 778.7 μs +1.2%
future-settle-early-3 772.3 μs 777.9 μs +0.7%
future-settle-early-4 866.2 μs 869.0 μs +0.3%
game-sm-success_1-1 551.8 μs 556.5 μs +0.9%
game-sm-success_1-2 287.9 μs 288.7 μs +0.3%
game-sm-success_1-3 909.8 μs 927.6 μs +2.0%
game-sm-success_1-4 335.8 μs 335.3 μs -0.1%
game-sm-success_2-1 560.0 μs 558.8 μs -0.2%
game-sm-success_2-2 287.6 μs 289.4 μs +0.6%
game-sm-success_2-3 924.5 μs 924.6 μs +0.0%
game-sm-success_2-4 334.6 μs 335.3 μs +0.2%
game-sm-success_2-5 911.7 μs 927.3 μs +1.7%
game-sm-success_2-6 335.8 μs 335.0 μs -0.2%
multisig-sm-1 561.5 μs 573.7 μs +2.2%
multisig-sm-2 546.0 μs 556.7 μs +2.0%
multisig-sm-3 552.2 μs 563.9 μs +2.1%
multisig-sm-4 558.6 μs 567.8 μs +1.6%
multisig-sm-5 792.8 μs 806.0 μs +1.7%
multisig-sm-6 561.5 μs 573.5 μs +2.1%
multisig-sm-7 547.0 μs 555.1 μs +1.5%
multisig-sm-8 553.1 μs 562.3 μs +1.7%
multisig-sm-9 557.8 μs 567.4 μs +1.7%
multisig-sm-10 792.1 μs 805.5 μs +1.7%
ping-pong-1 468.3 μs 471.6 μs +0.7%
ping-pong-2 466.7 μs 473.6 μs +1.5%
ping-pong_2-1 286.6 μs 284.6 μs -0.7%
prism-1 242.3 μs 243.4 μs +0.5%
prism-2 587.1 μs 596.7 μs +1.6%
prism-3 530.6 μs 531.6 μs +0.2%
pubkey-1 202.7 μs 203.7 μs +0.5%
stablecoin_1-1 1.301 ms 1.293 ms -0.6%
stablecoin_1-2 280.9 μs 283.8 μs +1.0%
stablecoin_1-3 1.501 ms 1.488 ms -0.9%
stablecoin_1-4 298.8 μs 301.3 μs +0.8%
stablecoin_1-5 1.926 ms 1.916 ms -0.5%
stablecoin_1-6 368.0 μs 368.3 μs +0.1%
stablecoin_2-1 1.283 ms 1.290 ms +0.5%
stablecoin_2-2 279.9 μs 283.7 μs +1.4%
stablecoin_2-3 1.496 ms 1.488 ms -0.5%
stablecoin_2-4 298.7 μs 300.7 μs +0.7%
token-account-1 267.6 μs 275.6 μs +3.0%
token-account-2 479.9 μs 483.4 μs +0.7%
uniswap-1 591.7 μs 595.3 μs +0.6%
uniswap-2 316.0 μs 318.1 μs +0.7%
uniswap-3 2.515 ms 2.526 ms +0.4%
uniswap-4 482.7 μs 487.0 μs +0.9%
uniswap-5 1.653 ms 1.667 ms +0.8%
uniswap-6 457.5 μs 467.0 μs +2.1%
vesting-1 498.3 μs 499.6 μs +0.3%
ce72537 6478b97 Change
TOTAL 50.38 ms 50.74 ms +0.7%

Copy link
Contributor

Click here to check the status of your benchmark.

Copy link
Contributor

Comparing benchmark results of 'validation' on 'ce72537391' (base) and '6478b97e0e' (PR)

Results table
Script ce72537 6478b97 Change
auction_1-1 271.5 μs 267.5 μs -1.5%
auction_1-2 939.5 μs 942.7 μs +0.3%
auction_1-3 932.4 μs 931.8 μs -0.1%
auction_1-4 352.8 μs 343.4 μs -2.7%
auction_2-1 272.7 μs 268.5 μs -1.5%
auction_2-2 939.1 μs 943.2 μs +0.4%
auction_2-3 1.225 ms 1.226 ms +0.1%
auction_2-4 935.5 μs 931.4 μs -0.4%
auction_2-5 352.8 μs 342.3 μs -3.0%
crowdfunding-success-1 319.3 μs 313.1 μs -1.9%
crowdfunding-success-2 318.6 μs 311.7 μs -2.2%
crowdfunding-success-3 318.0 μs 311.9 μs -1.9%
currency-1 371.5 μs 370.9 μs -0.2%
escrow-redeem_1-1 520.3 μs 520.3 μs 0.0%
escrow-redeem_1-2 520.5 μs 518.9 μs -0.3%
escrow-redeem_2-1 608.5 μs 600.5 μs -1.3%
escrow-redeem_2-2 607.8 μs 597.5 μs -1.7%
escrow-redeem_2-3 608.4 μs 597.9 μs -1.7%
escrow-refund-1 235.7 μs 231.1 μs -2.0%
future-increase-margin-1 372.5 μs 370.6 μs -0.5%
future-increase-margin-2 797.7 μs 797.4 μs -0.0%
future-increase-margin-3 797.1 μs 792.9 μs -0.5%
future-increase-margin-4 714.3 μs 714.8 μs +0.1%
future-increase-margin-5 1.188 ms 1.187 ms -0.1%
future-pay-out-1 371.7 μs 370.5 μs -0.3%
future-pay-out-2 795.9 μs 789.8 μs -0.8%
future-pay-out-3 798.7 μs 792.3 μs -0.8%
future-pay-out-4 1.172 ms 1.182 ms +0.9%
future-settle-early-1 371.9 μs 371.0 μs -0.2%
future-settle-early-2 800.4 μs 794.5 μs -0.7%
future-settle-early-3 798.5 μs 794.0 μs -0.6%
future-settle-early-4 882.8 μs 882.3 μs -0.1%
game-sm-success_1-1 572.6 μs 569.1 μs -0.6%
game-sm-success_1-2 306.6 μs 299.0 μs -2.5%
game-sm-success_1-3 938.5 μs 942.7 μs +0.4%
game-sm-success_1-4 357.7 μs 347.5 μs -2.9%
game-sm-success_2-1 574.0 μs 570.7 μs -0.6%
game-sm-success_2-2 306.1 μs 298.8 μs -2.4%
game-sm-success_2-3 939.1 μs 943.3 μs +0.4%
game-sm-success_2-4 357.0 μs 346.7 μs -2.9%
game-sm-success_2-5 940.2 μs 942.7 μs +0.3%
game-sm-success_2-6 357.3 μs 347.4 μs -2.8%
multisig-sm-1 579.7 μs 586.2 μs +1.1%
multisig-sm-2 565.9 μs 565.6 μs -0.1%
multisig-sm-3 572.2 μs 574.9 μs +0.5%
multisig-sm-4 578.2 μs 580.8 μs +0.4%
multisig-sm-5 814.9 μs 820.3 μs +0.7%
multisig-sm-6 579.0 μs 587.2 μs +1.4%
multisig-sm-7 566.5 μs 565.2 μs -0.2%
multisig-sm-8 571.4 μs 574.0 μs +0.5%
multisig-sm-9 578.0 μs 580.4 μs +0.4%
multisig-sm-10 815.2 μs 818.0 μs +0.3%
ping-pong-1 485.2 μs 482.2 μs -0.6%
ping-pong-2 485.1 μs 481.9 μs -0.7%
ping-pong_2-1 299.2 μs 292.3 μs -2.3%
prism-1 259.3 μs 251.4 μs -3.0%
prism-2 611.5 μs 610.3 μs -0.2%
prism-3 555.3 μs 544.7 μs -1.9%
pubkey-1 216.4 μs 209.8 μs -3.0%
stablecoin_1-1 1.324 ms 1.311 ms -1.0%
stablecoin_1-2 298.9 μs 291.8 μs -2.4%
stablecoin_1-3 1.552 ms 1.507 ms -2.9%
stablecoin_1-4 318.7 μs 310.8 μs -2.5%
stablecoin_1-5 1.998 ms 1.943 ms -2.8%
stablecoin_1-6 391.7 μs 379.7 μs -3.1%
stablecoin_2-1 1.324 ms 1.310 ms -1.1%
stablecoin_2-2 299.1 μs 292.4 μs -2.2%
stablecoin_2-3 1.535 ms 1.508 ms -1.8%
stablecoin_2-4 318.9 μs 311.0 μs -2.5%
token-account-1 280.3 μs 281.8 μs +0.5%
token-account-2 498.2 μs 496.2 μs -0.4%
uniswap-1 609.2 μs 606.4 μs -0.5%
uniswap-2 333.2 μs 327.1 μs -1.8%
uniswap-3 2.582 ms 2.570 ms -0.5%
uniswap-4 515.3 μs 501.8 μs -2.6%
uniswap-5 1.711 ms 1.691 ms -1.2%
uniswap-6 501.1 μs 481.4 μs -3.9%
vesting-1 514.1 μs 510.4 μs -0.7%
ce72537 6478b97 Change
TOTAL 52.20 ms 51.77 ms -0.8%

Copy link
Contributor

Click here to check the status of your benchmark.

@effectfully
Copy link
Contributor Author

/benchmark validation

1 similar comment
@effectfully
Copy link
Contributor Author

/benchmark validation

Copy link
Contributor

Comparing benchmark results of 'validation' on 'ce72537391' (base) and '6478b97e0e' (PR)

Results table
Script ce72537 6478b97 Change
auction_1-1 255.5 μs 259.5 μs +1.6%
auction_1-2 916.4 μs 925.1 μs +0.9%
auction_1-3 915.0 μs 914.1 μs -0.1%
auction_1-4 331.3 μs 331.1 μs -0.1%
auction_2-1 256.1 μs 259.6 μs +1.4%
auction_2-2 916.0 μs 921.7 μs +0.6%
auction_2-3 1.194 ms 1.208 ms +1.2%
auction_2-4 905.8 μs 913.9 μs +0.9%
auction_2-5 330.3 μs 331.3 μs +0.3%
crowdfunding-success-1 299.5 μs 302.2 μs +0.9%
crowdfunding-success-2 297.8 μs 302.4 μs +1.5%
crowdfunding-success-3 300.1 μs 301.8 μs +0.6%
currency-1 357.7 μs 361.9 μs +1.2%
escrow-redeem_1-1 498.8 μs 505.8 μs +1.4%
escrow-redeem_1-2 499.6 μs 506.1 μs +1.3%
escrow-redeem_2-1 583.3 μs 584.4 μs +0.2%
escrow-redeem_2-2 582.5 μs 583.3 μs +0.1%
escrow-redeem_2-3 583.6 μs 582.6 μs -0.2%
escrow-refund-1 222.7 μs 225.4 μs +1.2%
future-increase-margin-1 358.5 μs 361.0 μs +0.7%
future-increase-margin-2 769.4 μs 776.2 μs +0.9%
future-increase-margin-3 768.7 μs 774.9 μs +0.8%
future-increase-margin-4 691.6 μs 702.8 μs +1.6%
future-increase-margin-5 1.152 ms 1.167 ms +1.3%
future-pay-out-1 357.9 μs 361.4 μs +1.0%
future-pay-out-2 769.3 μs 774.6 μs +0.7%
future-pay-out-3 767.0 μs 775.9 μs +1.2%
future-pay-out-4 1.153 ms 1.168 ms +1.3%
future-settle-early-1 357.8 μs 361.3 μs +1.0%
future-settle-early-2 767.7 μs 774.0 μs +0.8%
future-settle-early-3 769.1 μs 776.1 μs +0.9%
future-settle-early-4 862.8 μs 868.8 μs +0.7%
game-sm-success_1-1 551.8 μs 555.1 μs +0.6%
game-sm-success_1-2 286.6 μs 288.6 μs +0.7%
game-sm-success_1-3 909.3 μs 922.4 μs +1.4%
game-sm-success_1-4 334.8 μs 335.6 μs +0.2%
game-sm-success_2-1 551.1 μs 555.0 μs +0.7%
game-sm-success_2-2 286.7 μs 288.7 μs +0.7%
game-sm-success_2-3 909.8 μs 927.4 μs +1.9%
game-sm-success_2-4 333.9 μs 334.9 μs +0.3%
game-sm-success_2-5 909.2 μs 925.8 μs +1.8%
game-sm-success_2-6 334.3 μs 334.4 μs +0.0%
multisig-sm-1 559.5 μs 573.5 μs +2.5%
multisig-sm-2 544.8 μs 554.6 μs +1.8%
multisig-sm-3 551.4 μs 563.3 μs +2.2%
multisig-sm-4 557.2 μs 566.5 μs +1.7%
multisig-sm-5 791.2 μs 804.5 μs +1.7%
multisig-sm-6 558.0 μs 570.3 μs +2.2%
multisig-sm-7 546.4 μs 555.2 μs +1.6%
multisig-sm-8 551.8 μs 560.8 μs +1.6%
multisig-sm-9 556.7 μs 567.7 μs +2.0%
multisig-sm-10 790.1 μs 804.3 μs +1.8%
ping-pong-1 467.2 μs 470.6 μs +0.7%
ping-pong-2 467.5 μs 471.8 μs +0.9%
ping-pong_2-1 285.3 μs 285.2 μs -0.0%
prism-1 243.0 μs 243.1 μs +0.0%
prism-2 586.6 μs 594.8 μs +1.4%
prism-3 530.3 μs 530.9 μs +0.1%
pubkey-1 201.4 μs 202.8 μs +0.7%
stablecoin_1-1 1.280 ms 1.296 ms +1.3%
stablecoin_1-2 280.3 μs 283.3 μs +1.1%
stablecoin_1-3 1.501 ms 1.496 ms -0.3%
stablecoin_1-4 298.5 μs 301.2 μs +0.9%
stablecoin_1-5 1.903 ms 1.917 ms +0.7%
stablecoin_1-6 367.1 μs 367.1 μs 0.0%
stablecoin_2-1 1.280 ms 1.297 ms +1.3%
stablecoin_2-2 280.3 μs 283.2 μs +1.0%
stablecoin_2-3 1.501 ms 1.494 ms -0.5%
stablecoin_2-4 299.1 μs 302.0 μs +1.0%
token-account-1 268.4 μs 273.6 μs +1.9%
token-account-2 478.2 μs 482.4 μs +0.9%
uniswap-1 590.1 μs 598.3 μs +1.4%
uniswap-2 316.1 μs 317.3 μs +0.4%
uniswap-3 2.515 ms 2.539 ms +1.0%
uniswap-4 481.4 μs 484.3 μs +0.6%
uniswap-5 1.683 ms 1.663 ms -1.2%
uniswap-6 457.3 μs 468.1 μs +2.4%
vesting-1 495.4 μs 499.9 μs +0.9%
ce72537 6478b97 Change
TOTAL 50.26 ms 50.71 ms +0.9%

Copy link
Contributor

Click here to check the status of your benchmark.

Copy link
Contributor

Comparing benchmark results of 'validation' on 'ce72537391' (base) and '6478b97e0e' (PR)

Results table
Script ce72537 6478b97 Change
auction_1-1 258.1 μs 260.4 μs +0.9%
auction_1-2 920.8 μs 922.7 μs +0.2%
auction_1-3 911.2 μs 913.7 μs +0.3%
auction_1-4 337.4 μs 331.9 μs -1.6%
auction_2-1 259.4 μs 260.2 μs +0.3%
auction_2-2 921.5 μs 922.4 μs +0.1%
auction_2-3 1.202 ms 1.204 ms +0.2%
auction_2-4 914.2 μs 913.1 μs -0.1%
auction_2-5 334.3 μs 331.1 μs -1.0%
crowdfunding-success-1 302.4 μs 302.4 μs 0.0%
crowdfunding-success-2 302.9 μs 302.4 μs -0.2%
crowdfunding-success-3 311.3 μs 301.7 μs -3.1%
currency-1 360.6 μs 362.4 μs +0.5%
escrow-redeem_1-1 501.4 μs 507.0 μs +1.1%
escrow-redeem_1-2 501.1 μs 505.1 μs +0.8%
escrow-redeem_2-1 590.3 μs 583.4 μs -1.2%
escrow-redeem_2-2 587.9 μs 583.4 μs -0.8%
escrow-redeem_2-3 587.2 μs 582.1 μs -0.9%
escrow-refund-1 224.4 μs 224.7 μs +0.1%
future-increase-margin-1 360.0 μs 361.3 μs +0.4%
future-increase-margin-2 775.3 μs 773.9 μs -0.2%
future-increase-margin-3 774.3 μs 777.3 μs +0.4%
future-increase-margin-4 698.0 μs 698.4 μs +0.1%
future-increase-margin-5 1.163 ms 1.167 ms +0.3%
future-pay-out-1 361.0 μs 364.0 μs +0.8%
future-pay-out-2 779.1 μs 773.5 μs -0.7%
future-pay-out-3 772.6 μs 774.9 μs +0.3%
future-pay-out-4 1.162 ms 1.165 ms +0.3%
future-settle-early-1 360.8 μs 361.6 μs +0.2%
future-settle-early-2 773.0 μs 775.3 μs +0.3%
future-settle-early-3 774.4 μs 775.2 μs +0.1%
future-settle-early-4 871.1 μs 865.9 μs -0.6%
game-sm-success_1-1 555.0 μs 555.3 μs +0.1%
game-sm-success_1-2 290.0 μs 288.6 μs -0.5%
game-sm-success_1-3 917.1 μs 927.6 μs +1.1%
game-sm-success_1-4 337.9 μs 334.7 μs -0.9%
game-sm-success_2-1 554.0 μs 558.1 μs +0.7%
game-sm-success_2-2 289.5 μs 289.4 μs -0.0%
game-sm-success_2-3 916.0 μs 925.0 μs +1.0%
game-sm-success_2-4 338.5 μs 335.1 μs -1.0%
game-sm-success_2-5 916.0 μs 925.8 μs +1.1%
game-sm-success_2-6 337.1 μs 335.2 μs -0.6%
multisig-sm-1 563.9 μs 574.0 μs +1.8%
multisig-sm-2 549.7 μs 556.5 μs +1.2%
multisig-sm-3 557.0 μs 563.8 μs +1.2%
multisig-sm-4 562.2 μs 568.5 μs +1.1%
multisig-sm-5 796.0 μs 803.8 μs +1.0%
multisig-sm-6 562.7 μs 571.3 μs +1.5%
multisig-sm-7 551.7 μs 556.0 μs +0.8%
multisig-sm-8 555.4 μs 561.4 μs +1.1%
multisig-sm-9 561.3 μs 568.3 μs +1.2%
multisig-sm-10 796.2 μs 802.7 μs +0.8%
ping-pong-1 470.0 μs 472.5 μs +0.5%
ping-pong-2 469.9 μs 471.3 μs +0.3%
ping-pong_2-1 289.2 μs 284.1 μs -1.8%
prism-1 244.6 μs 243.2 μs -0.6%
prism-2 591.6 μs 595.4 μs +0.6%
prism-3 534.8 μs 532.6 μs -0.4%
pubkey-1 204.4 μs 203.0 μs -0.7%
stablecoin_1-1 1.290 ms 1.295 ms +0.4%
stablecoin_1-2 283.3 μs 283.0 μs -0.1%
stablecoin_1-3 1.489 ms 1.495 ms +0.4%
stablecoin_1-4 301.3 μs 302.3 μs +0.3%
stablecoin_1-5 1.949 ms 1.922 ms -1.4%
stablecoin_1-6 371.2 μs 368.5 μs -0.7%
stablecoin_2-1 1.299 ms 1.291 ms -0.6%
stablecoin_2-2 282.8 μs 283.1 μs +0.1%
stablecoin_2-3 1.512 ms 1.498 ms -0.9%
stablecoin_2-4 300.6 μs 301.3 μs +0.2%
token-account-1 269.8 μs 274.3 μs +1.7%
token-account-2 481.0 μs 483.1 μs +0.4%
uniswap-1 594.5 μs 594.7 μs +0.0%
uniswap-2 318.9 μs 318.0 μs -0.3%
uniswap-3 2.532 ms 2.532 ms 0.0%
uniswap-4 486.4 μs 484.3 μs -0.4%
uniswap-5 1.682 ms 1.668 ms -0.8%
uniswap-6 460.7 μs 466.9 μs +1.3%
vesting-1 498.9 μs 499.1 μs +0.0%
ce72537 6478b97 Change
TOTAL 50.67 ms 50.71 ms +0.1%

Copy link
Contributor

Click here to check the status of your benchmark.

Copy link
Contributor

Comparing benchmark results of 'validation' on 'ce72537391' (base) and '6478b97e0e' (PR)

Results table
Script ce72537 6478b97 Change
auction_1-1 256.1 μs 258.9 μs +1.1%
auction_1-2 916.2 μs 922.5 μs +0.7%
auction_1-3 907.2 μs 910.8 μs +0.4%
auction_1-4 331.1 μs 331.7 μs +0.2%
auction_2-1 256.9 μs 259.8 μs +1.1%
auction_2-2 916.1 μs 924.8 μs +0.9%
auction_2-3 1.196 ms 1.201 ms +0.4%
auction_2-4 911.0 μs 910.6 μs -0.0%
auction_2-5 331.5 μs 331.1 μs -0.1%
crowdfunding-success-1 299.1 μs 301.6 μs +0.8%
crowdfunding-success-2 299.4 μs 302.6 μs +1.1%
crowdfunding-success-3 299.5 μs 301.8 μs +0.8%
currency-1 358.3 μs 361.6 μs +0.9%
escrow-redeem_1-1 498.3 μs 505.1 μs +1.4%
escrow-redeem_1-2 499.9 μs 504.0 μs +0.8%
escrow-redeem_2-1 584.2 μs 581.7 μs -0.4%
escrow-redeem_2-2 584.3 μs 581.3 μs -0.5%
escrow-redeem_2-3 585.0 μs 580.9 μs -0.7%
escrow-refund-1 222.4 μs 224.1 μs +0.8%
future-increase-margin-1 358.8 μs 361.8 μs +0.8%
future-increase-margin-2 770.6 μs 775.1 μs +0.6%
future-increase-margin-3 769.1 μs 776.7 μs +1.0%
future-increase-margin-4 693.2 μs 700.1 μs +1.0%
future-increase-margin-5 1.155 ms 1.168 ms +1.1%
future-pay-out-1 358.4 μs 362.0 μs +1.0%
future-pay-out-2 769.1 μs 775.0 μs +0.8%
future-pay-out-3 769.5 μs 773.7 μs +0.5%
future-pay-out-4 1.148 ms 1.162 ms +1.2%
future-settle-early-1 358.2 μs 361.4 μs +0.9%
future-settle-early-2 769.6 μs 774.9 μs +0.7%
future-settle-early-3 771.9 μs 777.4 μs +0.7%
future-settle-early-4 870.1 μs 867.1 μs -0.3%
game-sm-success_1-1 556.5 μs 555.2 μs -0.2%
game-sm-success_1-2 287.1 μs 288.5 μs +0.5%
game-sm-success_1-3 913.1 μs 926.2 μs +1.4%
game-sm-success_1-4 334.4 μs 334.9 μs +0.1%
game-sm-success_2-1 550.7 μs 555.0 μs +0.8%
game-sm-success_2-2 287.1 μs 288.9 μs +0.6%
game-sm-success_2-3 912.0 μs 927.0 μs +1.6%
game-sm-success_2-4 335.5 μs 335.0 μs -0.1%
game-sm-success_2-5 910.0 μs 924.9 μs +1.6%
game-sm-success_2-6 335.2 μs 334.7 μs -0.1%
multisig-sm-1 560.3 μs 573.7 μs +2.4%
multisig-sm-2 546.4 μs 553.5 μs +1.3%
multisig-sm-3 552.6 μs 562.0 μs +1.7%
multisig-sm-4 557.0 μs 565.4 μs +1.5%
multisig-sm-5 793.7 μs 801.6 μs +1.0%
multisig-sm-6 557.9 μs 570.5 μs +2.3%
multisig-sm-7 546.6 μs 554.5 μs +1.4%
multisig-sm-8 552.2 μs 562.7 μs +1.9%
multisig-sm-9 558.2 μs 567.2 μs +1.6%
multisig-sm-10 791.8 μs 805.1 μs +1.7%
ping-pong-1 466.4 μs 472.5 μs +1.3%
ping-pong-2 468.4 μs 470.3 μs +0.4%
ping-pong_2-1 286.8 μs 284.9 μs -0.7%
prism-1 242.5 μs 242.9 μs +0.2%
prism-2 589.7 μs 593.3 μs +0.6%
prism-3 531.2 μs 530.8 μs -0.1%
pubkey-1 203.1 μs 202.8 μs -0.1%
stablecoin_1-1 1.283 ms 1.294 ms +0.9%
stablecoin_1-2 281.4 μs 283.1 μs +0.6%
stablecoin_1-3 1.500 ms 1.492 ms -0.5%
stablecoin_1-4 298.6 μs 306.8 μs +2.7%
stablecoin_1-5 1.937 ms 1.906 ms -1.6%
stablecoin_1-6 368.1 μs 367.0 μs -0.3%
stablecoin_2-1 1.279 ms 1.287 ms +0.6%
stablecoin_2-2 280.5 μs 283.2 μs +1.0%
stablecoin_2-3 1.482 ms 1.484 ms +0.1%
stablecoin_2-4 299.0 μs 300.7 μs +0.6%
token-account-1 269.8 μs 274.9 μs +1.9%
token-account-2 478.2 μs 483.5 μs +1.1%
uniswap-1 592.5 μs 595.9 μs +0.6%
uniswap-2 316.5 μs 318.1 μs +0.5%
uniswap-3 2.513 ms 2.525 ms +0.5%
uniswap-4 482.1 μs 486.1 μs +0.8%
uniswap-5 1.652 ms 1.662 ms +0.6%
uniswap-6 458.5 μs 465.0 μs +1.4%
vesting-1 498.3 μs 499.4 μs +0.2%
ce72537 6478b97 Change
TOTAL 50.31 ms 50.63 ms +0.6%

Copy link
Contributor

@kwxm kwxm left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This seems perfectly reasonable. It doesn't sound like it's going to impose a massive penalty on typical programs and it's probably better to avoid any possible surprises.

plutus-core/plutus-core/src/PlutusCore/Builtin/Meaning.hs Outdated Show resolved Hide resolved
@@ -294,13 +294,29 @@ instance
-- See Note [One-shotting runtime denotations].
-- Grow the builtin application within the received action and recurse on the result.
toMonoF getBoth = BuiltinExpectArgument . oneShot $ \arg ->
-- Ironically computing the unlifted value strictly is the best way of doing deferred
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ironically computing

This sounds like some kind of technique: "ironic computation". We should invent something just so we can call it that.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Love the idea.

Co-authored-by: Kenneth MacKenzie <kenneth.mackenzie@iohk.io>
@effectfully effectfully enabled auto-merge (squash) November 29, 2024 12:49
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Builtins No Changelog Required Add this to skip the Changelog Check Performance
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants