DeepSeek V4.1 Flash (max)
1.7%
Bugs resolved
n/a
Total cost
n/a
Turns / repo
n/a
Output tokens / repo
Estimated from recorded Fireworks token usage and cache hits at public serverless Standard prices; not an invoice. Datafusion trajectory and usage were lost to a disk-full error; its resources and full-model averages are unavailable.
Per-repository results
100 repositories| # | Repository | Language | Bugs resolved | Cost | Turns | Tokens |
|---|---|---|---|---|---|---|
| 1 | agda | hs | 0.0% (0/45) | $2.18 | 679 | 314.7k |
| 2 | arrow | cpp | 0.0% (0/47) | $2.25 | 645 | 277.4k |
| 3 | arrow-py | py | 0.0% (0/4) | $0.97 | 334 | 251.9k |
| 4 | astropy | py | 0.0% (0/80) | $2.35 | 672 | 307.2k |
| 5 | aws-cdk | ts | 2.7% (1/37) | $2.20 | 731 | 319.8k |
| 6 | babel | js | 0.0% (0/31) | $2.66 | 674 | 372.2k |
| 7 | black | py | 4.8% (1/21) | $1.58 | 453 | 316.9k |
| 8 | click | py | 0.0% (0/13) | $0.94 | 288 | 205.1k |
| 9 | clippy | rs | 0.0% (0/76) | $0.44 | 223 | 137.2k |
| 10 | conan | py | 0.0% (0/24) | $2.04 | 596 | 208.5k |
| 11 | cvc5 | cpp | 0.0% (0/38) | $1.57 | 564 | 240.5k |
| 12 | dart-sdk | dart | 2.0% (1/50) | $1.65 | 594 | 245.6k |
| 13 | dask | py | 0.0% (0/21) | $2.27 | 663 | 352.2k |
| 14 | dataframes-jl | jl | 14.3% (1/7) | $1.64 | 510 | 286.6k |
| 15 | datafusion | rs | 0.0% (0/38) | n/a | n/a | n/a |
| 16 | dateutil | py | 30.0% (3/10) | $0.95 | 299 | 261.9k |
| 17 | dayjs | js | 18.2% (2/11) | $1.10 | 300 | 315.3k |
| 18 | distributions-jl | jl | 11.1% (1/9) | $1.29 | 427 | 259.3k |
| 19 | dmd | d | 0.0% (0/112) | $2.33 | 780 | 319.6k |
| 20 | dolphinscheduler | java | 0.0% (0/10) | $1.87 | 611 | 244.7k |
| 21 | duckdb | cpp | 0.0% (0/109) | $1.99 | 715 | 329.5k |
| 22 | echo | go | 0.0% (0/6) | $1.18 | 290 | 368.5k |
| 23 | elixir | ex | 6.4% (3/47) | $2.83 | 816 | 397.6k |
| 24 | fasthttp | go | 22.2% (2/9) | $1.60 | 427 | 316.5k |
| 25 | formulajs | js | 22.2% (2/9) | $1.20 | 316 | 361.6k |
| 26 | fsharp | fs | 0.0% (0/28) | $2.41 | 739 | 381.2k |
| 27 | gdal | cpp | 0.0% (0/72) | $1.08 | 406 | 217.9k |
| 28 | gin | go | 18.2% (2/11) | $0.91 | 252 | 295.5k |
| 29 | gitoxide | rs | 0.0% (0/9) | $1.84 | 640 | 236.2k |
| 30 | go | go | 4.1% (4/98) | $1.57 | 492 | 371.3k |
| 31 | go-git | go | 0.0% (0/23) | $2.16 | 564 | 350.2k |
| 32 | goawk | go | 21.4% (3/14) | $1.54 | 415 | 361.6k |
| 33 | godot | cpp | 0.0% (0/17) | $2.07 | 591 | 296.9k |
| 34 | gorm | go | 0.0% (0/19) | $1.35 | 327 | 363.2k |
| 35 | gson | java | 0.0% (0/6) | $1.43 | 474 | 271.8k |
| 36 | hdf5 | c | 0.0% (0/14) | $2.10 | 706 | 295.9k |
| 37 | idris2 | idr | 0.0% (0/13) | $1.89 | 536 | 288.6k |
| 38 | isomorphic-git | js | 0.0% (0/13) | $1.31 | 420 | 272.1k |
| 39 | isort | py | 18.2% (2/11) | $2.29 | 671 | 379.7k |
| 40 | jerryscript | c | 6.7% (1/15) | $2.47 | 731 | 400.8k |
| 41 | jest | ts | 0.0% (0/20) | $0.01 | 6 | 1.6k |
| 42 | keycloak | java | 1.6% (1/64) | $2.64 | 813 | 274.4k |
| 43 | lean4 | lean | 0.0% (0/63) | $2.59 | 647 | 441.2k |
| 44 | libexpat | c | 22.2% (2/9) | $1.89 | 527 | 314.3k |
| 45 | luxon | js | 14.3% (2/14) | $1.26 | 366 | 331.7k |
| 46 | material-ui | js | 2.6% (1/39) | $1.56 | 525 | 264.6k |
| 47 | mathlib4 | lean | 0.0% (0/14) | $1.66 | 468 | 426.8k |
| 48 | matplotlib | py | 0.0% (0/78) | $1.98 | 519 | 376.3k |
| 49 | micropython | c | 0.0% (0/22) | $2.30 | 657 | 324.9k |
| 50 | modelingtoolkit-jl | jl | 0.0% (0/10) | $1.31 | 492 | 270.4k |
| 51 | mongoose | js | 2.9% (2/70) | $2.18 | 660 | 287.6k |
| 52 | mpmath | py | 0.0% (0/16) | $2.73 | 776 | 382.9k |
| 53 | mypy | py | 0.0% (0/91) | $1.67 | 523 | 211.8k |
| 54 | nacos | java | 0.0% (0/12) | $1.65 | 528 | 232.3k |
| 55 | netty | java | 2.1% (2/96) | $1.33 | 438 | 315.1k |
| 56 | networkx | py | 0.0% (0/18) | $1.80 | 549 | 347.7k |
| 57 | nim | nim | 1.0% (2/192) | $3.23 | 797 | 423.7k |
| 58 | numpy | py | 1.5% (2/131) | $2.22 | 544 | 387.2k |
| 59 | nuxt | ts | 0.0% (0/6) | $1.04 | 379 | 159.2k |
| 60 | openapi-generator | mustache | 0.0% (0/31) | $1.21 | 442 | 199.5k |
| 61 | opencv | cpp | 0.0% (0/47) | $2.46 | 728 | 338.7k |
| 62 | optuna | py | n/a | n/a | n/a | n/a |
| 63 | oxc | rs | 0.0% (0/6) | $2.44 | 758 | 288.9k |
| 64 | pandas | py | 0.4% (1/228) | $2.06 | 603 | 403.1k |
| 65 | pendulum | py | 33.3% (3/9) | $1.37 | 389 | 349.9k |
| 66 | php-src | c | 3.8% (1/26) | $2.08 | 549 | 480.2k |
| 67 | phpspreadsheet | php | 0.0% (0/9) | $1.48 | 465 | 232.6k |
| 68 | pint | py | 0.0% (0/13) | $2.14 | 543 | 445.1k |
| 69 | prettier | js | 0.0% (0/34) | $1.61 | 605 | 245.2k |
| 70 | proj | cpp | 0.0% (0/21) | $2.29 | 657 | 316.4k |
| 71 | pulsar | java | 0.0% (0/19) | $1.63 | 548 | 260.6k |
| 72 | quarkus | java | 0.0% (0/72) | $1.87 | 598 | 309.4k |
| 73 | qutip | py | 10.0% (1/10) | $1.94 | 600 | 316.9k |
| 74 | rails | rb | 0.0% (0/140) | $1.45 | 445 | 282.7k |
| 75 | react-router | ts | 0.0% (0/14) | $1.55 | 510 | 218.2k |
| 76 | roslyn | cs | 0.0% (0/31) | $1.43 | 583 | 224.7k |
| 77 | ruff | rs | 0.0% (0/52) | $2.70 | 711 | 468.5k |
| 78 | rxjava | java | 3.8% (1/26) | $1.55 | 523 | 231.5k |
| 79 | scikit-learn | py | 0.0% (0/80) | $2.02 | 561 | 343.8k |
| 80 | scipy | py | 0.0% (0/136) | $2.48 | 632 | 513.3k |
| 81 | shapely | py | 44.4% (4/9) | $1.55 | 441 | 309.7k |
| 82 | shardingsphere | java | 0.0% (0/15) | $2.09 | 618 | 305.3k |
| 83 | sqlglot | py | 0.8% (1/130) | $2.48 | 646 | 370.3k |
| 84 | stylelint | js | 0.0% (0/54) | $1.48 | 477 | 321.5k |
| 85 | sunpy | py | 0.0% (0/15) | $1.29 | 466 | 166.0k |
| 86 | svgo | js | 18.2% (2/11) | $1.16 | 355 | 276.8k |
| 87 | swc | rs | 5.3% (1/19) | $2.67 | 746 | 380.7k |
| 88 | symfony | php | 0.0% (0/149) | $0.75 | 268 | 181.9k |
| 89 | syn | rs | 15.4% (2/13) | $1.62 | 402 | 423.7k |
| 90 | tarantool | c | n/a | n/a | n/a | n/a |
| 91 | terser | js | 0.0% (0/6) | $3.79 | 951 | 586.4k |
| 92 | testify | go | 0.0% (0/9) | $0.97 | 257 | 330.6k |
| 93 | three-js | js | 0.0% (0/9) | $1.76 | 496 | 295.6k |
| 94 | tinygrad | py | 0.0% (0/15) | $1.58 | 522 | 256.9k |
| 95 | tokio | rs | 0.0% (0/12) | $1.41 | 485 | 238.7k |
| 96 | trino | java | 2.3% (1/43) | $0.70 | 363 | 163.9k |
| 97 | v | v | 1.7% (4/239) | $1.65 | 610 | 286.6k |
| 98 | webpack | js | 2.9% (1/35) | $0.29 | 166 | 98.1k |
| 99 | xarray | py | 3.2% (1/31) | $2.44 | 615 | 378.9k |
| 100 | z3 | cpp | 0.0% (0/11) | $2.26 | 767 | 360.9k |