Base metric: Adjusted average of 1 trial(s) (after 0 discards).
Final reported metric (heatmap & graphs): Median of 12 outer repetition(s) of the base metric.
Cell values are final aggregated execution times relative to the fastest shim for that specific Blueprint/Benchmark row (lower/lighter is better, 1.00x is fastest).
Hover over a cell to see the absolute median time in nanoseconds. Click on a 'Blueprint: Benchmark 📈' entry to navigate to its detailed graph.
Column headers for shims include an overall rank. This rank is calculated dynamically based on the weights selected in the Global Settings panel below.
The 'Overall Relative Performance' row normalizes scores so the best shim is 1.00x. N/A results are penalized (treated as 20.00x slower) when calculating this overall metric.
✝ indicates a shim known to use a tombstone-like mechanism (applies to erase benchmarks only).
| Blueprint: Benchmark | DICT | Verstable_2_2_1 | absl | ankerl | boost | emilib2 | folly_f14_fast | folly_f14_vector | indivi_flat_umap | llvm_dense | omm | qt6_hash |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 16-char c-string key, 64-bit value: Insert Non-Existing 📈 | 1.00 400743.00 ns | 1.84 737762.50 ns | 1.73 692777.50 ns | 1.71 686923.50 ns | 1.66 665638.50 ns | 1.43 575035.00 ns | 1.72 690950.50 ns | 1.39 558041.50 ns | 1.54 618289.50 ns | 1.96 787407.00 ns | 1.39 558571.50 ns | 1.68 675116.00 ns |
| 32-bit integer key, 32-bit value: Insert Non-Existing 📈 | 1.65 161576.00 ns | 1.75 171737.00 ns | 1.38 135368.00 ns | 1.92 188091.00 ns | 1.13 110343.00 ns | 1.34 131753.50 ns | 1.06 103941.00 ns | 1.12 110098.00 ns | 1.39 136135.00 ns | 1.28 125326.50 ns | 1.00 98074.00 ns | 1.40 136957.50 ns |
| 64-bit integer key, 448-bit value: Insert Non-Existing 📈 | 1.00 225634.00 ns | 2.42 546155.00 ns | 1.89 425495.00 ns | 1.37 309823.00 ns | 1.69 381612.50 ns | 2.02 455070.50 ns | 1.37 308198.00 ns | 1.39 312683.00 ns | 2.03 458383.00 ns | 2.47 556454.00 ns | 1.77 399198.00 ns | 1.64 370155.50 ns |
| 16-char c-string key, 64-bit value: Reinsert After Erasure 📈 | 1.27✝ 313435.50 ns | 1.32 326065.00 ns | 1.25✝ 307852.00 ns | 1.00 246700.50 ns | 1.09✝ 268712.00 ns | 1.10✝ 271734.00 ns | 1.36✝ 335375.50 ns | 1.07✝ 263267.00 ns | 1.15 284697.00 ns | 1.93✝ 475732.50 ns | 1.08✝ 266305.00 ns | 1.47 362042.50 ns |
| 32-bit integer key, 32-bit value: Reinsert After Erasure 📈 | 2.55✝ 129089.50 ns | 1.62 81882.00 ns | 1.51✝ 76564.00 ns | 1.26 63817.50 ns | 1.02✝ 51501.00 ns | 1.46✝ 73891.00 ns | 1.48✝ 75137.50 ns | 1.07✝ 54111.50 ns | 1.76 88930.50 ns | 1.91✝ 96831.00 ns | 1.00✝ 50619.50 ns | 1.60 80951.00 ns |
| 64-bit integer key, 448-bit value: Reinsert After Erasure 📈 | 2.09✝ 120761.50 ns | 2.33 134496.00 ns | 2.00✝ 115364.00 ns | 1.32 76403.00 ns | 1.59✝ 91956.50 ns | 1.73✝ 100046.50 ns | 1.03✝ 59563.50 ns | 1.00✝ 57813.50 ns | 2.29 132535.50 ns | 4.31✝ 249276.00 ns | 1.45✝ 83903.00 ns | 3.45 199320.00 ns |
| 16-char c-string key, 64-bit value: Erase Existing 📈 | 1.04✝ 39563812.50 ns | 1.06 40274996.50 ns | 1.26✝ 48031996.00 ns | 1.74 66264067.50 ns | 1.05✝ 40159470.50 ns | 1.03✝ 39262755.00 ns | 1.28✝ 48902631.50 ns | 1.65✝ 62912695.00 ns | 1.10 42152751.50 ns | 1.14✝ 43421452.00 ns | 1.00✝ 38161645.50 ns | 2.73 104199449.00 ns |
| 32-bit integer key, 32-bit value: Erase Existing 📈 | 1.57✝ 6544002.50 ns | 1.77 7372676.00 ns | 2.04✝ 8503659.00 ns | 4.23 17644151.00 ns | 1.09✝ 4533152.00 ns | 1.09✝ 4543899.50 ns | 1.36✝ 5673114.50 ns | 2.51✝ 10492442.50 ns | 1.55 6454806.50 ns | 1.14✝ 4766715.50 ns | 1.00✝ 4175694.00 ns | 5.38 22448983.50 ns |
| 64-bit integer key, 448-bit value: Erase Existing 📈 | 1.00✝ 7699060.00 ns | 1.77 13609922.00 ns | 1.99✝ 15330997.00 ns | 2.70 20770448.00 ns | 1.43✝ 11007429.00 ns | 1.37✝ 10516705.50 ns | 1.83✝ 14068250.50 ns | 1.83✝ 14089367.00 ns | 1.83 14075685.00 ns | 1.54✝ 11888247.00 ns | 1.21✝ 9317581.50 ns | 5.17 39794699.50 ns |
| 16-char c-string key, 64-bit value: Replace Existing 📈 | 1.06 45469876.00 ns | 1.07 45846335.50 ns | 1.10 46981416.00 ns | 1.06 45208236.00 ns | 1.00 42737929.00 ns | 1.09 46637483.50 ns | 1.15 49348266.50 ns | 1.05 44917857.00 ns | 1.18 50430061.00 ns | 1.20 51270659.00 ns | 1.03 44123138.00 ns | 1.45 62032498.00 ns |
| 32-bit integer key, 32-bit value: Replace Existing 📈 | 1.88 12536668.00 ns | 1.24 8239297.00 ns | 1.17 7781648.00 ns | 1.62 10775944.00 ns | 1.05 6987162.00 ns | 1.16 7741491.50 ns | 1.15 7628373.00 ns | 1.13 7521995.00 ns | 1.47 9791143.00 ns | 1.09 7274797.50 ns | 1.00 6658753.00 ns | 1.94 12947961.50 ns |
| 64-bit integer key, 448-bit value: Replace Existing 📈 | 1.36 13876856.50 ns | 1.64 16771271.00 ns | 1.62 16488802.50 ns | 1.42 14514067.50 ns | 1.47 14944713.00 ns | 1.68 17098598.50 ns | 1.01 10268493.00 ns | 1.00 10196267.50 ns | 1.84 18751019.00 ns | 1.67 17070665.50 ns | 1.25 12716571.50 ns | 2.80 28507397.00 ns |
| 16-char c-string key, 64-bit value: Erase Non-Existing 📈 | 1.84 56243930.00 ns | 1.09 33351755.00 ns | 1.08 33160140.50 ns | 1.45 44317326.00 ns | 1.05 32097702.50 ns | 1.03 31642843.00 ns | 1.25 38338941.00 ns | 1.18 36102192.00 ns | 1.08 33196714.50 ns | 2.15 65854057.50 ns | 1.00 30640083.50 ns | 1.67 51192890.50 ns |
| 32-bit integer key, 32-bit value: Erase Non-Existing 📈 | 4.33 12972602.00 ns | 2.55 7629623.00 ns | 1.67 4992408.00 ns | 3.01 9022260.00 ns | 1.08 3226301.00 ns | 1.60 4796892.50 ns | 2.00 5980199.00 ns | 1.90 5689094.50 ns | 1.77 5297463.00 ns | 3.39 10154221.00 ns | 1.00 2995503.50 ns | 3.30 9872548.00 ns |
| 64-bit integer key, 448-bit value: Erase Non-Existing 📈 | 3.19 13594934.00 ns | 2.07 8829470.00 ns | 1.57 6699543.00 ns | 2.61 11092454.00 ns | 1.08 4617469.50 ns | 1.42 6032005.50 ns | 1.84 7834442.00 ns | 1.78 7583277.50 ns | 1.51 6445260.50 ns | 5.52 23497445.00 ns | 1.00 4256658.50 ns | 4.20 17863643.50 ns |
| 16-char c-string key, 64-bit value: Lookup Existing 📈 | 1.00 38480460.00 ns | 1.05 40400071.00 ns | 1.15 44103354.50 ns | 1.12 43174806.00 ns | 1.17 44845395.00 ns | 1.16 44459407.50 ns | 1.23 47201883.50 ns | 1.13 43343368.00 ns | 1.28 49271307.50 ns | 1.25 47946099.00 ns | 1.13 43652164.50 ns | 1.59 61330423.00 ns |
| 32-bit integer key, 32-bit value: Lookup Existing 📈 | 1.24 6479090.50 ns | 1.34 6994322.50 ns | 1.20 6223277.50 ns | 1.74 9075728.50 ns | 1.03 5341065.50 ns | 1.12 5837346.00 ns | 1.05 5440990.50 ns | 1.00 5204600.00 ns | 1.36 7098237.00 ns | 1.15 6006315.00 ns | 1.01 5270873.00 ns | 2.35 12217043.50 ns |
| 64-bit integer key, 448-bit value: Lookup Existing 📈 | 1.00 7731648.00 ns | 1.56 12005167.50 ns | 2.16 16642644.00 ns | 1.55 11975019.50 ns | 1.63 12522857.00 ns | 2.10 16167280.50 ns | 1.00 7735991.00 ns | 1.00 7703129.50 ns | 2.21 17013357.50 ns | 1.87 14377445.50 ns | 1.60 12316827.50 ns | 3.99 30754071.00 ns |
| 16-char c-string key, 64-bit value: Lookup Non-Existing 📈 | 1.60 49031040.50 ns | 1.09 33306334.00 ns | 1.08 33154023.00 ns | 1.14 34698235.00 ns | 1.02 31066600.00 ns | 1.10 33498989.50 ns | 1.24 37785144.00 ns | 1.15 35123957.00 ns | 1.05 32036046.50 ns | 2.05 62641365.00 ns | 1.00 30567817.00 ns | 2.03 62174193.50 ns |
| 32-bit integer key, 32-bit value: Lookup Non-Existing 📈 | 3.91 12272616.50 ns | 2.32 7289746.50 ns | 1.37 4316056.50 ns | 2.00 6277946.50 ns | 1.06 3316881.50 ns | 1.56 4909614.50 ns | 1.83 5755615.50 ns | 1.75 5505461.50 ns | 1.53 4818447.50 ns | 3.56 11167389.50 ns | 1.00 3140612.50 ns | 3.33 10447465.50 ns |
| 64-bit integer key, 448-bit value: Lookup Non-Existing 📈 | 3.08 13011393.00 ns | 1.73 7308476.00 ns | 1.42 6002331.00 ns | 2.02 8538660.00 ns | 1.08 4565547.00 ns | 1.49 6300814.50 ns | 1.74 7368250.50 ns | 1.75 7416513.00 ns | 1.43 6029315.50 ns | 5.80 24507018.00 ns | 1.00 4228166.00 ns | 3.94 16678541.50 ns |
| 16-char c-string key, 64-bit value: Iteration 📈 | 17.54 2316176.00 ns | 8.53 1125462.00 ns | 11.23 1482512.50 ns | 1.00 132017.50 ns | 7.00 923866.50 ns | 6.11 806997.50 ns | 5.31 700713.50 ns | 1.01 133698.50 ns | 5.38 709899.00 ns | 20.21 2668230.00 ns | 5.84 771165.50 ns | 34.35 4534753.50 ns |
| 32-bit integer key, 32-bit value: Iteration 📈 | 17.24 2275115.00 ns | 8.59 1133339.50 ns | 10.77 1421446.00 ns | 1.00 131976.50 ns | 6.09 804381.00 ns | 5.86 772750.00 ns | 4.98 656971.00 ns | 1.87 247339.00 ns | 4.88 643515.00 ns | 20.20 2665643.00 ns | 6.05 798079.50 ns | 33.95 4480236.00 ns |
| 64-bit integer key, 448-bit value: Iteration 📈 | 7.67 7909607.00 ns | 1.90 1962333.00 ns | 2.10 2169192.50 ns | 1.00 1036208.50 ns | 2.14 2204703.00 ns | 1.94 2002983.50 ns | 1.00 1031625.00 ns | 1.00 1032834.00 ns | 2.12 2183356.00 ns | 3.06 3160533.50 ns | 2.04 2101266.50 ns | 6.14 6331199.50 ns |
Overall Relative Performance | - | - | - | - | - | - | - | - | - | - | - | - |
Graphs show time (Y-axis) vs. number of keys (X-axis). Each line represents a shim. Lower is better. Y-axis scales dynamically per graph based on the shims shown.
Click on a graph title to return to the heatmap overview.