True LRU

True LRU based on true recency.

TLRU and TRC are abbreviations for TrueLRU (spica/tlru).

Maintenance

The source code is maintained on the next source repository.

https://github.com/falsandtru/spica

Strategies

- True LRU

LRU and Clock are significantly low performance due to their wrong algorithm based on false recency. True recency outperforms false recency.

There are three kinds of recency relationships between entries, used and used, used and unused, and unused and unused. However, LRU and Clock violate some recency. True LRU outperforms LRU and Clock by observing all recency.

The fundamental error of LRU is that new entries are considered most recently used. In fact, they have never been used in the cache. Therefore, new entries must to be added after the entries actually used.

``Sequence: 1, 2, 3, 3, 2, 4

LRU

MRU |4 2 3 1| LRU Hit |0 1 1 0| ^ Violation of the recency between used and unused.

Clock

N-1 |4 3 2 1| 0 Hit |0 1 1 0| ^ Violation of the recency between used and used.

True LRU

MRU |2 3 4 1| LRU Hit |1 1 0 0| ^ ^ ^ Ideal recency(Recency-complete).`

The fact that this recency is already used and widespread in Clock proves that it is neither strange nor unreasonable, and that Clock has the equivalent or significantly higher hit ratio than LRU shows that recency between used and unused entries is more effective and more important than recency between used entries.

Also, Clock is known as an approximation algorithm for LRU, but since LRU and Clock are thus algorithms based on a different kind of recency, Clock is actually not an approximation algorithm for LRU but a completely different recency-based algorithm based on a different kind of recency.

|Algorithm|Used-Used|Used-Unused|Unused-Unused| |:-------:|:-------:|:---------:|:-----------:| |LRU |✓ | |✓ | |Clock | |✓ |✓ | |True LRU |✓ |✓ |✓ |

As with reuse distance, there is a difference between used and unused in recency, whether finite or infinite, and there are various possible ways to bridge the difference. This adjustability exists only for True LRU and Clock, but not for LRU.

The large improvement from LRU in True LRU indicates that the majority of the improvements in all algorithms are due to the accidental eviction of unused entries, which are confused and misinterpreted as unique improvements, and that the improvements due to the uniqueness of each algorithm are small or minor. Taking True LRU as the true baseline instead of LRU, the other algorithms have not achieve very attractive performance, especially in general versatility.

`Efficiency`

`$3`

Some different cache algorithms require extra memory space to retain evicted keys. Linear time complexity indicates the existence of batch processing. Note that admission algorithm doesn't work without eviction algorithm.

https://github.com/ben-manes/caffeine/wiki/Efficiency https://github.com/zhongch4g/LIRS2/blob/master/src/replace_lirs_base.cc

`$3`

A pointer is 8 bytes, bool and int8 are each 1 byte in C.

#### 8 byte key and value (int64, float64, 8 chars)

In-memory cache, memoize, etc.

|Algorithm|Entry overhead|Key size|Total per entry|Attenuation coefficient| |:-------:|-------------:|-------:|--------------:|----------------------:| |LRU | 16 bytes| 1x| 32 bytes| 100.00%| |SLRU | 16 bytes| 1x| 32 bytes| 100.00%| |TLRU | 16 bytes| 1x| 32 bytes| 100.00%| |DWC | 17 bytes| 1x| 33 bytes| 96.96%| |ARC | 17 bytes| 2x| 58 bytes| 55.17%| |LIRS | 33 bytes| 3x| 131 bytes| 24.42%| |LIRS | 33 bytes| 10x| 418 bytes| 7.65%| |W-TinyLFU| 56 bytes| 1x| 72 bytes| 44.44%|

#### 32 byte key and 8 byte value (Session ID / ID)

In-memory KVS, etc.

|Algorithm|Entry overhead|Key size|Total per entry|Attenuation coefficient| |:-------:|-------------:|-------:|--------------:|----------------------:| |LRU | 16 bytes| 1x| 56 bytes| 100.00%| |SLRU | 16 bytes| 1x| 56 bytes| 100.00%| |TLRU | 16 bytes| 1x| 56 bytes| 100.00%| |DWC | 17 bytes| 1x| 57 bytes| 98.24%| |ARC | 17 bytes| 2x| 88 bytes| 63.63%| |LIRS | 33 bytes| 3x| 203 bytes| 27.58%| |LIRS | 33 bytes| 10x| 658 bytes| 8.51%| |W-TinyLFU| 56 bytes| 1x| 96 bytes| 58.33%|

#### 16 byte key and 512 byte value (Domain / DNS packet)

DNS cache server, etc.

|Algorithm|Entry overhead|Key size|Total per entry|Attenuation coefficient| |:-------:|-------------:|-------:|--------------:|----------------------:| |LRU | 16 bytes| 1x| 544 bytes| 100.00%| |SLRU | 16 bytes| 1x| 544 bytes| 100.00%| |TLRU | 16 bytes| 1x| 544 bytes| 100.00%| |DWC | 17 bytes| 1x| 545 bytes| 99.81%| |ARC | 17 bytes| 2x| 578 bytes| 94.11%| |LIRS | 33 bytes| 3x| 659 bytes| 82.54%| |LIRS | 33 bytes| 10x| 1,002 bytes| 54.29%| |W-TinyLFU| 56 bytes| 1x| 584 bytes| 93.15%|

`Resistance`

LIRS's burst resistance means the resistance to continuous cache misses for the last LIR entry or the HIR entries. TLRU's loop resistance is limited to initial only.

|Algorithm|Type |Scan|Loop|Burst| |:-------:|:---:|:--:|:--:|:---:| |LRU |Evict| | | ✓ | |SLRU |Evict| ✓ | | ✓ | |TLRU |Evict| ✓ | ✓ | ✓ | |DWC |Evict| ✓ | ✓ | ✓ | |ARC |Evict| ✓ | | ✓ | |LIRS |Evict| ✓ | ✓ | | |W-TinyLFU|Admit| ✓ | ✓ | ✓ |

`$3`

DWC automatically adjusts the history size according to the loop size.

|Algorithm|Method |Duration |Layout|History size|Resistance|Efficiency| |:-------:|:--------:|:-------:|:----:|-----------:|---------:|---------:| |TLRU |Eventual |Initial |Inner | 100%| > 10x| > 1,000%| |DWC |Statistics|Permanent|Inner | 8%| 4x| 5,000%| |DWC |Statistics|Permanent|Inner | 14%| 10x| 7,142%| |DWC |Statistics|Permanent|Inner | 100%| 96x| 9,600%| |LIRS |Log |Permanent|Outer |300-250,000%| 3-2,500x| 100%| |W-TinyLFU|Hash |Permanent|Outer | 500%| 4x| 80%|

`Hit ratio`

Note that another cache algorithm sometimes changes the parameter values per workload to get a favorite result as the paper of TinyLFU has changed the window size of W-TinyLFU.

- DWC's results are measured by the same default parameter values. - Other results are measured by the simulator in Caffeine. - https://github.com/ben-manes/caffeine/wiki/Efficiency - https://docs.google.com/spreadsheets/d/1G3deNz1gJCoXBE2IuraUSwLE7H_EMn4Sn2GU0HTpI5Y (https://github.com/jedisct1/rust-arc-cache/issues/1)

1. Set the datasets to ./benchmark/trace (See ./benchmark/ratio.ts). - https://github.com/dgraph-io/benchmarks - https://traces.cs.umass.edu/index.php/Storage/Storage 2. Runnpm i. 3. Runnpm run bench. 4. Click the DEBUG button to open a debug tab. 5. Close the previous tab. 6. Press F12 key to open devtools. 7. Select the console tab.

`$3`

!image

W-TinyLFU > (LIRS), DWC > TLRU > ARC > SLRU > LRU

`WS1 1,000,000 LRU hit ratio 2.95% SLRU hit ratio 6.96% TLRU hit ratio 8.09% TLRU - LRU hit ratio delta 5.14% TLRU - SLRU hit ratio delta 1.12%

WS1 2,000,000 LRU hit ratio 6.08% SLRU hit ratio 12.67% TLRU hit ratio 18.03% TLRU - LRU hit ratio delta 11.94% TLRU - SLRU hit ratio delta 5.35%

WS1 3,000,000 LRU hit ratio 9.63% SLRU hit ratio 17.69% TLRU hit ratio 26.92% TLRU - LRU hit ratio delta 17.29% TLRU - SLRU hit ratio delta 9.22%

WS1 4,000,000 LRU hit ratio 21.59% SLRU hit ratio 27.09% TLRU hit ratio 35.88% TLRU - LRU hit ratio delta 14.28% TLRU - SLRU hit ratio delta 8.78%

WS1 5,000,000 LRU hit ratio 33.91% SLRU hit ratio 37.88% TLRU hit ratio 44.19% TLRU - LRU hit ratio delta 10.28% TLRU - SLRU hit ratio delta 6.31%

WS1 6,000,000 LRU hit ratio 45.74% SLRU hit ratio 48.43% TLRU hit ratio 51.66% TLRU - LRU hit ratio delta 5.92% TLRU - SLRU hit ratio delta 3.22%

WS1 7,000,000 LRU hit ratio 54.89% SLRU hit ratio 56.76% TLRU hit ratio 57.70% TLRU - LRU hit ratio delta 2.81% TLRU - SLRU hit ratio delta 0.93%

WS1 8,000,000 LRU hit ratio 61.40% SLRU hit ratio 62.12% TLRU hit ratio 62.46% TLRU - LRU hit ratio delta 1.06% TLRU - SLRU hit ratio delta 0.34%`

`$3`

!image

W-TinyLFU > (LIRS), DWC > TLRU, SLRU > ARC > LRU

`WS2 1,000,000 LRU hit ratio 2.91% SLRU hit ratio 12.31% TLRU hit ratio 9.28% TLRU - LRU hit ratio delta 6.37% TLRU - SLRU hit ratio delta -3.03%

WS2 2,000,000 LRU hit ratio 6.19% SLRU hit ratio 21.40% TLRU hit ratio 19.86% TLRU - LRU hit ratio delta 13.67% TLRU - SLRU hit ratio delta -1.54%

WS2 3,000,000 LRU hit ratio 10.09% SLRU hit ratio 28.48% TLRU hit ratio 30.05% TLRU - LRU hit ratio delta 19.95% TLRU - SLRU hit ratio delta 1.57%

WS2 4,000,000 LRU hit ratio 23.45% SLRU hit ratio 37.81% TLRU hit ratio 40.41% TLRU - LRU hit ratio delta 16.95% TLRU - SLRU hit ratio delta 2.59%

WS2 5,000,000 LRU hit ratio 37.94% SLRU hit ratio 48.89% TLRU hit ratio 50.39% TLRU - LRU hit ratio delta 12.45% TLRU - SLRU hit ratio delta 1.50%

WS2 6,000,000 LRU hit ratio 51.69% SLRU hit ratio 59.29% TLRU hit ratio 60.05% TLRU - LRU hit ratio delta 8.36% TLRU - SLRU hit ratio delta 0.76%

WS2 7,000,000 LRU hit ratio 63.81% SLRU hit ratio 69.45% TLRU hit ratio 69.29% TLRU - LRU hit ratio delta 5.48% TLRU - SLRU hit ratio delta -0.15%

WS2 8,000,000 LRU hit ratio 73.11% SLRU hit ratio 76.65% TLRU hit ratio 76.33% TLRU - LRU hit ratio delta 3.21% TLRU - SLRU hit ratio delta -0.32%`

`$3`

!image

ARC > SLRU, TLRU > (LIRS), DWC > LRU > W-TinyLFU

`F1 2,500 LRU hit ratio 27.74% SLRU hit ratio 28.32% TLRU hit ratio 27.48% TLRU - LRU hit ratio delta -0.25% TLRU - SLRU hit ratio delta -0.83%

F1 5,000 LRU hit ratio 30.55% SLRU hit ratio 32.18% TLRU hit ratio 31.52% TLRU - LRU hit ratio delta 0.96% TLRU - SLRU hit ratio delta -0.66%

F1 7,500 LRU hit ratio 32.18% SLRU hit ratio 34.48% TLRU hit ratio 34.04% TLRU - LRU hit ratio delta 1.86% TLRU - SLRU hit ratio delta -0.43%

F1 10,000 LRU hit ratio 33.27% SLRU hit ratio 35.98% TLRU hit ratio 35.57% TLRU - LRU hit ratio delta 2.29% TLRU - SLRU hit ratio delta -0.41%

F1 12,500 LRU hit ratio 34.19% SLRU hit ratio 37.09% TLRU hit ratio 36.72% TLRU - LRU hit ratio delta 2.53% TLRU - SLRU hit ratio delta -0.36%

F1 15,000 LRU hit ratio 34.97% SLRU hit ratio 37.79% TLRU hit ratio 37.60% TLRU - LRU hit ratio delta 2.63% TLRU - SLRU hit ratio delta -0.18%

F1 17,500 LRU hit ratio 35.62% SLRU hit ratio 38.45% TLRU hit ratio 38.32% TLRU - LRU hit ratio delta 2.70% TLRU - SLRU hit ratio delta -0.12%

F1 20,000 LRU hit ratio 36.17% SLRU hit ratio 39.01% TLRU hit ratio 38.82% TLRU - LRU hit ratio delta 2.65% TLRU - SLRU hit ratio delta -0.18%`

`$3`

!image

W-TinyLFU > DWC > TLRU, (LIRS) > SLRU > ARC > LRU

`DS1 1,000,000 LRU hit ratio 3.08% SLRU hit ratio 6.12% TLRU hit ratio 10.47% TLRU - LRU hit ratio delta 7.39% TLRU - SLRU hit ratio delta 4.35%

DS1 2,000,000 LRU hit ratio 10.74% SLRU hit ratio 23.31% TLRU hit ratio 22.78% TLRU - LRU hit ratio delta 12.03% TLRU - SLRU hit ratio delta -0.52%

DS1 3,000,000 LRU hit ratio 18.59% SLRU hit ratio 36.78% TLRU hit ratio 34.45% TLRU - LRU hit ratio delta 15.86% TLRU - SLRU hit ratio delta -2.33%

DS1 4,000,000 LRU hit ratio 20.24% SLRU hit ratio 39.07% TLRU hit ratio 39.68% TLRU - LRU hit ratio delta 19.44% TLRU - SLRU hit ratio delta 0.61%

DS1 5,000,000 LRU hit ratio 21.03% SLRU hit ratio 40.66% TLRU hit ratio 46.69% TLRU - LRU hit ratio delta 25.66% TLRU - SLRU hit ratio delta 6.03%

DS1 6,000,000 LRU hit ratio 33.95% SLRU hit ratio 49.80% TLRU hit ratio 53.64% TLRU - LRU hit ratio delta 19.68% TLRU - SLRU hit ratio delta 3.83%

DS1 7,000,000 LRU hit ratio 38.89% SLRU hit ratio 56.62% TLRU hit ratio 61.28% TLRU - LRU hit ratio delta 22.38% TLRU - SLRU hit ratio delta 4.65%

DS1 8,000,000 LRU hit ratio 43.03% SLRU hit ratio 57.56% TLRU hit ratio 68.93% TLRU - LRU hit ratio delta 25.90% TLRU - SLRU hit ratio delta 11.36%`

`$3`

!image

W-TinyLFU > (LIRS), DWC > TLRU, SLRU, ARC > LRU

`S3 100,000 LRU hit ratio 2.32% SLRU hit ratio 9.91% TLRU hit ratio 6.99% TLRU - LRU hit ratio delta 4.66% TLRU - SLRU hit ratio delta -2.91%

S3 200,000 LRU hit ratio 4.63% SLRU hit ratio 17.77% TLRU hit ratio 15.49% TLRU - LRU hit ratio delta 10.85% TLRU - SLRU hit ratio delta -2.28%

S3 300,000 LRU hit ratio 7.58% SLRU hit ratio 23.92% TLRU hit ratio 23.85% TLRU - LRU hit ratio delta 16.26% TLRU - SLRU hit ratio delta -0.07%

S3 400,000 LRU hit ratio 12.03% SLRU hit ratio 29.36% TLRU hit ratio 31.94% TLRU - LRU hit ratio delta 19.90% TLRU - SLRU hit ratio delta 2.58%

S3 500,000 LRU hit ratio 22.76% SLRU hit ratio 37.49% TLRU hit ratio 40.35% TLRU - LRU hit ratio delta 17.58% TLRU - SLRU hit ratio delta 2.85%

S3 600,000 LRU hit ratio 34.63% SLRU hit ratio 46.14% TLRU hit ratio 48.40% TLRU - LRU hit ratio delta 13.77% TLRU - SLRU hit ratio delta 2.25%

S3 700,000 LRU hit ratio 46.04% SLRU hit ratio 54.93% TLRU hit ratio 55.86% TLRU - LRU hit ratio delta 9.82% TLRU - SLRU hit ratio delta 0.93%

S3 800,000 LRU hit ratio 56.59% SLRU hit ratio 63.83% TLRU hit ratio 63.88% TLRU - LRU hit ratio delta 7.28% TLRU - SLRU hit ratio delta 0.05%`

`$3`

!image

ARC > DWC > SLRU, TLRU > W-TinyLFU > (LIRS) > LRU

`OLTP 250 LRU hit ratio 16.47% SLRU hit ratio 15.67% TLRU hit ratio 17.06% TLRU - LRU hit ratio delta 0.59% TLRU - SLRU hit ratio delta 1.39%

OLTP 500 LRU hit ratio 23.44% SLRU hit ratio 28.51% TLRU hit ratio 27.86% TLRU - LRU hit ratio delta 4.41% TLRU - SLRU hit ratio delta -0.65%

OLTP 750 LRU hit ratio 28.28% SLRU hit ratio 33.89% TLRU hit ratio 33.11% TLRU - LRU hit ratio delta 4.83% TLRU - SLRU hit ratio delta -0.77%

OLTP 1,000 LRU hit ratio 32.83% SLRU hit ratio 37.52% TLRU hit ratio 36.53% TLRU - LRU hit ratio delta 3.69% TLRU - SLRU hit ratio delta -0.98%

OLTP 1,250 LRU hit ratio 36.20% SLRU hit ratio 39.88% TLRU hit ratio 38.88% TLRU - LRU hit ratio delta 2.67% TLRU - SLRU hit ratio delta -0.99%

OLTP 1,500 LRU hit ratio 38.69% SLRU hit ratio 41.77% TLRU hit ratio 40.79% TLRU - LRU hit ratio delta 2.09% TLRU - SLRU hit ratio delta -0.97%

OLTP 1,750 LRU hit ratio 40.78% SLRU hit ratio 43.22% TLRU hit ratio 42.36% TLRU - LRU hit ratio delta 1.57% TLRU - SLRU hit ratio delta -0.85%

OLTP 2,000 LRU hit ratio 42.46% SLRU hit ratio 44.45% TLRU hit ratio 43.65% TLRU - LRU hit ratio delta 1.18% TLRU - SLRU hit ratio delta -0.79%`

`$3`

!image

W-TinyLFU, (LIRS) > DWC > TLRU >> SLRU > ARC > LRU

`GLI 250 LRU hit ratio 0.93% SLRU hit ratio 1.39% TLRU hit ratio 10.62% TLRU - LRU hit ratio delta 9.69% TLRU - SLRU hit ratio delta 9.22%

GLI 500 LRU hit ratio 0.96% SLRU hit ratio 1.39% TLRU hit ratio 25.03% TLRU - LRU hit ratio delta 24.06% TLRU - SLRU hit ratio delta 23.63%

GLI 750 LRU hit ratio 1.16% SLRU hit ratio 1.42% TLRU hit ratio 37.28% TLRU - LRU hit ratio delta 36.12% TLRU - SLRU hit ratio delta 35.85%

GLI 1,000 LRU hit ratio 11.22% SLRU hit ratio 31.34% TLRU hit ratio 47.17% TLRU - LRU hit ratio delta 35.95% TLRU - SLRU hit ratio delta 15.82%

GLI 1,250 LRU hit ratio 21.25% SLRU hit ratio 41.32% TLRU hit ratio 52.04% TLRU - LRU hit ratio delta 30.78% TLRU - SLRU hit ratio delta 10.72%

GLI 1,500 LRU hit ratio 36.56% SLRU hit ratio 51.86% TLRU hit ratio 53.00% TLRU - LRU hit ratio delta 16.43% TLRU - SLRU hit ratio delta 1.14%

GLI 1,750 LRU hit ratio 45.04% SLRU hit ratio 55.06% TLRU hit ratio 55.88% TLRU - LRU hit ratio delta 10.83% TLRU - SLRU hit ratio delta 0.81%

GLI 2,000 LRU hit ratio 57.41% SLRU hit ratio 57.41% TLRU hit ratio 57.96% TLRU - LRU hit ratio delta 0.54% TLRU - SLRU hit ratio delta 0.54%`

`Throughput`

- Clock: spica/clock - ILRU: lru-cache (https://www.npmjs.com/package/lru-cache) - LRU: spica/lru - TLRU-C: spica/tlru (spica/tlru.clock) - TLRU-L: spica/tlru.lru - DWC: spica/cache

https://github.com/falsandtru/spica/blob/master/benchmark/cache.ts

`OS: Linux 6.2 Ubuntu 22.04.4 LTS 22.04.4 LTS (Jammy Jellyfish) CPU: (4) x64 AMD EPYC 7763 64-Core Processor Memory: 14.61 GB / 15.61 GB Container: Yes

'Clock new x 1,580,578 ops/sec ±2.36% (120 runs sampled)'

'TClock new x 1,635,917 ops/sec ±1.73% (114 runs sampled)'

'ILRU new x 17,306 ops/sec ±0.72% (122 runs sampled)'

'LRU new x 26,446,766 ops/sec ±1.27% (120 runs sampled)'

'TLRU-C new x 25,447,708 ops/sec ±1.16% (120 runs sampled)'

'TLRU-L new x 25,516,873 ops/sec ±1.15% (120 runs sampled)'

'DWC new x 8,852,793 ops/sec ±0.48% (123 runs sampled)'

'Clock simulation 100 10% x 9,916,253 ops/sec ±0.82% (121 runs sampled)'

'TClock simulation 100 10% x 9,178,812 ops/sec ±0.41% (122 runs sampled)'

'ILRU simulation 100 10% x 8,795,920 ops/sec ±0.45% (121 runs sampled)'

'LRU simulation 100 10% x 11,042,280 ops/sec ±0.41% (122 runs sampled)'

'TLRU-C simulation 100 10% x 10,776,622 ops/sec ±0.69% (122 runs sampled)'

'TLRU-L simulation 100 10% x 9,087,601 ops/sec ±0.55% (122 runs sampled)'

'DWC simulation 100 10% x 5,970,465 ops/sec ±0.31% (122 runs sampled)'

'Clock simulation 1,000 10% x 9,957,449 ops/sec ±0.44% (123 runs sampled)'

'TClock simulation 1,000 10% x 9,045,578 ops/sec ±0.87% (122 runs sampled)'

'ILRU simulation 1,000 10% x 8,120,270 ops/sec ±0.40% (123 runs sampled)'

'LRU simulation 1,000 10% x 10,033,399 ops/sec ±1.03% (121 runs sampled)'

'TLRU-C simulation 1,000 10% x 10,012,036 ops/sec ±0.48% (123 runs sampled)'

'TLRU-L simulation 1,000 10% x 8,728,394 ops/sec ±0.53% (123 runs sampled)'

'DWC simulation 1,000 10% x 6,824,871 ops/sec ±0.44% (121 runs sampled)'

'Clock simulation 10,000 10% x 8,950,040 ops/sec ±0.68% (122 runs sampled)'

'TClock simulation 10,000 10% x 8,184,728 ops/sec ±0.36% (123 runs sampled)'

'ILRU simulation 10,000 10% x 6,836,598 ops/sec ±0.35% (121 runs sampled)'

'LRU simulation 10,000 10% x 8,375,776 ops/sec ±0.40% (121 runs sampled)'

'TLRU-C simulation 10,000 10% x 8,056,049 ops/sec ±0.87% (120 runs sampled)'

'TLRU-L simulation 10,000 10% x 7,152,724 ops/sec ±0.30% (123 runs sampled)'

'DWC simulation 10,000 10% x 5,707,307 ops/sec ±0.40% (122 runs sampled)'

'Clock simulation 100,000 10% x 6,066,442 ops/sec ±1.54% (120 runs sampled)'

'TClock simulation 100,000 10% x 5,931,329 ops/sec ±1.52% (118 runs sampled)'

'ILRU simulation 100,000 10% x 3,989,516 ops/sec ±1.24% (117 runs sampled)'

'LRU simulation 100,000 10% x 5,775,982 ops/sec ±1.73% (119 runs sampled)'

'TLRU-C simulation 100,000 10% x 6,121,879 ops/sec ±2.03% (117 runs sampled)'

'TLRU-L simulation 100,000 10% x 5,372,740 ops/sec ±2.16% (117 runs sampled)'

'DWC simulation 100,000 10% x 4,371,865 ops/sec ±1.97% (114 runs sampled)'

'Clock simulation 1,000,000 10% x 2,921,542 ops/sec ±2.82% (107 runs sampled)'

'TClock simulation 1,000,000 10% x 2,734,509 ops/sec ±4.05% (102 runs sampled)'

'ILRU simulation 1,000,000 10% x 1,702,357 ops/sec ±2.64% (108 runs sampled)'

'LRU simulation 1,000,000 10% x 2,404,423 ops/sec ±3.55% (107 runs sampled)'

'TLRU-C simulation 1,000,000 10% x 2,509,557 ops/sec ±3.64% (106 runs sampled)'

'TLRU-L simulation 1,000,000 10% x 2,400,923 ops/sec ±3.88% (103 runs sampled)'

'DWC simulation 1,000,000 10% x 3,086,653 ops/sec ±3.95% (107 runs sampled)'

'Clock simulation 100 50% x 11,638,221 ops/sec ±0.44% (123 runs sampled)'

'TClock simulation 100 50% x 10,645,049 ops/sec ±0.69% (123 runs sampled)'

'ILRU simulation 100 50% x 10,786,602 ops/sec ±0.47% (122 runs sampled)'

'LRU simulation 100 50% x 12,558,754 ops/sec ±0.62% (121 runs sampled)'

'TLRU-C simulation 100 50% x 12,613,469 ops/sec ±0.48% (122 runs sampled)'

'TLRU-L simulation 100 50% x 10,785,803 ops/sec ±0.45% (122 runs sampled)'

'DWC simulation 100 50% x 6,507,728 ops/sec ±0.43% (123 runs sampled)'

'Clock simulation 1,000 50% x 11,225,959 ops/sec ±0.41% (122 runs sampled)'

'TClock simulation 1,000 50% x 10,633,288 ops/sec ±0.51% (123 runs sampled)'

'ILRU simulation 1,000 50% x 9,807,774 ops/sec ±0.83% (122 runs sampled)'

'LRU simulation 1,000 50% x 11,547,226 ops/sec ±0.47% (122 runs sampled)'

'TLRU-C simulation 1,000 50% x 11,500,223 ops/sec ±0.69% (121 runs sampled)'

'TLRU-L simulation 1,000 50% x 10,370,843 ops/sec ±0.40% (123 runs sampled)'

'DWC simulation 1,000 50% x 5,861,780 ops/sec ±0.37% (123 runs sampled)'

'Clock simulation 10,000 50% x 10,005,777 ops/sec ±0.58% (122 runs sampled)'

'TClock simulation 10,000 50% x 9,164,085 ops/sec ±0.44% (122 runs sampled)'

'ILRU simulation 10,000 50% x 8,145,309 ops/sec ±0.44% (121 runs sampled)'

'LRU simulation 10,000 50% x 8,836,874 ops/sec ±0.51% (120 runs sampled)'

'TLRU-C simulation 10,000 50% x 8,739,594 ops/sec ±0.53% (122 runs sampled)'

'TLRU-L simulation 10,000 50% x 7,752,474 ops/sec ±0.44% (121 runs sampled)'

'DWC simulation 10,000 50% x 4,774,496 ops/sec ±0.49% (120 runs sampled)'

'Clock simulation 100,000 50% x 6,886,961 ops/sec ±1.39% (118 runs sampled)'

'TClock simulation 100,000 50% x 6,671,489 ops/sec ±1.43% (118 runs sampled)'

'ILRU simulation 100,000 50% x 4,727,141 ops/sec ±1.40% (117 runs sampled)'

'LRU simulation 100,000 50% x 6,267,110 ops/sec ±2.01% (117 runs sampled)'

'TLRU-C simulation 100,000 50% x 6,497,513 ops/sec ±1.95% (118 runs sampled)'

'TLRU-L simulation 100,000 50% x 5,929,699 ops/sec ±2.30% (117 runs sampled)'

'DWC simulation 100,000 50% x 4,007,906 ops/sec ±1.48% (110 runs sampled)'

'Clock simulation 1,000,000 50% x 3,388,591 ops/sec ±3.09% (105 runs sampled)'

'TClock simulation 1,000,000 50% x 3,030,444 ops/sec ±3.52% (103 runs sampled)'

'ILRU simulation 1,000,000 50% x 1,957,735 ops/sec ±3.24% (106 runs sampled)'

'LRU simulation 1,000,000 50% x 2,378,468 ops/sec ±3.26% (107 runs sampled)'

'TLRU-C simulation 1,000,000 50% x 2,319,526 ops/sec ±3.01% (110 runs sampled)'

'TLRU-L simulation 1,000,000 50% x 2,326,281 ops/sec ±2.40% (107 runs sampled)'

'DWC simulation 1,000,000 50% x 1,873,066 ops/sec ±3.42% (101 runs sampled)'

'Clock simulation 100 90% x 17,142,365 ops/sec ±0.70% (122 runs sampled)'

'TClock simulation 100 90% x 17,515,002 ops/sec ±0.92% (120 runs sampled)'

'ILRU simulation 100 90% x 16,941,103 ops/sec ±0.74% (121 runs sampled)'

'LRU simulation 100 90% x 16,965,079 ops/sec ±0.89% (120 runs sampled)'

'TLRU-C simulation 100 90% x 16,764,673 ops/sec ±0.80% (119 runs sampled)'

'TLRU-L simulation 100 90% x 15,833,669 ops/sec ±0.67% (122 runs sampled)'

'DWC simulation 100 90% x 8,241,562 ops/sec ±0.33% (122 runs sampled)'

'Clock simulation 1,000 90% x 16,186,628 ops/sec ±0.92% (122 runs sampled)'

'TClock simulation 1,000 90% x 16,620,457 ops/sec ±0.68% (122 runs sampled)'

'ILRU simulation 1,000 90% x 14,897,888 ops/sec ±0.62% (122 runs sampled)'

'LRU simulation 1,000 90% x 15,072,880 ops/sec ±0.62% (122 runs sampled)'

'TLRU-C simulation 1,000 90% x 14,802,277 ops/sec ±1.06% (120 runs sampled)'

'TLRU-L simulation 1,000 90% x 14,243,896 ops/sec ±0.60% (122 runs sampled)'

'DWC simulation 1,000 90% x 7,878,478 ops/sec ±0.55% (123 runs sampled)'

'Clock simulation 10,000 90% x 14,397,140 ops/sec ±0.96% (122 runs sampled)'

'TClock simulation 10,000 90% x 14,674,408 ops/sec ±0.76% (122 runs sampled)'

'ILRU simulation 10,000 90% x 12,163,240 ops/sec ±0.56% (122 runs sampled)'

'LRU simulation 10,000 90% x 11,176,342 ops/sec ±1.02% (121 runs sampled)'

'TLRU-C simulation 10,000 90% x 10,623,051 ops/sec ±0.62% (120 runs sampled)'

'TLRU-L simulation 10,000 90% x 10,157,939 ops/sec ±0.90% (122 runs sampled)'

'DWC simulation 10,000 90% x 7,044,033 ops/sec ±0.74% (122 runs sampled)'

'Clock simulation 100,000 90% x 9,289,594 ops/sec ±1.22% (117 runs sampled)'

'TClock simulation 100,000 90% x 9,424,672 ops/sec ±1.28% (117 runs sampled)'

'ILRU simulation 100,000 90% x 7,244,655 ops/sec ±0.98% (117 runs sampled)'

'LRU simulation 100,000 90% x 7,412,012 ops/sec ±2.06% (115 runs sampled)'

'TLRU-C simulation 100,000 90% x 7,348,881 ops/sec ±2.79% (113 runs sampled)'

'TLRU-L simulation 100,000 90% x 7,138,284 ops/sec ±1.86% (113 runs sampled)'

'DWC simulation 100,000 90% x 5,590,257 ops/sec ±1.48% (116 runs sampled)'

'Clock simulation 1,000,000 90% x 5,098,637 ops/sec ±3.30% (103 runs sampled)'

'TClock simulation 1,000,000 90% x 4,743,456 ops/sec ±3.51% (103 runs sampled)'

'ILRU simulation 1,000,000 90% x 3,168,501 ops/sec ±2.45% (111 runs sampled)'

'LRU simulation 1,000,000 90% x 2,594,390 ops/sec ±3.09% (112 runs sampled)'

'TLRU-C simulation 1,000,000 90% x 2,546,277 ops/sec ±2.43% (109 runs sampled)'

'TLRU-L simulation 1,000,000 90% x 2,478,672 ops/sec ±2.63% (111 runs sampled)'

'DWC simulation 1,000,000 90% x 2,154,161 ops/sec ±1.80% (114 runs sampled)'

'ILRU simulation 100 90% expire x 4,875,225 ops/sec ±2.21% (119 runs sampled)'

'DWC simulation 100 90% expire x 7,322,013 ops/sec ±0.68% (120 runs sampled)'

'ILRU simulation 1,000 90% expire x 4,600,040 ops/sec ±2.52% (118 runs sampled)'

'DWC simulation 1,000 90% expire x 7,126,746 ops/sec ±0.67% (122 runs sampled)'

'ILRU simulation 10,000 90% expire x 3,992,238 ops/sec ±2.12% (119 runs sampled)'

'DWC simulation 10,000 90% expire x 5,431,828 ops/sec ±0.87% (120 runs sampled)'

'ILRU simulation 100,000 90% expire x 3,132,253 ops/sec ±2.06% (114 runs sampled)'

'DWC simulation 100,000 90% expire x 2,914,127 ops/sec ±2.99% (100 runs sampled)'

'ILRU simulation 1,000,000 90% expire x 1,361,462 ops/sec ±1.48% (114 runs sampled)'

'DWC simulation 1,000,000 90% expire x 1,349,727 ops/sec ±2.02% (111 runs sampled)'`

`API`

`ts export class TLRU { constructor(capacity: number, demotion?: number, window?: number, retrial?: boolean); readonly length: number; readonly size: number; add(key: K, value: V): boolean; set(key: K, value: V): this; get(key: K): V | undefined; has(key: K): boolean; delete(key: K): boolean; clear(): void; [Symbol.iterator](): Iterator<[K, V], undefined, undefined>; }``

True LRU

!CI