bentocache

!image

Bentocache is a robust multi-tier caching solution for Node.js applications

Features

- 🗄️ Multi-tier caching
- 🔄 Synchronization of local cache via Bus
- 🚀 Many drivers (Redis, Upstash, In-memory, Postgres, Sqlite and others)
- 🛡️ Grace period and timeouts. Serve stale data when the store is dead or slow
- 🤓 SWR-like caching strategy
- 🗂️ Namespaces. Group your keys by categories.
- 🏷️ Tagging. Easy invalidations.
- 🛑 Cache stampede protection.
- 🏷️ Named caches
- 📖 Well documented + handy JSDoc annotations
- 📊 Events. Useful for monitoring and metrics
- 📝 Easy Prometheus integration and ready-to-use Grafana dashboard
- 🧩 Easily extendable with your own driver

See documentation at bentocache.dev

Why Bentocache ?

There are already caching libraries for Node: keyv, cache-manager, or unstorage. However, I think that we could rather consider these libraries as bridges that allow different stores to be used via a unified API, rather than true caching solutions as such.

Not to knock them, on the contrary, they have their use cases and cool. Some are even "marketed" as such and are still very handy for simple caching system.

Bentocache, on the other hand, is a full-featured caching solution. We indeed have this notion of unified access to differents drivers, but in addition to that, we have a ton of features that will allow you to do robust caching.

Quick presentation

Bentocache is a caching solution aimed at combining performance and flexibility. If you are looking for a caching system that can transition from basic use to advanced multi-level configuration, you are in the right place. Here's what you need to know :

$3

The one-level mode is a standard caching method. Choose from a variety of drivers such as Redis, In-Memory, Filesystem, DynamoDB, and more, and you're ready to go.

In addition to this, you benefit from many features that allow you to efficiently manage your cache, such as cache stampede protection, grace periods, timeouts, namespaces, etc.

$3

For those looking to go further, you can use the two-levels caching system. Here's basically how it works:

- L1: Local Cache: First level cache. Data is stored in memory with an LRU algorithm for quick access
- L2: Distributed Cache: If the data is not in the in-memory cache, it is searched in the distributed cache (Redis, for example)
- Synchronization via Bus: In a multi-instance context, you can synchronize different local in-memory caches of your instances via a Bus like Redis or RabbitMQ. This method maintains cache integrity across multiple instances

Here is a simplified diagram of the flow :

!Bentocache Flow

All of this is managed invisibly for you via Bentocache. The only thing to do is to set up a bus in your infrastructure. But if you need multi-level cache, you're probably already using Redis rather than your database as a distributed cache. So you can leverage it to synchronize your local caches

The major benefit of multi-tier caching, is that it allows for responses between 2,000x and 5,000x faster. While Redis is fast, accessing RAM is REALLY MUCH faster.

In fact, it's a quite common pattern : to quote an example, it's what Stackoverflow does.

To give some perspective, here's a simple benchmark that shows the difference between a simple distributed cache ( using Redis ) vs a multi-tier cache ( using Redis + In-memory cache ) :

!Redis vs Multi-tier caching

Features

Below is a list of the main features of BentoCache. If you want to know more, you can read each associated documentation page.

$3

Multi-layer caching allows you to combine the speed of in-memory caching with the persistence of a distributed cache. Best of both worlds.

$3

Many drivers available to suit all situations: Redis, Upstash, Database (MySQL, SQLite, PostgreSQL), DynamoDB, Filesystem, In-memory (LRU Cache), Vercel KV...

See the drivers documentation for list of available drivers. Also, it is very easy to extend the library and add your own driver

$3

- Grace period: Keep your application running smoothly with the ability to temporarily use expired cache entries when your database is down, or when a factory is failing.

- Cache stampede prevention: Ensuring that only one factory is executed at the same time.

- Retry queue : When an application fails to publish something to the bus, it is added to a queue and retried later.

$3

If your factory is taking too long to execute, you can just return a little bit of stale data while keeping the factory running in the background. Next time the entry is requested, it will be already computed and served immediately.

$3

Allows associating a cache entry with one or more tags to simplify invalidation. Instead of managing individual keys, entries can be grouped under multiple tags and invalidated in a single operation.

``ts
await bento.getOrSet({
key: 'foo',
factory: getFromDb(),
tags: ['tag-1', 'tag-2']
});

await bento.deleteByTag({ tags: ['tag-1'] });
`

$3

Another way to group your keys is to use namespaces. This allows you to invalidate everything at once later :

`ts
const users = bento.namespace('users')

users.set({ key: '32', value: { name: 'foo' } })
users.set({ key: '33', value: { name: 'bar' } })

users.clear()
`

$3

Events are emitted by Bentocache throughout its execution, allowing you to collect metrics and monitor your cache.

`ts
bento.on('cache:hit', () => {})
bento.on('cache:miss', () => {})
// ...
`

See the events documentation for more information.

$3

All TTLs can be passed in a human-readable string format. We use lukeed/ms under the hood. (this is optional, and you can pass a number in milliseconds if you prefer)

`ts
bento.getOrSet({
key: 'foo',
factory: () => getFromDb(),
ttl: '2.5h',
grace: '6h',
})
`

$3

You can pass a logger to Bentocache, and it will log everything that happens. Can be useful for debugging or monitoring.

`ts
import { pino } from 'pino'

const bento = new BentoCache({
logger: pino()
})
``

See the logging documentation for more information.

Sponsor

If you like this project, please consider supporting it by sponsoring it. It will help a lot to maintain and improve it. Thanks a lot !