@microfleet/ioredis-lock

!ioredis-lock

Node distributed locking using redis with lua scripts. Compatible with
redis >= 2.6.12. A better alternative to locking strategies based on SETNX or
WATCH/MULTI. Refer to Implementation and
Alternatives for details.

* Installation
* Overview
* Implementation
* Alternatives
* API
* [redislock.createLock(client, \[options\])](#redislockcreatelockclient-options)
* redislock.getAcquiredLocks()
* redislock.LockAcquisitionError
* redislock.LockReleaseError
* redislock.LockExtendError
* Class: Lock
* lock.acquire(key)
* lock.release()
* lock.extend(time)
* Tests

Installation

Using npm, you can install redislock with npm i @microfleet/ioredis-lock -S.

Overview

redislock offers both atomic acquire and release operations, avoiding race
conditions among clients, as well as the need for lock-specific redis
connections. Lock creation requires a node_redis client, and accepts an
object specifying the following three options:

* timeout: Time in milliseconds before which a lock expires (default: 10000 ms)
* retries: Maximum number of retries in acquiring a lock if the first attempt failed (default: 0)
* delay: Time in milliseconds to wait between each attempt (default: 50 ms)

`` javascript
import Bluebird from 'bluebird'
import { Redis } from 'ioredis'
import { createLock } from '@microfleet/ioredis-lock'

const client = new Redis();
const lock = createLock(client, {
timeout: 20000,
retries: 3,
delay: 100,
});

// this uses bind feature of bluebird
Bluebird
.bind(lock)
.call('acquire', 'app:feature:lock')
.catch(err => {
// handle err
})
.call('release')
.catch(err => {
// handle err
})
.then(() => {
// all good
});
`

Supports promises, thanks to bluebird, out of the box:

`javascript
import Bluebird from 'bluebird'
import { Redis } from 'ioredis'
import { createLock, LockAcquisitionError, LockReleaseError } from '@microfleet/ioredis-lock'

const client = new Redis();
const lock = createLock(client);

Bluebird
.resolve(lock.acquire('app:feature:lock'))
.then(() => {
// Lock has been acquired
return lock.release();
}).then(() => {
// Lock has been released
}).catch(LockAcquisitionError, (err) => {
// The lock could not be acquired
}).catch(LockReleaseError, (err) => {
// The lock could not be released
});
`

Implementation

Locking is performed using the following redis command:

`
SET key uuid PX timeout NX
`

If the SET returns OK, the lock has been acquired on the given key, and an
expiration has been set. Then, releasing a lock uses the following redis script:

` lua
if redis.call('GET', KEYS[1]) == ARGV[1] then
return redis.call('DEL', KEYS[1])
end
return 0
`

This ensures that the key is deleted only if it is currently holding the lock,
by passing its UUID as an argument. Extending a lock is done with a similar
lua script:

` lua
if redis.call('GET', KEYS[1]) == ARGV[1] then
return redis.call('PEXPIRE', KEYS[1], ARGV[2])
end
return 0
`

Alternatives

Some alternative locking implementations do not use a random identifier, but
instead simply invoke SETNX, assigning a timestamp. This has the problem of
requiring synchronization of clocks between all instances to maintain timeout
accuracy. Furthermore, freeing a lock with such an implementation may risk
deleting a key set by a different lock.

Another technique used is to WATCH the key for changes when freeing,
achieving a CAS-like operation, as described below:

`
WATCH key # Begin watching the key for changes
GET key # Retrieve its value, return an error if not equal to the lock's UUID
MULTI # Start transaction
DEL key # Delete the key
EXEC # Execute the transaction, which will fail if the key had expired
`

However, this has the issue of requiring that you use a 1:1 mapping of redis
clients to locks to ensure that a competing MULTI is not invoked, and that
the release is unaffected by other watched keys.

In addition to the above, most locking libraries aren't compatible with promises
by default, and due to their API, require "promisifying" individual locks.
redislock avoids this issue by taking advantage of bluebird's nodeify
function to offer an API that easily supports both callbacks and promises.

API

The module exports three functions for lock creation and management, as well
as two errors for simplified error handling when using promises.

#### redislock.createLock(client, [options])

Creates and returns a new Lock instance, configured for use with the supplied
redis client, as well as options, if provided. The options object may contain
following three keys, as outlined at the start of the documentation: timeout,
retries and delay.

` javascript
const lock = redislock.createLock(client, {
timeout: 10000,
retries: 3,
delay: 100
})
`

#### redislock.getAcquiredLocks()

Returns an array of currently active/acquired locks.

` javascript
// Create 3 locks, but only acquire 2
redislock.createLock(client);

await redislock.createLock(client).acquire('app:lock1')
await redislock.createLock(client).acquire('app:lock2')

const locks = redislock.getAcquiredLocks(); // [lock, lock]
`

#### redislock.LockAcquisitionError

The constructor for a LockAcquisitionError. Thrown or returned when a lock
could not be acquired.

#### redislock.LockReleaseError

The constructor for a LockReleaseError. Thrown or returned when a lock
could not be released.

#### redislock.LockExtendError

The constructor for a LockExtendError. Thrown or returned when a lock
could not be extended.

Class: Lock

The lock class exposed by redislock. Each instance is assigned a UUID v1 string
as an id, and is configured to work with the given redis client

#### lock.acquire(key)

Attempts to acquire a lock, given a key, and an optional callback function.
If the initial lock fails, additional attempts will be made for the
configured number of retries, and padded by the delay. The callback is
invoked with an error on failure, and returns a promise if no callback is
supplied. If invoked in the context of a promise, it may throw a
LockAcquisitionError.

` javascript
const lock = redislock.createLock(client);

try {
await lock.acquire('example:lock')
} catch (err) {
console.log(err.message); // 'Lock already held'
}

`

#### lock.release([fn])

Attempts to release the lock, and accepts an optional callback function. The callback is invoked with an error on failure, and returns a promise if no callback is supplied. If invoked in the context of a promise, it may throw a LockReleaseError.

`js
import { setTimeout } from 'node:timers/promises'

const lock = redislock.createLock(client)

try {
await lock.acquire('app:lock')
await setTimeout(20e3)

try {
await lock.release();
} catch (err) {
console.log(err.message); // 'Lock on app:lock has expired'
}

} catch (err) {
throw err
}
`

#### lock.extend(time)

Attempts to extend the timeout of a lock, and accepts an optional callback
function. The callback is invoked with an error on failure, and returns a
promise if no callback is supplied. If invoked in the context of a promise,
it may throw a LockExtendError.

` javascript
const lock = redislock.createLock(client);
await lock.acquire('app:lock')

await setTimeout(20e3)
try {
await lock.extend(20000)
} catch (err) {
console.log(err.message); // 'Lock on app:lock has expired'
}
`

Tests

Unit and functional tests are available in the base spec directory, and can
be ran using npm test. Additional integration tests, which require an active
redis-server configured on the default port and host, can be ran using
mocha spec/integration/`. Both tests suites are ran as part of the Travis CI
build thanks to their support for services such as redis.