Ollama JavaScript Library

The Ollama JavaScript library provides the easiest way to integrate your JavaScript project with Ollama.

Getting Started

``
npm i ollama
`

Usage

`javascript
import ollama from 'ollama'

const response = await ollama.chat({
model: 'llama3.1',
messages: [{ role: 'user', content: 'Why is the sky blue?' }],
})
console.log(response.message.content)
`

$3

To use the library without node, import the browser module.

`javascript
import ollama from 'ollama/browser'
`

Streaming responses

Response streaming can be enabled by setting stream: true, modifying function calls to return an AsyncGenerator where each part is an object in the stream.

`javascript
import ollama from 'ollama'

const message = { role: 'user', content: 'Why is the sky blue?' }
const response = await ollama.chat({
model: 'llama3.1',
messages: [message],
stream: true,
})
for await (const part of response) {
process.stdout.write(part.message.content)
}
`

Cloud Models

Run larger models by offloading to Ollama’s cloud while keeping your local workflow.

You can see models currently available on Ollama's cloud here.

$3

1) Sign in (one-time):

`
ollama signin
`

2) Pull a cloud model:

`
ollama pull gpt-oss:120b-cloud
`

3) Use as usual (offloads automatically):

`javascript
import { Ollama } from 'ollama'

const ollama = new Ollama()
const response = await ollama.chat({
model: 'gpt-oss:120b-cloud',
messages: [{ role: 'user', content: 'Explain quantum computing' }],
stream: true,
})
for await (const part of response) {
process.stdout.write(part.message.content)
}
`

$3

Access cloud models directly by pointing the client at https://ollama.com.

1) Create an API key, then set the OLLAMA_API_KEY environment variable:

`
export OLLAMA_API_KEY=your_api_key
`

2) Generate a response via the cloud API:

`javascript
import { Ollama } from 'ollama'

const ollama = new Ollama({
host: 'https://ollama.com',
headers: { Authorization: 'Bearer ' + process.env.OLLAMA_API_KEY },
})

const response = await ollama.chat({
model: 'gpt-oss:120b',
messages: [{ role: 'user', content: 'Explain quantum computing' }],
stream: true,
})

for await (const part of response) {
process.stdout.write(part.message.content)
}
`

API

The Ollama JavaScript library's API is designed around the Ollama REST API

$3

`javascript
ollama.chat(request)
`

- request