Opik TypeScript SDK

Open-source LLM evaluation platform

The Opik TypeScript SDK allows you to integrate your TypeScript and JavaScript applications with the Opik platform, enabling comprehensive tracing, evaluation, and monitoring of your LLM systems. Opik helps you build, evaluate, and optimize LLM systems that run better, faster, and cheaper.

Opik is an open-source LLM evaluation platform by Comet. For more information about the broader Opik ecosystem, visit our main GitHub repository, Website, or Documentation.

Installation

You can install the opik package using your favorite package manager.

``bash
npm install opik
`

Opik Configuration

You can configure the Opik client using environment variables.

.env file:

`bash
OPIK_API_KEY="your-api-key"
OPIK_URL_OVERRIDE="https://www.comet.com/opik/api"
OPIK_PROJECT_NAME="your-project-name"
OPIK_WORKSPACE_NAME="your-workspace-name"
`

Or you can pass the configuration to the Opik client constructor.

`typescript
import { Opik } from "opik";

const client = new Opik({
apiKey: "",
apiUrl: "https://www.comet.com/opik/api",
projectName: "",
workspaceName: "",
});
`

Usage

`typescript
import { Opik } from "opik";

// Create a new Opik client with your configuration
const client = new Opik();

// Log 10 traces
for (let i = 0; i < 10; i++) {
const someTrace = client.trace({
name: Trace ${i},
input: {
prompt: Hello, world! ${i},
},
output: {
response: Hello, world! ${i},
},
});

// For each trace, log 10 spans
for (let j = 0; j < 10; j++) {
const someSpan = someTrace.span({
name: Span ${i}-${j},
type: "llm",
input: {
prompt: Hello, world! ${i}:${j},
},
output: {
response: Hello, world! ${i}:${j},
},
});

// Some LLM work
await new Promise((resolve) => setTimeout(resolve, 100));

// Mark the span as ended
someSpan.end();
}

// Mark the trace as ended
someTrace.end();
}

// Flush the client to send all traces and spans
await client.flush();
`

Integrations

Opik provides seamless integrations with popular AI frameworks and tools. Check out our integration packages:

- Vercel AI - opik-vercel
- OpenAI - opik-openai
- LangChain - opik-langchain
- Google Gemini - opik-gemini`

Contributing

Contributions are welcome! If you have any suggestions or improvements, please feel free to open an issue or submit a pull request.

License

This project is licensed under the Apache License 2.0.