Otari is an OpenAI-compatible LLM gateway from Mozilla AI (powered by any-llm) that provides API key management, budget enforcement, and usage tracking across multiple LLM providers (OpenAI, Anthropic, Google, etc.). You can run it yourself and point jupyterlite-ai at it as a generic OpenAI-compatible provider.
Setting up Otari¶
Install and run the gateway by following the Otari Quick Start guide. Once it is running, take note of:
the gateway URL (e.g.
http://localhost:8000)an Otari API key (see the Otari documentation for creating one)
Configuring jupyterlite-ai to use Otari¶
Configure the Generic provider (OpenAI-compatible) with the following settings:
Base URL:
http://localhost:8000/v1(or your gateway server URL)Model: the model name with its provider prefix, e.g.
openai:gpt-4ooranthropic:claude-sonnet-4-5-20250929API Key: your Otari API key