Skip to main content

Opik (opik)

Open source LLM observability and evaluation: traces, datasets, experiments and online scoring rules.

Generated from catalog/services/opik.yaml: do not edit by hand.

Summary​

Version1.8.16
Useinstall and configure, configure and connect
Layerfunctional (AI catalog)
CategoryEvaluation and LLM operations
Installation methodspodman
External connectionno
Sandbox onlyno

Licence​

SPDX identifierApache-2.0
Licence policycore licence (MIT or Apache-2.0)
Licence exception-
Platform componentopik

Packages and artifacts​

A package the project of the service publishes (its image, its binary archive, its Python or OS package) carries the licence of the service; a third-party package carries the licence written on its row, read from the official upstream metadata.

KindPackageVersionLicenceDetails
container imageghcr.io/comet-ml/opik/opik-backend1.8.16Apache-2.0image key backend, used by backend, digest sha256:3235c026ff3d3c79c14a4019d7cb5939d5c656ce339c1e3d8ad871acefc87d1d
container imageghcr.io/comet-ml/opik/opik-python-backend1.8.16Apache-2.0image key python-backend, used by python-backend, digest sha256:dece136e60eb8c6005182753e0f5ae927b865188d006599ccbdb09be2d7e5c87
container imageghcr.io/comet-ml/opik/opik-frontend1.8.16Apache-2.0image key frontend, used by frontend, digest sha256:eefeef6e4fca4ede768b01aa5e104ca762bd89ea249b2d37708d08072503acba

Images are pinned by tag in the descriptor, and by digest when the descriptor declares one (the offline bundle then refuses a pulled image that does not carry it); the digest is recorded in the mirror of the Manager when the offline bundle is imported, and every pull or load is checked against it.

Supported systems and architectures​

MethodOperating systemsArchitectures
podmanRHEL family (dnf), Debian family (apt), Arch Linux (pacman)x86_64, aarch64 (not restricted by the descriptor)

Certified host systems: RHEL 8/9/10, Rocky Linux 8/9/10, AlmaLinux 8/9/10, Oracle Linux 8/9, CentOS Stream 9/10, Ubuntu 22.04/24.04, Debian 12, Arch Linux (rolling). The host preflight accepts these systems (other releases of a known family give a warning, end of life releases are refused) and the x86_64 and aarch64 architectures.

Prerequisites​

Host​

  • at least 4096 MB of memory (warning, memory).

Network and ports​

ComponentPort namePortOpened in the host firewall
python-backendhttp8000/tcpno
backendapi8080/tcpyes
backendadmin3003/tcpno
frontendui5180/tcpyes

Services and connections needed​

  • mysql: mysql.
  • clickhouse: clickhouse.
  • redis: redis.
  • s3: seaweedfs.

Details and resolution: see Dependencies.

Installation methods and modes​

MethodDefaultWhat the method uses
podmanyesthe container images of the descriptor, run by Podman under systemd

Components​

ComponentKindInstallation methodsPorts
Python backend (python-backend)masterpodman8000/tcp
Backend (backend)masterpodman8080/tcp, 3003/tcp
Interface (frontend)masterpodman5180/tcp
  • backend runs only on a host that also runs python-backend.
  • frontend runs only on a host that also runs backend (mode single).

Single (single) (default)​

One instance of each component.

What the mode deploys:

ComponentPlacement
python-backendmin 1, max 1
backendmin 1, max 1
frontendmin 1, max 1

Replicated (replicated)​

Several stateless instances behind the load balancer, sharing the MySQL state database, ClickHouse, Redis and the attachment bucket of the bindings; place a Python backend on every backend host, each interface balances over every backend.

What the mode deploys:

ComponentPlacement
python-backendmin 2, recommended 2
backendmin 2, recommended 2
frontendmin 1, recommended 2

Install this service​

The install wizard of the Navin Manager plans, validates and runs the installation; you need the services:install permission on the cluster.

  1. Open the wizard. In Clusters, choose the row action Install services of the target cluster. The wizard opens on its first step, Service.

  2. Choose the service. On the Service step, select Opik. The card shows the licence Apache-2.0 and the dependencies the installation needs.

  3. Choose the hosts and the mode. On the Hosts step, tick the hosts, then choose the Mode: single (default), replicated. Each mode deploys the components listed in Installation methods and modes. With several components, place each one on its hosts in Component placement (Suggest placement proposes a placement that respects the cardinalities).

  4. Bind the dependencies. On the Bindings step, choose for each dependency (mysql, clickhouse, redis, s3) Install with the platform or Use an existing connection; an optional dependency can stay on No binding.

  5. Configure. On the Configure step, review the parameters (see Configuration parameters). Passwords left empty with a generated default are generated and sealed by the Manager.

  6. Review and install. On the Install step the Manager validates the plan and shows the installation order; when it says "The plan is valid. Ready to install.", choose Install. A highly available mode is installed only when its HA checks pass.

  7. Verify. The operation ends when the health checks of every instance pass (see Health checks); the service then shows as running in Services.

Connect an existing service​

Schemeshttps, http
Default port8080
Authenticationoptional
Health checkhealth_url + /health-check
Authentication methodFieldsDescription
none-Self-hosted open source Opik: no authentication.
api_keyapi_keyOpik Cloud or Enterprise: API key, sent without Bearer, with the workspace of the Workspace field.

Official documentation: https://www.comet.com/docs/opik/reference/rest_api/opik-rest-api/

FieldTypeDefaultDescriptionNotes
Health endpoint URL (health_url)url-Health endpoint URL of the existing service.-
Workspace (workspace)stringdefaultWorkspace used by the platform.-

High availability​

Clusterreplicas (replication)
High availabilityexternal (external)
Failoverload balancer (load-balancer)
Replicationshared store (shared-store)
Quorumnone (none)
Discoverynone (none)
Entry pointload balancer (load-balancer)
Official documentationhttps://www.comet.com/docs/opik/self-host/scaling

Prerequisites​

PrerequisiteMust be highly availableModesDescription
mysqlyesmodes of level ha or clusterHighly available MySQL (state database).
clickhouseyesmodes of level ha or clusterHighly available ClickHouse (traces and spans).
redisyesmodes of level ha or clusterHighly available Redis.
s3yesmodes of level ha or clusterHighly available object storage for the attachments.

Topology per mode​

ModesHighest catalog levelDistributionQuorum componentFault domainsDescription
singlestandalone (standalone)single (single)-1One instance of each component.
replicatedha (ha)active-active (active-active)-2Several stateless backends, Python backends and frontends sharing MySQL, ClickHouse, Redis and the bucket.

Configuration parameters​

General​

ParameterTypeDefaultAllowed valuesRequiredSecretRestartDescription
Backend port (backend_port)port8080-nononoPort of the REST and OTLP API.
Backend admin port (backend_admin_port)port3003-nononoPort of the health and metrics endpoints of the backend.
Python backend port (python_backend_port)port8000-nononoPort of the Python evaluator.
Interface port (frontend_port)port5180-nononoPort of the web interface (nginx).
TLS (tls_enabled)boolfalse-nonoyesServe the web interface and its /api/ entry (REST API and OTLP of the SDK through the interface) in HTTPS with a certificate of the Manager CA (nginx of the image, TLS 1.2 and 1.3). The backend port itself stays HTTP: point the SDK and the OTLP exporters at https://<interface>/api.

Dependencies​

For each active dependency the Manager takes the first of: the binding chosen in the wizard; a service of the same installation that provides it; a service already installed in the cluster; the only connection of the expected type. Otherwise an optional dependency stays unbound, and a required one is added to the installation in its default mode (the column below names the catalog service added).

BindingProvided byConnection typeEndpointOptionalWhen nothing is boundDescription
mysql-mysql-nomysql is added to the installationState database: MySQL 8.4 (GPL-2.0) provided by the client or installed separately, never shipped with Opik.
clickhouse-clickhouse-noclickhouse is added to the installationAnalytical store of traces and spans.
redis-redis-noredis is added to the installationCache and locks.
s3seaweedfss3s3noseaweedfs is added to the installationBucket of attachments (SeaweedFS of the platform by default, or an existing S3 connection).

Endpoints​

EndpointSchemeComponentPortPathTLS parameterBinding parametersBinding secretsProvisioning command
apihttpbackend8080 (backend_port)-----
uihttpfrontend5180 (frontend_port)-tls_enabled---

Health checks​

Liveness (per instance)​

ComponentCheckDetails
python-backendHTTP http://127.0.0.1:{{ config.python_backend_port }}/healthcheckExpected 200; 60 retries; interval 3 s; timeout 5 s
backendHTTP http://127.0.0.1:{{ config.backend_admin_port }}/health-checkExpected 200; 90 retries; interval 3 s; timeout 5 s
frontendHTTP {{ 'https' if config.tls_enabled else 'http' }}://{{ host.ip or '127.0.0.1' }}:{{ config.frontend_port }}/Expected 200; 30 retries; interval 2 s; timeout 5 s

Preflight checks​

CheckTypeMeaningSeverityComponents
memorymemory_mb {"min": 4096}at least 4096 MB of memorywarningevery component

Uninstall​

Paths removed when the data is purged: {{ paths.data }}, {{ paths.log }}.

  • Opik: {{ 'https' if config.tls_enabled else 'http' }}://{{ host.fqdn }}:{{ config.frontend_port }}/

Upstream documentation​