Skip to main content

Prometheus (prometheus)

Collects the metrics of every managed component through the manager service discovery and evaluates the platform alert rules.

Generated from catalog/services/prometheus.yaml: do not edit by hand.

Summary​

Version3.5.5
Useinstall and configure, configure and connect
Layerfunctional (AI catalog)
CategoryObservability
Installation methodsbinary
External connectionno
Sandbox onlyno

Licence​

SPDX identifierApache-2.0
Licence policycore licence (MIT or Apache-2.0)
Licence exception-
Platform componentprometheus

Packages and artifacts​

A package the project of the service publishes (its image, its binary archive, its Python or OS package) carries the licence of the service; a third-party package carries the licence written on its row, read from the official upstream metadata.

KindPackageVersionLicenceDetails
binary archiveprometheus-3.5.5.linux-amd64.tar.gz3.5.5Apache-2.0https://github.com/prometheus/prometheus/releases/download/v3.5.5/prometheus-3.5.5.linux-amd64.tar.gz, x86_64, checksum sha256

Supported systems and architectures​

MethodOperating systemsArchitectures
binaryRHEL family (dnf), Debian family (apt), Arch Linux (pacman)x86_64 (architecture of the artifacts of the descriptor)

Certified host systems: RHEL 8/9/10, Rocky Linux 8/9/10, AlmaLinux 8/9/10, Oracle Linux 8/9, CentOS Stream 9/10, Ubuntu 22.04/24.04, Debian 12, Arch Linux (rolling). The host preflight accepts these systems (other releases of a known family give a warning, end of life releases are refused) and the x86_64 and aarch64 architectures.

Prerequisites​

Host​

  • at least 2048 MB of memory (warning, memory).
  • at least 20480 MB free for /var/lib/navin (warning, disk).

Programs the commands and checks of the service start on the host, outside the managed roots: add them to allowed_commands of the agent (see Security of the Navin agent), else the agent refuses them with command_not_allowed: /usr/bin/curl.

Network and ports​

ComponentPort namePortOpened in the host firewall
prometheushttp9090/tcpyes

Services and connections needed​

Details and resolution: see Dependencies.

Installation methods and modes​

MethodDefaultWhat the method uses
binaryyesthe binary archives of the descriptor, unpacked under the service directory

Components​

ComponentKindInstallation methodsPorts
Prometheus server (prometheus)masterbinary9090/tcp

Single (single) (default)​

One Prometheus server.

What the mode deploys:

ComponentPlacement
prometheusmin 1, max 1

High availability (ha)​

Two identical replicas distinguished by the replica external label.

What the mode deploys:

ComponentPlacement
prometheusmin 2, max 2, recommended 2

Install this service​

The install wizard of the Navin Manager plans, validates and runs the installation; you need the services:install permission on the cluster.

  1. Open the wizard. In Clusters, choose the row action Install services of the target cluster. The wizard opens on its first step, Service.

  2. Choose the service. On the Service step, select Prometheus. The card shows the licence Apache-2.0 and the dependencies the installation needs.

  3. Choose the hosts and the mode. On the Hosts step, tick the hosts, then choose the Mode: single (default), ha. Each mode deploys the components listed in Installation methods and modes.

  4. Bind the dependencies. On the Bindings step, choose for each dependency (alertmanager, blackbox) Install with the platform or Use an existing connection; an optional dependency can stay on No binding.

  5. Configure. On the Configure step, review the parameters (see Configuration parameters); the required ones are manager_token. Passwords left empty with a generated default are generated and sealed by the Manager.

  6. Review and install. On the Install step the Manager validates the plan and shows the installation order; when it says "The plan is valid. Ready to install.", choose Install. A highly available mode is installed only when its HA checks pass.

  7. Verify. The operation ends when the health checks of every instance pass (see Health checks); the service then shows as running in Services.

Connect an existing service​

Schemeshttps, http
Default port9090
Authenticationoptional
Health check/-/ready
Authentication methodFieldsDescription
basicusername, passwordUsers of the web configuration file (--web.config.file, basic_auth_users hashed with bcrypt).
client_certificateclient_cert, client_keyClient certificate required by tls_server_config (client_auth_type RequireAndVerifyClientCert).
none-Default of Prometheus: no authentication, keep it on a filtered network.

Official documentation: https://prometheus.io/docs/prometheus/latest/configuration/https/

High availability​

Clusterreplicas (replication)
High availabilityredundancy (redundancy)
Failoverclient side (client)
Replicationnone (none)
Quorumnone (none)
Discoverystatic (static)
Entry pointany node (any-node)
Official documentationhttps://prometheus.io/docs/introduction/faq/

Prerequisites​

PrerequisiteMust be highly availableModesDescription
alertmanageryeshaAlertmanager cluster deduplicating the alerts of both replicas.

Topology per mode​

ModesHighest catalog levelDistributionQuorum componentFault domainsDescription
singlestandalone (standalone)single (single)-1One Prometheus server.
haha (ha)active-active (active-active)-2Two identical replicas scraping the same targets, distinguished by the replica external label.

Notes​

  • Redundancy, not a unified storage: each replica keeps its own local data (small gaps may differ); Thanos or a similar layer is optional for a global deduplicated view.

Configuration parameters​

Network​

ParameterTypeDefaultAllowed valuesRequiredSecretRestartDescription
HTTP port (port)port9090-nononoPort of the API and user interface.
TLS (tls_enabled)boolfalse-nononoServe the API and the interface over HTTPS (--web.config.file) with a certificate issued by the manager CA; the self scrape and the remote write clients then verify it with that CA.

Storage​

ParameterTypeDefaultAllowed valuesRequiredSecretRestartDescription
Retention (retention)duration15d-nononoHow long samples are kept.
Disk alert threshold (disk_alert_percent)int85min 50, max 99nononoUsed disk percentage raising an alert.

Discovery​

ParameterTypeDefaultAllowed valuesRequiredSecretRestartDescription
Scrape interval (scrape_interval)duration30s-nononoInterval between two scrapes of a target.
Manager API token (manager_token)password--yesyesnoRead only token of the manager API used by the service discovery; written to a file readable by Prometheus only.

Dependencies​

For each active dependency the Manager takes the first of: the binding chosen in the wizard; a service of the same installation that provides it; a service already installed in the cluster; the only connection of the expected type. Otherwise an optional dependency stays unbound, and a required one is added to the installation in its default mode (the column below names the catalog service added).

BindingProvided byConnection typeEndpointOptionalWhen nothing is boundDescription
alertmanageralertmanager-httpyesstays unbound (optional)Alertmanager receiving the platform alerts.
blackboxblackbox-exporter-httpyesstays unbound (optional)Blackbox exporter whose probes (manager health and the probes parameter) Prometheus runs through /probe: availability, latency and certificate expiry of the endpoints (rule NavinCertificateExpiry).

Endpoints​

EndpointSchemeComponentPortPathTLS parameterBinding parametersBinding secretsProvisioning command
httphttpprometheus9090 (port)-tls_enabled---

Commands​

CommandComponentTargetDescription
Reload (reload)prometheusevery hostReloads the configuration and the rules without restart.
Show targets (targets)prometheusfirst hostLists the active targets and their health.

Health checks​

Liveness (per instance)​

ComponentCheckDetails
prometheusHTTP {{ 'https' if config.tls_enabled else 'http' }}://{{ host.fqdn if config.tls_enabled else (host.ip or '127.0.0.1') }}:{{ config.port }}/-/readyExpected 200; 60 retries; interval 2 s; timeout 3 s

Preflight checks​

CheckTypeMeaningSeverityComponents
memorymemory_mb {"min": 2048}at least 2048 MB of memorywarningevery component
diskdisk_free_mb {"min": 20480}at least 20480 MB free for /var/lib/navinwarningevery component
port_freeport_free {"param": "port"}port 9090 free on the hostblockingevery component

Uninstall​

Paths removed when the data is purged: {{ paths.data }}, {{ paths.log }}.

  • Prometheus interface: {{ 'https' if config.tls_enabled else 'http' }}://{{ host.fqdn }}:{{ config.port }}/

Upstream documentation​