Skip to main content

Troubleshoot the Navin agent

This page lists the messages of the Navin agent and of the Manager about agents, with their cause and fix. Start with sudo nm-agent status and sudo navinctl logs agent 200.

Registration​

SymptomCauseFix
The CA returned by the manager has the fingerprint <a>, expected <b> (ca_mismatch)wrong --ca-sha256, or another server answers (interception)copy the fingerprint shown next to the token; if it matches, check the address of the Manager
The manager address <url> does not use https: ... (insecure_server)the command uses http toward another hostuse the https address of the Manager (https://<fqdn>:8460) shown next to the token
Registration refused by the manager (401): ... (register_failed)token expired, used up or revokedcreate a new token (Hosts > Add hosts or navin-manager enroll-token)
The manager cannot be reached: ... (network_error)DNS, firewall, port 8460 closed, or TLS not trustedcurl -v https://<manager-fqdn>:8460/api/v1/version; with the self-signed certificate add --ca-file
The openssl command is missing (openssl_missing)Python agent without opensslinstall openssl
enroll.env stays on the hostregistration from enroll.env refusedsudo navinctl logs enroll shows the reason; the timer retries every minute

Run​

SymptomCauseFix
This host is not registered: run nm-agent register first. (not_registered)no credentials in the state directoryregister the host
Invalid configuration file ... (config_invalid)invalid JSON, wrong type, service_driver other than systemd or process, unknown log_levelfix agent.json (reference)
The unit does not start and systemctl status shows a condition failed/etc/navin-manager-agent/agent.json is missing (ConditionPathExists)register the host, which writes the file
The Manager answers 401 agent_signature_invalidclock skew over 300 seconds, host decommissioned or revokedsynchronize the clock (chronyd, systemd-timesyncd); register again if the host was decommissioned
The host is lost in Hostsno heartbeat receivedcheck the unit, the network to port 8461 and the logs

Tasks​

SymptomCauseFix
path_not_allowedthe task writes outside allowed_roots, or through a symbolic link or ..fix the path of the catalog, or add the root to allowed_roots
command_not_allowedthe program is neither in allowed_commands nor below an allowed root, or a shell is usedadd the absolute program to allowed_commands
checksum_mismatchthe downloaded file differs from the sha256 of the manifestreload the mirror from a verified bundle (Mirror)
archive_unsafethe archive holds absolute names, .., devices or escaping linksrebuild the bundle from the official release
archive_too_largethe archive declares more than 200 000 members or 64 GiBrebuild the bundle from the official release
download_too_largethe mirror sends more than 64 GiB for one filecheck the URL of the mirror and the manifest of the bundle
disk_space_lowless than 1 GiB would stay free in the cache (/var/lib/navin) or the destinationfree disk space on the host, then retry the operation
A task needing root fails in the sandboxthe rootless agent refuses system packages, kernel parameters, limits, firewall and unitsrun the agent as root, or use a sandbox cluster where the planner does not send them