Skip to main content

SeaweedFS object storage (seaweedfs)

S3 compatible object storage of the platform, installed by default: documents, media, model files, exports, backups and the WORM audit archive, and the store meant for skills and MCP servers. Masters, volume servers, filers and the S3 gateway, single node or distributed with replicated volumes.

Generated from catalog/services/seaweedfs.yaml: do not edit by hand.

Summary​

Version4.51
Useinstall and configure
Layerinfrastructure (shown apart)
CategoryStorage
Installation methodsbinary, podman
External connections3
Sandbox onlyno
Foundation serviceyes, selected by default by the install wizard

Licence​

SPDX identifierApache-2.0
Licence policycore licence (MIT or Apache-2.0)
Licence exception-
Platform componentseaweedfs

Packages and artifacts​

A package the project of the service publishes (its image, its binary archive, its Python or OS package) carries the licence of the service; a third-party package carries the licence written on its row, read from the official upstream metadata.

KindPackageVersionLicenceDetails
container imagedocker.io/chrislusf/seaweedfs4.51Apache-2.0image key weed, used by master, volume, filer, s3, admin, digest sha256:f7a49e3f3972ebed5be2ed4befa4a0c68eb7bdddba6e692d42729ceb545134b8
binary archiveseaweedfs-4.51-linux_amd64.tar.gz4.51Apache-2.0https://github.com/seaweedfs/seaweedfs/releases/download/4.51/linux_amd64.tar.gz, x86_64

Images are pinned by tag in the descriptor, and by digest when the descriptor declares one (the offline bundle then refuses a pulled image that does not carry it); the digest is recorded in the mirror of the Manager when the offline bundle is imported, and every pull or load is checked against it.

Supported systems and architectures​

MethodOperating systemsArchitectures
binaryRHEL family (dnf), Debian family (apt), Arch Linux (pacman)x86_64 (architecture of the artifacts of the descriptor)
podmanRHEL family (dnf), Debian family (apt), Arch Linux (pacman)x86_64, aarch64 (not restricted by the descriptor)

Certified host systems: RHEL 8/9/10, Rocky Linux 8/9/10, AlmaLinux 8/9/10, Oracle Linux 8/9, CentOS Stream 9/10, Ubuntu 22.04/24.04, Debian 12, Arch Linux (rolling). The host preflight accepts these systems (other releases of a known family give a warning, end of life releases are refused) and the x86_64 and aarch64 architectures.

Prerequisites​

Host​

  • at least 1024 MB of memory (blocking, memory).
  • at least 10240 MB free for /var/lib/navin (warning, disk).

Network and ports​

ComponentPort namePortOpened in the host firewall
masterhttp9333/tcpyes
mastergrpc19333/tcpyes
mastermetrics9324/tcpyes
volumehttp8180/tcpyes
volumegrpc18180/tcpyes
volumemetrics9325/tcpyes
filerhttp8888/tcpyes
filergrpc18888/tcpyes
filermetrics9326/tcpyes
s3s38333/tcpyes
s3metrics9327/tcpyes
adminadmin12535/tcpyes

Services and connections needed​

This service has no dependency.

Installation methods and modes​

MethodDefaultWhat the method uses
binaryyesthe binary archives of the descriptor, unpacked under the service directory
podman-the container images of the descriptor, run by Podman under systemd

Components​

ComponentKindInstallation methodsPorts
Master (master)masterbinary, podman9333/tcp, 19333/tcp, 9324/tcp
Volume server (volume)workerbinary, podman8180/tcp, 18180/tcp, 9325/tcp
Filer (filer)masterbinary, podman8888/tcp, 18888/tcp, 9326/tcp
S3 gateway (s3)workerbinary, podman8333/tcp, 9327/tcp
Admin console (admin)masterbinary, podman12535/tcp

Single node (single) (default)​

One master, one volume server, one filer, one S3 gateway and the admin console.

What the mode deploys:

ComponentPlacement
mastermin 1, max 1
volumemin 1, max 1
filermin 1, max 1
s3min 1, max 1
adminmin 1, max 1

Distributed (distributed)​

Raft masters (odd count), replicated volume servers, several filers and S3 gateways behind the load balancer.

What the mode deploys:

ComponentPlacement
mastermin 3, odd number, recommended 3
volumemin 3, recommended 3
filermin 2, recommended 2
s3min 2, recommended 2
adminmin 1, max 1

Install this service​

The install wizard of the Navin Manager plans, validates and runs the installation; you need the services:install permission on the cluster.

  1. Open the wizard. In Clusters, choose the row action Install services of the target cluster. The wizard opens on its first step, Service.

  2. Choose the service. On the Service step, select SeaweedFS object storage. The card shows the licence Apache-2.0. Pick the Method among binary, podman (default binary). To register an existing s3 service of your organisation instead, turn on Use an existing external service. As a foundation service it is already selected when the cluster does not have it.

  3. Choose the hosts and the mode. On the Hosts step, tick the hosts, then choose the Mode: single (default), distributed. Each mode deploys the components listed in Installation methods and modes. With several components, place each one on its hosts in Component placement (Suggest placement proposes a placement that respects the cardinalities).

  4. Bindings. This service has no dependency: the Bindings step has nothing to bind.

  5. Configure. On the Configure step, review the parameters (see Configuration parameters). Passwords left empty with a generated default are generated and sealed by the Manager.

  6. Review and install. On the Install step the Manager validates the plan and shows the installation order; when it says "The plan is valid. Ready to install.", choose Install. A highly available mode is installed only when its HA checks pass.

  7. Verify. The operation ends when the health checks of every instance pass (see Health checks); the service then shows as running in Services. Open the service and choose Run the smoke test in the Checks card: Creates a bucket, puts an object and reads it back through the S3 API (signature V4), then deletes both.

High availability​

Clusternative (native)
High availabilitynative (native)
Failoverload balancer (load-balancer)
Replicationnative (native)
QuorumRaft (raft)
Discoverystatic (static)
Entry pointload balancer (load-balancer)
Official documentationhttps://github.com/seaweedfs/seaweedfs/blob/master/note/slides/seaweedfs-production-setup.md
Referenceshttps://github.com/seaweedfs/seaweedfs/wiki/Production-Setup
Peer TLS parametertls_enabled
Cluster status commandvolume_list

Topology per mode​

ModesHighest catalog levelDistributionQuorum componentFault domainsDescription
singlestandalone (standalone)single (single)-1One master, one volume server, one filer and one S3 gateway.
distributedcluster (cluster)active-active (active-active)master3Raft masters, replicated volume servers, several filers and S3 gateways behind the load balancer.

Notes​

  • Optional when the bank already runs a highly available object storage: bind the services to it.
  • Each filer keeps its metadata in a local leveldb2 store synchronised with its peers; a shared metadata store is the stronger option of the official documentation.

Configuration parameters​

Network​

ParameterTypeDefaultAllowed valuesRequiredSecretRestartDescription
Master port (master_port)port9333-nononoHTTP port of the masters; gRPC uses this port plus 10000.
Volume port (volume_port)port8180-nononoHTTP port of the volume servers; gRPC uses this port plus 10000.
Filer port (filer_port)port8888-nononoHTTP port of the filers; gRPC uses this port plus 10000.
S3 API port (s3_port)port8333-nononoPort of the S3 gateway.
Metrics port of the master (master_metrics_port)port9324-nononoPrometheus port of the master (distinct per process: one host can run every component).
Metrics port of the volume servers (volume_metrics_port)port9325-nononoPrometheus port of the volume servers (distinct per process: one host can run every component).
Metrics port of the filers (filer_metrics_port)port9326-nononoPrometheus port of the filers (distinct per process: one host can run every component).
Metrics port of the S3 gateways (s3_metrics_port)port9327-nononoPrometheus port of the S3 gateways (distinct per process: one host can run every component).
Admin console port (admin_ui_port)port12535-nononoHTTP port of the web console weed admin; the worker gRPC uses this port plus 10000.

Storage​

ParameterTypeDefaultAllowed valuesRequiredSecretRestartDescription
Region (region)stringeu-west-3-nononoS3 region announced to the clients (signature V4 scope).
Replication (replication)enum000000, 001, 010, 100, 002nononoDefault replica placement (xyz: other data centres, other racks, other servers). (recommended '000' if len(topology.volume) < 2 else ('001' if len(topology.volume) < 3 else '002'))
Volume size limit (volume_size_mb)int1024min 64, max 30000, MBnononoSize at which a volume becomes read only and a new one is created.
Volumes per server (max_volumes)int100min 1, max 10000nononoMaximum number of volumes of one volume server.

Security​

ParameterTypeDefaultAllowed valuesRequiredSecretRestartDescription
Admin access key (admin_access_key)stringnavin-admin^[A-Za-z0-9_-]{3,64}$nononoAccess key of the S3 administrator identity.
Admin secret key (admin_secret_key)passwordgenerated-noyesnoSecret key of the S3 administrator (operator commands and smoke test only).
Admin console user (admin_ui_user)stringadmin^[A-Za-z0-9_.-]{3,64}$nononoLogin of the web console weed admin (WEED_ADMIN_USER).
Admin console password (admin_ui_password)passwordgenerated-noyesnoPassword of the web console weed admin (WEED_ADMIN_PASSWORD), generated at each install and kept in the Manager vault; without it the console would run without authentication.
TLS (tls_enabled)boolfalse-nonoyesMutual TLS on the gRPC of every component (security.toml) and HTTPS on every HTTP port (S3 API, filers, volume servers, masters, admin console) with the certificates issued by the manager CA.

Endpoints​

EndpointSchemeComponentPortPathTLS parameterBinding parametersBinding secretsProvisioning command
s3https38333 (s3_port)-tls_enabledregion, bucket, access_key, path_stylesecret_keyprovision_consumer
filerhttpfiler8888 (filer_port)-tls_enabled---

Client configuration files​

Files rendered for the client configuration download:

  • seaweedfs.env (client.env.j2)

Commands​

CommandComponentTargetDescription
Provision a consumer bucket (provision_consumer)s3first hostCreates the bucket and an S3 identity limited to that bucket for one consumer (idempotent).
Volume list (volume_list)s3first hostRuns volume.list in weed shell (servers, volumes, replicas).

Command parameters​

CommandParameterTypeDefaultRequiredDescription
provision_consumerBucket (bucket)string-yesBucket of the consumer.
provision_consumerAccess key (access_key)string-yesIdentity of the consumer.
provision_consumerSecret key (secret_key)password-yesSecret key of the identity (derived per consumer).

Health checks​

Liveness (per instance)​

ComponentCheckDetails
masterHTTP {{ 'https' if config.tls_enabled else 'http' }}://{{ host.fqdn }}:{{ config.master_port }}/cluster/statusExpected 200; 60 retries; interval 2 s; timeout 5 s
volumeHTTP {{ 'https' if config.tls_enabled else 'http' }}://{{ host.fqdn }}:{{ config.volume_port }}/statusExpected 200; 60 retries; interval 2 s; timeout 5 s
filerHTTP {{ 'https' if config.tls_enabled else 'http' }}://{{ host.fqdn }}:{{ config.filer_port }}/healthzExpected 200; 60 retries; interval 2 s; timeout 5 s
s3HTTP {{ 'https' if config.tls_enabled else 'http' }}://{{ host.fqdn }}:{{ config.s3_port }}/healthzExpected 200; 60 retries; interval 2 s; timeout 5 s
adminHTTP {{ 'https' if config.tls_enabled else 'http' }}://{{ host.fqdn }}:{{ config.admin_ui_port }}/healthExpected 200; 60 retries; interval 2 s; timeout 5 s

Readiness (service check)​

CheckDetails
HTTP {{ 'https' if config.tls_enabled else 'http' }}://{{ host.fqdn }}:{{ config.master_port }}/cluster/healthzExpected 200
HTTP {{ 'https' if config.tls_enabled else 'http' }}://{{ host.fqdn }}:{{ config.s3_port }}/healthzExpected 200

Smoke test​

Creates a bucket, puts an object and reads it back through the S3 API (signature V4), then deletes both. (s3: put, get, cleanup)

Preflight checks​

CheckTypeMeaningSeverityComponents
memorymemory_mb {"min": 1024}at least 1024 MB of memoryblockingevery component
diskdisk_free_mb {"path": "/var/lib/navin", "min": 10240}at least 10240 MB free for /var/lib/navinwarningvolume
s3_port_freeport_free {"param": "s3_port"}port 8333 free on the hostblockings3
master_port_freeport_free {"param": "master_port"}port 9333 free on the hostblockingmaster

Uninstall​

Paths removed when the data is purged: {{ paths.data }}, {{ paths.log }}.

  • Admin console: {{ 'https' if config.tls_enabled else 'http' }}://{{ host.fqdn }}:{{ config.admin_ui_port }}/
  • SeaweedFS master: {{ 'https' if config.tls_enabled else 'http' }}://{{ host.fqdn }}:{{ config.master_port }}/

Upstream documentation​