Skip to main content

D-10 Connector Hub

Brick D: Tools, skills, plugins, MCP, connectors. French version: D-10-connector-hub

1. Role and responsibilities​

Runs adapters: API calls, syncs, connectivity tests, with OAuth, API keys or service accounts.

  • Connectivity test
  • Incremental sync to RAG (E-06)
  • Honour the target system rate limit

2. Position in the architecture and interactions​

  • Callers: Scheduler, Tool Gateway, portal.
  • Execution path: Synchronous (test), asynchronous (sync).
  • Every interaction goes through the Control Plane API v1 (/v1) behind the API Gateway (D-14).

3. Open source component and developed part​

  • Open source: Adapters (Airbyte CDK possible)
  • Developed: Adapter framework and API.
  • External integration through an adapter eai/integrations/<system>.py with an in-process fallback when the URL is not configured.

4. Data model​

Tables (schema eai, tenant_id RLS):

  • eai.connectors
  • eai.connector_sync_runs

Common columns: id uuid, tenant_id uuid NOT NULL, created_at, updated_at; RLS policy current_setting('app.tenant_id', true)::uuid.

5. Contract​

  • Applied contract: connector-manifest
  • JSON Schema: contracts/v1/connector-manifest.schema.json
  • Key fields: spec.sync, spec.rate_limit
  • Validation: POST /v1/contracts/{name}/validate; manifest apply: POST /v1/manifests/apply.

6. API endpoints​

  • POST /v1/connectors/{name}/test
  • POST /v1/connectors/{name}/sync
  • GET /v1/connectors/{name}/sync-runs

Request POST /v1/connectors/{name}/sync:

{
  "mode": "incremental",
  "target_knowledge_base": "kb_support"
}

Response:

{
  "sync_run_id": "sync_31",
  "status": "running"
}

7. SDK examples​

Python:

from enterprise_ai import EnterpriseAI

client = EnterpriseAI(base_url="<control-plane-url>", api_key="eai_xxx_secret")
client.connectors.test("salesforce-eu")
client.connectors.sync("salesforce-eu", full=False)

TypeScript:

import { EnterpriseAI } from "@enterprise-ai/sdk";

const client = new EnterpriseAI({ baseUrl: "<control-plane-url>", apiKey: process.env.EAI_API_KEY });
await client.connectors.sync("salesforce-eu", { full: false });

Java:

EnterpriseAIClient client = EnterpriseAIClient.builder()
    .baseUrl("<control-plane-url>")
    .apiKey(System.getenv("EAI_API_KEY"))
    .build();
client.connectors().sync("salesforce-eu");

Go:

c, _ := eai.NewClient(eai.WithBaseURL("<control-plane-url>"), eai.WithAPIKey(os.Getenv("EAI_API_KEY")))
c.Connectors.Sync(ctx, "salesforce-eu")

8. Configuration​

  • Environment variables: EAI_DATABASE_URL
  • Helm values keys: controlPlane.config, controlPlane.secrets

9. Security controls​

  • Credentials obtained by lease only
  • Source ACLs propagated to documents
  • Every request carries the tenant resolved from the credential; PostgreSQL RLS
  • Every mutation and policy decision writes a hash-chained audit event

10. Observability​

  • Prometheus metrics: eai_connector_requests_total{connector}, eai_connector_sync_duration_seconds
  • Traces: OpenTelemetry spans with GenAI semantic conventions (gen_ai.operation.name, gen_ai.agent.id, gen_ai.tool.name), attributes eai.tenant_id, eai.run_id, traceparent propagation.
  • Audit actions: connector.test, connector.sync

11. FinOps units​

  • Connector requests, synced volume.
  • Emitted as Usage Event (POST /v1/finops/usage) with tenant, project, agent and run.

12. Failure modes and resilience​

  • Persisted sync cursor: incremental resume
  • Backoff on target 429
  • Normalized errors (error envelope, message_i18n en/fr)

13. Standalone adoption (client of a client)​

  • enterprise_ai.connectors + Control Plane.
  • SDK: enterprise_ai.tools / mcp / skills / plugins / connectors / channels
  • Minimal deployment: Helm chart with controlPlane.enabled=true and PostgreSQL; disabled external components use their in-process fallback.

14. Acceptance tests​

  1. Test with wrong credential -> status failed
  2. Cross-tenant access refused
  3. Error returned in fr with Accept-Language: fr