Model modalities matrix (B-06)
Page generated by python -m eai.domains.llm.modalities from the registry capabilities and the adapters test evidence. A capability without an adapter test is shown "declared, not verified", never "verified". The test tests/test_llm_modalities_matrix.py fails when this page is out of date.
Registry models
| Model | text | vision | image | audio | video |
|---|
gpt-4o (openai) | verified | declared, not verified | no | no | no |
gpt-4o-mini (openai) | verified | declared, not verified | no | no | no |
o4-mini (openai) | verified | declared, not verified | no | no | no |
o3 (openai) | verified | declared, not verified | no | no | no |
gpt-5-mini (openai) | verified | declared, not verified | no | no | no |
claude-sonnet-4-5 (anthropic) | verified | declared, not verified | no | no | no |
bedrock-claude-sonnet-4-eu (aws_bedrock) | verified | declared, not verified | no | no | no |
gemini-2-5-flash (google_ai_studio) | verified | declared, not verified | no | declared, not verified | declared, not verified |
gemini-2-5-pro (google_ai_studio) | verified | declared, not verified | no | declared, not verified | declared, not verified |
mistral-large (mistral) | verified | no | no | no | no |
deepseek-reasoner (deepseek) | verified | no | no | no | no |
llama-3-1-70b-vllm (vllm) | verified | no | no | no | no |
text-embedding-3-small (openai) | verified | no | no | no | no |
bge-m3-vllm (vllm) | verified | no | no | no | no |
rerank-v3-5 (cohere) | verified | no | no | no | no |
Specialized adapters
| Adapter | Modality | Status | Test evidence |
|---|
video_generation | video | declared, not verified | none |
realtime_voice | audio | declared, not verified | none |
image_generation | image | declared, not verified | none |
batch | text | declared, not verified | none |
rerank | text | verified | test_llm_gateway.py::test_anthropic_wire_and_embeddings_rerank |
stt | audio | verified | test_llm_gateway_adapters.py::test_stt_multipart_upload_reaches_the_adapter_as_multipart |
tts | audio | verified | test_llm_gateway_adapters.py::test_tts_audio_answer_is_returned_as_bytes |
Test evidence
chat: test_llm_gateway.py::test_streaming_sse, test_llm_litellm_proxy_real.py::test_platform_gateway_calls_through_the_real_litellm_proxyembeddings: test_llm_gateway.py::test_anthropic_wire_and_embeddings_rerankrerank: test_llm_gateway.py::test_anthropic_wire_and_embeddings_rerankstt: test_llm_gateway_adapters.py::test_stt_multipart_upload_reaches_the_adapter_as_multiparttts: test_llm_gateway_adapters.py::test_tts_audio_answer_is_returned_as_bytes
Legend
- verified: a gateway or adapter test calls the modality end to end.
- declared, not verified: capability declared in the registry, no adapter test.
- no: capability not declared.