GenAI OTel Conformance Dashboard

Generated 2026-04-14 21:32 UTC — genai-otel-conformance | Detailed Results | |

Create Agent Spans
Library Lang Instrumentation Required Conditionally Required Recommended Opt-In
gen_ai.operation.name gen_ai.provider.name gen_ai.system error.type gen_ai.agent.description gen_ai.agent.id gen_ai.agent.name gen_ai.agent.version gen_ai.request.model server.port server.address gen_ai.system_instructions
AutoGen Python Native ✓ ✓ ✓ ✓
OpenInference ✓ ✓ ✓ ✓
Prototype ✓ ✓ ✓ ✓ ✓
LangChain Python OTel Contrib ✓ ✓ ✓
OpenLLMetry ✓ ✓ ✓
Invoke Agent Client Spans
Library Lang Instrumentation Required Conditionally Required Recommended Opt-In
gen_ai.operation.name gen_ai.provider.name gen_ai.system error.type gen_ai.agent.description gen_ai.agent.id gen_ai.agent.name gen_ai.agent.version gen_ai.conversation.id gen_ai.data_source.id gen_ai.output.type gen_ai.request.choice.count gen_ai.request.model gen_ai.request.seed server.port gen_ai.request.frequency_penalty gen_ai.request.max_tokens gen_ai.request.presence_penalty gen_ai.request.stop_sequences gen_ai.request.temperature gen_ai.request.top_p gen_ai.response.finish_reasons gen_ai.usage.cache_creation.input_tokens gen_ai.usage.cache_read.input_tokens gen_ai.usage.input_tokens gen_ai.usage.output_tokens server.address gen_ai.input.messages gen_ai.output.messages gen_ai.system_instructions gen_ai.tool.definitions
AWS Bedrock Agent Python Prototype ✓ ✓ ✓ ✓ ✓ ✓
JS Prototype ✓ ✓ ✓ ✓ ✓ ✓
Java Prototype ✓ ✓ ✓ ✓ ✓ ✓
Azure AI Foundry Python Prototype ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
OpenAI Assistants Python Prototype ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
Pydantic AI Python Native ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
OpenInference ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
Invoke Agent Internal Spans
Library Lang Instrumentation Required Conditionally Required Recommended Opt-In
gen_ai.operation.name gen_ai.provider.name gen_ai.system error.type gen_ai.agent.description gen_ai.agent.id gen_ai.agent.name gen_ai.agent.version gen_ai.conversation.id gen_ai.data_source.id gen_ai.output.type gen_ai.request.choice.count gen_ai.request.model gen_ai.request.seed gen_ai.request.frequency_penalty gen_ai.request.max_tokens gen_ai.request.presence_penalty gen_ai.request.stop_sequences gen_ai.request.temperature gen_ai.request.top_p gen_ai.response.finish_reasons gen_ai.usage.cache_creation.input_tokens gen_ai.usage.cache_read.input_tokens gen_ai.usage.input_tokens gen_ai.usage.output_tokens gen_ai.input.messages gen_ai.output.messages gen_ai.system_instructions gen_ai.tool.definitions
CrewAI Python OpenLLMetry ✓
Google ADK Python Native ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
OpenInference ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
LangChain Python OTel Contrib ✓ ✓ ✓ ✓
OpenLLMetry ✓ ✓ ✓ ✓
OpenAI Agents Python Native ✓ ✓
OpenLLMetry ✓ ✓
Pydantic AI Python Native ✓ ✓ ✓
OpenInference ✓ ✓ ✓
Invoke Workflow Spans
Library Lang Instrumentation Required Conditionally Required Opt-In
gen_ai.operation.name error.type gen_ai.workflow.name gen_ai.input.messages gen_ai.output.messages
LangChain Python OTel Contrib ✓ ✓ ✓
OpenLLMetry ✓ ✓ ✓
JS OpenLLMetry ✓
Inference Spans
Library Lang Instrumentation Required Conditionally Required Recommended Opt-In
gen_ai.operation.name gen_ai.provider.name gen_ai.system error.type gen_ai.conversation.id gen_ai.output.type gen_ai.request.choice.count gen_ai.request.model gen_ai.request.seed server.port gen_ai.request.frequency_penalty gen_ai.request.max_tokens gen_ai.request.presence_penalty gen_ai.request.stop_sequences gen_ai.request.temperature gen_ai.request.top_k gen_ai.request.top_p gen_ai.response.finish_reasons gen_ai.response.id gen_ai.response.model gen_ai.usage.cache_creation.input_tokens gen_ai.usage.cache_read.input_tokens gen_ai.usage.input_tokens gen_ai.usage.output_tokens server.address gen_ai.input.messages gen_ai.output.messages gen_ai.system_instructions gen_ai.tool.definitions
Anthropic Python OTel Contrib ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
OpenLLMetry ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
Prototype ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
JS OpenLLMetry ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
Prototype ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
AutoGen Python Prototype ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
AWS Bedrock Python OpenLLMetry ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
Prototype ✓ ✓ ✓ ✓ ✓ ✓ ✓
JS OTel Contrib ✓ ✓ ✓ ✓ ✓ ✓
Prototype ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
Java OTel Contrib ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
Prototype ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
Azure AI Inference Python OTel Contrib ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
Prototype ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
Azure OpenAI Python OTel Contrib ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
OpenLLMetry ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
Prototype ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
JS OTel Contrib ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
OpenLLMetry ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
Prototype ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
C# Native ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
Prototype ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
Claude Agent SDK Python Prototype ✓ ✓
Cohere Python OTel Contrib ✓ ✓ ✓ ✓
OpenLLMetry ✓ ✓ ✓ ✓
Prototype ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
JS OpenLLMetry ✓ ✓
Prototype ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
CrewAI Python Prototype ✓ ✓ ✓ ✓
DSPy Python Native ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
Prototype ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
Google ADK Python Native ✓ ✓ ✓ ✓ ✓ ✓
OpenInference ✓ ✓ ✓ ✓ ✓ ✓ ✓
Prototype ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
Google GenAI Python OTel Contrib ✓ ✓ ✓ ✓ ✓ ✓
OpenLLMetry ✓ ✓ ✓ ✓ ✓
Prototype ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
Groq Python OpenLLMetry ✓ ✓ ✓ ✓ ✓ ✓
Prototype ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
Haystack Python OpenLLMetry ✓
Prototype ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
Instructor Python Prototype ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
LangChain Python OTel Contrib ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
OpenLLMetry ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
Prototype ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
JS OpenLLMetry ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
Prototype ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
LiteLLM Python Native ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
Prototype ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
LlamaIndex Python OpenLLMetry ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
Prototype ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
JS OpenLLMetry ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
Prototype ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
Microsoft.Extensions.AI C# Native ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
Prototype ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
Mistral AI Python OpenInference ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
OpenLLMetry ✓ ✓ ✓ ✓ ✓ ✓ ✓
Prototype ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
OpenAI Python OTel Contrib ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
OpenLLMetry ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
Prototype ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
JS OTel Contrib ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
OpenLLMetry ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
Prototype ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
Java OTel Contrib ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
Prototype ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
OpenAI Agents Python OTel Contrib ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
OpenLLMetry ✓ ✓
Prototype ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
Promptflow Python Prototype ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
Pydantic AI Python Native ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
OpenInference ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
Prototype ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
Semantic Kernel C# Native ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
Prototype ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
Vercel AI SDK JS Native ✓ ✓ ✓ ✓ ✓ ✓ ✓
OpenInference ✓ ✓ ✓ ✓ ✓ ✓ ✓
Prototype ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
Vertex AI Python OTel Contrib ✓ ✓ ✓ ✓ ✓
OpenLLMetry ✓ ✓ ✓ ✓ ✓
Prototype ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
JS OpenLLMetry ✓ ✓ ✓
Prototype ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
Embeddings Spans
Library Lang Instrumentation Required Conditionally Required Recommended
gen_ai.operation.name gen_ai.provider.name gen_ai.system error.type gen_ai.request.model server.port gen_ai.embeddings.dimension.count gen_ai.request.encoding_formats gen_ai.response.model gen_ai.usage.input_tokens server.address
AWS Bedrock Python OpenLLMetry ✓ ✓ ✓ ✓
Prototype ✓ ✓ ✓ ✓
JS OpenLLMetry ✓ ✓ ✓ ✓ ✓
Prototype ✓ ✓ ✓ ✓ ✓
Azure AI Inference Python Prototype ✓ ✓ ✓ ✓ ✓ ✓ ✓
Azure OpenAI Python OTel Contrib ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
OpenLLMetry ✓ ✓ ✓ ✓ ✓
Prototype ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
JS OTel Contrib ✓ ✓ ✓ ✓ ✓ ✓ ✓
Prototype ✓ ✓ ✓ ✓ ✓ ✓ ✓
Cohere Python OTel Contrib ✓ ✓
OpenLLMetry ✓ ✓
Prototype ✓ ✓ ✓ ✓
JS Prototype ✓ ✓ ✓ ✓
Google GenAI Python Prototype ✓ ✓ ✓
LangChain Python Prototype ✓ ✓ ✓
JS Prototype ✓ ✓ ✓
LiteLLM Python Native ✓ ✓ ✓ ✓ ✓
Prototype ✓ ✓ ✓ ✓ ✓
LlamaIndex Python Prototype ✓ ✓ ✓
JS Prototype ✓ ✓ ✓
Mistral AI Python OpenInference ✓ ✓ ✓ ✓ ✓ ✓ ✓
OpenLLMetry ✓ ✓ ✓
Prototype ✓ ✓ ✓ ✓ ✓ ✓ ✓
OpenAI Python OTel Contrib ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
OpenLLMetry ✓ ✓ ✓ ✓ ✓
Prototype ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
JS OTel Contrib ✓ ✓ ✓ ✓ ✓ ✓ ✓
Prototype ✓ ✓ ✓ ✓ ✓ ✓ ✓
Java OTel Contrib ✓ ✓ ✓ ✓ ✓ ✓
Prototype ✓ ✓ ✓ ✓ ✓ ✓
Execute Tool Spans
Library Lang Instrumentation Required Conditionally Required Recommended Opt-In
gen_ai.operation.name error.type gen_ai.tool.call.id gen_ai.tool.description gen_ai.tool.name gen_ai.tool.type gen_ai.tool.call.arguments gen_ai.tool.call.result
LangChain Python OTel Contrib ✓ ✓ ✓ ✓ ✓ ✓
OpenLLMetry ✓ ✓ ✓ ✓ ✓ ✓
OpenAI Agents Python Native ✓
OpenLLMetry ✓ ✓
Pydantic AI Python Native ✓ ✓
OpenInference ✓ ✓
Semantic Kernel C# Native ✓ ✓ ✓ ✓ ✓
Prototype ✓ ✓ ✓ ✓ ✓
Client Operation Duration Metric
Library Lang Instrumentation Required Conditionally Required Recommended
gen_ai.operation.name error.type gen_ai.request.model server.port gen_ai.response.model server.address
Anthropic Python OTel Contrib ✓
OpenLLMetry ✓
AWS Bedrock Python OpenLLMetry ✓
JS OTel Contrib ✓ ✓
Java OTel Contrib ✓ ✓
Azure OpenAI Python OTel Contrib ✓ ✓ ✓ ✓ ✓
OpenLLMetry ✓ ✓ ✓
JS OTel Contrib ✓ ✓ ✓ ✓ ✓
C# Native ✓ ✓ ✓ ✓ ✓
Google GenAI Python OTel Contrib ✓ ✓
OpenLLMetry ✓
Groq Python OpenLLMetry ✓
LangChain Python OTel Contrib ✓
OpenLLMetry ✓
LlamaIndex Python OpenLLMetry ✓ ✓ ✓
Microsoft.Extensions.AI C# Native ✓ ✓ ✓ ✓ ✓
OpenAI Python OTel Contrib ✓ ✓ ✓ ✓ ✓
OpenLLMetry ✓ ✓ ✓
JS OTel Contrib ✓ ✓ ✓ ✓ ✓
Java OTel Contrib ✓ ✓ ✓
OpenAI Agents Python OTel Contrib ✓ ✓ ✓ ✓ ✓
Client Token Usage Metric
Library Lang Instrumentation Required Conditionally Required Recommended
gen_ai.operation.name gen_ai.token.type gen_ai.request.model server.port gen_ai.response.model server.address
Anthropic Python OTel Contrib ✓ ✓
OpenLLMetry ✓ ✓
AWS Bedrock Python OpenLLMetry ✓ ✓
JS OTel Contrib ✓ ✓ ✓
Java OTel Contrib ✓ ✓ ✓
Azure OpenAI Python OTel Contrib ✓ ✓ ✓ ✓ ✓ ✓
OpenLLMetry ✓ ✓ ✓ ✓
JS OTel Contrib ✓ ✓ ✓ ✓ ✓ ✓
C# Native ✓ ✓ ✓ ✓ ✓ ✓
CrewAI Python OpenLLMetry ✓ ✓
Google GenAI Python OTel Contrib ✓ ✓ ✓
OpenLLMetry ✓ ✓
Groq Python OpenLLMetry ✓ ✓
LangChain Python OTel Contrib ✓ ✓
OpenLLMetry ✓ ✓
LlamaIndex Python OpenLLMetry ✓ ✓ ✓ ✓
Microsoft.Extensions.AI C# Native ✓ ✓ ✓ ✓ ✓ ✓
OpenAI Python OTel Contrib ✓ ✓ ✓ ✓ ✓ ✓
OpenLLMetry ✓ ✓ ✓ ✓
JS OTel Contrib ✓ ✓ ✓ ✓ ✓ ✓
Java OTel Contrib ✓ ✓ ✓ ✓
OpenAI Agents Python OTel Contrib ✓ ✓ ✓ ✓ ✓ ✓
Inference Operation Details Event
Library Lang Instrumentation Required Conditionally Required Recommended
gen_ai.operation.name error.type gen_ai.request.model server.port gen_ai.input.messages gen_ai.output.messages gen_ai.response.finish_reasons gen_ai.response.id gen_ai.response.model gen_ai.system_instructions gen_ai.tool.definitions gen_ai.usage.input_tokens gen_ai.usage.output_tokens server.address
Anthropic Python Prototype ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
JS Prototype ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
AWS Bedrock Python Prototype ✓ ✓ ✓ ✓ ✓ ✓ ✓
JS Prototype ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
Java Prototype ✓ ✓ ✓ ✓ ✓ ✓ ✓
Azure AI Inference Python Prototype ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
Azure OpenAI Python Prototype ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
JS Prototype ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
C# Prototype ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
Cohere Python Prototype ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
JS Prototype ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
DSPy Python Prototype ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
Google GenAI Python Prototype ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
Groq Python Prototype ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
Haystack Python Prototype ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
Instructor Python Prototype ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
LangChain Python Prototype ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
JS Prototype ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
LiteLLM Python Prototype ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
LlamaIndex Python Prototype ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
JS Prototype ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
Microsoft.Extensions.AI C# Prototype ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
Mistral AI Python Prototype ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
OpenAI Python Prototype ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
JS Prototype ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
Java Prototype ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
Promptflow Python Prototype ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
Pydantic AI Python Prototype ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
Semantic Kernel C# Prototype ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
Vercel AI SDK JS Prototype ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
Vertex AI Python Prototype ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
JS Prototype ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
Evaluation Result Event
Library Lang Instrumentation Required Recommended
gen_ai.evaluation.name gen_ai.evaluation.explanation gen_ai.evaluation.score.label gen_ai.evaluation.score.value gen_ai.response.id
Azure AI Evaluation Python Prototype ✓ ✓ ✓ ✓
DSPy Python Prototype ✓ ✓ ✓ ✓ ✓