AI integrations

AI / LLM

These integrations allow you to interact with AI and LLM services.

Anthropic

Operators:

airflow.providers.anthropic.operators.batch, airflow.providers.anthropic.operators.agent.

Hooks:

airflow.providers.anthropic.hooks.anthropic.

Sensors:

airflow.providers.anthropic.sensors.batch.

Triggers:

airflow.providers.anthropic.triggers.batch, airflow.providers.anthropic.triggers.agent.

Guides:

Anthropic Operators.

Provider:

apache-airflow-providers-anthropic

Product documentation:

Anthropic

Common AI

Operators:

airflow.providers.common.ai.operators.agent, airflow.providers.common.ai.operators.llm, airflow.providers.common.ai.operators.llm_batch, airflow.providers.common.ai.operators.llm_file_analysis, airflow.providers.common.ai.operators.llm_branch, airflow.providers.common.ai.operators.llm_sql, airflow.providers.common.ai.operators.llm_schema_compare, airflow.providers.common.ai.operators.document_loader, airflow.providers.common.ai.operators.llamaindex_embedding, airflow.providers.common.ai.operators.llamaindex_retrieval.

Triggers:

airflow.providers.common.ai.triggers.llm_batch.

Guides:

Agents with tools: AgentOperator and @task.agent, Single prompts: LLMOperator and @task.llm, Batch processing: LLMBatchOperator, Analyze files and images: LLMFileAnalysisOperator and @task.llm_file_analysis, Branch on an answer: LLMBranchOperator and @task.llm_branch, Natural language to SQL: LLMSQLQueryOperator and @task.llm_sql, Detect schema drift: LLMSchemaCompareOperator and @task.llm_schema_compare, Load documents: DocumentLoaderOperator.

Provider:

apache-airflow-providers-common-ai

Product documentation:

Common AI

LangChain

Hooks:

airflow.providers.common.ai.hooks.langchain.

Provider:

apache-airflow-providers-common-ai

Product documentation:

LangChain

LlamaIndex

Hooks:

airflow.providers.common.ai.hooks.llamaindex.

Guides:

Embed documents: LlamaIndexEmbeddingOperator, Retrieve context: LlamaIndexRetrievalOperator.

Provider:

apache-airflow-providers-common-ai

Product documentation:

LlamaIndex

MCP Server

Hooks:

airflow.providers.common.ai.hooks.mcp.

Provider:

apache-airflow-providers-common-ai

Product documentation:

MCP Server

OpenAI

Operators:

airflow.providers.openai.operators.openai, airflow.providers.openai.operators.agent.

Hooks:

airflow.providers.openai.hooks.openai.

Triggers:

airflow.providers.openai.triggers.openai, airflow.providers.openai.triggers.agent.

Guides:

OpenAIEmbeddingOperator.

Provider:

apache-airflow-providers-openai

Product documentation:

OpenAI

Pydantic AI

Hooks:

airflow.providers.common.ai.hooks.pydantic_ai.

Provider:

apache-airflow-providers-common-ai

Product documentation:

Pydantic AI

Was this entry helpful?