# Spice.ai OSS > A portable SQL query and AI compute engine, written in Rust, for data-grounded apps and agents. - [Spice.ai OSS](/) ## cookbook A collection of guides and samples to help you build data-grounded AI apps and agents with Spice.ai Open-Source. Find ready-to-use examples for data acceleration, AI agents, LLM memory, and more. - [🧑‍🍳 Spice.ai OSS Cookbook](/cookbook): A collection of guides and samples to help you build data-grounded AI apps and agents with Spice.ai Open-Source. Find ready-to-use examples for data acceleration, AI agents, LLM memory, and more. ## docs Spice is an open-source SQL query and AI compute engine, written in Rust, for data-driven applications and AI agents. Learn about data federation, acceleration, RAG, and building intelligent apps. - [Spice.ai Open Source](/docs): Spice is an open-source SQL query and AI compute engine, written in Rust, for data-driven applications and AI agents. Learn about data federation, acceleration, RAG, and building intelligent apps. ### next Spice is an open-source SQL query and AI compute engine, written in Rust, for data-driven applications and AI agents. Learn about data federation, acceleration, RAG, and building intelligent apps. - [Spice.ai Open Source](/docs/next): Spice is an open-source SQL query and AI compute engine, written in Rust, for data-driven applications and AI agents. Learn about data federation, acceleration, RAG, and building intelligent apps. - [Tags](/docs/next/tags) - [One doc tagged with "Acknowledgements"](/docs/next/tags/acknowledgements): Project acknowledgements, credits, and attributions. - [3 docs tagged with "ADBC"](/docs/next/tags/adbc): Arrow Database Connectivity driver configuration and usage. - [4 docs tagged with "API"](/docs/next/tags/api): HTTP, Arrow Flight SQL, ODBC, JDBC, and ADBC API reference. - [One doc tagged with "Argo CD"](/docs/next/tags/argocd): Argo CD declarative GitOps continuous delivery for Kubernetes. - [2 docs tagged with "Arrow"](/docs/next/tags/arrow): Apache Arrow columnar data format integration. - [One doc tagged with "Arrow Flight SQL"](/docs/next/tags/arrow-flight-sql): Arrow Flight SQL protocol implementation and configuration. - [One doc tagged with "Auth"](/docs/next/tags/auth): Authentication and authorization mechanisms. - [2 docs tagged with "Authentication"](/docs/next/tags/authentication): User authentication methods and security protocols. - [5 docs tagged with "Azure"](/docs/next/tags/azure): Microsoft Azure cloud services and integrations. - [2 docs tagged with "Blob Storage"](/docs/next/tags/blob-storage): Object storage services and blob data access. - [One doc tagged with "Caching"](/docs/next/tags/caching): Data caching strategies and performance optimization. - [13 docs tagged with "Catalogs"](/docs/next/tags/catalogs): Data catalog connectors and metadata management. - [2 docs tagged with "Cayenne"](/docs/next/tags/cayenne): Cayenne (Vortex) data accelerator built on Vortex columnar format. - [2 docs tagged with "CLI"](/docs/next/tags/cli): Spice command-line interface commands and usage. - [5 docs tagged with "Component Metrics"](/docs/next/tags/component-metrics): Runtime component performance metrics and monitoring. - [One doc tagged with "Components"](/docs/next/tags/components): Runtime components including catalogs, data connectors, and models. - [2 docs tagged with "Configuration"](/docs/next/tags/configuration): System configuration files and runtime settings. - [2 docs tagged with "Cosmos DB"](/docs/next/tags/cosmosdb): Azure Cosmos DB (NoSQL / Core SQL) data connector. - [One doc tagged with "C#"](/docs/next/tags/csharp): C# programming language topics. - [7 docs tagged with "Data Accelerators"](/docs/next/tags/data-accelerators): Data acceleration engines for high-performance query execution. - [48 docs tagged with "Data Connectors"](/docs/next/tags/data-connectors): Data source connectors and integration patterns. - [One doc tagged with "Data Lake"](/docs/next/tags/data-lake): Data lake architectures and storage solutions. - [3 docs tagged with "Databricks"](/docs/next/tags/databricks): Databricks platform integration and Unity Catalog support. - [2 docs tagged with "Datasets"](/docs/next/tags/datasets): Dataset definitions and data source configurations. - [One doc tagged with "Debezium"](/docs/next/tags/debezium): Debezium change data capture integration. - [One doc tagged with "Debugging"](/docs/next/tags/debugging): Debugging techniques and troubleshooting tools. - [3 docs tagged with "Delta Lake"](/docs/next/tags/delta-lake): Delta Lake open table format support. - [One doc tagged with "Dependencies"](/docs/next/tags/dependencies): Third-party dependencies and software requirements. - [8 docs tagged with "Deployment"](/docs/next/tags/deployment): Production deployment using Docker and Kubernetes. - [2 docs tagged with "Docker"](/docs/next/tags/docker): Docker containerization and deployment configurations. - [One doc tagged with ".NET"](/docs/next/tags/dotnet): .NET framework topics. - [One doc tagged with "Dremio"](/docs/next/tags/dremio): Dremio data lake engine integration. - [2 docs tagged with "DuckDB"](/docs/next/tags/duckdb): DuckDB embedded analytical database integration. - [2 docs tagged with "DuckLake"](/docs/next/tags/ducklake): DuckLake catalog integration. - [2 docs tagged with "DynamoDB"](/docs/next/tags/dynamodb): Amazon DynamoDB NoSQL database integration. - [2 docs tagged with "Elasticsearch"](/docs/next/tags/elasticsearch): Elasticsearch data connector and vector engine integration. - [7 docs tagged with "Embeddings"](/docs/next/tags/embeddings): Vector embeddings and semantic similarity operations. - [6 docs tagged with "Features"](/docs/next/tags/features): Core platform features including acceleration, caching, and search. - [One doc tagged with "Federation"](/docs/next/tags/federation): Cross-database queries and federated data access. - [One doc tagged with "File"](/docs/next/tags/file): File-based data connectors and local file access. - [One doc tagged with "Flux"](/docs/next/tags/flux): Flux CD GitOps toolkit for Kubernetes. - [One doc tagged with "Flux CD"](/docs/next/tags/fluxcd): Flux CD GitOps toolkit for Kubernetes. - [2 docs tagged with "Functions"](/docs/next/tags/functions): User-defined SQL scalar functions and remote function endpoints. - [One doc tagged with "Getting Started"](/docs/next/tags/getting-started): Installation guides and quickstart tutorials. - [3 docs tagged with "GitHub"](/docs/next/tags/github): GitHub repository data connector and integration. - [3 docs tagged with "GitOps"](/docs/next/tags/gitops): GitOps continuous delivery patterns for Kubernetes. - [2 docs tagged with "Glue"](/docs/next/tags/glue): AWS Glue ETL service and data catalog integration. - [One doc tagged with "Go"](/docs/next/tags/go): Go programming language topics. - [One doc tagged with "Golang"](/docs/next/tags/golang): Go (Golang) programming language topics. - [One doc tagged with "GraphQL"](/docs/next/tags/graphql): GraphQL API data connectors and query language support. - [3 docs tagged with "Helm"](/docs/next/tags/helm): Helm package manager for deploying Spice.ai on Kubernetes. - [One doc tagged with "HTTPS"](/docs/next/tags/https): HTTPS data connectors and secure web API access. - [2 docs tagged with "Hugging Face"](/docs/next/tags/huggingface): Hugging Face model hub and transformer model integration. - [2 docs tagged with "Iceberg"](/docs/next/tags/iceberg): Apache Iceberg open table format support. - [One doc tagged with "In-Memory"](/docs/next/tags/in-memory): In-memory data processing and temporary storage. - [One doc tagged with "Integration"](/docs/next/tags/integration): Third-party system integrations and connectivity patterns. - [One doc tagged with "Java"](/docs/next/tags/java): Java programming language topics. - [One doc tagged with "JavaScript"](/docs/next/tags/javascript): JavaScript programming language topics. - [One doc tagged with "JDBC"](/docs/next/tags/jdbc): Java Database Connectivity driver configuration. - [One doc tagged with "Kafka"](/docs/next/tags/kafka): Apache Kafka event streaming platform integration. - [6 docs tagged with "Kubernetes"](/docs/next/tags/kubernetes): Kubernetes orchestration and secret management. - [One doc tagged with "libSQL"](/docs/next/tags/libsql): libSQL database topics. - [One doc tagged with "Local"](/docs/next/tags/local): Local model execution and on-premise services. - [One doc tagged with "Logging"](/docs/next/tags/logging): Application logging configuration and log management. - [One doc tagged with "Login"](/docs/next/tags/login): User login processes and session management. - [One doc tagged with "Manifest"](/docs/next/tags/manifest): Configuration manifest files and schema definitions. - [One doc tagged with "MCP"](/docs/next/tags/mcp): Model Context Protocol for AI tool integration. - [2 docs tagged with "Memory"](/docs/next/tags/memory): In-memory data connectors and volatile storage. - [16 docs tagged with "Models"](/docs/next/tags/models): Machine learning models and AI inference engines. - [One doc tagged with "MongoDB"](/docs/next/tags/mongodb): MongoDB NoSQL document database integration. - [One doc tagged with "MSSQL"](/docs/next/tags/mssql): Microsoft SQL Server database integration. - [3 docs tagged with "MySQL"](/docs/next/tags/mysql): MySQL relational database integration. - [One doc tagged with "Node.js"](/docs/next/tags/nodejs): Node.js runtime environment topics. - [3 docs tagged with "NoSQL"](/docs/next/tags/nosql): NoSQL database systems and document stores. - [29 docs tagged with "Observability"](/docs/next/tags/observability): Monitoring, tracing, and metrics for system visibility. - [One doc tagged with "ODBC"](/docs/next/tags/odbc): Open Database Connectivity driver configuration. - [One doc tagged with "Open Source"](/docs/next/tags/open-source): Open source licenses and community contributions. - [3 docs tagged with "OpenAI"](/docs/next/tags/openai): OpenAI API integration and GPT model access. - [2 docs tagged with "Oracle"](/docs/next/tags/oracle): Documentation related to Oracle database integration. - [2 docs tagged with "Overrides"](/docs/next/tags/overrides): Parameter overrides and configuration customization. - [2 docs tagged with "Overview"](/docs/next/tags/overview): High-level component and feature overviews. - [2 docs tagged with "Parameters"](/docs/next/tags/parameters): Configuration parameters and runtime options. - [One doc tagged with "Performance"](/docs/next/tags/performance): Performance optimization and benchmarking. - [One doc tagged with "Persistence"](/docs/next/tags/persistence): Data persistence and durable storage mechanisms. - [4 docs tagged with "Postgres"](/docs/next/tags/postgres): PostgreSQL database integration and configuration. - [One doc tagged with "Python"](/docs/next/tags/python): Python programming language topics. - [3 docs tagged with "Query"](/docs/next/tags/query): SQL query execution, parameterized queries, and prepared statements. - [4 docs tagged with "Reference"](/docs/next/tags/reference): API reference, CLI commands, and configuration syntax. - [One doc tagged with "Relational"](/docs/next/tags/relational): Relational database systems and SQL operations. - [3 docs tagged with "Runtime"](/docs/next/tags/runtime): Runtime behavior and execution environment. - [One doc tagged with "Rust"](/docs/next/tags/rust): Rust programming language topics. - [2 docs tagged with "S3"](/docs/next/tags/s3): Amazon S3 object storage integration. - [One doc tagged with "S3 Express"](/docs/next/tags/s3-express): Amazon S3 Express One Zone storage. - [One doc tagged with "Sandbox"](/docs/next/tags/sandbox): Sandbox environments and isolated testing. - [One doc tagged with "ScyllaDB"](/docs/next/tags/scylladb): ScyllaDB database integration. - [6 docs tagged with "SDK"](/docs/next/tags/sdk): Software Development Kit topics and usage. - [10 docs tagged with "Search"](/docs/next/tags/search): Vector search, semantic search, and ranking capabilities. - [2 docs tagged with "Security"](/docs/next/tags/security): Security features and data protection mechanisms. - [One doc tagged with "Snowflake"](/docs/next/tags/snowflake): Snowflake cloud data warehouse integration. - [7 docs tagged with "SpiceAI"](/docs/next/tags/spiceai): SpiceAI cloud platform and managed services. - [5 docs tagged with "Spicepod"](/docs/next/tags/spicepod): Spicepod configuration files, manifest syntax, and package management. - [6 docs tagged with "SQL"](/docs/next/tags/sql): SQL query language support and database operations. - [5 docs tagged with "Tools"](/docs/next/tags/tools): Development tools and utility integrations. - [2 docs tagged with "Tracing"](/docs/next/tags/tracing): Distributed tracing and request monitoring. - [One doc tagged with "Troubleshooting"](/docs/next/tags/troubleshooting): Problem diagnosis and resolution guides. - [One doc tagged with "Turso"](/docs/next/tags/turso): Turso data accelerator integration. - [2 docs tagged with "UDF"](/docs/next/tags/udf): User-defined functions registered with the SQL engine. - [2 docs tagged with "Unity Catalog"](/docs/next/tags/unity-catalog): Databricks Unity Catalog data governance integration. - [One doc tagged with "Views"](/docs/next/tags/views): Virtual views and data transformation layers. - [One doc tagged with "Vortex"](/docs/next/tags/vortex): Vortex columnar file format and storage engine. - [10 docs tagged with "Write"](/docs/next/tags/write): Data connectors and catalogs that support write operations. - [One doc tagged with "YAML"](/docs/next/tags/yaml): YAML configuration syntax and file formats. - [One doc tagged with "Zipkin"](/docs/next/tags/zipkin): Zipkin distributed tracing system integration. - [Open Source Acknowledgements](/docs/next/acknowledgements): Spice AI acknowledges the following open source projects for making this project possible: - [Spice.ai API Reference](/docs/next/api): Spice.ai API reference including HTTP REST API, Arrow Flight SQL, JDBC, ODBC, ADBC connectors, authentication, and TLS configuration. - [ADBC: Arrow Database Connectivity](/docs/next/api/adbc): ADBC API Documentation - [Arrow Flight SQL API](/docs/next/api/arrow-flight-sql): Query Spice using JDBC/ODBC/ADBC - [Authentication](/docs/next/api/auth): Authentication documentation - [Generate Package](/docs/next/api/HTTP/generate-package): This endpoint generates a zip package from a specified GitHub source. - [List Catalogs](/docs/next/api/HTTP/get-catalogs): Returns a list of all registered catalogs (data sources). Catalogs provide metadata about schemas and tables available from external data sources. - [Get Iceberg API config](/docs/next/api/HTTP/get-config): This endpoint returns the Iceberg Catalog API configuration, including details about overrides, defaults, and available endpoints. - [List Datasets](/docs/next/api/HTTP/get-datasets): This endpoint returns a list of configured datasets. The response can be formatted as **JSON** or **CSV**, - [List Iceberg namespaces](/docs/next/api/HTTP/get-iceberg-namespaces): This endpoint retrieves namespaces available in the Iceberg catalog. - [ML Prediction](/docs/next/api/HTTP/get-model-predict): Make a ML prediction using a specific model. - [List Models](/docs/next/api/HTTP/get-models): List all models, both machine learning and language models, available in the runtime. - [Check if a namespace exists.](/docs/next/api/HTTP/get-namespace): This endpoint returns a 200 OK response if the namespace exists, otherwise it returns a 404 Not Found response. - [List Spicepods](/docs/next/api/HTTP/get-spicepods): Get a list of spicepods and their summary details. - [Check Runtime Status](/docs/next/api/HTTP/get-status): Return the status of all connections (http, flight, metrics, opentelemetry) in the runtime. - [Get a table.](/docs/next/api/HTTP/get-table): This endpoint returns the table if it exists, otherwise it returns a 404 Not Found response. - [List Workers](/docs/next/api/HTTP/get-workers): Returns a list of all registered workers in the runtime. Workers are configurable processing units that can perform tasks like load balancing between models or implementing fallback strategies. - [Check Namespace exists](/docs/next/api/HTTP/head-namespace): This endpoint returns a 200 OK response if the namespace exists, otherwise it returns a 404 Not Found response. - [Check if a table exists.](/docs/next/api/HTTP/head-table): This endpoint returns a 200 OK response if the table exists, otherwise it returns a 404 Not Found response. - [list_tables](/docs/next/api/HTTP/list-tables): list_tables - [List Tools](/docs/next/api/HTTP/list-tools): Returns a list of all available tools in the Spice runtime. Tools provide reusable functionality that can be invoked programmatically or by AI agents. - [Send message to MCP server](/docs/next/api/HTTP/mcp-event): Send message to the MCP endoint, for a given session. - [Establish an MCP SSE Connection](/docs/next/api/HTTP/operation-id): Initiates a Server-Sent Events (SSE) connection using the Model Context Protocol (MCP) to interact with Spice tools. - [Update Refresh SQL](/docs/next/api/HTTP/patch-dataset-acceleration): Update the refresh SQL for a dataset's acceleration. - [Batch ML Predictions](/docs/next/api/HTTP/post-batch-predict): Perform a batch of ML predictions, using multiple models, in one request. This is useful for ensembling or A/B testing different models. - [Create Chat Completion](/docs/next/api/HTTP/post-chat-completions): Creates a model response for the given chat conversation. - [Refresh Dataset](/docs/next/api/HTTP/post-dataset-refresh): Trigger an on-demand refresh for an accelerated dataset. - [Create Embeddings](/docs/next/api/HTTP/post-embeddings): Creates an embedding vector representing the input text. - [Text-to-SQL (NSQL)](/docs/next/api/HTTP/post-nsql): Generate and optionally execute a natural-language text-to-SQL (NSQL) query. - [post_responses](/docs/next/api/HTTP/post-responses): post_responses - [Search](/docs/next/api/HTTP/post-search): Perform a vector similarity search (VSS) operation on a dataset. - [SQL Query](/docs/next/api/HTTP/post-sql): Execute a SQL query and return the results. - [Check Readiness](/docs/next/api/HTTP/ready): Check the runtime status of all the components of the runtime. If the service is ready, it returns an HTTP 200 status with the message 'ready'. If not, it returns a 503 status with the message 'not ready'. - [Run Tool](/docs/next/api/HTTP/run-tool): Execute a specific tool by name. The request body schema and response format are defined by each individual tool's specification. Use `GET /v1/tools` to discover available tools and their parameter schemas. - [runtime](/docs/next/api/HTTP/runtime): The spiced runtime - [JDBC: Java Database Connectivity](/docs/next/api/jdbc): JDBC API Documentation - [ODBC: Open Database Connectivity](/docs/next/api/odbc): ODBC API Documentation - [API Overview](/docs/next/api/overview): Spice.ai API overview, including SQL query interfaces, OpenAI-compatible endpoints, Iceberg catalog REST APIs, and the Model Context Protocol (MCP) for integrating external tools. - [TLS: Transport Layer Security](/docs/next/api/tls): Encryption in transit with TLS documentation - [Spice.ai CLI Reference](/docs/next/cli): Complete CLI reference for Spice.ai including commands to create, manage Spicepods, run queries, and interact with the Spice runtime. - [Spice.ai OSS CLI command reference](/docs/next/cli/reference): Spice CLI command reference - [add](/docs/next/cli/reference/add): Add a Spicepod to the project. - [catalogs](/docs/next/cli/reference/catalogs): List catalogs currently loaded by the Spice runtime. - [chat](/docs/next/cli/reference/chat): spice chat CLI documentation - [completions](/docs/next/cli/reference/completions): Generate shell completions for the Spice CLI. - [connect](/docs/next/cli/reference/connect): Connect to an app on the Spice.ai Cloud Platform. - [dataset](/docs/next/cli/reference/dataset): Configure a Spice dataset. - [datasets](/docs/next/cli/reference/datasets): Lists datasets loaded by the Spice runtime - [feedback](/docs/next/cli/reference/feedback): Open the Spice.ai community Slack in the default browser to share feedback. - [init](/docs/next/cli/reference/init): Initialize Spice app in the current working directory. - [install](/docs/next/cli/reference/install): Download and install the latest version of the Spice runtime. - [login](/docs/next/cli/reference/login): Login to the Spice.ai Platform, or other services with sub-commands. - [models](/docs/next/cli/reference/models): Lists models loaded by the Spice runtime - [nsql](/docs/next/cli/reference/nsql): spice nsql CLI documentation - [pods](/docs/next/cli/reference/pods): Lists Spicepods loaded by the Spice runtime - [query](/docs/next/cli/reference/query): Submit an async query or start an interactive async query REPL against the Spice runtime's distributed query engine. - [refresh](/docs/next/cli/reference/refresh): Refreshes an accelerated dataset loaded by the Spice runtime - [run](/docs/next/cli/reference/run): Run Spice - starts the Spice runtime, installing if necessary. - [search](/docs/next/cli/reference/search): Performs embeddings-based searches across search-configured datasets. - [spiced](/docs/next/cli/reference/spiced): Command-line reference for the spiced runtime binary — flags, defaults, and differences from spice run. - [sql](/docs/next/cli/reference/sql): Start an interactive SQL query session against the Spice runtime - [status](/docs/next/cli/reference/status): Spice runtime status - [trace](/docs/next/cli/reference/trace): Provides a user-friendly trace stack into an operation that occurred in Spice. This command retrieves and displays task execution traces from the runtime.task_history table. - [upgrade](/docs/next/cli/reference/upgrade): Upgrades the Spice CLI & Runtime to the latest release - [validate](/docs/next/cli/reference/validate): Validate a spicepod.yaml without starting the runtime. - [version](/docs/next/cli/reference/version): Outputs the current version of the Spice CLI and runtime - [Configuring Trace Levels](/docs/next/cli/tracing): Configuring Spice.ai OSS trace output verbosity levels - [Clients and Tools](/docs/next/clients): Client and tools for connecting to Spice - [DBeaver](/docs/next/clients/dbeaver): Configure DBeaver to query Spice via JDBC - [JetBrains DataGrip](/docs/next/clients/jetbrains-datagrip): Configure JetBrains Datagrip to query Spice via JDBC - [Microsoft Power BI Connector](/docs/next/clients/powerbi): Use Microsoft Power BI to access, visualize and analyze Spice datasets. - [Apache Superset](/docs/next/clients/superset): Use Apache Superset to query and visualize datasets loaded in Spice. - [Tableau](/docs/next/clients/tableau): Use Tableau to to access, visualise and analyse datasets loaded in Spice. - [How Spice Compares](/docs/next/comparison): Compare Spice.ai with data platforms (Databricks, Snowflake), query engines (Trino, Dremio, ClickHouse), vector databases (Turbopuffer, LanceDB), search engines (Elasticsearch), and AI frameworks (LangChain, LlamaIndex, Ollama). - [Spice.ai Runtime Components](/docs/next/components): Configure Spice.ai runtime components including data connectors, data accelerators, catalog connectors, model providers, embedding models, and secret stores. - [Catalog Connectors](/docs/next/components/catalogs): Connect to external catalog providers like Unity Catalog, Databricks, Iceberg, AWS Glue, Snowflake, ADBC, PostgreSQL, MySQL, MSSQL, Oracle, and more for federated SQL query in Spice. - [ADBC Catalog Connector](/docs/next/components/catalogs/adbc): Connect to databases via ADBC for automatic schema and table discovery. - [Databricks Catalog Connector](/docs/next/components/catalogs/databricks): Connect to a Databricks Unity Catalog provider. - [DuckLake Catalog Connector](/docs/next/components/catalogs/ducklake): Connect to a DuckLake catalog for federated SQL query. - [Glue Catalog Connector](/docs/next/components/catalogs/glue): Connect to an AWS Glue Data Catalog. - [Iceberg Catalog Connector](/docs/next/components/catalogs/iceberg): Connect to an Iceberg catalog provider. - [Microsoft SQL Server Catalog Connector](/docs/next/components/catalogs/mssql): Connect to a Microsoft SQL Server database as a catalog provider for federated SQL query. - [MySQL Catalog Connector](/docs/next/components/catalogs/mysql): Connect to a MySQL database as a catalog provider for federated SQL query. - [Oracle Catalog Connector](/docs/next/components/catalogs/oracle): Connect to an Oracle database as a catalog provider for federated SQL query. - [PostgreSQL Catalog Connector](/docs/next/components/catalogs/postgres): Connect to a PostgreSQL database as a catalog provider for federated SQL query. - [Snowflake Catalog Connector](/docs/next/components/catalogs/snowflake): Connect to a Snowflake database as a catalog provider for federated SQL query. - [Spice.ai Catalog Connector](/docs/next/components/catalogs/spiceai): Connect to the Spice.ai built-in catalog. - [Unity Catalog Catalog Connector](/docs/next/components/catalogs/unity-catalog): Connect to a Unity Catalog provider. - [Unity Catalog Catalog Connector Deployment Guide](/docs/next/components/catalogs/unity-catalog/deployment): Operating guide for the Unity Catalog catalog connector in production: workspace authentication, table-type filtering, effective-permissions flow, and observability. - [Data Accelerators](/docs/next/components/data-accelerators): Data acceleration engines for local materialization and query acceleration in Spice - [In-Memory Arrow Data Accelerator](/docs/next/components/data-accelerators/arrow): In-Memory Arrow Data Accelerator Documentation - [Arrow Data Accelerator Deployment Guide](/docs/next/components/data-accelerators/arrow/deployment): Operating guide for the Arrow (in-memory) data accelerator in production: memory sizing, indexes, and observability. - [Spice Cayenne Data Accelerator](/docs/next/components/data-accelerators/cayenne): Spice Cayenne Data Accelerator (Vortex) Documentation - [Cayenne Data Accelerator Deployment Guide](/docs/next/components/data-accelerators/cayenne/deployment): Operating guide for Spice Cayenne in production: footer and segment caches, S3 Express, metastore durability, and observability. - [DuckDB Data Accelerator](/docs/next/components/data-accelerators/duckdb): DuckDB Data Accelerator Documentation - [DuckDB Data Accelerator Deployment Guide](/docs/next/components/data-accelerators/duckdb/deployment): Operating guide for the DuckDB data accelerator in production: memory vs file mode, checkpointing, spill, pool sizing, and observability. - [PostgreSQL Data Accelerator](/docs/next/components/data-accelerators/postgres): PostgreSQL Data Accelerator Documentation - [PostgreSQL Data Accelerator Deployment Guide](/docs/next/components/data-accelerators/postgres/deployment): Operating guide for the PostgreSQL data accelerator in production: authentication, connection pooling, and observability. - [SQLite Data Accelerator](/docs/next/components/data-accelerators/sqlite): SQLite Data Accelerator Documentation - [SQLite Data Accelerator Deployment Guide](/docs/next/components/data-accelerators/sqlite/deployment): Operating guide for the SQLite data accelerator in production: file mode, busy timeout, pool, and observability. - [Turso Data Accelerator](/docs/next/components/data-accelerators/turso): Turso (libSQL) Data Accelerator Documentation - [Data Connectors](/docs/next/components/data-connectors): Learn how to use Data Connector to query external data. - [Azure BlobFS Data Connector](/docs/next/components/data-connectors/abfs): Azure BlobFS Data Connector Documentation - [ADBC Data Connector](/docs/next/components/data-connectors/adbc): ADBC Data Connector Documentation - [ClickHouse Data Connector](/docs/next/components/data-connectors/clickhouse): ClickHouse Data Connector Documentation - [Azure Cosmos DB Data Connector](/docs/next/components/data-connectors/cosmosdb): Query Azure Cosmos DB (NoSQL / Core SQL API) containers as SQL tables in Spice. Read-only scan with schema inferred from a sample of documents. - [Azure Cosmos DB Data Connector Deployment Guide](/docs/next/components/data-connectors/cosmosdb/deployment): Operating guide for the Azure Cosmos DB data connector in production: authentication, RU sizing, resilience, metrics, and observability. - [Databricks Data Connector](/docs/next/components/data-connectors/databricks): Databricks Data Connector Documentation - [Databricks Deployment Guide](/docs/next/components/data-connectors/databricks/deployment): Operating guide for the Databricks connector in production: resilience controls, Unity Catalog behavior, metrics, and observability. - [Debezium Data Connector](/docs/next/components/data-connectors/debezium): Debezium Data Connector Documentation - [Delta Lake Data Connector](/docs/next/components/data-connectors/delta-lake): Delta Lake Data Connector Documentation - [Delta Lake Data Connector Deployment Guide](/docs/next/components/data-connectors/delta-lake/deployment): Operating guide for the Delta Lake data connector in production: object store auth, metadata caching, metrics, and observability. - [Dremio Data Connector](/docs/next/components/data-connectors/dremio): Dremio Data Connector Documentation - [Dremio Data Connector Deployment Guide](/docs/next/components/data-connectors/dremio/deployment): Operating guide for the Dremio data connector in production: authentication, Flight SQL transport, and observability. - [DuckDB Data Connector](/docs/next/components/data-connectors/duckdb): DuckDB Data Connector Documentation - [DuckDB Data Connector Deployment Guide](/docs/next/components/data-connectors/duckdb/deployment): Operating guide for the DuckDB data connector in production: file vs memory mode, durability, and observability. - [DuckLake Data Connector](/docs/next/components/data-connectors/ducklake): DuckLake Data Connector Documentation - [DynamoDB Data Connector](/docs/next/components/data-connectors/dynamodb): DynamoDB Data Connector Documentation - [DynamoDB Data Connector Deployment Guide](/docs/next/components/data-connectors/dynamodb/deployment): Operating guide for the DynamoDB data connector in production: IAM, streams, checkpointing, lag behavior, and observability. - [Elasticsearch Data Connector](/docs/next/components/data-connectors/elasticsearch): Query Elasticsearch indexes as SQL tables in Spice, including kNN vector search, full-text search, and hybrid search. - [Elasticsearch Data Connector Deployment Guide](/docs/next/components/data-connectors/elasticsearch/deployment): Operating guide for the Elasticsearch data connector in production: authentication, TLS, resilience, and operational tuning. - [File Data Connector](/docs/next/components/data-connectors/file): File Data Connector Documentation - [File Data Connector Deployment Guide](/docs/next/components/data-connectors/file/deployment): Operating guide for the File data connector in production: permissions, formats, performance, and observability. - [Flight SQL Data Connector](/docs/next/components/data-connectors/flightsql): Flight SQL Data Connector Documentation - [FTP/SFTP Data Connector](/docs/next/components/data-connectors/ftp): FTP/SFTP Data Connector Documentation - [GCS Data Connector](/docs/next/components/data-connectors/gcs): GCS (Google Cloud Storage) Data Connector Documentation - [GitHub Data Connector](/docs/next/components/data-connectors/github): GitHub Data Connector Documentation - [GitHub Data Connector Deployment Guide](/docs/next/components/data-connectors/github/deployment): Operating guide for the GitHub data connector in production: PATs, rate limits, pagination, and observability. - [Glue Data Connector](/docs/next/components/data-connectors/glue): Connect to and query tables in an AWS Glue Data Catalog - [GraphQL Data Connector](/docs/next/components/data-connectors/graphql): GraphQL Data Connector Documentation - [GraphQL Data Connector Deployment Guide](/docs/next/components/data-connectors/graphql/deployment): Operating guide for the GraphQL data connector in production: authentication, pagination, rate limits, and observability. - [HTTP(s) Data Connector](/docs/next/components/data-connectors/https): HTTP(s) Data Connector Documentation - [HTTP(s) Data Connector Deployment Guide](/docs/next/components/data-connectors/https/deployment): Operating guide for the HTTP(s) data connector in production: authentication, rate control, retries, and observability. - [Iceberg Data Connector](/docs/next/components/data-connectors/iceberg): Connect to and query Apache Iceberg tables - [IMAP Data Connector](/docs/next/components/data-connectors/imap): IMAP Data Connector Documentation - [Kafka Data Connector](/docs/next/components/data-connectors/kafka): Kafka Data Connector Documentation - [Localpod Data Connector](/docs/next/components/data-connectors/localpod): Localpod Data Connector Documentation - [Memory Data Connector](/docs/next/components/data-connectors/memory): Memory Data Connector Documentation - [MongoDB Data Connector](/docs/next/components/data-connectors/mongodb): MongoDB Data Connector Documentation - [Microsoft SQL Server Data Connector](/docs/next/components/data-connectors/mssql): Microsoft SQL Server Data Connector - [MySQL Data Connector](/docs/next/components/data-connectors/mysql): MySQL Data Connector Documentation - [MySQL Data Connector Deployment Guide](/docs/next/components/data-connectors/mysql/deployment): Operating guide for the MySQL data connector in production: authentication, connection pooling, TLS, metrics, and observability. - [NFS Data Connector](/docs/next/components/data-connectors/nfs): NFS Data Connector Documentation - [Pull the latest official Spice image](/docs/next/components/data-connectors/odbc): ODBC Data Connector Documentation - [Oracle Data Connector](/docs/next/components/data-connectors/oracle): Oracle Data Connector Documentation - [PostgreSQL Data Connector](/docs/next/components/data-connectors/postgres): PostgreSQL Data Connector Documentation - [PostgreSQL Data Connector Deployment Guide](/docs/next/components/data-connectors/postgres/deployment): Operating guide for the PostgreSQL data connector in production: authentication, connection pooling, TLS, metrics, and observability. - [Amazon Redshift Data Connector](/docs/next/components/data-connectors/redshift): Connect to Amazon Redshift using the PostgreSQL connector in Spice. - [S3 Data Connector](/docs/next/components/data-connectors/s3): S3 Data Connector Documentation - [S3 Data Connector Deployment Guide](/docs/next/components/data-connectors/s3/deployment): Operating guide for the S3 data connector in production: IAM, credential chains, file formats, metrics, and observability. - [ScyllaDB Data Connector](/docs/next/components/data-connectors/scylladb): ScyllaDB Data Connector Documentation - [SharePoint Data Connector](/docs/next/components/data-connectors/sharepoint): SharePoint Data Connector Documentation - [SMB Data Connector](/docs/next/components/data-connectors/smb): SMB Data Connector Documentation - [Snowflake Data Connector](/docs/next/components/data-connectors/snowflake): Snowflake Data Connector Documentation - [Apache Spark Connector](/docs/next/components/data-connectors/spark): Apache Spark Connector Documentation - [Spice.ai Data Connector](/docs/next/components/data-connectors/spiceai): Federated SQL across Spice runtimes — Spice Cloud Platform datasets and self-hosted Spice instances (cluster-sidecar pattern). - [Spice.ai Data Connector Deployment Guide](/docs/next/components/data-connectors/spiceai/deployment): Operating guide for the Spice.ai connector in production: API keys, Flight endpoints, message sizing, sidecar topology, and observability. - [Embedding Models](/docs/next/components/embeddings): Describes how embedding models are used in Spice to convert text into numerical vectors for machine learning and search applications. - [Azure OpenAI Embedding Models](/docs/next/components/embeddings/azure): To use an embedding model hosted on Azure OpenAI, specify the azure path in the from field and the following parameters from the Azure OpenAI Model Deployment page: - [Amazon Bedrock Model Provider](/docs/next/components/embeddings/bedrock): Instructions for using Amazon Bedrock embedding models - [Databricks Model Provider](/docs/next/components/embeddings/databricks): Instructions for using Databricks Mosaic AI Models - [Google AI Embedding Models](/docs/next/components/embeddings/google): To use a hosted Google AI embedding model, specify the google path in the from field of your configuration. - [HuggingFace Text Embedding Models](/docs/next/components/embeddings/huggingface): To use an embedding model from HuggingFace with Spice, specify the huggingface path in the from field of your configuration. The model and its related files will be automatically downloaded, loaded, and served locally by Spice. - [Hugging Face Embedding Deployment Guide](/docs/next/components/embeddings/huggingface/deployment): Operating guide for Hugging Face embeddings in production: tokens, download cache, pooling, device selection, and observability. - [Local Filesystem Embedding Models](/docs/next/components/embeddings/local): Embedding models can be run with files stored locally. This method is useful for using models that are not hosted on remote services. - [Local Embedding Deployment Guide](/docs/next/components/embeddings/local/deployment): Operating guide for filesystem-loaded embedding models in production: formats, pooling, device selection, and observability. - [Model2Vec Embedding Models](/docs/next/components/embeddings/model2vec): Model2Vec embedding models help generate efficient static word embeddings from sentence transformer models for use in Spice, supporting local and Hugging Face sources with options for private models and performance tuning. - [OpenAI (or Compatible) Embedding Models](/docs/next/components/embeddings/openai): To use a hosted OpenAI (or compatible) embedding model, specify the openai path in the from field of your configuration. - [OpenAI Embedding Deployment Guide](/docs/next/components/embeddings/openai/deployment): Operating guide for the OpenAI embedding provider in production: API keys, usage tiers, batching, retries, metrics, and observability. - [Model Providers](/docs/next/components/models): Overview of supported model providers for LLMs in Spice. - [Anthropic Models](/docs/next/components/models/anthropic): Instructions for using language models hosted on Anthropic with Spice. - [Azure OpenAI Models](/docs/next/components/models/azure): Instructions for using Azure OpenAI models - [Amazon Bedrock Models](/docs/next/components/models/bedrock): How to use Amazon Bedrock models with Spice. - [Databricks Model Provider](/docs/next/components/models/databricks): Instructions for using Databricks Mosaic AI Models - [Filesystem Hosted Models](/docs/next/components/models/filesystem): Instructions for using models hosted on a filesystem with Spice. - [Filesystem Model Deployment Guide](/docs/next/components/models/filesystem/deployment): Operating guide for filesystem-loaded models in production: formats, device selection, memory footprint, and observability. - [Google AI Models](/docs/next/components/models/google): Instructions for using language models hosted on Google AI with Spice. - [HuggingFace](/docs/next/components/models/huggingface): Instructions for using machine learning models hosted on HuggingFace with Spice. - [Hugging Face Model Deployment Guide](/docs/next/components/models/huggingface/deployment): Operating guide for the Hugging Face model in production: tokens, download cache, device selection, local inference footprint, and observability. - [OpenAI (or Compatible) Language Models](/docs/next/components/models/openai): Instructions for using language models hosted on OpenAI or compatible services with Spice. - [OpenAI Model Deployment Guide](/docs/next/components/models/openai/deployment): Operating guide for the OpenAI model in production: API keys, usage tiers, rate limiting, Responses API, metrics, and observability. - [Perplexity Models (Deprecated)](/docs/next/components/models/perplexity): Perplexity model support is no longer supported in Spice. - [Spice Cloud Platform](/docs/next/components/models/spiceai): Instructions for using models hosted on the Spice Cloud Platform with Spice. - [xAI Models](/docs/next/components/models/xai): Instructions for using xAI models - [Secret Stores](/docs/next/components/secret-stores): Configure secret stores to manage sensitive data like passwords, tokens, and API keys. - [AWS Secrets Manager Secret Store](/docs/next/components/secret-stores/aws-secrets-manager): AWS Secrets Manager Secret Store Documentation - [Azure Key Vault Secret Store](/docs/next/components/secret-stores/azure-keyvault): Azure Key Vault Secret Store Documentation - [Environment Secret Store](/docs/next/components/secret-stores/env): Environment Variables Secret Store Documentation - [HashiCorp Vault Secret Store](/docs/next/components/secret-stores/hashicorp-vault): HashiCorp Vault Secret Store Documentation - [Keyring Secret Store](/docs/next/components/secret-stores/keyring): Keyring Secret Store Documentation - [Kubernetes Secret Store](/docs/next/components/secret-stores/kubernetes): Kubernetes Secret Store Documentation - [LLM Tools (Function Calling)](/docs/next/components/tools): Overview of supported LLM tools (function calling) and how to define new tools - [Model Context Protocol Tools](/docs/next/components/tools/mcp): Spice integrates with tools and services using the Model Context Protocol (MCP). MCP tools can be configured to run internally or connect to external servers over HTTP using the Streamable HTTP transport. - [Web Search Tool (Deprecated)](/docs/next/components/tools/websearch): The websearch tool is no longer supported in Spice. - [Vector Engines](/docs/next/components/vectors): Configure vector engines for efficient embedding storage and similarity search in Spice. - [DuckDB Vector Engine](/docs/next/components/vectors/duckdb): Use DuckDB as a vector engine in Spice for HNSW-based vector search via the DuckDB VSS extension. - [Elasticsearch Vector Engine](/docs/next/components/vectors/elasticsearch): Use Elasticsearch as a vector engine in Spice for kNN vector search, full-text search, and hybrid search. - [Amazon S3 Vectors Engine](/docs/next/components/vectors/s3_vectors): Amazon S3 Vectors Engine Documentation - [Spice.ai Deployment Guide](/docs/next/deployment): Deploy Spice.ai in your environment using Docker, Kubernetes, AWS, Azure, or the Spice Cloud Platform. Learn about sidecar, microservice, tiered, and cluster deployment architectures. - [Deployment Architectures](/docs/next/deployment/architectures): Explore Spice deployment architectures including sidecar, microservice, tiered, sharded, and cluster configurations. - [Cluster-Based Deployment (Spice.ai Enterprise)](/docs/next/deployment/architectures/cluster): Deploying Spice as a cluster - [Cluster-Sidecar Deployment](/docs/next/deployment/architectures/cluster-sidecar): Deploying Spice with sidecar caching backed by a centralized cluster for acceleration, distributed query, and ingestion. - [Cloud Hosted](/docs/next/deployment/architectures/hosted): Deploying Spice cloud hosted in the Spice Cloud Platform - [Microservice Deployment (Single or Multiple Replicas)](/docs/next/deployment/architectures/microservice): Deploying Spice as a microservice - [Sharded](/docs/next/deployment/architectures/sharded): Deploying Spice with shards - [Sidecar Deployment](/docs/next/deployment/architectures/sidecar): Deploying Spice as a application sidecar - [Tiered Deployment](/docs/next/deployment/architectures/tiered): Deploying Spice in tiers - [AWS Deployment Options](/docs/next/deployment/aws): Guide to deploying Spice.ai applications on Amazon Web Services (AWS) - [AWS Integrations](/docs/next/deployment/aws/integrations): Complete guide to Spice.ai integrations with Amazon Web Services, including data connectors, AI models, vector stores, and secret management. - [Azure Deployment Options](/docs/next/deployment/azure): Guide to deploying Spice.ai applications on Microsoft Azure - [Azure Integrations](/docs/next/deployment/azure/integrations): Spice.ai integrations with Microsoft Azure, including data connectors, AI models, embeddings, and authentication. - [CI/CD Deployment](/docs/next/deployment/ci-cd): Deploy Spice.ai applications using continuous integration and delivery pipelines, including Helm, Kubernetes GitOps with Argo CD or Flux, GitHub Actions, and the Spice Cloud deploy action. - [Spice Cloud Platform Deployment](/docs/next/deployment/cloud): Guide to deploying data and AI applications using the managed Spice Cloud Platform - [Docker](/docs/next/deployment/docker): Run Spice.ai as a Docker container. - [Docker Sandbox Guide - v1.3.0](/docs/next/deployment/docker/sandbox): Migrating to v1.3.0 - [Google Cloud Deployment Options](/docs/next/deployment/gcp): Guide to deploying Spice.ai applications on Google Cloud Platform (GCP). - [GCP Integrations](/docs/next/deployment/gcp/integrations): Spice.ai integrations with Google Cloud Platform, including data connectors, AI models, embeddings, and authentication. - [Kubernetes Deployment](/docs/next/deployment/kubernetes): Deploy Spice.ai on Kubernetes using Helm, Argo CD, or Flux. - [Kubernetes - Argo CD](/docs/next/deployment/kubernetes/argocd): Deploy Spice.ai on self-hosted Kubernetes using Argo CD and the Spice Helm chart. - [Kubernetes - Flux](/docs/next/deployment/kubernetes/flux): Deploy Spice.ai on Kubernetes using Flux CD and the Spice Helm chart. - [Kubernetes - Helm](/docs/next/deployment/kubernetes/helm): Deploy Spice.ai in Kubernetes using Helm. - [Read/Write Separation](/docs/next/deployment/read-write-separation): Separate write/ingest workloads (cluster) from read workloads (application sidecars, agents) using shared snapshots and live query delegation. - [Spice.ai FAQ](/docs/next/faq): Answers to frequently asked questions about Spice.ai including features, use cases, differences from Trino/Presto/Dremio, federated queries, caching, and AI capabilities. - [Spice.ai Features](/docs/next/features): Explore Spice.ai features including data federation, data acceleration, caching, search, LLM integration, embeddings, observability, and more for building data-driven AI applications. - [Caching](/docs/next/features/caching): Learn how to use Spice in-memory caching - [Change Data Capture (CDC)](/docs/next/features/cdc): Learn how to use Change Data Capture (CDC) in Spice. - [Debezium (CDC over Kafka)](/docs/next/features/cdc/debezium): Consume Debezium change events from Kafka into a Spice-accelerated dataset for sources without a native Spice CDC path. - [DynamoDB Streams (Native CDC)](/docs/next/features/cdc/dynamodb-streams): Stream INSERT, UPDATE, and DELETE events from Amazon DynamoDB directly into a Spice-accelerated dataset using DynamoDB Streams. - [MongoDB Change Streams (Native CDC)](/docs/next/features/cdc/mongodb-streams): Stream insert, update, replace, and delete events from MongoDB directly into a Spice-accelerated dataset using MongoDB Change Streams. - [MySQL Binlog Replication (Native CDC)](/docs/next/features/cdc/mysql-replication): Stream INSERT, UPDATE, and DELETE events from MySQL directly into a Spice-accelerated dataset using native binary log (binlog) replication. - [PostgreSQL Logical Replication (Native CDC)](/docs/next/features/cdc/postgres-replication): Stream INSERT, UPDATE, and DELETE events from PostgreSQL directly into a Spice-accelerated dataset using native logical replication. - [Data Acceleration](/docs/next/features/data-acceleration): Learn how to use local data acceleration in Spice. - [Constraints](/docs/next/features/data-acceleration/constraints): Learn how to add/configure constraints on local acceleration tables in Spice. - [Data Refresh](/docs/next/features/data-acceleration/data-refresh): Data refresh for accelerated datasets - [Hash Index for Arrow Acceleration](/docs/next/features/data-acceleration/hash-index): Learn how to use hash indexes for O(1) point lookups on Arrow-accelerated datasets. - [Indexes](/docs/next/features/data-acceleration/indexes): Learn how to add indexes to local acceleration tables in Spice. - [Partitioning](/docs/next/features/data-acceleration/partitioning): Partition accelerated datasets to make filtered queries faster by reading only the relevant partitions. - [Refresh Modes](/docs/next/features/data-acceleration/refresh-modes): Refresh modes for accelerated datasets in Spice. - [Append Refresh Mode](/docs/next/features/data-acceleration/refresh-modes/append): Incrementally append new rows to an accelerated dataset. - [Caching Refresh Mode](/docs/next/features/data-acceleration/refresh-modes/caching): Learn how to use caching refresh mode for HTTP-based datasets - [Changes Refresh Mode](/docs/next/features/data-acceleration/refresh-modes/changes): Apply incremental inserts, updates, and deletes via Change Data Capture. - [Full Refresh Mode](/docs/next/features/data-acceleration/refresh-modes/full): Replace the entire accelerated dataset on each refresh. - [Snapshot Refresh Mode](/docs/next/features/data-acceleration/refresh-modes/snapshot): Reload acceleration data exclusively from the snapshot store. - [Snapshots](/docs/next/features/data-acceleration/snapshots): Bootstrap file-mode accelerations from managed snapshots to eliminate cold starts. - [Data Ingestion](/docs/next/features/data-ingestion): Learn how to ingest data in Spice. - [Distributed Query](/docs/next/features/distributed-query): Learn how to run Spice in distributed mode for larger scale queries, including the async queries API. - [Embedding Datasets](/docs/next/features/embeddings): Learn how to define, or augment existing datasets with embedding column(s). - [Functions](/docs/next/features/functions): Define custom scalar and table SQL functions inline (SQL tier) or by calling remote HTTP services (Remote tier), automatically exposed as SQL functions and LLM tools. - [Large Language Models](/docs/next/features/large-language-models): Learn how to configure large language models (LLMs) - [Evaluating Language Models (Deprecated)](/docs/next/features/large-language-models/evals): Language model evals are no longer supported in Spice. - [Model Context Protocol (MCP)](/docs/next/features/large-language-models/mcp): Learn how to use the Model Context Protocol (MCP) with Spice. - [Language Model Memory](/docs/next/features/large-language-models/memory): Learn how to provide LLMs with memory - [Language Model Overrides](/docs/next/features/large-language-models/parameter_overrides): Learn how to override default LLM hyperparameters in Spice. - [System Prompt parameterization](/docs/next/features/large-language-models/parameterized_prompts): Learn how to update system prompts for each request with Jinja-styled templating. - [Load and Serve Models Locally](/docs/next/features/large-language-models/serving): Learn how to load and serve large learning models. - [Language Models Tools](/docs/next/features/large-language-models/tools): Learn how LLMs interact with the Spice runtime. - [Machine Learning Models](/docs/next/features/machine-learning-models): Deprecated in vNext: Support for loading and serving traditional machine learning (ONNX) models for inference was removed in vNext, along with the /v1/predict and /v1/models//predict prediction endpoints. See the v2.1 docs for documentation of this feature. - [Observability & Monitoring](/docs/next/features/observability): Monitor Spice with Prometheus metrics, OpenTelemetry, and distributed tracing. - [Component Metrics](/docs/next/features/observability/component_metrics): Learn how to enable optional component metrics. - [Query Federation](/docs/next/features/query-federation): Learn how to use federated SQL queries in Spice.ai Open Source - [Parameterized Queries](/docs/next/features/query-federation/parameterized-queries): Learn how to use prepared statements and parameterized queries in Spice for improved security and performance. - [URL Tables](/docs/next/features/query-federation/url-tables): Query object store files directly using URLs without pre-registering datasets - [Search Functionality](/docs/next/features/search): Learn how Spice can search across datasets using database-native and vector-search methods. - [Full-Text Search](/docs/next/features/search/full-text): Learn how Spice can perform full text search - [Multi-Vector Search](/docs/next/features/search/multi-vector): Embed list-of-strings columns as a column of vectors and use ColBERT-style late-interaction search in Spice. - [Reranking](/docs/next/features/search/rerank): Rerank search results using dedicated reranker models or LLM-as-reranker for improved relevance. - [Vector-Based Search](/docs/next/features/search/vector-search): Learn how Spice can perform searches using vector-based methods. - [Semantic Model](/docs/next/features/semantic-model): Attach descriptions and metadata to datasets, views, and columns in Spice so LLMs, SQL functions, and humans share the same understanding of your data. - [Tool Registry](/docs/next/features/tool-registry): Reduce per-turn token cost and improve LLM tool selection accuracy by replacing individual tool definitions with searchable tool_search and tool_invoke meta-tools backed by hybrid full-text, keyword, schema, and vector search. - [Views](/docs/next/features/views): Documentation for defining Views in Spice - [Web Search](/docs/next/features/web-search): Learn how Spice can perform web search - [Workers](/docs/next/features/workers): Configure workers in the Spice runtime to coordinate interactions between LLMs and tools, with load-balancing, round-robin, and fallback strategies. - [Getting Started with Spice.ai OSS](/docs/next/getting-started): Get started with Spice.ai in 5 minutes. Install the CLI, connect to datasets, run SQL queries, and use AI models with OpenAI-compatible APIs. - [Community Data](/docs/next/getting-started/spiceai): Connect to the Spice.ai Cloud Platform to access community datasets. - [Spicepods](/docs/next/getting-started/spicepods): An introduction to Spicepods - [Telemetry](/docs/next/getting-started/telemetry): Learn how Spice AI uses anonymous telemetry. - [Install Spice.ai OSS](/docs/next/installation): Install Spice.ai OSS on macOS, Linux, Windows, or WSL using the install script, Homebrew, PowerShell, or direct download from GitHub releases. - [Building Intelligent AI Applications with Spice.ai](/docs/next/intelligent-applications): Learn how to build intelligent, data-driven AI applications and agents with Spice.ai. Explore patterns for RAG, LLM integration, and real-time AI inference. - [Monitoring](/docs/next/monitoring): Monitor Spice.ai deployments with Datadog, Grafana, New Relic, Prometheus, and Zipkin integrations. - [Datadog](/docs/next/monitoring/datadog): Monitoring Spice with Datadog - [Grafana & Prometheus](/docs/next/monitoring/grafana): Monitoring Spice instances with Grafana & Prometheus - [New Relic](/docs/next/monitoring/new-relic): Monitoring Spice with New Relic - [Spice Cloud Platform](/docs/next/monitoring/spice-cloud): Connect a self-hosted Spice runtime to the Spice Cloud Platform to centralize task history and runtime observability across deployments. - [Zipkin Integration](/docs/next/monitoring/zipkin): Learn how to integrate Spice with Zipkin tracing. - [Spice.ai OSS Reference Docs](/docs/next/reference): Reference documentation for Spice.ai including API reference, CLI commands, Spicepod configuration syntax, SQL reference, and data type specifications. - [Cron Schedules](/docs/next/reference/cron): The Runtime supports cron expressions with optional seconds, like /10 which evaluates to every 10th second (10, 20, 30, etc). - [Data Types Reference](/docs/next/reference/datatypes): Spice uses Apache Arrow data types internally, providing consistent type handling across different data sources and accelerators. This section documents how Arrow types map to specific accelerators and object store formats. - [Accelerator Data Types](/docs/next/reference/datatypes/accelerators): Spice adheres to Apache Arrow data types. Data accelerators do not support all Arrow data types. The table below outlines the data type compatibility for each accelerator, and datatype used within the accelerator. - [Object Store Data Types](/docs/next/reference/datatypes/object_store): Spice adheres to Apache Arrow data types. The table below lists the types of supported file type from object stores and their corresponding Apache Arrow type mappings in Spice. - [Spice Runtime Distributions](/docs/next/reference/distributions): Distribution variants of the Spice runtime for different use cases and deployment scenarios, including data-only, GPU-accelerated, NAS, and allocator variants. - [Duration](/docs/next/reference/duration): Durations are represented as integers with a time unit suffix. - [File Formats](/docs/next/reference/file_format): File-based data connectors — including s3//, file//, sftp://, and others — support multiple structured and document file formats. This page details the format-specific parameters available for each. - [Managing Memory Usage](/docs/next/reference/memory): Guidelines and best practices for managing memory usage and optimizing performance in Spice deployments. - [Models Grade Report](/docs/next/reference/models): Spice AI graded Large-Language-Model (LLM) evaluation report - [Performance Tuning](/docs/next/reference/performance-tuning): Comprehensive guide to optimizing query performance, acceleration, and resource utilization in Spice deployments. - [YAML syntax for Spicepod manifests](/docs/next/reference/spicepod): Detailed documentation on the Spicepod manifest syntax (spicepod.yaml) - [catalogs](/docs/next/reference/spicepod/catalogs): Catalogs YAML reference - [Datasets](/docs/next/reference/spicepod/datasets): Datasets YAML reference - [Embeddings](/docs/next/reference/spicepod/embeddings): Embeddings YAML reference - [Evals (Deprecated)](/docs/next/reference/spicepod/evals): The evals Spicepod component is no longer supported in Spice. - [Functions (User-Defined Functions)](/docs/next/reference/spicepod/functions): User-defined functions YAML reference - [Reserved Keywords](/docs/next/reference/spicepod/keywords): Reserved keywords for datasets - [Models](/docs/next/reference/spicepod/models): Models YAML reference - [Runtime](/docs/next/reference/spicepod/runtime): Runtime YAML reference - [Tools (Function Calling)](/docs/next/reference/spicepod/tools): Tools YAML reference - [Views](/docs/next/reference/spicepod/views): Views YAML reference - [Workers](/docs/next/reference/spicepod/workers): Workers YAML reference - [SQL Reference](/docs/next/reference/sql): Complete SQL reference for Spice.ai including SELECT syntax, subqueries, DML statements, aggregate functions, AI functions, JSON operators, and search capabilities. - [Aggregate Functions](/docs/next/reference/sql/aggregate_functions): Spice is built on Apache DataFusion and uses the PostgreSQL dialect, even when querying datasources with different SQL dialects. When using a data accelerator like DuckDB, function support is specific to each acceleration engine, and not all functions are supported by all acceleration engines. - [AI Functions](/docs/next/reference/sql/ai): AI functions in Spice provide direct integration with large language models (LLMs) and embedding models within SQL queries. These functions process text through configured model providers and return generated responses or vector embeddings. - [DML (Data Manipulation Language)](/docs/next/reference/sql/dml): Data Manipulation Language (DML) statements for inserting and modifying data in Spice. - [Explain](/docs/next/reference/sql/explain): Spice is built on Apache DataFusion and uses the PostgreSQL dialect, even when querying datasources with different SQL dialects. - [Information Schema](/docs/next/reference/sql/information_schema): Spice is built on Apache DataFusion and uses the PostgreSQL dialect, even when querying datasources with different SQL dialects. - [JSON Functions and Operators](/docs/next/reference/sql/json): Reference for JSON functions and operators in Spice SQL - [Operators](/docs/next/reference/sql/operators): Spice is built on Apache DataFusion and uses the PostgreSQL dialect, even when querying datasources with different SQL dialects. - [Prepared Statements](/docs/next/reference/sql/prepared_statements): Spice is built on Apache DataFusion and uses the PostgreSQL dialect, even when querying datasources with different SQL dialects. - [Scalar Functions](/docs/next/reference/sql/scalar_functions): Spice is built on Apache DataFusion and uses the PostgreSQL dialect, even when querying datasources with different SQL dialects. When using a data accelerator like DuckDB, function support is specific to each acceleration engine, and not all functions are supported by all acceleration engines. - [Search in SQL](/docs/next/reference/sql/search): Reference for search functions and filtering in Spice SQL. - [SELECT](/docs/next/reference/sql/select): Spice is built on Apache DataFusion and uses the PostgreSQL dialect, even when querying datasources with different SQL dialects. - [Subqueries](/docs/next/reference/sql/subqueries): Spice is built on Apache DataFusion and uses the PostgreSQL dialect, even when querying datasources with different SQL dialects. - [Spice.ai Open Source System Requirements](/docs/next/reference/system_requirements): System requirements for running Spice.ai Open Source - [Task History](/docs/next/reference/task_history): The Spice runtime stores information about completed tasks in the spice.runtime.task_history table. Each task represents a single unit of execution within the runtime, such as a SQL query or an AI chat completion, and is represented by a unique span. - [SDKs](/docs/next/sdks): Connect to Spice using official SDKs - [Dotnet SDK](/docs/next/sdks/dotnet): Connect to Spice using the Dotnet SDK - [Go SDK](/docs/next/sdks/golang): Connect to Spice using the Go SDK - [Java SDK](/docs/next/sdks/java): Connect to Spice using the Java SDK - [JavaScript SDK](/docs/next/sdks/javascript): Connect to Spice using the JavaScript SDK - [Python SDK](/docs/next/sdks/python): Connect to Spice using the Python SDK - [Rust SDK](/docs/next/sdks/rust): Connect to Spice using the Rust SDK - [Troubleshooting Spice](/docs/next/troubleshooting): Review and debug runtime tasks, logs, and diagnostic steps in Spice. - [Spice.ai Use Cases](/docs/next/use-cases): Discover how to use Spice.ai for data federation, reverse-ETL, database CDN, enterprise search, RAG, and building AI-powered applications and agents. - [AI Applications and Agents](/docs/next/use-cases/ai): AI Applications and Agents - [Agentic AI Applications and Agents](/docs/next/use-cases/ai/agentic-apps): Spice.ai builds intelligent, autonomous agents for SaaS applications, enabling context-aware automation and decision-making. - [Edge-Enabled AI Applications and Agents](/docs/next/use-cases/ai/edge-ai): Spice.ai deploys AI applications and agents across cloud and edge for low-latency decisions in security IoT use cases. - [Federated MCP Client for Distributed Tool Ecosystems](/docs/next/use-cases/ai/federated-mcp-server): Spice.ai federates external MCP servers for scalable, tool-driven AI applications in security, improving threat analysis. - [Multi-Tenant AI Agents](/docs/next/use-cases/ai/multi-tenant-agents): Deploy AI agents across many SaaS tenants with strict isolation and no per-tenant ETL pipelines. - [Object-Store Based SQL Query, Search, and LLM Inference Engine](/docs/next/use-cases/ai/object-store-ai-engine): Spice.ai enables SQL queries, hybrid search, and LLM inference on object-store data for security applications, delivering real-time insights. - [Real-Time Decision-Making for Intelligent Applications](/docs/next/use-cases/ai/real-time-decision-making): Spice.ai powers instant, context-aware decisions for applications like security recommendations by grounding AI in federated, low-latency datasets. - [Tool-Augmented AI with Model Context Protocol Server](/docs/next/use-cases/ai/tool-calling-ai): Spice.ai extends AI with custom tools via MCP server in finserv, integrating domain-specific APIs for enhanced functionality. - [Caching](/docs/next/use-cases/caching): Caching use cases with Spice.ai, including write-through, read-through, SQL, S3, and HTTP caching. - [HTTP Cache](/docs/next/use-cases/caching/http-cache): Use Spice.ai to cache HTTP API responses locally, reducing API call frequency and providing fast, SQL-queryable access to external API data. - [Read-Through Cache](/docs/next/use-cases/caching/read-through-cache): Use Spice.ai as a read-through cache with the SQL results cache for federated data sources and HTTP APIs. - [S3 Cache](/docs/next/use-cases/caching/s3-cache): Use Spice.ai to cache S3 and object store data locally for fast, repeatable SQL queries without re-reading from remote storage. - [SQL and Database Cache](/docs/next/use-cases/caching/sql-database-cache): Use Spice.ai to cache SQL database tables and query results locally for low-latency access and reduced load on upstream databases. - [Write-Through Cache](/docs/next/use-cases/caching/write-through-cache): Use Spice.ai as a write-through cache that writes data to both a local accelerator and the upstream data source. - [Data Federation, Acceleration, and SQL Query](/docs/next/use-cases/data): Data Federation, Acceleration, and SQL Query - [Application Resilience and Performance Optimization](/docs/next/use-cases/data/application-resilence-and-acceleration): Spice.ai colocates dynamic data with SaaS applications as a database CDN, ensuring resilience and high performance. - [Data Mesh for Unified Data Access](/docs/next/use-cases/data/data-mesh): Give domain teams decentralized, real-time data ownership and access across disparate sources through a unified SQL interface. - [Database CDN for Enhanced Performance](/docs/next/use-cases/data/database-cdn): Spice.ai acts as a database CDN for SaaS applications, caching dynamic data to ensure high performance and resilience. - [ETL-free Workflows and Data Migrations](/docs/next/use-cases/data/etl-free-workflows): Federate legacy and modern data systems without ETL for faster migrations, lower overhead, and zero application downtime. - [Object-Store Data Engine](/docs/next/use-cases/data/object-store-data-engine): Spice.ai federates, accelerates, and queries object-store data for finserv applications, enabling real-time data access without centralized warehouses. - [Reverse-ETL for Operational Workflows](/docs/next/use-cases/data/reverse-etl): Serve enriched data from warehouses and data lakes to operational systems and applications, eliminating complex pipelines. - [Spice for Retrieval-Augmented-Generation (RAG)](/docs/next/use-cases/rag): Use Spice for Retrieval-Augmented-Generation (RAG) - [RAG for Contextual Applications](/docs/next/use-cases/rag/applications): Build context-rich AI applications using Spice for Retrieval-Augmented Generation (RAG). - [Retrieval-Augmented Generation for AI-Powered Reporting](/docs/next/use-cases/rag/reporting): Spice.ai generates dynamic, context-aware AI-driven reports for operational insights in health-tech, ensuring compliance and precision. - [Search & Retrieval](/docs/next/use-cases/search): Search & Retrieval - [Simplifying Real-Time Data Collection and Search](/docs/next/use-cases/search/data-collection-and-search): Spice.ai processes streaming and static data with integrated search for real-time insights, focusing on application logic. - [Enterprise Search and Retrieval](/docs/next/use-cases/search/enterprise-search): Spice.ai powers semantic and precise search for finserv knowledge bases with hybrid vector and keyword capabilities. - [Object-Store Native Search Engine](/docs/next/use-cases/search/object-store-search-engine): Spice.ai powers a cloud-native embedded search engine on object-store data for security applications, enabling semantic and precise search. ### v1.10 Spice is a SQL query, search, and LLM-inference engine, written in Rust, for data-driven applications and AI agents. - [Spice.ai Open Source](/docs/v1.10): Spice is a SQL query, search, and LLM-inference engine, written in Rust, for data-driven applications and AI agents. - [Tags](/docs/v1.10/tags) - [One doc tagged with "Acknowledgements"](/docs/v1.10/tags/acknowledgements): Project acknowledgements, credits, and attributions. - [One doc tagged with "ADBC"](/docs/v1.10/tags/adbc): Arrow Database Connectivity driver configuration and usage. - [4 docs tagged with "API"](/docs/v1.10/tags/api): HTTP, Arrow Flight SQL, ODBC, JDBC, and ADBC API reference. - [One doc tagged with "Arrow"](/docs/v1.10/tags/arrow): Apache Arrow columnar data format integration. - [One doc tagged with "Arrow Flight SQL"](/docs/v1.10/tags/arrow-flight-sql): Arrow Flight SQL protocol implementation and configuration. - [One doc tagged with "Auth"](/docs/v1.10/tags/auth): Authentication and authorization mechanisms. - [One doc tagged with "Authentication"](/docs/v1.10/tags/authentication): User authentication methods and security protocols. - [2 docs tagged with "Azure"](/docs/v1.10/tags/azure): Microsoft Azure cloud services and integrations. - [One doc tagged with "Blob Storage"](/docs/v1.10/tags/blob-storage): Object storage services and blob data access. - [One doc tagged with "Caching"](/docs/v1.10/tags/caching): Data caching strategies and performance optimization. - [5 docs tagged with "Catalogs"](/docs/v1.10/tags/catalogs): Data catalog connectors and metadata management. - [One doc tagged with "Cayenne"](/docs/v1.10/tags/cayenne): Cayenne (Vortex) data accelerator built on Vortex columnar format. - [2 docs tagged with "CLI"](/docs/v1.10/tags/cli): Spice command-line interface commands and usage. - [5 docs tagged with "Component Metrics"](/docs/v1.10/tags/component-metrics): Runtime component performance metrics and monitoring. - [One doc tagged with "Components"](/docs/v1.10/tags/components): Runtime components including catalogs, data connectors, and models. - [2 docs tagged with "Configuration"](/docs/v1.10/tags/configuration): System configuration files and runtime settings. - [One doc tagged with "Data Accelerators"](/docs/v1.10/tags/data-accelerators): Data acceleration engines for high-performance query execution. - [19 docs tagged with "Data Connectors"](/docs/v1.10/tags/data-connectors): Data source connectors and integration patterns. - [One doc tagged with "Data Lake"](/docs/v1.10/tags/data-lake): Data lake architectures and storage solutions. - [2 docs tagged with "Databricks"](/docs/v1.10/tags/databricks): Databricks platform integration and Unity Catalog support. - [2 docs tagged with "Datasets"](/docs/v1.10/tags/datasets): Dataset definitions and data source configurations. - [One doc tagged with "Debezium"](/docs/v1.10/tags/debezium): Debezium change data capture integration. - [One doc tagged with "Debugging"](/docs/v1.10/tags/debugging): Debugging techniques and troubleshooting tools. - [2 docs tagged with "Delta Lake"](/docs/v1.10/tags/delta-lake): Delta Lake open table format support. - [One doc tagged with "Dependencies"](/docs/v1.10/tags/dependencies): Third-party dependencies and software requirements. - [3 docs tagged with "Deployment"](/docs/v1.10/tags/deployment): Production deployment using Docker and Kubernetes. - [2 docs tagged with "Docker"](/docs/v1.10/tags/docker): Docker containerization and deployment configurations. - [One doc tagged with "DynamoDB"](/docs/v1.10/tags/dynamodb): Amazon DynamoDB NoSQL database integration. - [3 docs tagged with "Embeddings"](/docs/v1.10/tags/embeddings): Vector embeddings and semantic similarity operations. - [One doc tagged with "Evaluation"](/docs/v1.10/tags/evaluation): Model evaluation metrics and assessment frameworks. - [2 docs tagged with "Features"](/docs/v1.10/tags/features): Core platform features including acceleration, caching, and search. - [One doc tagged with "Federation"](/docs/v1.10/tags/federation): Cross-database queries and federated data access. - [One doc tagged with "Getting Started"](/docs/v1.10/tags/getting-started): Installation guides and quickstart tutorials. - [One doc tagged with "GitHub"](/docs/v1.10/tags/github): GitHub repository data connector and integration. - [2 docs tagged with "Glue"](/docs/v1.10/tags/glue): AWS Glue ETL service and data catalog integration. - [2 docs tagged with "Iceberg"](/docs/v1.10/tags/iceberg): Apache Iceberg open table format support. - [One doc tagged with "In-Memory"](/docs/v1.10/tags/in-memory): In-memory data processing and temporary storage. - [One doc tagged with "Integration"](/docs/v1.10/tags/integration): Third-party system integrations and connectivity patterns. - [One doc tagged with "JDBC"](/docs/v1.10/tags/jdbc): Java Database Connectivity driver configuration. - [One doc tagged with "Kafka"](/docs/v1.10/tags/kafka): Apache Kafka event streaming platform integration. - [2 docs tagged with "Kubernetes"](/docs/v1.10/tags/kubernetes): Kubernetes orchestration and secret management. - [One doc tagged with "Logging"](/docs/v1.10/tags/logging): Application logging configuration and log management. - [One doc tagged with "Login"](/docs/v1.10/tags/login): User login processes and session management. - [One doc tagged with "Manifest"](/docs/v1.10/tags/manifest): Configuration manifest files and schema definitions. - [One doc tagged with "MCP"](/docs/v1.10/tags/mcp): Model Context Protocol for AI tool integration. - [2 docs tagged with "Memory"](/docs/v1.10/tags/memory): In-memory data connectors and volatile storage. - [13 docs tagged with "Models"](/docs/v1.10/tags/models): Machine learning models and AI inference engines. - [One doc tagged with "MongoDB"](/docs/v1.10/tags/mongodb): MongoDB NoSQL document database integration. - [One doc tagged with "MySQL"](/docs/v1.10/tags/mysql): MySQL relational database integration. - [One doc tagged with "NoSQL"](/docs/v1.10/tags/nosql): NoSQL database systems and document stores. - [One doc tagged with "Observability"](/docs/v1.10/tags/observability): Monitoring, tracing, and metrics for system visibility. - [One doc tagged with "ODBC"](/docs/v1.10/tags/odbc): Open Database Connectivity driver configuration. - [One doc tagged with "Open Source"](/docs/v1.10/tags/open-source): Open source licenses and community contributions. - [One doc tagged with "OpenAI"](/docs/v1.10/tags/openai): OpenAI API integration and GPT model access. - [One doc tagged with "Oracle"](/docs/v1.10/tags/oracle): Documentation related to Oracle database integration. - [2 docs tagged with "Overrides"](/docs/v1.10/tags/overrides): Parameter overrides and configuration customization. - [2 docs tagged with "Overview"](/docs/v1.10/tags/overview): High-level component and feature overviews. - [2 docs tagged with "Parameters"](/docs/v1.10/tags/parameters): Configuration parameters and runtime options. - [2 docs tagged with "Performance"](/docs/v1.10/tags/performance): Performance optimization and benchmarking. - [One doc tagged with "Persistence"](/docs/v1.10/tags/persistence): Data persistence and durable storage mechanisms. - [4 docs tagged with "Reference"](/docs/v1.10/tags/reference): API reference, CLI commands, and configuration syntax. - [One doc tagged with "Relational"](/docs/v1.10/tags/relational): Relational database systems and SQL operations. - [One doc tagged with "Runtime"](/docs/v1.10/tags/runtime): Runtime behavior and execution environment. - [One doc tagged with "Sandbox"](/docs/v1.10/tags/sandbox): Sandbox environments and isolated testing. - [5 docs tagged with "Search"](/docs/v1.10/tags/search): Vector search, semantic search, and ranking capabilities. - [One doc tagged with "Security"](/docs/v1.10/tags/security): Security features and data protection mechanisms. - [2 docs tagged with "SpiceAI"](/docs/v1.10/tags/spiceai): SpiceAI cloud platform and managed services. - [5 docs tagged with "Spicepod"](/docs/v1.10/tags/spicepod): Spicepod configuration files, manifest syntax, and package management. - [2 docs tagged with "SQL"](/docs/v1.10/tags/sql): SQL query language support and database operations. - [3 docs tagged with "Tools"](/docs/v1.10/tags/tools): Development tools and utility integrations. - [2 docs tagged with "Tracing"](/docs/v1.10/tags/tracing): Distributed tracing and request monitoring. - [One doc tagged with "Troubleshooting"](/docs/v1.10/tags/troubleshooting): Problem diagnosis and resolution guides. - [One doc tagged with "Unity Catalog"](/docs/v1.10/tags/unity-catalog): Databricks Unity Catalog data governance integration. - [One doc tagged with "Views"](/docs/v1.10/tags/views): Virtual views and data transformation layers. - [One doc tagged with "Vortex"](/docs/v1.10/tags/vortex): Vortex columnar file format and storage engine. - [6 docs tagged with "Write"](/docs/v1.10/tags/write): Data connectors and catalogs that support write operations. - [One doc tagged with "YAML"](/docs/v1.10/tags/yaml): YAML configuration syntax and file formats. - [One doc tagged with "Zipkin"](/docs/v1.10/tags/zipkin): Zipkin distributed tracing system integration. - [Open Source Acknowledgements](/docs/v1.10/acknowledgements): Spice AI acknowledges the following open source projects for making this project possible: - [API](/docs/v1.10/api): API - [ADBC: Arrow Database Connectivity](/docs/v1.10/api/adbc): ADBC API Documentation - [Arrow Flight SQL API](/docs/v1.10/api/arrow-flight-sql): Query Spice using JDBC/ODBC/ADBC - [Authentication](/docs/v1.10/api/auth): Authentication documentation - [Generate Package](/docs/v1.10/api/HTTP/generate-package): This endpoint generates a zip package from a specified GitHub source. - [List Catalogs](/docs/v1.10/api/HTTP/get-catalogs): List Catalogs - [Get Iceberg API config](/docs/v1.10/api/HTTP/get-config): This endpoint returns the Iceberg Catalog API configuration, including details about overrides, defaults, and available endpoints. - [List Datasets](/docs/v1.10/api/HTTP/get-datasets): This endpoint returns a list of configured datasets. The response can be formatted as **JSON** or **CSV**, - [List Iceberg namespaces](/docs/v1.10/api/HTTP/get-iceberg-namespaces): This endpoint retrieves namespaces available in the Iceberg catalog. - [ML Prediction](/docs/v1.10/api/HTTP/get-model-predict): Make a ML prediction using a specific model. - [List Models](/docs/v1.10/api/HTTP/get-models): List all models, both machine learning and language models, available in the runtime. - [List Spicepods](/docs/v1.10/api/HTTP/get-spicepods): Get a list of spicepods and their details. In CSV format, it will return a summarised form. - [Check Runtime Status](/docs/v1.10/api/HTTP/get-status): Return the status of all connections (http, flight, metrics, opentelemetry) in the runtime. - [Check Namespace exists](/docs/v1.10/api/HTTP/head-namespace): This endpoint returns a 200 OK response if the namespace exists, otherwise it returns a 404 Not Found response. - [List Evals](/docs/v1.10/api/HTTP/list): Return all evals available to run in the runtime. - [Send message to MCP server](/docs/v1.10/api/HTTP/mcp-event): Send message to the MCP endoint, for a given session. - [Establish an MCP SSE Connection](/docs/v1.10/api/HTTP/operation-id): Initiates a Server-Sent Events (SSE) connection using the Model Context Protocol (MCP) to interact with Spice tools. - [Update Refresh SQL](/docs/v1.10/api/HTTP/patch-dataset-acceleration): Update the refresh SQL for a dataset's acceleration. - [Run Tool](/docs/v1.10/api/HTTP/post): The request body and JSON response formats match the tool’s specification. - [Batch ML Predictions](/docs/v1.10/api/HTTP/post-batch-predict): Perform a batch of ML predictions, using multiple models, in one request. This is useful for ensembling or A/B testing different models. - [Create Chat Completion](/docs/v1.10/api/HTTP/post-chat-completions): Creates a model response for the given chat conversation. - [Refresh Dataset](/docs/v1.10/api/HTTP/post-dataset-refresh): Trigger an on-demand refresh for an accelerated dataset. - [Create Embeddings](/docs/v1.10/api/HTTP/post-embeddings): Creates an embedding vector representing the input text. - [Run Eval](/docs/v1.10/api/HTTP/post-eval): Evaluate a model against a eval spice specification - [Text-to-SQL (NSQL)](/docs/v1.10/api/HTTP/post-nsql): Generate and optionally execute a natural-language text-to-SQL (NSQL) query. - [Search](/docs/v1.10/api/HTTP/post-search): Perform a vector similarity search (VSS) operation on a dataset. - [SQL Query](/docs/v1.10/api/HTTP/post-sql): Execute a SQL query and return the results. - [Check Readiness](/docs/v1.10/api/HTTP/ready): Check the runtime status of all the components of the runtime. If the service is ready, it returns an HTTP 200 status with the message 'ready'. If not, it returns a 503 status with the message 'not ready'. - [runtime](/docs/v1.10/api/HTTP/runtime): The spiced runtime - [JDBC: Java Database Connectivity](/docs/v1.10/api/jdbc): JDBC API Documentation - [ODBC: Open Database Connectivity](/docs/v1.10/api/odbc): ODBC API Documentation - [API Overview](/docs/v1.10/api/overview): Spice.ai API overview, including SQL query interfaces, OpenAI-compatible endpoints, Iceberg catalog REST APIs, and the Model Context Protocol (MCP) for integrating external tools. - [TLS: Transport Layer Security](/docs/v1.10/api/tls): Encryption in transit with TLS documentation - [Spice.ai OSS CLI documentation](/docs/v1.10/cli): Detailed documentation on the Spice.ai OSS CLI - [Spice.ai OSS CLI command reference](/docs/v1.10/cli/reference): Spice CLI command reference - [add](/docs/v1.10/cli/reference/add): Add a Spicepod to the project. - [catalogs](/docs/v1.10/cli/reference/catalogs): List catalogs currently loaded by the Spice runtime. - [chat](/docs/v1.10/cli/reference/chat): spice chat CLI documentation - [Completion](/docs/v1.10/cli/reference/completion): Generate the autocompletion script for spice for the specified shell. - [connect](/docs/v1.10/cli/reference/connect): Connect to an app on the Spice.ai Cloud Platform. - [dataset](/docs/v1.10/cli/reference/dataset): Configure a Spice dataset. - [datasets](/docs/v1.10/cli/reference/datasets): Lists datasets loaded by the Spice runtime - [init](/docs/v1.10/cli/reference/init): Initialize Spice app in the current working directory. - [install](/docs/v1.10/cli/reference/install): Download and install the latest version of the Spice runtime. - [login](/docs/v1.10/cli/reference/login): Login to the Spice.ai Platform, or other services with sub-commands. - [models](/docs/v1.10/cli/reference/models): Lists models loaded by the Spice runtime - [pods](/docs/v1.10/cli/reference/pods): Lists Spicepods loaded by the Spice runtime - [refresh](/docs/v1.10/cli/reference/refresh): Refreshes an accelerated dataset loaded by the Spice runtime - [run](/docs/v1.10/cli/reference/run): Run Spice - starts the Spice runtime, installing if necessary. - [search](/docs/v1.10/cli/reference/search): Performs embeddings-based searches across search configured datasets. Note: Search requires the ai feature to be installed. - [sql](/docs/v1.10/cli/reference/sql): Start an interactive SQL query session against the Spice runtime - [status](/docs/v1.10/cli/reference/status): Spice runtime status - [trace](/docs/v1.10/cli/reference/trace): Provides a user-friendly trace stack into an operation that occurred in Spice. This command retrieves and displays task execution traces from the runtime.task_history table. - [upgrade](/docs/v1.10/cli/reference/upgrade): Upgrades the Spice CLI & Runtime to the latest release - [version](/docs/v1.10/cli/reference/version): Outputs the current version of the Spice CLI and runtime - [Configuring Trace Levels](/docs/v1.10/cli/tracing): Configuring Spice.ai OSS trace output verbosity levels - [Clients and Tools](/docs/v1.10/clients): Client and tools - [DBeaver](/docs/v1.10/clients/dbeaver): Configure DBeaver to query Spice via JDBC - [JetBrains DataGrip](/docs/v1.10/clients/jetbrains-datagrip): Configure JetBrains Datagrip to query Spice via JDBC - [Microsoft Power BI Connector](/docs/v1.10/clients/powerbi): Use Microsoft Power BI to access, visualize and analyze Spice datasets. - [Apache Superset](/docs/v1.10/clients/superset): Use Apache Superset to query and visualize datasets loaded in Spice. - [Tableau](/docs/v1.10/clients/tableau): Use Tableau to to access, visualise and analyse datasets loaded in Spice. - [Runtime Components](/docs/v1.10/components): Runtime components' - [Catalog Connectors](/docs/v1.10/components/catalogs) - [Databricks Catalog Connector](/docs/v1.10/components/catalogs/databricks): Connect to a Databricks Unity Catalog provider. - [Glue Catalog Connector](/docs/v1.10/components/catalogs/glue): Connect to an AWS Glue Data Catalog. - [Iceberg Catalog Connector](/docs/v1.10/components/catalogs/iceberg): Connect to an Iceberg catalog provider. - [Spice.ai Catalog Connector](/docs/v1.10/components/catalogs/spiceai): Connect to the Spice.ai built-in catalog. - [Unity Catalog Catalog Connector](/docs/v1.10/components/catalogs/unity-catalog): Connect to a Unity Catalog provider. - [Data Accelerators](/docs/v1.10/components/data-accelerators) - [In-Memory Arrow Data Accelerator](/docs/v1.10/components/data-accelerators/arrow): In-Memory Arrow Data Accelerator Documentation - [Cayenne Data Accelerator](/docs/v1.10/components/data-accelerators/cayenne): Cayenne Data Accelerator (Vortex) Documentation - [DuckDB Data Accelerator](/docs/v1.10/components/data-accelerators/duckdb): DuckDB Data Accelerator Documentation - [PostgreSQL Data Accelerator](/docs/v1.10/components/data-accelerators/postgres): PostgreSQL Data Accelerator Documentation - [SQLite Data Accelerator](/docs/v1.10/components/data-accelerators/sqlite): SQLite Data Accelerator Documentation - [Data Connectors](/docs/v1.10/components/data-connectors): Learn how to use Data Connector to query external data. - [Azure BlobFS Data Connector](/docs/v1.10/components/data-connectors/abfs): Azure BlobFS Data Connector Documentation - [ClickHouse Data Connector](/docs/v1.10/components/data-connectors/clickhouse): ClickHouse Data Connector Documentation - [Databricks Data Connector](/docs/v1.10/components/data-connectors/databricks): Databricks Data Connector Documentation - [Debezium Data Connector](/docs/v1.10/components/data-connectors/debezium): Debezium Data Connector Documentation - [Delta Lake Data Connector](/docs/v1.10/components/data-connectors/delta-lake): Delta Lake Data Connector Documentation - [Dremio Data Connector](/docs/v1.10/components/data-connectors/dremio): Dremio Data Connector Documentation - [DuckDB Data Connector](/docs/v1.10/components/data-connectors/duckdb): DuckDB Data Connector Documentation - [DynamoDB Data Connector](/docs/v1.10/components/data-connectors/dynamodb): DynamoDB Data Connector Documentation - [File Data Connector](/docs/v1.10/components/data-connectors/file): File Data Connector Documentation - [Flight SQL Data Connector](/docs/v1.10/components/data-connectors/flightsql): Flight SQL Data Connector Documentation - [FTP/SFTP Data Connector](/docs/v1.10/components/data-connectors/ftp): FTP/SFTP Data Connector Documentation - [GitHub Data Connector](/docs/v1.10/components/data-connectors/github): GitHub Data Connector Documentation - [Glue Data Connector](/docs/v1.10/components/data-connectors/glue): Glue Data Connector Documentation - [GraphQL Data Connector](/docs/v1.10/components/data-connectors/graphql): GraphQL Data Connector Documentation - [HTTP(s) Data Connector](/docs/v1.10/components/data-connectors/https): HTTP(s) Data Connector Documentation - [Iceberg Data Connector](/docs/v1.10/components/data-connectors/iceberg): Connect to and query Apache Iceberg tables - [IMAP Data Connector](/docs/v1.10/components/data-connectors/imap): IMAP Data Connector Documentation - [Kafka Data Connector](/docs/v1.10/components/data-connectors/kafka): Kafka Data Connector Documentation - [Localpod Data Connector](/docs/v1.10/components/data-connectors/localpod): Localpod Data Connector Documentation - [Memory Data Connector](/docs/v1.10/components/data-connectors/memory): Memory Data Connector Documentation - [MongoDB Data Connector](/docs/v1.10/components/data-connectors/mongodb): MongoDB Data Connector Documentation - [Microsoft SQL Server Data Connector](/docs/v1.10/components/data-connectors/mssql): Microsoft SQL Server Data Connector - [MySQL Data Connector](/docs/v1.10/components/data-connectors/mysql): MySQL Data Connector Documentation - [Pull the latest official Spice image](/docs/v1.10/components/data-connectors/odbc): ODBC Data Connector Documentation - [Oracle Data Connector](/docs/v1.10/components/data-connectors/oracle): Oracle Data Connector Documentation - [PostgreSQL Data Connector](/docs/v1.10/components/data-connectors/postgres): PostgreSQL Data Connector Documentation - [Amazon Redshift Data Connector](/docs/v1.10/components/data-connectors/redshift): Connect to Amazon Redshift using the PostgreSQL connector in Spice. - [S3 Data Connector](/docs/v1.10/components/data-connectors/s3): S3 Data Connector Documentation - [SharePoint Data Connector](/docs/v1.10/components/data-connectors/sharepoint): SharePoint Data Connector Documentation - [Snowflake Data Connector](/docs/v1.10/components/data-connectors/snowflake): Snowflake Data Connector Documentation - [Apache Spark Connector](/docs/v1.10/components/data-connectors/spark): Apache Spark Connector Documentation - [Spice.ai Data Connector](/docs/v1.10/components/data-connectors/spiceai): Spice.ai Data Connector Documentation - [Embedding Models](/docs/v1.10/components/embeddings): Describes how embedding models are used in Spice to convert text into numerical vectors for machine learning and search applications. - [Azure OpenAI Embedding Models](/docs/v1.10/components/embeddings/azure): To use an embedding model hosted on Azure OpenAI, specify the azure path in the from field and the following parameters from the Azure OpenAI Model Deployment page: - [Amazon Bedrock Model Provider](/docs/v1.10/components/embeddings/bedrock): Instructions for using Amazon Bedrock embedding models - [Databricks Model Provider](/docs/v1.10/components/embeddings/databricks): Instructions for using Databricks Mosaic AI Models - [HuggingFace Text Embedding Models](/docs/v1.10/components/embeddings/huggingface): To use an embedding model from HuggingFace with Spice, specify the huggingface path in the from field of your configuration. The model and its related files will be automatically downloaded, loaded, and served locally by Spice. - [Local Filesystem Embedding Models](/docs/v1.10/components/embeddings/local): Embedding models can be run with files stored locally. This method is useful for using models that are not hosted on remote services. - [Model2Vec Embedding Models](/docs/v1.10/components/embeddings/model2vec): Model2Vec embedding models help generate efficient static word embeddings from sentence transformer models for use in Spice, supporting local and Hugging Face sources with options for private models and performance tuning. - [OpenAI (or Compatible) Embedding Models](/docs/v1.10/components/embeddings/openai): To use a hosted OpenAI (or compatible) embedding model, specify the openai path in the from field of your configuration. - [Model Providers](/docs/v1.10/components/models): Overview of supported model providers for ML and LLMs in Spice. - [Anthropic Models](/docs/v1.10/components/models/anthropic): Instructions for using language models hosted on Anthropic with Spice. - [Azure OpenAI Models](/docs/v1.10/components/models/azure): Instructions for using Azure OpenAI models - [Amazon Bedrock Models](/docs/v1.10/components/models/bedrock): How to use Amazon Bedrock models with Spice. - [Databricks Model Provider](/docs/v1.10/components/models/databricks): Instructions for using Databricks Mosaic AI Models - [Filesystem Hosted Models](/docs/v1.10/components/models/filesystem): Instructions for using models hosted on a filesystem with Spice. - [HuggingFace](/docs/v1.10/components/models/huggingface): Instructions for using machine learning models hosted on HuggingFace with Spice. - [OpenAI (or Compatible) Language Models](/docs/v1.10/components/models/openai): Instructions for using language models hosted on OpenAI or compatible services with Spice. - [Perplexity Models](/docs/v1.10/components/models/perplexity): Instructions for using language models hosted on Perplexity with Spice. - [Spice Cloud Platform](/docs/v1.10/components/models/spiceai): Instructions for using models hosted on the Spice Cloud Platform with Spice. - [xAI Models](/docs/v1.10/components/models/xai): Instructions for using xAI models - [Secret Stores](/docs/v1.10/components/secret-stores) - [AWS Secrets Manager Secret Store](/docs/v1.10/components/secret-stores/aws-secrets-manager): AWS Secrets Manager Secret Store Documentation - [Environment Secret Store](/docs/v1.10/components/secret-stores/env): Environment Variables Secret Store Documentation - [Keyring Secret Store](/docs/v1.10/components/secret-stores/keyring): Keyring Secret Store Documentation - [Kubernetes Secret Store](/docs/v1.10/components/secret-stores/kubernetes): Kubernetes Secret Store Documentation - [LLM Tools (Function Calling)](/docs/v1.10/components/tools): Overview of supported LLM tools (function calling) and how to define new tools - [Model Context Protocol Tools](/docs/v1.10/components/tools/mcp): Spice integrates with tools and services using the Model Context Protocol (MCP). MCP tools can be configured to run internally or connect to external servers over HTTP using the Server-Sent Events (SSE) protocol. - [Web Search Tool](/docs/v1.10/components/tools/websearch): The Web Search Tool enables Spice models to search the web for information. The tool is available through the websearch tool, and backed by different search engines. - [Vector Engines](/docs/v1.10/components/vectors) - [Amazon S3 Vectors Engine](/docs/v1.10/components/vectors/s3_vectors): Amazon S3 Vectors Engine Documentation - [Views](/docs/v1.10/components/views): Documentation for defining Views in Spice - [Workers Overview](/docs/v1.10/components/workers): Detailed documentation for workers in the Spice runtime. - [Deployment](/docs/v1.10/deployment): Deploy Spice.ai in your environment - [Deployment Architectures](/docs/v1.10/deployment/architectures): Spice.ai Open Source Deployment architectures - [Cluster-Based Deployment (Spice.ai Enterprise)](/docs/v1.10/deployment/architectures/cluster): Deploying Spice as a cluster - [Cloud Hosted](/docs/v1.10/deployment/architectures/hosted): Deploying Spice cloud hosted in the Spice Cloud Platform - [Microservice Deployment (Single or Multiple Replicas)](/docs/v1.10/deployment/architectures/microservice): Deploying Spice as a microservice - [Sharded](/docs/v1.10/deployment/architectures/sharded): Deploying Spice with shards - [Sidecar Deployment](/docs/v1.10/deployment/architectures/sidecar): Deploying Spice as a application sidecar - [Tiered Deployment](/docs/v1.10/deployment/architectures/tiered): Deploying Spice in tiers - [AWS Deployment Options](/docs/v1.10/deployment/aws): Guide to deploying Spice.ai applications on Amazon Web Services (AWS) - [AWS Integrations](/docs/v1.10/deployment/aws/integrations): Complete guide to Spice.ai integrations with Amazon Web Services, including data connectors, AI models, vector stores, and secret management. - [Spice Cloud Platform Deployment](/docs/v1.10/deployment/cloud): Guide to deploying data and AI applications using the managed Spice Cloud Platform - [Docker - Kubernetes](/docs/v1.10/deployment/docker): Running Spice.ai as Docker container - [Docker Sandbox Guide - v1.3.0](/docs/v1.10/deployment/docker/sandbox): Migrating to v1.3.0 - [Helm - Kubernetes](/docs/v1.10/deployment/kubernetes): Deploy Spice.ai in Kubernetes using Helm. - [Frequently Asked Questions](/docs/v1.10/faq): Get answers to common questions about Spice.ai, including its features, differences from other tools, and use cases - [Features](/docs/v1.10/features): Features - [Caching](/docs/v1.10/features/caching): Learn how to use Spice in-memory caching - [Change Data Capture (CDC)](/docs/v1.10/features/cdc): Learn how to use Change Data Capture (CDC) in Spice. - [Data Acceleration](/docs/v1.10/features/data-acceleration): Learn how to use local data acceleration in Spice. - [Constraints](/docs/v1.10/features/data-acceleration/constraints): Learn how to add/configure constraints on local acceleration tables in Spice. - [Data Refresh](/docs/v1.10/features/data-acceleration/data-refresh): Data refresh for accelerated datasets - [Indexes](/docs/v1.10/features/data-acceleration/indexes): Learn how to add indexes to local acceleration tables in Spice. - [Partitioning](/docs/v1.10/features/data-acceleration/partitioning): Partitioning for accelerated datasets - [Caching Refresh Mode](/docs/v1.10/features/data-acceleration/refresh-modes/caching): Learn how to use caching refresh mode for HTTP-based datasets - [Snapshots](/docs/v1.10/features/data-acceleration/snapshots): Bootstrap file-mode accelerations from managed snapshots to eliminate cold starts. - [Data Ingestion](/docs/v1.10/features/data-ingestion): Learn how to ingest data in Spice. - [Distributed Query](/docs/v1.10/features/distributed-query): Learn how to run Spice in distributed mode for larger scale queries. - [Embedding Datasets](/docs/v1.10/features/embeddings): Learn how to define, or augment existing datasets with embedding column(s). - [Large Language Models](/docs/v1.10/features/large-language-models): Learn how to configure large language models (LLMs) - [Evaluating Language Models](/docs/v1.10/features/large-language-models/evals): Learn how Spice evaluates, tracks, compares, and improves language model performance for specific tasks - [Model Context Protocol (MCP)](/docs/v1.10/features/large-language-models/mcp): Learn how to use the Model Context Protocol (MCP) with Spice. - [Language Model Memory](/docs/v1.10/features/large-language-models/memory): Learn how to provide LLMs with memory - [Language Model Overrides](/docs/v1.10/features/large-language-models/parameter_overrides): Learn how to override default LLM hyperparameters in Spice. - [System Prompt parameterization](/docs/v1.10/features/large-language-models/parameterized_prompts): Learn how to update system prompts for each request with Jinja-styled templating. - [Load and Serve Models Locally](/docs/v1.10/features/large-language-models/serving): Learn how to load and serve large learning models. - [Language Models Tools](/docs/v1.10/features/large-language-models/tools): Learn how LLMs interact with the Spice runtime. - [Machine Learning Models](/docs/v1.10/features/machine-learning-models): Spice supports loading and serving ONNX models for inference, from sources including local filesystems, Hugging Face, and the Spice.ai Cloud platform. - [Observability & Monitoring](/docs/v1.10/features/observability): Monitor Spice with Prometheus metrics, OpenTelemetry, and distributed tracing. - [Component Metrics](/docs/v1.10/features/observability/component_metrics): Learn how to enable optional component metrics. - [Query Federation](/docs/v1.10/features/query-federation): Learn how to use federated SQL queries in Spice.ai Open Source - [Search Functionality](/docs/v1.10/features/search): Learn how Spice can search across datasets using database-native and vector-search methods. - [Full-Text Search](/docs/v1.10/features/search/full-text): Learn how Spice can perform full text search - [Vector-Based Search](/docs/v1.10/features/search/vector-search): Learn how Spice can perform searches using vector-based methods. - [Semantic Model](/docs/v1.10/features/semantic-model): Learn how to define and use semantic data models with Spice. - [Web Search](/docs/v1.10/features/web-search): Learn how Spice can perform web search - [Getting started with Spice.ai OSS](/docs/v1.10/getting-started): Get started with Spice in 5 minutes - [Community Data](/docs/v1.10/getting-started/spiceai): Connect to the Spice.ai Cloud Platform to access community datasets. - [Spicepods](/docs/v1.10/getting-started/spicepods): An introduction to Spicepods - [Telemetry](/docs/v1.10/getting-started/telemetry): Learn how Spice AI uses anonymous telemetry. - [Spice.ai OSS Installation](/docs/v1.10/installation): Instructions for installing Spice.ai OSS - [Intelligent Applications](/docs/v1.10/intelligent-applications): Building intelligent data and AI-driven applications with Spice.ai - [Monitoring](/docs/v1.10/monitoring): Monitoring Spice.ai deployments - [Datadog](/docs/v1.10/monitoring/datadog): Monitoring Spice with Datadog - [Grafana & Prometheus](/docs/v1.10/monitoring/grafana): Monitoring Spice instances with Grafana & Prometheus - [Zipkin Integration](/docs/v1.10/monitoring/zipkin): Learn how to integrate Spice with Zipkin tracing. - [Spice.ai OSS Reference Docs](/docs/v1.10/reference): Reference documentation on the Spice API, CLI and Pod manifest syntax. - [Cron Schedules](/docs/v1.10/reference/cron): The Runtime supports cron expressions with optional seconds, like /10 which evaluates to every 10th second (10, 20, 30, etc). - [Data Types Reference](/docs/v1.10/reference/datatypes) - [Accelerator Data Types](/docs/v1.10/reference/datatypes/accelerators): Spice adheres to Apache Arrow data types. Data accelerators do not support all Arrow data types. The table below outlines the data type compatibility for each accelerator, and datatype used within the accelerator. - [Object Store Data Types](/docs/v1.10/reference/datatypes/object_store): Spice adheres to Apache Arrow data types. The table below lists the types of supported file type from object stores and their corresponding Apache Arrow type mappings in Spice. - [Duration](/docs/v1.10/reference/duration): Durations are represented as integers with a time unit suffix. - [File Formats](/docs/v1.10/reference/file_format): Spice currently supports CSV, JSON, and Parquet data file-formats for data connectors that can read files from a file system or cloud object storage (i.e. s3//, file://, etc.). Support for Iceberg and other file-formats are on the roadmap. - [Managing Memory Usage](/docs/v1.10/reference/memory): Guidelines and best practices for managing memory usage and optimizing performance in Spice.ai Open Source deployments. - [Models Grade Report](/docs/v1.10/reference/models): Spice AI graded Large-Language-Model (LLM) evaluation report - [YAML syntax for Spicepod manifests](/docs/v1.10/reference/spicepod): Detailed documentation on the Spicepod manifest syntax (spicepod.yaml) - [catalogs](/docs/v1.10/reference/spicepod/catalogs): Catalogs YAML reference - [Datasets](/docs/v1.10/reference/spicepod/datasets): Datasets YAML reference - [Embeddings](/docs/v1.10/reference/spicepod/embeddings): Embeddings YAML reference - [evals](/docs/v1.10/reference/spicepod/evals): Evaluations YAML reference - [Reserved Keywords](/docs/v1.10/reference/spicepod/keywords): Reserved keywords for datasets - [Models](/docs/v1.10/reference/spicepod/models): Models YAML reference - [Runtime](/docs/v1.10/reference/spicepod/runtime): Runtime YAML reference - [Tools (Function Calling)](/docs/v1.10/reference/spicepod/tools): Tools YAML reference - [Views](/docs/v1.10/reference/spicepod/views): Views YAML reference - [Workers](/docs/v1.10/reference/spicepod/workers): Workers YAML reference - [SQL Reference](/docs/v1.10/reference/sql): This section provides a comprehensive reference for SQL support in Spice.ai, including syntax, data types, operators, functions, and system features. The reference is organized by topic for ease of navigation. - [Aggregate Functions](/docs/v1.10/reference/sql/aggregate_functions): Spice is built on Apache DataFusion and uses the PostgreSQL dialect, even when querying datasources with different SQL dialects. Note, when using a data accelerator like DuckDB, function support is specific to each acceleration engine, and not all functions are supported by all acceleration engines. - [AI Functions](/docs/v1.10/reference/sql/ai): AI functions in Spice provide direct integration with large language models (LLMs) and embedding models within SQL queries. These functions process text through configured model providers and return generated responses or vector embeddings. - [DML (Data Manipulation Language)](/docs/v1.10/reference/sql/dml): Data Manipulation Language (DML) statements for inserting and modifying data in Spice. - [Explain](/docs/v1.10/reference/sql/explain): Spice is built on Apache DataFusion and uses the PostgreSQL dialect, even when querying datasources with different SQL dialects. - [Information Schema](/docs/v1.10/reference/sql/information_schema): Spice is built on Apache DataFusion and uses the PostgreSQL dialect, even when querying datasources with different SQL dialects. - [JSON Functions and Operators](/docs/v1.10/reference/sql/json): Reference for JSON functions and operators in Spice SQL - [Operators](/docs/v1.10/reference/sql/operators): Spice is built on Apache DataFusion and uses the PostgreSQL dialect, even when querying datasources with different SQL dialects. - [Prepared Statements](/docs/v1.10/reference/sql/prepared_statements): Spice is built on Apache DataFusion and uses the PostgreSQL dialect, even when querying datasources with different SQL dialects. - [Scalar Functions](/docs/v1.10/reference/sql/scalar_functions): Spice is built on Apache DataFusion and uses the PostgreSQL dialect, even when querying datasources with different SQL dialects. Note, when using a data accelerator like DuckDB, function support is specific to each acceleration engine, and not all functions are supported by all acceleration engines. - [Search in SQL](/docs/v1.10/reference/sql/search): Reference for search functions and filtering in Spice SQL. - [SELECT](/docs/v1.10/reference/sql/select): Spice is built on Apache DataFusion and uses the PostgreSQL dialect, even when querying datasources with different SQL dialects. - [Subqueries](/docs/v1.10/reference/sql/subqueries): Spice is built on Apache DataFusion and uses the PostgreSQL dialect, even when querying datasources with different SQL dialects. - [Spice.ai Open Source System Requirements](/docs/v1.10/reference/system_requirements): System requirements for running Spice.ai Open Source - [Task History](/docs/v1.10/reference/task_history): The Spice runtime stores information about completed tasks in the spice.runtime.task_history table. Each task represents a single unit of execution within the runtime, such as a SQL query or an AI chat completion, and is represented by a unique span. - [SDKs](/docs/v1.10/sdks): Connect to spice, using official Spice SDKs - [Dotnet SDK for Spice.ai](/docs/v1.10/sdks/dotnet): Connect to Spice using Spice Dotnet SDK - [Go SDK](/docs/v1.10/sdks/golang): Connect to spice using spice go SDK - [Java SDK](/docs/v1.10/sdks/java): Connect to Spice using Spice Java SDK - [JavaScript SDK](/docs/v1.10/sdks/javascript): Connect to spice using Spice.js SDK - [Python SDK](/docs/v1.10/sdks/python): Connect to spice using spice python SDK - [Rust SDK](/docs/v1.10/sdks/rust): Connect to spice using spice rust SDK - [Troubleshooting Spice](/docs/v1.10/troubleshooting): Review and debug runtime tasks, logs, and diagnostic steps in Spice. - [Spice.ai Use Cases](/docs/v1.10/use-cases): Use cases for Spice.ai' - [AI Applications and Agents](/docs/v1.10/use-cases/ai): AI Applications and Agents - [Agentic AI Applications and Agents](/docs/v1.10/use-cases/ai/agentic-apps): Spice.ai builds intelligent, autonomous agents for SaaS applications, enabling context-aware automation and decision-making. - [Edge-Enabled AI Applications and Agents](/docs/v1.10/use-cases/ai/edge-ai): Spice.ai deploys AI applications and agents across cloud and edge for low-latency decisions in security IoT use cases. - [Federated MCP Client for Distributed Tool Ecosystems](/docs/v1.10/use-cases/ai/federated-mcp-server): Spice.ai federates external MCP servers for scalable, tool-driven AI applications in security, enhancing threat analysis. - [Object-Store Based SQL Query, Search, and LLM Inference Engine](/docs/v1.10/use-cases/ai/object-store-ai-engine): Spice.ai enables SQL queries, hybrid search, and LLM inference on object-store data for security applications, delivering real-time insights. - [Real-Time Decision-Making for Intelligent Applications](/docs/v1.10/use-cases/ai/real-time-decision-making): Spice.ai powers instant, context-aware decisions for applications like security recommendations by grounding AI in federated, low-latency datasets. - [Tool-Augmented AI with Model Context Protocol Server](/docs/v1.10/use-cases/ai/tool-calling-ai): Spice.ai extends AI with custom tools via MCP server in finserv, integrating domain-specific APIs for enhanced functionality. - [Data Federation, Acceleration, and SQL Query](/docs/v1.10/use-cases/data): Data Federation, Acceleration, and SQL Query - [Application Resilience and Performance Optimization](/docs/v1.10/use-cases/data/application-resilence-and-acceleration): Spice.ai colocates dynamic data with SaaS applications as a database CDN, ensuring resilience and high performance. - [Data Mesh for Unified Data Access](/docs/v1.10/use-cases/data/data-mesh): Spice.ai enables unified data access across disparate sources for health-tech applications, fostering a data mesh architecture. - [Database CDN for Enhanced Performance](/docs/v1.10/use-cases/data/database-cdn): Spice.ai acts as a database CDN for SaaS applications, caching dynamic data to ensure high performance and resilience. - [ETL-free Workflows and Data Migrations](/docs/v1.10/use-cases/data/etl-free-workflows): Spice.ai enables data migrations and workflows without ETL by federating legacy and modern systems for seamless transitions. - [Object-Store Data Engine](/docs/v1.10/use-cases/data/object-store-data-engine): Spice.ai federates, accelerates, and queries object-store data for finserv applications, enabling real-time data access without centralized warehouses. - [Reverse-ETL for Operational Workflows](/docs/v1.10/use-cases/data/reverse-etl): Spice.ai serves enriched data from warehouses to operational systems for real-time actions, eliminating complex ETL pipelines. - [Retrieval-Augmented-Generation (RAG)](/docs/v1.10/use-cases/rag): Retrieval-Augmented-Generation (RAG) - [Spice for Retrieval-Augmented-Generation (RAG)](/docs/v1.10/use-cases/rag/applications): Use Spice for Retrieval-Augmented-Generation (RAG) - [Retrieval-Augmented Generation for AI-Powered Reporting](/docs/v1.10/use-cases/rag/reporting): Spice.ai generates dynamic, context-aware AI-driven reports for operational insights in health-tech, ensuring compliance and precision. - [Search & Retrieval](/docs/v1.10/use-cases/search): Search & Retrieval - [Simplifying Real-Time Data Collection and Search](/docs/v1.10/use-cases/search/data-collection-and-search): Spice.ai processes streaming and static data with integrated search for real-time insights, focusing on application logic. - [Enterprise Search and Retrieval](/docs/v1.10/use-cases/search/enterprise-search): Spice.ai powers semantic and precise search for finserv knowledge bases with hybrid vector and keyword capabilities. - [Object-Store Native Search Engine](/docs/v1.10/use-cases/search/object-store-search-engine): Spice.ai powers a cloud-native embedded search engine on object-store data for security applications, enabling semantic and precise search. ### v1.11 Spice is an open-source SQL query and AI compute engine, written in Rust, for data-driven applications and AI agents. Learn about data federation, acceleration, RAG, and building intelligent apps. - [Spice.ai Open Source](/docs/v1.11): Spice is an open-source SQL query and AI compute engine, written in Rust, for data-driven applications and AI agents. Learn about data federation, acceleration, RAG, and building intelligent apps. - [Tags](/docs/v1.11/tags) - [One doc tagged with "Acknowledgements"](/docs/v1.11/tags/acknowledgements): Project acknowledgements, credits, and attributions. - [2 docs tagged with "ADBC"](/docs/v1.11/tags/adbc): Arrow Database Connectivity driver configuration and usage. - [4 docs tagged with "API"](/docs/v1.11/tags/api): HTTP, Arrow Flight SQL, ODBC, JDBC, and ADBC API reference. - [One doc tagged with "Arrow"](/docs/v1.11/tags/arrow): Apache Arrow columnar data format integration. - [One doc tagged with "Arrow Flight SQL"](/docs/v1.11/tags/arrow-flight-sql): Arrow Flight SQL protocol implementation and configuration. - [One doc tagged with "Auth"](/docs/v1.11/tags/auth): Authentication and authorization mechanisms. - [One doc tagged with "Authentication"](/docs/v1.11/tags/authentication): User authentication methods and security protocols. - [3 docs tagged with "Azure"](/docs/v1.11/tags/azure): Microsoft Azure cloud services and integrations. - [One doc tagged with "Blob Storage"](/docs/v1.11/tags/blob-storage): Object storage services and blob data access. - [One doc tagged with "Caching"](/docs/v1.11/tags/caching): Data caching strategies and performance optimization. - [5 docs tagged with "Catalogs"](/docs/v1.11/tags/catalogs): Data catalog connectors and metadata management. - [One doc tagged with "Cayenne"](/docs/v1.11/tags/cayenne): Cayenne (Vortex) data accelerator built on Vortex columnar format. - [2 docs tagged with "CLI"](/docs/v1.11/tags/cli): Spice command-line interface commands and usage. - [5 docs tagged with "Component Metrics"](/docs/v1.11/tags/component-metrics): Runtime component performance metrics and monitoring. - [One doc tagged with "Components"](/docs/v1.11/tags/components): Runtime components including catalogs, data connectors, and models. - [2 docs tagged with "Configuration"](/docs/v1.11/tags/configuration): System configuration files and runtime settings. - [One doc tagged with "C#"](/docs/v1.11/tags/csharp): C# programming language topics. - [2 docs tagged with "Data Accelerators"](/docs/v1.11/tags/data-accelerators): Data acceleration engines for high-performance query execution. - [20 docs tagged with "Data Connectors"](/docs/v1.11/tags/data-connectors): Data source connectors and integration patterns. - [One doc tagged with "Data Lake"](/docs/v1.11/tags/data-lake): Data lake architectures and storage solutions. - [2 docs tagged with "Databricks"](/docs/v1.11/tags/databricks): Databricks platform integration and Unity Catalog support. - [2 docs tagged with "Datasets"](/docs/v1.11/tags/datasets): Dataset definitions and data source configurations. - [One doc tagged with "Debezium"](/docs/v1.11/tags/debezium): Debezium change data capture integration. - [One doc tagged with "Debugging"](/docs/v1.11/tags/debugging): Debugging techniques and troubleshooting tools. - [2 docs tagged with "Delta Lake"](/docs/v1.11/tags/delta-lake): Delta Lake open table format support. - [One doc tagged with "Dependencies"](/docs/v1.11/tags/dependencies): Third-party dependencies and software requirements. - [3 docs tagged with "Deployment"](/docs/v1.11/tags/deployment): Production deployment using Docker and Kubernetes. - [2 docs tagged with "Docker"](/docs/v1.11/tags/docker): Docker containerization and deployment configurations. - [One doc tagged with ".NET"](/docs/v1.11/tags/dotnet): .NET framework topics. - [One doc tagged with "DynamoDB"](/docs/v1.11/tags/dynamodb): Amazon DynamoDB NoSQL database integration. - [3 docs tagged with "Embeddings"](/docs/v1.11/tags/embeddings): Vector embeddings and semantic similarity operations. - [One doc tagged with "Evaluation"](/docs/v1.11/tags/evaluation): Model evaluation metrics and assessment frameworks. - [5 docs tagged with "Features"](/docs/v1.11/tags/features): Core platform features including acceleration, caching, and search. - [One doc tagged with "Federation"](/docs/v1.11/tags/federation): Cross-database queries and federated data access. - [One doc tagged with "Getting Started"](/docs/v1.11/tags/getting-started): Installation guides and quickstart tutorials. - [One doc tagged with "GitHub"](/docs/v1.11/tags/github): GitHub repository data connector and integration. - [2 docs tagged with "Glue"](/docs/v1.11/tags/glue): AWS Glue ETL service and data catalog integration. - [One doc tagged with "Go"](/docs/v1.11/tags/go): Go programming language topics. - [One doc tagged with "Golang"](/docs/v1.11/tags/golang): Go (Golang) programming language topics. - [2 docs tagged with "Iceberg"](/docs/v1.11/tags/iceberg): Apache Iceberg open table format support. - [One doc tagged with "In-Memory"](/docs/v1.11/tags/in-memory): In-memory data processing and temporary storage. - [One doc tagged with "Integration"](/docs/v1.11/tags/integration): Third-party system integrations and connectivity patterns. - [One doc tagged with "Java"](/docs/v1.11/tags/java): Java programming language topics. - [One doc tagged with "JavaScript"](/docs/v1.11/tags/javascript): JavaScript programming language topics. - [One doc tagged with "JDBC"](/docs/v1.11/tags/jdbc): Java Database Connectivity driver configuration. - [One doc tagged with "Kafka"](/docs/v1.11/tags/kafka): Apache Kafka event streaming platform integration. - [2 docs tagged with "Kubernetes"](/docs/v1.11/tags/kubernetes): Kubernetes orchestration and secret management. - [One doc tagged with "libSQL"](/docs/v1.11/tags/libsql): libSQL database topics. - [One doc tagged with "Logging"](/docs/v1.11/tags/logging): Application logging configuration and log management. - [One doc tagged with "Login"](/docs/v1.11/tags/login): User login processes and session management. - [One doc tagged with "Manifest"](/docs/v1.11/tags/manifest): Configuration manifest files and schema definitions. - [One doc tagged with "MCP"](/docs/v1.11/tags/mcp): Model Context Protocol for AI tool integration. - [2 docs tagged with "Memory"](/docs/v1.11/tags/memory): In-memory data connectors and volatile storage. - [13 docs tagged with "Models"](/docs/v1.11/tags/models): Machine learning models and AI inference engines. - [One doc tagged with "MongoDB"](/docs/v1.11/tags/mongodb): MongoDB NoSQL document database integration. - [One doc tagged with "MySQL"](/docs/v1.11/tags/mysql): MySQL relational database integration. - [One doc tagged with "Node.js"](/docs/v1.11/tags/nodejs): Node.js runtime environment topics. - [One doc tagged with "NoSQL"](/docs/v1.11/tags/nosql): NoSQL database systems and document stores. - [One doc tagged with "Observability"](/docs/v1.11/tags/observability): Monitoring, tracing, and metrics for system visibility. - [One doc tagged with "ODBC"](/docs/v1.11/tags/odbc): Open Database Connectivity driver configuration. - [One doc tagged with "Open Source"](/docs/v1.11/tags/open-source): Open source licenses and community contributions. - [One doc tagged with "OpenAI"](/docs/v1.11/tags/openai): OpenAI API integration and GPT model access. - [One doc tagged with "Oracle"](/docs/v1.11/tags/oracle): Documentation related to Oracle database integration. - [2 docs tagged with "Overrides"](/docs/v1.11/tags/overrides): Parameter overrides and configuration customization. - [2 docs tagged with "Overview"](/docs/v1.11/tags/overview): High-level component and feature overviews. - [2 docs tagged with "Parameters"](/docs/v1.11/tags/parameters): Configuration parameters and runtime options. - [2 docs tagged with "Performance"](/docs/v1.11/tags/performance): Performance optimization and benchmarking. - [One doc tagged with "Persistence"](/docs/v1.11/tags/persistence): Data persistence and durable storage mechanisms. - [One doc tagged with "Python"](/docs/v1.11/tags/python): Python programming language topics. - [3 docs tagged with "Query"](/docs/v1.11/tags/query): SQL query execution, parameterized queries, and prepared statements. - [4 docs tagged with "Reference"](/docs/v1.11/tags/reference): API reference, CLI commands, and configuration syntax. - [One doc tagged with "Relational"](/docs/v1.11/tags/relational): Relational database systems and SQL operations. - [One doc tagged with "Runtime"](/docs/v1.11/tags/runtime): Runtime behavior and execution environment. - [One doc tagged with "Rust"](/docs/v1.11/tags/rust): Rust programming language topics. - [One doc tagged with "S3"](/docs/v1.11/tags/s3): Amazon S3 object storage integration. - [One doc tagged with "S3 Express"](/docs/v1.11/tags/s3-express): Amazon S3 Express One Zone storage. - [One doc tagged with "Sandbox"](/docs/v1.11/tags/sandbox): Sandbox environments and isolated testing. - [One doc tagged with "ScyllaDB"](/docs/v1.11/tags/scylladb): ScyllaDB database integration. - [6 docs tagged with "SDK"](/docs/v1.11/tags/sdk): Software Development Kit topics and usage. - [5 docs tagged with "Search"](/docs/v1.11/tags/search): Vector search, semantic search, and ranking capabilities. - [2 docs tagged with "Security"](/docs/v1.11/tags/security): Security features and data protection mechanisms. - [2 docs tagged with "SpiceAI"](/docs/v1.11/tags/spiceai): SpiceAI cloud platform and managed services. - [5 docs tagged with "Spicepod"](/docs/v1.11/tags/spicepod): Spicepod configuration files, manifest syntax, and package management. - [5 docs tagged with "SQL"](/docs/v1.11/tags/sql): SQL query language support and database operations. - [3 docs tagged with "Tools"](/docs/v1.11/tags/tools): Development tools and utility integrations. - [2 docs tagged with "Tracing"](/docs/v1.11/tags/tracing): Distributed tracing and request monitoring. - [One doc tagged with "Troubleshooting"](/docs/v1.11/tags/troubleshooting): Problem diagnosis and resolution guides. - [One doc tagged with "Turso"](/docs/v1.11/tags/turso): Turso data accelerator integration. - [One doc tagged with "Unity Catalog"](/docs/v1.11/tags/unity-catalog): Databricks Unity Catalog data governance integration. - [One doc tagged with "Views"](/docs/v1.11/tags/views): Virtual views and data transformation layers. - [One doc tagged with "Vortex"](/docs/v1.11/tags/vortex): Vortex columnar file format and storage engine. - [6 docs tagged with "Write"](/docs/v1.11/tags/write): Data connectors and catalogs that support write operations. - [One doc tagged with "YAML"](/docs/v1.11/tags/yaml): YAML configuration syntax and file formats. - [One doc tagged with "Zipkin"](/docs/v1.11/tags/zipkin): Zipkin distributed tracing system integration. - [Open Source Acknowledgements](/docs/v1.11/acknowledgements): Spice AI acknowledges the following open source projects for making this project possible: - [Spice.ai API Reference](/docs/v1.11/api): Spice.ai API reference including HTTP REST API, Arrow Flight SQL, JDBC, ODBC, ADBC connectors, authentication, and TLS configuration. - [ADBC: Arrow Database Connectivity](/docs/v1.11/api/adbc): ADBC API Documentation - [Arrow Flight SQL API](/docs/v1.11/api/arrow-flight-sql): Query Spice using JDBC/ODBC/ADBC - [Authentication](/docs/v1.11/api/auth): Authentication documentation - [Generate Package](/docs/v1.11/api/HTTP/generate-package): This endpoint generates a zip package from a specified GitHub source. - [List Catalogs](/docs/v1.11/api/HTTP/get-catalogs): List Catalogs - [Get Iceberg API config](/docs/v1.11/api/HTTP/get-config): This endpoint returns the Iceberg Catalog API configuration, including details about overrides, defaults, and available endpoints. - [List Datasets](/docs/v1.11/api/HTTP/get-datasets): This endpoint returns a list of configured datasets. The response can be formatted as **JSON** or **CSV**, - [List Iceberg namespaces](/docs/v1.11/api/HTTP/get-iceberg-namespaces): This endpoint retrieves namespaces available in the Iceberg catalog. - [ML Prediction](/docs/v1.11/api/HTTP/get-model-predict): Make a ML prediction using a specific model. - [List Models](/docs/v1.11/api/HTTP/get-models): List all models, both machine learning and language models, available in the runtime. - [List Spicepods](/docs/v1.11/api/HTTP/get-spicepods): Get a list of spicepods and their summary details. - [Check Runtime Status](/docs/v1.11/api/HTTP/get-status): Return the status of all connections (http, flight, metrics, opentelemetry) in the runtime. - [Check Namespace exists](/docs/v1.11/api/HTTP/head-namespace): This endpoint returns a 200 OK response if the namespace exists, otherwise it returns a 404 Not Found response. - [List Evals](/docs/v1.11/api/HTTP/list): Return all evals available to run in the runtime. - [Send message to MCP server](/docs/v1.11/api/HTTP/mcp-event): Send message to the MCP endoint, for a given session. - [Establish an MCP SSE Connection](/docs/v1.11/api/HTTP/operation-id): Initiates a Server-Sent Events (SSE) connection using the Model Context Protocol (MCP) to interact with Spice tools. - [Update Refresh SQL](/docs/v1.11/api/HTTP/patch-dataset-acceleration): Update the refresh SQL for a dataset's acceleration. - [Run Tool](/docs/v1.11/api/HTTP/post): The request body and JSON response formats match the tool’s specification. - [Batch ML Predictions](/docs/v1.11/api/HTTP/post-batch-predict): Perform a batch of ML predictions, using multiple models, in one request. This is useful for ensembling or A/B testing different models. - [Create Chat Completion](/docs/v1.11/api/HTTP/post-chat-completions): Creates a model response for the given chat conversation. - [Refresh Dataset](/docs/v1.11/api/HTTP/post-dataset-refresh): Trigger an on-demand refresh for an accelerated dataset. - [Create Embeddings](/docs/v1.11/api/HTTP/post-embeddings): Creates an embedding vector representing the input text. - [Run Eval](/docs/v1.11/api/HTTP/post-eval): Evaluate a model against a eval spice specification - [Text-to-SQL (NSQL)](/docs/v1.11/api/HTTP/post-nsql): Generate and optionally execute a natural-language text-to-SQL (NSQL) query. - [Search](/docs/v1.11/api/HTTP/post-search): Perform a vector similarity search (VSS) operation on a dataset. - [SQL Query](/docs/v1.11/api/HTTP/post-sql): Execute a SQL query and return the results. - [Check Readiness](/docs/v1.11/api/HTTP/ready): Check the runtime status of all the components of the runtime. If the service is ready, it returns an HTTP 200 status with the message 'ready'. If not, it returns a 503 status with the message 'not ready'. - [runtime](/docs/v1.11/api/HTTP/runtime): The spiced runtime - [JDBC: Java Database Connectivity](/docs/v1.11/api/jdbc): JDBC API Documentation - [ODBC: Open Database Connectivity](/docs/v1.11/api/odbc): ODBC API Documentation - [API Overview](/docs/v1.11/api/overview): Spice.ai API overview, including SQL query interfaces, OpenAI-compatible endpoints, Iceberg catalog REST APIs, and the Model Context Protocol (MCP) for integrating external tools. - [TLS: Transport Layer Security](/docs/v1.11/api/tls): Encryption in transit with TLS documentation - [Spice.ai CLI Reference](/docs/v1.11/cli): Complete CLI reference for Spice.ai including commands to create, manage Spicepods, run queries, and interact with the Spice runtime. - [Spice.ai OSS CLI command reference](/docs/v1.11/cli/reference): Spice CLI command reference - [add](/docs/v1.11/cli/reference/add): Add a Spicepod to the project. - [catalogs](/docs/v1.11/cli/reference/catalogs): List catalogs currently loaded by the Spice runtime. - [chat](/docs/v1.11/cli/reference/chat): spice chat CLI documentation - [Completion](/docs/v1.11/cli/reference/completion): Generate the autocompletion script for spice for the specified shell. - [connect](/docs/v1.11/cli/reference/connect): Connect to an app on the Spice.ai Cloud Platform. - [dataset](/docs/v1.11/cli/reference/dataset): Configure a Spice dataset. - [datasets](/docs/v1.11/cli/reference/datasets): Lists datasets loaded by the Spice runtime - [init](/docs/v1.11/cli/reference/init): Initialize Spice app in the current working directory. - [install](/docs/v1.11/cli/reference/install): Download and install the latest version of the Spice runtime. - [login](/docs/v1.11/cli/reference/login): Login to the Spice.ai Platform, or other services with sub-commands. - [models](/docs/v1.11/cli/reference/models): Lists models loaded by the Spice runtime - [pods](/docs/v1.11/cli/reference/pods): Lists Spicepods loaded by the Spice runtime - [query](/docs/v1.11/cli/reference/query): Submit an async query or start an interactive async query REPL against the Spice runtime's distributed query engine. - [refresh](/docs/v1.11/cli/reference/refresh): Refreshes an accelerated dataset loaded by the Spice runtime - [run](/docs/v1.11/cli/reference/run): Run Spice - starts the Spice runtime, installing if necessary. - [search](/docs/v1.11/cli/reference/search): Performs embeddings-based searches across search configured datasets. Note: Search requires the ai feature to be installed. - [sql](/docs/v1.11/cli/reference/sql): Start an interactive SQL query session against the Spice runtime - [status](/docs/v1.11/cli/reference/status): Spice runtime status - [trace](/docs/v1.11/cli/reference/trace): Provides a user-friendly trace stack into an operation that occurred in Spice. This command retrieves and displays task execution traces from the runtime.task_history table. - [upgrade](/docs/v1.11/cli/reference/upgrade): Upgrades the Spice CLI & Runtime to the latest release - [version](/docs/v1.11/cli/reference/version): Outputs the current version of the Spice CLI and runtime - [Configuring Trace Levels](/docs/v1.11/cli/tracing): Configuring Spice.ai OSS trace output verbosity levels - [Clients and Tools](/docs/v1.11/clients): Client and tools for connecting to Spice - [DBeaver](/docs/v1.11/clients/dbeaver): Configure DBeaver to query Spice via JDBC - [JetBrains DataGrip](/docs/v1.11/clients/jetbrains-datagrip): Configure JetBrains Datagrip to query Spice via JDBC - [Microsoft Power BI Connector](/docs/v1.11/clients/powerbi): Use Microsoft Power BI to access, visualize and analyze Spice datasets. - [Apache Superset](/docs/v1.11/clients/superset): Use Apache Superset to query and visualize datasets loaded in Spice. - [Tableau](/docs/v1.11/clients/tableau): Use Tableau to to access, visualise and analyse datasets loaded in Spice. - [How Spice Compares](/docs/v1.11/comparison): Compare Spice.ai with data platforms (Databricks, Snowflake), query engines (Trino, Dremio, ClickHouse), vector databases (Turbopuffer, LanceDB), search engines (Elasticsearch), and AI frameworks (LangChain, LlamaIndex, Ollama). - [Spice.ai Runtime Components](/docs/v1.11/components): Configure Spice.ai runtime components including data connectors, data accelerators, catalog connectors, model providers, embedding models, and secret stores. - [Catalog Connectors](/docs/v1.11/components/catalogs): Connect to external catalog providers like Unity Catalog, Databricks, Iceberg, and AWS Glue for federated SQL query in Spice. - [Databricks Catalog Connector](/docs/v1.11/components/catalogs/databricks): Connect to a Databricks Unity Catalog provider. - [Glue Catalog Connector](/docs/v1.11/components/catalogs/glue): Connect to an AWS Glue Data Catalog. - [Iceberg Catalog Connector](/docs/v1.11/components/catalogs/iceberg): Connect to an Iceberg catalog provider. - [Spice.ai Catalog Connector](/docs/v1.11/components/catalogs/spiceai): Connect to the Spice.ai built-in catalog. - [Unity Catalog Catalog Connector](/docs/v1.11/components/catalogs/unity-catalog): Connect to a Unity Catalog provider. - [Data Accelerators](/docs/v1.11/components/data-accelerators): Data acceleration engines for local materialization and query acceleration in Spice - [In-Memory Arrow Data Accelerator](/docs/v1.11/components/data-accelerators/arrow): In-Memory Arrow Data Accelerator Documentation - [Spice Cayenne Data Accelerator](/docs/v1.11/components/data-accelerators/cayenne): Spice Cayenne Data Accelerator (Vortex) Documentation - [DuckDB Data Accelerator](/docs/v1.11/components/data-accelerators/duckdb): DuckDB Data Accelerator Documentation - [PostgreSQL Data Accelerator](/docs/v1.11/components/data-accelerators/postgres): PostgreSQL Data Accelerator Documentation - [SQLite Data Accelerator](/docs/v1.11/components/data-accelerators/sqlite): SQLite Data Accelerator Documentation - [Turso Data Accelerator](/docs/v1.11/components/data-accelerators/turso): Turso (libSQL) Data Accelerator Documentation - [Data Connectors](/docs/v1.11/components/data-connectors): Learn how to use Data Connector to query external data. - [Azure BlobFS Data Connector](/docs/v1.11/components/data-connectors/abfs): Azure BlobFS Data Connector Documentation - [ClickHouse Data Connector](/docs/v1.11/components/data-connectors/clickhouse): ClickHouse Data Connector Documentation - [Databricks Data Connector](/docs/v1.11/components/data-connectors/databricks): Databricks Data Connector Documentation - [Debezium Data Connector](/docs/v1.11/components/data-connectors/debezium): Debezium Data Connector Documentation - [Delta Lake Data Connector](/docs/v1.11/components/data-connectors/delta-lake): Delta Lake Data Connector Documentation - [Dremio Data Connector](/docs/v1.11/components/data-connectors/dremio): Dremio Data Connector Documentation - [DuckDB Data Connector](/docs/v1.11/components/data-connectors/duckdb): DuckDB Data Connector Documentation - [DynamoDB Data Connector](/docs/v1.11/components/data-connectors/dynamodb): DynamoDB Data Connector Documentation - [File Data Connector](/docs/v1.11/components/data-connectors/file): File Data Connector Documentation - [Flight SQL Data Connector](/docs/v1.11/components/data-connectors/flightsql): Flight SQL Data Connector Documentation - [FTP/SFTP Data Connector](/docs/v1.11/components/data-connectors/ftp): FTP/SFTP Data Connector Documentation - [GitHub Data Connector](/docs/v1.11/components/data-connectors/github): GitHub Data Connector Documentation - [Glue Data Connector](/docs/v1.11/components/data-connectors/glue): Glue Data Connector Documentation - [GraphQL Data Connector](/docs/v1.11/components/data-connectors/graphql): GraphQL Data Connector Documentation - [HTTP(s) Data Connector](/docs/v1.11/components/data-connectors/https): HTTP(s) Data Connector Documentation - [Iceberg Data Connector](/docs/v1.11/components/data-connectors/iceberg): Connect to and query Apache Iceberg tables - [IMAP Data Connector](/docs/v1.11/components/data-connectors/imap): IMAP Data Connector Documentation - [Kafka Data Connector](/docs/v1.11/components/data-connectors/kafka): Kafka Data Connector Documentation - [Localpod Data Connector](/docs/v1.11/components/data-connectors/localpod): Localpod Data Connector Documentation - [Memory Data Connector](/docs/v1.11/components/data-connectors/memory): Memory Data Connector Documentation - [MongoDB Data Connector](/docs/v1.11/components/data-connectors/mongodb): MongoDB Data Connector Documentation - [Microsoft SQL Server Data Connector](/docs/v1.11/components/data-connectors/mssql): Microsoft SQL Server Data Connector - [MySQL Data Connector](/docs/v1.11/components/data-connectors/mysql): MySQL Data Connector Documentation - [NFS Data Connector](/docs/v1.11/components/data-connectors/nfs): NFS Data Connector Documentation - [Pull the latest official Spice image](/docs/v1.11/components/data-connectors/odbc): ODBC Data Connector Documentation - [Oracle Data Connector](/docs/v1.11/components/data-connectors/oracle): Oracle Data Connector Documentation - [PostgreSQL Data Connector](/docs/v1.11/components/data-connectors/postgres): PostgreSQL Data Connector Documentation - [Amazon Redshift Data Connector](/docs/v1.11/components/data-connectors/redshift): Connect to Amazon Redshift using the PostgreSQL connector in Spice. - [S3 Data Connector](/docs/v1.11/components/data-connectors/s3): S3 Data Connector Documentation - [ScyllaDB Data Connector](/docs/v1.11/components/data-connectors/scylladb): ScyllaDB Data Connector Documentation - [SharePoint Data Connector](/docs/v1.11/components/data-connectors/sharepoint): SharePoint Data Connector Documentation - [SMB Data Connector](/docs/v1.11/components/data-connectors/smb): SMB Data Connector Documentation - [Snowflake Data Connector](/docs/v1.11/components/data-connectors/snowflake): Snowflake Data Connector Documentation - [Apache Spark Connector](/docs/v1.11/components/data-connectors/spark): Apache Spark Connector Documentation - [Spice.ai Data Connector](/docs/v1.11/components/data-connectors/spiceai): Spice.ai Data Connector Documentation - [Embedding Models](/docs/v1.11/components/embeddings): Describes how embedding models are used in Spice to convert text into numerical vectors for machine learning and search applications. - [Azure OpenAI Embedding Models](/docs/v1.11/components/embeddings/azure): To use an embedding model hosted on Azure OpenAI, specify the azure path in the from field and the following parameters from the Azure OpenAI Model Deployment page: - [Amazon Bedrock Model Provider](/docs/v1.11/components/embeddings/bedrock): Instructions for using Amazon Bedrock embedding models - [Databricks Model Provider](/docs/v1.11/components/embeddings/databricks): Instructions for using Databricks Mosaic AI Models - [Google AI Embedding Models](/docs/v1.11/components/embeddings/google): To use a hosted Google AI embedding model, specify the google path in the from field of your configuration. - [HuggingFace Text Embedding Models](/docs/v1.11/components/embeddings/huggingface): To use an embedding model from HuggingFace with Spice, specify the huggingface path in the from field of your configuration. The model and its related files will be automatically downloaded, loaded, and served locally by Spice. - [Local Filesystem Embedding Models](/docs/v1.11/components/embeddings/local): Embedding models can be run with files stored locally. This method is useful for using models that are not hosted on remote services. - [Model2Vec Embedding Models](/docs/v1.11/components/embeddings/model2vec): Model2Vec embedding models help generate efficient static word embeddings from sentence transformer models for use in Spice, supporting local and Hugging Face sources with options for private models and performance tuning. - [OpenAI (or Compatible) Embedding Models](/docs/v1.11/components/embeddings/openai): To use a hosted OpenAI (or compatible) embedding model, specify the openai path in the from field of your configuration. - [Model Providers](/docs/v1.11/components/models): Overview of supported model providers for ML and LLMs in Spice. - [Anthropic Models](/docs/v1.11/components/models/anthropic): Instructions for using language models hosted on Anthropic with Spice. - [Azure OpenAI Models](/docs/v1.11/components/models/azure): Instructions for using Azure OpenAI models - [Amazon Bedrock Models](/docs/v1.11/components/models/bedrock): How to use Amazon Bedrock models with Spice. - [Databricks Model Provider](/docs/v1.11/components/models/databricks): Instructions for using Databricks Mosaic AI Models - [Filesystem Hosted Models](/docs/v1.11/components/models/filesystem): Instructions for using models hosted on a filesystem with Spice. - [Google AI Models](/docs/v1.11/components/models/google): Instructions for using language models hosted on Google AI with Spice. - [HuggingFace](/docs/v1.11/components/models/huggingface): Instructions for using machine learning models hosted on HuggingFace with Spice. - [OpenAI (or Compatible) Language Models](/docs/v1.11/components/models/openai): Instructions for using language models hosted on OpenAI or compatible services with Spice. - [Perplexity Models](/docs/v1.11/components/models/perplexity): Instructions for using language models hosted on Perplexity with Spice. - [Spice Cloud Platform](/docs/v1.11/components/models/spiceai): Instructions for using models hosted on the Spice Cloud Platform with Spice. - [xAI Models](/docs/v1.11/components/models/xai): Instructions for using xAI models - [Secret Stores](/docs/v1.11/components/secret-stores): Configure secret stores to manage sensitive data like passwords, tokens, and API keys. - [AWS Secrets Manager Secret Store](/docs/v1.11/components/secret-stores/aws-secrets-manager): AWS Secrets Manager Secret Store Documentation - [Environment Secret Store](/docs/v1.11/components/secret-stores/env): Environment Variables Secret Store Documentation - [Keyring Secret Store](/docs/v1.11/components/secret-stores/keyring): Keyring Secret Store Documentation - [Kubernetes Secret Store](/docs/v1.11/components/secret-stores/kubernetes): Kubernetes Secret Store Documentation - [LLM Tools (Function Calling)](/docs/v1.11/components/tools): Overview of supported LLM tools (function calling) and how to define new tools - [Model Context Protocol Tools](/docs/v1.11/components/tools/mcp): Spice integrates with tools and services using the Model Context Protocol (MCP). MCP tools can be configured to run internally or connect to external servers over HTTP using the Server-Sent Events (SSE) protocol. - [Web Search Tool](/docs/v1.11/components/tools/websearch): Configure web search tools for LLMs to search the internet using Perplexity and other search engines. - [Vector Engines](/docs/v1.11/components/vectors): Configure vector engines for efficient embedding storage and similarity search in Spice. - [Amazon S3 Vectors Engine](/docs/v1.11/components/vectors/s3_vectors): Amazon S3 Vectors Engine Documentation - [Views](/docs/v1.11/components/views): Documentation for defining Views in Spice - [Workers Overview](/docs/v1.11/components/workers): Detailed documentation for workers in the Spice runtime. - [Spice.ai Deployment Guide](/docs/v1.11/deployment): Deploy Spice.ai in your environment using Docker, Kubernetes, AWS, or the Spice Cloud Platform. Learn about sidecar, microservice, tiered, and cluster deployment architectures. - [Deployment Architectures](/docs/v1.11/deployment/architectures): Explore Spice deployment architectures including sidecar, microservice, tiered, sharded, and cluster configurations. - [Cluster-Based Deployment (Spice.ai Enterprise)](/docs/v1.11/deployment/architectures/cluster): Deploying Spice as a cluster - [Cloud Hosted](/docs/v1.11/deployment/architectures/hosted): Deploying Spice cloud hosted in the Spice Cloud Platform - [Hybrid Deployment](/docs/v1.11/deployment/architectures/hybrid): Deploying Spice with sidecar caching backed by a centralized cluster for acceleration, distributed query, and ingestion. - [Microservice Deployment (Single or Multiple Replicas)](/docs/v1.11/deployment/architectures/microservice): Deploying Spice as a microservice - [Sharded](/docs/v1.11/deployment/architectures/sharded): Deploying Spice with shards - [Sidecar Deployment](/docs/v1.11/deployment/architectures/sidecar): Deploying Spice as a application sidecar - [Tiered Deployment](/docs/v1.11/deployment/architectures/tiered): Deploying Spice in tiers - [AWS Deployment Options](/docs/v1.11/deployment/aws): Guide to deploying Spice.ai applications on Amazon Web Services (AWS) - [AWS Integrations](/docs/v1.11/deployment/aws/integrations): Complete guide to Spice.ai integrations with Amazon Web Services, including data connectors, AI models, vector stores, and secret management. - [Spice Cloud Platform Deployment](/docs/v1.11/deployment/cloud): Guide to deploying data and AI applications using the managed Spice Cloud Platform - [Docker - Kubernetes](/docs/v1.11/deployment/docker): Running Spice.ai as Docker container - [Docker Sandbox Guide - v1.3.0](/docs/v1.11/deployment/docker/sandbox): Migrating to v1.3.0 - [Helm - Kubernetes](/docs/v1.11/deployment/kubernetes): Deploy Spice.ai in Kubernetes using Helm. - [Spice.ai FAQ](/docs/v1.11/faq): Answers to frequently asked questions about Spice.ai including features, use cases, differences from Trino/Presto/Dremio, federated queries, caching, and AI capabilities. - [Spice.ai Features](/docs/v1.11/features): Explore Spice.ai features including data federation, data acceleration, caching, search, LLM integration, embeddings, observability, and more for building data-driven AI applications. - [Caching](/docs/v1.11/features/caching): Learn how to use Spice in-memory caching - [Change Data Capture (CDC)](/docs/v1.11/features/cdc): Learn how to use Change Data Capture (CDC) in Spice. - [Data Acceleration](/docs/v1.11/features/data-acceleration): Learn how to use local data acceleration in Spice. - [Constraints](/docs/v1.11/features/data-acceleration/constraints): Learn how to add/configure constraints on local acceleration tables in Spice. - [Data Refresh](/docs/v1.11/features/data-acceleration/data-refresh): Data refresh for accelerated datasets - [Hash Index for Arrow Acceleration](/docs/v1.11/features/data-acceleration/hash-index): Learn how to use hash indexes for O(1) point lookups on Arrow-accelerated datasets. - [Indexes](/docs/v1.11/features/data-acceleration/indexes): Learn how to add indexes to local acceleration tables in Spice. - [Partitioning](/docs/v1.11/features/data-acceleration/partitioning): Partitioning for accelerated datasets - [Caching Refresh Mode](/docs/v1.11/features/data-acceleration/refresh-modes/caching): Learn how to use caching refresh mode for HTTP-based datasets - [Snapshots](/docs/v1.11/features/data-acceleration/snapshots): Bootstrap file-mode accelerations from managed snapshots to eliminate cold starts. - [Data Ingestion](/docs/v1.11/features/data-ingestion): Learn how to ingest data in Spice. - [Distributed Query](/docs/v1.11/features/distributed-query): Learn how to run Spice in distributed mode for larger scale queries. - [Embedding Datasets](/docs/v1.11/features/embeddings): Learn how to define, or augment existing datasets with embedding column(s). - [Large Language Models](/docs/v1.11/features/large-language-models): Learn how to configure large language models (LLMs) - [Evaluating Language Models](/docs/v1.11/features/large-language-models/evals): Learn how Spice evaluates, tracks, compares, and improves language model performance for specific tasks - [Model Context Protocol (MCP)](/docs/v1.11/features/large-language-models/mcp): Learn how to use the Model Context Protocol (MCP) with Spice. - [Language Model Memory](/docs/v1.11/features/large-language-models/memory): Learn how to provide LLMs with memory - [Language Model Overrides](/docs/v1.11/features/large-language-models/parameter_overrides): Learn how to override default LLM hyperparameters in Spice. - [System Prompt parameterization](/docs/v1.11/features/large-language-models/parameterized_prompts): Learn how to update system prompts for each request with Jinja-styled templating. - [Load and Serve Models Locally](/docs/v1.11/features/large-language-models/serving): Learn how to load and serve large learning models. - [Language Models Tools](/docs/v1.11/features/large-language-models/tools): Learn how LLMs interact with the Spice runtime. - [Machine Learning Models](/docs/v1.11/features/machine-learning-models): Spice supports loading and serving ONNX models for inference, from sources including local filesystems, Hugging Face, and the Spice.ai Cloud platform. - [Observability & Monitoring](/docs/v1.11/features/observability): Monitor Spice with Prometheus metrics, OpenTelemetry, and distributed tracing. - [Component Metrics](/docs/v1.11/features/observability/component_metrics): Learn how to enable optional component metrics. - [Query Federation](/docs/v1.11/features/query-federation): Learn how to use federated SQL queries in Spice.ai Open Source - [Parameterized Queries](/docs/v1.11/features/query-federation/parameterized-queries): Learn how to use prepared statements and parameterized queries in Spice for improved security and performance. - [URL Tables](/docs/v1.11/features/query-federation/url-tables): Query object store files directly using URLs without pre-registering datasets - [Search Functionality](/docs/v1.11/features/search): Learn how Spice can search across datasets using database-native and vector-search methods. - [Full-Text Search](/docs/v1.11/features/search/full-text): Learn how Spice can perform full text search - [Vector-Based Search](/docs/v1.11/features/search/vector-search): Learn how Spice can perform searches using vector-based methods. - [Semantic Model](/docs/v1.11/features/semantic-model): Learn how to define and use semantic data models with Spice. - [Web Search](/docs/v1.11/features/web-search): Learn how Spice can perform web search - [Getting Started with Spice.ai OSS](/docs/v1.11/getting-started): Get started with Spice.ai in 5 minutes. Install the CLI, connect to datasets, run SQL queries, and use AI models with OpenAI-compatible APIs. - [Community Data](/docs/v1.11/getting-started/spiceai): Connect to the Spice.ai Cloud Platform to access community datasets. - [Spicepods](/docs/v1.11/getting-started/spicepods): An introduction to Spicepods - [Telemetry](/docs/v1.11/getting-started/telemetry): Learn how Spice AI uses anonymous telemetry. - [Install Spice.ai OSS](/docs/v1.11/installation): Install Spice.ai OSS on macOS, Linux, Windows, or WSL using the install script, Homebrew, PowerShell, or direct download from GitHub releases. - [Building Intelligent AI Applications with Spice.ai](/docs/v1.11/intelligent-applications): Learn how to build intelligent, data-driven AI applications and agents with Spice.ai. Explore patterns for RAG, LLM integration, and real-time AI inference. - [Monitoring](/docs/v1.11/monitoring): Monitor Spice.ai deployments with Datadog, Grafana, Prometheus, and Zipkin integrations. - [Datadog](/docs/v1.11/monitoring/datadog): Monitoring Spice with Datadog - [Grafana & Prometheus](/docs/v1.11/monitoring/grafana): Monitoring Spice instances with Grafana & Prometheus - [Zipkin Integration](/docs/v1.11/monitoring/zipkin): Learn how to integrate Spice with Zipkin tracing. - [Spice.ai OSS Reference Docs](/docs/v1.11/reference): Reference documentation for Spice.ai including API reference, CLI commands, Spicepod configuration syntax, SQL reference, and data type specifications. - [Cron Schedules](/docs/v1.11/reference/cron): The Runtime supports cron expressions with optional seconds, like /10 which evaluates to every 10th second (10, 20, 30, etc). - [Data Types Reference](/docs/v1.11/reference/datatypes): Spice uses Apache Arrow data types internally, providing consistent type handling across different data sources and accelerators. This section documents how Arrow types map to specific accelerators and object store formats. - [Accelerator Data Types](/docs/v1.11/reference/datatypes/accelerators): Spice adheres to Apache Arrow data types. Data accelerators do not support all Arrow data types. The table below outlines the data type compatibility for each accelerator, and datatype used within the accelerator. - [Object Store Data Types](/docs/v1.11/reference/datatypes/object_store): Spice adheres to Apache Arrow data types. The table below lists the types of supported file type from object stores and their corresponding Apache Arrow type mappings in Spice. - [Spice Runtime Distributions](/docs/v1.11/reference/distributions): Distribution variants of the Spice runtime for different use cases and deployment scenarios, including data-only, GPU-accelerated, NAS, and allocator variants. - [Duration](/docs/v1.11/reference/duration): Durations are represented as integers with a time unit suffix. - [File Formats](/docs/v1.11/reference/file_format): File-based data connectors — including s3//, file//, sftp://, and others — support multiple structured and document file formats. This page details the format-specific parameters available for each. - [Managing Memory Usage](/docs/v1.11/reference/memory): Guidelines and best practices for managing memory usage and optimizing performance in Spice deployments. - [Models Grade Report](/docs/v1.11/reference/models): Spice AI graded Large-Language-Model (LLM) evaluation report - [Performance Tuning](/docs/v1.11/reference/performance-tuning): Comprehensive guide to optimizing query performance, acceleration, and resource utilization in Spice deployments. - [YAML syntax for Spicepod manifests](/docs/v1.11/reference/spicepod): Detailed documentation on the Spicepod manifest syntax (spicepod.yaml) - [catalogs](/docs/v1.11/reference/spicepod/catalogs): Catalogs YAML reference - [Datasets](/docs/v1.11/reference/spicepod/datasets): Datasets YAML reference - [Embeddings](/docs/v1.11/reference/spicepod/embeddings): Embeddings YAML reference - [evals](/docs/v1.11/reference/spicepod/evals): Evaluations YAML reference - [Reserved Keywords](/docs/v1.11/reference/spicepod/keywords): Reserved keywords for datasets - [Models](/docs/v1.11/reference/spicepod/models): Models YAML reference - [Runtime](/docs/v1.11/reference/spicepod/runtime): Runtime YAML reference - [Tools (Function Calling)](/docs/v1.11/reference/spicepod/tools): Tools YAML reference - [Views](/docs/v1.11/reference/spicepod/views): Views YAML reference - [Workers](/docs/v1.11/reference/spicepod/workers): Workers YAML reference - [SQL Reference](/docs/v1.11/reference/sql): Complete SQL reference for Spice.ai including SELECT syntax, subqueries, DML statements, aggregate functions, AI functions, JSON operators, and search capabilities. - [Aggregate Functions](/docs/v1.11/reference/sql/aggregate_functions): Spice is built on Apache DataFusion and uses the PostgreSQL dialect, even when querying datasources with different SQL dialects. When using a data accelerator like DuckDB, function support is specific to each acceleration engine, and not all functions are supported by all acceleration engines. - [AI Functions](/docs/v1.11/reference/sql/ai): AI functions in Spice provide direct integration with large language models (LLMs) and embedding models within SQL queries. These functions process text through configured model providers and return generated responses or vector embeddings. - [DML (Data Manipulation Language)](/docs/v1.11/reference/sql/dml): Data Manipulation Language (DML) statements for inserting and modifying data in Spice. - [Explain](/docs/v1.11/reference/sql/explain): Spice is built on Apache DataFusion and uses the PostgreSQL dialect, even when querying datasources with different SQL dialects. - [Information Schema](/docs/v1.11/reference/sql/information_schema): Spice is built on Apache DataFusion and uses the PostgreSQL dialect, even when querying datasources with different SQL dialects. - [JSON Functions and Operators](/docs/v1.11/reference/sql/json): Reference for JSON functions and operators in Spice SQL - [Operators](/docs/v1.11/reference/sql/operators): Spice is built on Apache DataFusion and uses the PostgreSQL dialect, even when querying datasources with different SQL dialects. - [Prepared Statements](/docs/v1.11/reference/sql/prepared_statements): Spice is built on Apache DataFusion and uses the PostgreSQL dialect, even when querying datasources with different SQL dialects. - [Scalar Functions](/docs/v1.11/reference/sql/scalar_functions): Spice is built on Apache DataFusion and uses the PostgreSQL dialect, even when querying datasources with different SQL dialects. When using a data accelerator like DuckDB, function support is specific to each acceleration engine, and not all functions are supported by all acceleration engines. - [Search in SQL](/docs/v1.11/reference/sql/search): Reference for search functions and filtering in Spice SQL. - [SELECT](/docs/v1.11/reference/sql/select): Spice is built on Apache DataFusion and uses the PostgreSQL dialect, even when querying datasources with different SQL dialects. - [Subqueries](/docs/v1.11/reference/sql/subqueries): Spice is built on Apache DataFusion and uses the PostgreSQL dialect, even when querying datasources with different SQL dialects. - [Spice.ai Open Source System Requirements](/docs/v1.11/reference/system_requirements): System requirements for running Spice.ai Open Source - [Task History](/docs/v1.11/reference/task_history): The Spice runtime stores information about completed tasks in the spice.runtime.task_history table. Each task represents a single unit of execution within the runtime, such as a SQL query or an AI chat completion, and is represented by a unique span. - [SDKs](/docs/v1.11/sdks): Connect to Spice using official SDKs - [Dotnet SDK](/docs/v1.11/sdks/dotnet): Connect to Spice using the Dotnet SDK - [Go SDK](/docs/v1.11/sdks/golang): Connect to Spice using the Go SDK - [Java SDK](/docs/v1.11/sdks/java): Connect to Spice using the Java SDK - [JavaScript SDK](/docs/v1.11/sdks/javascript): Connect to Spice using the JavaScript SDK - [Python SDK](/docs/v1.11/sdks/python): Connect to Spice using the Python SDK - [Rust SDK](/docs/v1.11/sdks/rust): Connect to Spice using the Rust SDK - [Troubleshooting Spice](/docs/v1.11/troubleshooting): Review and debug runtime tasks, logs, and diagnostic steps in Spice. - [Spice.ai Use Cases](/docs/v1.11/use-cases): Discover how to use Spice.ai for data federation, reverse-ETL, database CDN, enterprise search, RAG, and building AI-powered applications and agents. - [AI Applications and Agents](/docs/v1.11/use-cases/ai): AI Applications and Agents - [Agentic AI Applications and Agents](/docs/v1.11/use-cases/ai/agentic-apps): Spice.ai builds intelligent, autonomous agents for SaaS applications, enabling context-aware automation and decision-making. - [Edge-Enabled AI Applications and Agents](/docs/v1.11/use-cases/ai/edge-ai): Spice.ai deploys AI applications and agents across cloud and edge for low-latency decisions in security IoT use cases. - [Federated MCP Client for Distributed Tool Ecosystems](/docs/v1.11/use-cases/ai/federated-mcp-server): Spice.ai federates external MCP servers for scalable, tool-driven AI applications in security, improving threat analysis. - [Object-Store Based SQL Query, Search, and LLM Inference Engine](/docs/v1.11/use-cases/ai/object-store-ai-engine): Spice.ai enables SQL queries, hybrid search, and LLM inference on object-store data for security applications, delivering real-time insights. - [Real-Time Decision-Making for Intelligent Applications](/docs/v1.11/use-cases/ai/real-time-decision-making): Spice.ai powers instant, context-aware decisions for applications like security recommendations by grounding AI in federated, low-latency datasets. - [Tool-Augmented AI with Model Context Protocol Server](/docs/v1.11/use-cases/ai/tool-calling-ai): Spice.ai extends AI with custom tools via MCP server in finserv, integrating domain-specific APIs for enhanced functionality. - [Data Federation, Acceleration, and SQL Query](/docs/v1.11/use-cases/data): Data Federation, Acceleration, and SQL Query - [Application Resilience and Performance Optimization](/docs/v1.11/use-cases/data/application-resilence-and-acceleration): Spice.ai colocates dynamic data with SaaS applications as a database CDN, ensuring resilience and high performance. - [Data Mesh for Unified Data Access](/docs/v1.11/use-cases/data/data-mesh): Spice.ai enables unified data access across disparate sources for health-tech applications, fostering a data mesh architecture. - [Database CDN for Enhanced Performance](/docs/v1.11/use-cases/data/database-cdn): Spice.ai acts as a database CDN for SaaS applications, caching dynamic data to ensure high performance and resilience. - [ETL-free Workflows and Data Migrations](/docs/v1.11/use-cases/data/etl-free-workflows): Spice.ai enables data migrations and workflows without ETL by federating legacy and modern systems for seamless transitions. - [Object-Store Data Engine](/docs/v1.11/use-cases/data/object-store-data-engine): Spice.ai federates, accelerates, and queries object-store data for finserv applications, enabling real-time data access without centralized warehouses. - [Reverse-ETL for Operational Workflows](/docs/v1.11/use-cases/data/reverse-etl): Spice.ai serves enriched data from warehouses to operational systems for real-time actions, eliminating complex ETL pipelines. - [Spice for Retrieval-Augmented-Generation (RAG)](/docs/v1.11/use-cases/rag): Use Spice for Retrieval-Augmented-Generation (RAG) - [Spice for Retrieval-Augmented-Generation (RAG)](/docs/v1.11/use-cases/rag/applications): Use Spice for Retrieval-Augmented-Generation (RAG) - [Retrieval-Augmented Generation for AI-Powered Reporting](/docs/v1.11/use-cases/rag/reporting): Spice.ai generates dynamic, context-aware AI-driven reports for operational insights in health-tech, ensuring compliance and precision. - [Search & Retrieval](/docs/v1.11/use-cases/search): Search & Retrieval - [Simplifying Real-Time Data Collection and Search](/docs/v1.11/use-cases/search/data-collection-and-search): Spice.ai processes streaming and static data with integrated search for real-time insights, focusing on application logic. - [Enterprise Search and Retrieval](/docs/v1.11/use-cases/search/enterprise-search): Spice.ai powers semantic and precise search for finserv knowledge bases with hybrid vector and keyword capabilities. - [Object-Store Native Search Engine](/docs/v1.11/use-cases/search/object-store-search-engine): Spice.ai powers a cloud-native embedded search engine on object-store data for security applications, enabling semantic and precise search. ### v1.5 Spice is a SQL query, search, and LLM-inference engine, written in Rust, for data-driven applications and AI agents. - [Spice.ai Open Source](/docs/v1.5): Spice is a SQL query, search, and LLM-inference engine, written in Rust, for data-driven applications and AI agents. - [Tags](/docs/v1.5/tags) - [One doc tagged with "Acknowledgements"](/docs/v1.5/tags/acknowledgements): Project acknowledgements, credits, and attributions. - [One doc tagged with "ADBC"](/docs/v1.5/tags/adbc): Arrow Database Connectivity driver configuration and usage. - [4 docs tagged with "API"](/docs/v1.5/tags/api): HTTP, Arrow Flight SQL, ODBC, JDBC, and ADBC API reference. - [One doc tagged with "Arrow"](/docs/v1.5/tags/arrow): Apache Arrow columnar data format integration. - [One doc tagged with "Arrow Flight SQL"](/docs/v1.5/tags/arrow-flight-sql): Arrow Flight SQL protocol implementation and configuration. - [One doc tagged with "Auth"](/docs/v1.5/tags/auth): Authentication and authorization mechanisms. - [One doc tagged with "Authentication"](/docs/v1.5/tags/authentication): User authentication methods and security protocols. - [2 docs tagged with "Azure"](/docs/v1.5/tags/azure): Microsoft Azure cloud services and integrations. - [One doc tagged with "Blob Storage"](/docs/v1.5/tags/blob-storage): Object storage services and blob data access. - [One doc tagged with "Cache Control"](/docs/v1.5/tags/cache-control-policy): Cache control headers and directives. - [One doc tagged with "Caching"](/docs/v1.5/tags/caching): Data caching strategies and performance optimization. - [5 docs tagged with "Catalogs"](/docs/v1.5/tags/catalogs): Data catalog connectors and metadata management. - [2 docs tagged with "CLI"](/docs/v1.5/tags/cli): Spice command-line interface commands and usage. - [2 docs tagged with "Component Metrics"](/docs/v1.5/tags/component-metrics): Runtime component performance metrics and monitoring. - [One doc tagged with "Components"](/docs/v1.5/tags/components): Runtime components including catalogs, data connectors, and models. - [2 docs tagged with "Configuration"](/docs/v1.5/tags/configuration): System configuration files and runtime settings. - [One doc tagged with "Data Connector"](/docs/v1.5/tags/data-connector): Data connector tools and integrations. - [13 docs tagged with "Data Connectors"](/docs/v1.5/tags/data-connectors): Data source connectors and integration patterns. - [One doc tagged with "Data Lake"](/docs/v1.5/tags/data-lake): Data lake architectures and storage solutions. - [2 docs tagged with "Databricks"](/docs/v1.5/tags/databricks): Databricks platform integration and Unity Catalog support. - [2 docs tagged with "Datasets"](/docs/v1.5/tags/datasets): Dataset definitions and data source configurations. - [One doc tagged with "Debugging"](/docs/v1.5/tags/debugging): Debugging techniques and troubleshooting tools. - [2 docs tagged with "Delta Lake"](/docs/v1.5/tags/delta-lake): Delta Lake open table format support. - [One doc tagged with "Dependencies"](/docs/v1.5/tags/dependencies): Third-party dependencies and software requirements. - [3 docs tagged with "Deployment"](/docs/v1.5/tags/deployment): Production deployment using Docker and Kubernetes. - [2 docs tagged with "Docker"](/docs/v1.5/tags/docker): Docker containerization and deployment configurations. - [One doc tagged with "DynamoDB"](/docs/v1.5/tags/dynamodb): Amazon DynamoDB NoSQL database integration. - [3 docs tagged with "Embeddings"](/docs/v1.5/tags/embeddings): Vector embeddings and semantic similarity operations. - [One doc tagged with "Evaluation"](/docs/v1.5/tags/evaluation): Model evaluation metrics and assessment frameworks. - [One doc tagged with "Features"](/docs/v1.5/tags/features): Core platform features including acceleration, caching, and search. - [One doc tagged with "Federation"](/docs/v1.5/tags/federation): Cross-database queries and federated data access. - [One doc tagged with "Getting Started"](/docs/v1.5/tags/getting-started): Installation guides and quickstart tutorials. - [One doc tagged with "GitHub"](/docs/v1.5/tags/github): GitHub repository data connector and integration. - [One doc tagged with "Glue"](/docs/v1.5/tags/glue): AWS Glue ETL service and data catalog integration. - [One doc tagged with "Iceberg"](/docs/v1.5/tags/iceberg): Apache Iceberg open table format support. - [One doc tagged with "In-Memory"](/docs/v1.5/tags/in-memory): In-memory data processing and temporary storage. - [One doc tagged with "Integration"](/docs/v1.5/tags/integration): Third-party system integrations and connectivity patterns. - [One doc tagged with "Introduction"](/docs/v1.5/tags/introduction): Introductory guides and getting started. - [One doc tagged with "JDBC"](/docs/v1.5/tags/jdbc): Java Database Connectivity driver configuration. - [2 docs tagged with "Kubernetes"](/docs/v1.5/tags/kubernetes): Kubernetes orchestration and secret management. - [One doc tagged with "Logging"](/docs/v1.5/tags/logging): Application logging configuration and log management. - [One doc tagged with "Login"](/docs/v1.5/tags/login): User login processes and session management. - [One doc tagged with "Manifest"](/docs/v1.5/tags/manifest): Configuration manifest files and schema definitions. - [One doc tagged with "MCP"](/docs/v1.5/tags/mcp): Model Context Protocol for AI tool integration. - [2 docs tagged with "Memory"](/docs/v1.5/tags/memory): In-memory data connectors and volatile storage. - [12 docs tagged with "Models"](/docs/v1.5/tags/models): Machine learning models and AI inference engines. - [One doc tagged with "MySQL"](/docs/v1.5/tags/mysql): MySQL relational database integration. - [One doc tagged with "NoSQL"](/docs/v1.5/tags/nosql): NoSQL database systems and document stores. - [One doc tagged with "ODBC"](/docs/v1.5/tags/odbc): Open Database Connectivity driver configuration. - [One doc tagged with "Open Source"](/docs/v1.5/tags/open-source): Open source licenses and community contributions. - [One doc tagged with "OpenAI"](/docs/v1.5/tags/openai): OpenAI API integration and GPT model access. - [One doc tagged with "Oracle"](/docs/v1.5/tags/oracle): Documentation related to Oracle database integration. - [2 docs tagged with "Overrides"](/docs/v1.5/tags/overrides): Parameter overrides and configuration customization. - [2 docs tagged with "Overview"](/docs/v1.5/tags/overview): High-level component and feature overviews. - [2 docs tagged with "Parameters"](/docs/v1.5/tags/parameters): Configuration parameters and runtime options. - [One doc tagged with "Performance"](/docs/v1.5/tags/performance): Performance optimization and benchmarking. - [One doc tagged with "Persistence"](/docs/v1.5/tags/persistence): Data persistence and durable storage mechanisms. - [3 docs tagged with "Reference"](/docs/v1.5/tags/reference): API reference, CLI commands, and configuration syntax. - [One doc tagged with "Relational"](/docs/v1.5/tags/relational): Relational database systems and SQL operations. - [One doc tagged with "Results Caching"](/docs/v1.5/tags/results-caching-feature): Query results caching configuration. - [One doc tagged with "Runtime"](/docs/v1.5/tags/runtime): Runtime behavior and execution environment. - [One doc tagged with "Sandbox"](/docs/v1.5/tags/sandbox): Sandbox environments and isolated testing. - [4 docs tagged with "Search"](/docs/v1.5/tags/search): Vector search, semantic search, and ranking capabilities. - [One doc tagged with "Security"](/docs/v1.5/tags/security): Security features and data protection mechanisms. - [2 docs tagged with "SpiceAI"](/docs/v1.5/tags/spiceai): SpiceAI cloud platform and managed services. - [3 docs tagged with "Spicepod"](/docs/v1.5/tags/spicepod): Spicepod configuration files, manifest syntax, and package management. - [One doc tagged with "Spicepods"](/docs/v1.5/tags/spicepods): Spicepod configuration and usage. - [2 docs tagged with "SQL"](/docs/v1.5/tags/sql): SQL query language support and database operations. - [3 docs tagged with "Tools"](/docs/v1.5/tags/tools): Development tools and utility integrations. - [One doc tagged with "Tracing"](/docs/v1.5/tags/tracing): Distributed tracing and request monitoring. - [One doc tagged with "Troubleshooting"](/docs/v1.5/tags/troubleshooting): Problem diagnosis and resolution guides. - [One doc tagged with "Unity Catalog"](/docs/v1.5/tags/unity-catalog): Databricks Unity Catalog data governance integration. - [One doc tagged with "YAML"](/docs/v1.5/tags/yaml): YAML configuration syntax and file formats. - [Open Source Acknowledgements](/docs/v1.5/acknowledgements): Spice AI acknowledges the following open source projects for making this project possible: - [API](/docs/v1.5/api): API - [ADBC: Arrow Database Connectivity](/docs/v1.5/api/adbc): ADBC API Documentation - [Arrow Flight SQL API](/docs/v1.5/api/arrow-flight-sql): Query Spice using JDBC/ODBC/ADBC - [Authentication](/docs/v1.5/api/auth): Authentication documentation - [Generate Package](/docs/v1.5/api/HTTP/generate-package): This endpoint generates a zip package from a specified GitHub source. - [List Catalogs](/docs/v1.5/api/HTTP/get-catalogs): List Catalogs - [Get Iceberg API config](/docs/v1.5/api/HTTP/get-config): This endpoint returns the Iceberg Catalog API configuration, including details about overrides, defaults, and available endpoints. - [List Datasets](/docs/v1.5/api/HTTP/get-datasets): This endpoint returns a list of configured datasets. The response can be formatted as **JSON** or **CSV**, - [List Iceberg namespaces](/docs/v1.5/api/HTTP/get-iceberg-namespaces): This endpoint retrieves namespaces available in the Iceberg catalog. - [ML Prediction](/docs/v1.5/api/HTTP/get-model-predict): Make a ML prediction using a specific model. - [List Models](/docs/v1.5/api/HTTP/get-models): List all models, both machine learning and language models, available in the runtime. - [List Spicepods](/docs/v1.5/api/HTTP/get-spicepods): Get a list of spicepods and their details. In CSV format, it will return a summarised form. - [Check Runtime Status](/docs/v1.5/api/HTTP/get-status): Return the status of all connections (http, flight, metrics, opentelemetry) in the runtime. - [Check Namespace exists](/docs/v1.5/api/HTTP/head-namespace): This endpoint returns a 200 OK response if the namespace exists, otherwise it returns a 404 Not Found response. - [List Evals](/docs/v1.5/api/HTTP/list): Return all evals available to run in the runtime. - [Send message to MCP server](/docs/v1.5/api/HTTP/mcp-event): Send message to the MCP endoint, for a given session. - [Establish an MCP SSE Connection](/docs/v1.5/api/HTTP/operation-id): Initiates a Server-Sent Events (SSE) connection using the Model Context Protocol (MCP) to interact with Spice tools. - [Update Refresh SQL](/docs/v1.5/api/HTTP/patch-dataset-acceleration): Update the refresh SQL for a dataset's acceleration. - [Run Tool](/docs/v1.5/api/HTTP/post): The request body and JSON response formats match the tool’s specification. - [Batch ML Predictions](/docs/v1.5/api/HTTP/post-batch-predict): Perform a batch of ML predictions, using multiple models, in one request. This is useful for ensembling or A/B testing different models. - [Create Chat Completion](/docs/v1.5/api/HTTP/post-chat-completions): Creates a model response for the given chat conversation. - [Refresh Dataset](/docs/v1.5/api/HTTP/post-dataset-refresh): Trigger an on-demand refresh for an accelerated dataset. - [Create Embeddings](/docs/v1.5/api/HTTP/post-embeddings): Creates an embedding vector representing the input text. - [Run Eval](/docs/v1.5/api/HTTP/post-eval): Evaluate a model against a eval spice specification - [Text-to-SQL (NSQL)](/docs/v1.5/api/HTTP/post-nsql): Generate and optionally execute a natural-language text-to-SQL (NSQL) query. - [Search](/docs/v1.5/api/HTTP/post-search): Perform a vector similarity search (VSS) operation on a dataset. - [SQL Query](/docs/v1.5/api/HTTP/post-sql): Execute a SQL query and return the results. - [Check Readiness](/docs/v1.5/api/HTTP/ready): Check the runtime status of all the components of the runtime. If the service is ready, it returns an HTTP 200 status with the message 'ready'. If not, it returns a 503 status with the message 'not ready'. - [runtime](/docs/v1.5/api/HTTP/runtime): The spiced runtime - [JDBC: Java Database Connectivity](/docs/v1.5/api/jdbc): JDBC API Documentation - [ODBC: Open Database Connectivity](/docs/v1.5/api/odbc): ODBC API Documentation - [API Overview](/docs/v1.5/api/overview): Spice.ai API overview, including SQL query interfaces, OpenAI-compatible endpoints, Iceberg catalog REST APIs, and the Model Context Protocol (MCP) for integrating external tools. - [TLS: Transport Layer Security](/docs/v1.5/api/tls): Encryption in transit with TLS documentation - [Spice.ai OSS CLI documentation](/docs/v1.5/cli): Detailed documentation on the Spice.ai OSS CLI - [Spice.ai OSS CLI command reference](/docs/v1.5/cli/reference): Spice CLI command reference - [add](/docs/v1.5/cli/reference/add): Add a Spicepod to the project. - [catalogs](/docs/v1.5/cli/reference/catalogs): List catalogs currently loaded by the Spice runtime. - [chat](/docs/v1.5/cli/reference/chat): spice chat CLI documentation - [Completion](/docs/v1.5/cli/reference/completion): Generate the autocompletion script for spice for the specified shell. - [connect](/docs/v1.5/cli/reference/connect): Connect to an app on the Spice.ai Cloud Platform. - [dataset](/docs/v1.5/cli/reference/dataset): Configure a Spice dataset. - [datasets](/docs/v1.5/cli/reference/datasets): Lists datasets loaded by the Spice runtime - [init](/docs/v1.5/cli/reference/init): Initialize Spice app in the current working directory. - [install](/docs/v1.5/cli/reference/install): Download and install the latest version of the Spice runtime. - [login](/docs/v1.5/cli/reference/login): Login to the Spice.ai Platform, or other services with sub-commands. - [models](/docs/v1.5/cli/reference/models): Lists models loaded by the Spice runtime - [pods](/docs/v1.5/cli/reference/pods): Lists Spicepods loaded by the Spice runtime - [refresh](/docs/v1.5/cli/reference/refresh): Refreshes an accelerated dataset loaded by the Spice runtime - [run](/docs/v1.5/cli/reference/run): Run Spice - starts the Spice runtime, installing if necessary. - [search](/docs/v1.5/cli/reference/search): Performs embeddings-based searches across search configured datasets. Note: Search requires the ai feature to be installed. - [sql](/docs/v1.5/cli/reference/sql): Start an interactive SQL query session against the Spice runtime - [status](/docs/v1.5/cli/reference/status): Spice runtime status - [trace](/docs/v1.5/cli/reference/trace): Provides a user-friendly trace stack into an operation that occurred in Spice. This command retrieves and displays task execution traces from the runtime.task_history table. - [upgrade](/docs/v1.5/cli/reference/upgrade): Upgrades the Spice CLI & Runtime to the latest release - [version](/docs/v1.5/cli/reference/version): Outputs the current version of the Spice CLI and runtime - [Configuring Trace Levels](/docs/v1.5/cli/tracing): Configuring Spice.ai OSS trace output verbosity levels - [Clients and Tools](/docs/v1.5/clients): Client and tools - [Datadog](/docs/v1.5/clients/Datadog): Monitoring Spice with Datadog - [DBeaver](/docs/v1.5/clients/DBeaver): Configure DBeaver to query Spice via JDBC - [Grafana & Prometheus](/docs/v1.5/clients/grafana): Monitoring Spice instances with Grafana & Prometheus - [JetBrains DataGrip](/docs/v1.5/clients/jetbrains-datagrip): Configure JetBrains Datagrip to query Spice via JDBC - [Apache Superset](/docs/v1.5/clients/superset): Use Apache Superset to query and visualize datasets loaded in Spice. - [Tableau](/docs/v1.5/clients/tableau): Use Tableau to to access, visualise and analyse datasets loaded in Spice. - [Runtime Components](/docs/v1.5/components): Runtime components' - [Catalog Connectors](/docs/v1.5/components/catalogs) - [Databricks Catalog Connector](/docs/v1.5/components/catalogs/databricks): Connect to a Databricks Unity Catalog provider. - [Glue Catalog Connector](/docs/v1.5/components/catalogs/glue): Connect to an AWS Glue Data Catalog. - [Iceberg Catalog Connector](/docs/v1.5/components/catalogs/iceberg): Connect to an Iceberg catalog provider. - [Spice.ai Catalog Connector](/docs/v1.5/components/catalogs/spiceai): Connect to the Spice.ai built-in catalog. - [Unity Catalog Catalog Connector](/docs/v1.5/components/catalogs/unity-catalog): Connect to a Unity Catalog provider. - [Data Accelerators](/docs/v1.5/components/data-accelerators) - [In-Memory Arrow Data Accelerator](/docs/v1.5/components/data-accelerators/arrow): In-Memory Arrow Data Accelerator Documentation - [DuckDB Data Accelerator](/docs/v1.5/components/data-accelerators/duckdb): DuckDB Data Accelerator Documentation - [PostgreSQL Data Accelerator](/docs/v1.5/components/data-accelerators/postgres): PostgreSQL Data Accelerator Documentation - [SQLite Data Accelerator](/docs/v1.5/components/data-accelerators/sqlite): SQLite Data Accelerator Documentation - [Data Connectors](/docs/v1.5/components/data-connectors): Learn how to use Data Connector to query external data. - [Azure BlobFS Data Connector](/docs/v1.5/components/data-connectors/abfs): Azure BlobFS Data Connector Documentation - [ClickHouse Data Connector](/docs/v1.5/components/data-connectors/clickhouse): ClickHouse Data Connector Documentation - [Databricks Data Connector](/docs/v1.5/components/data-connectors/databricks): Databricks Data Connector Documentation - [Debezium Data Connector](/docs/v1.5/components/data-connectors/debezium): Debezium Data Connector Documentation - [Delta Lake Data Connector](/docs/v1.5/components/data-connectors/delta-lake): Delta Lake Data Connector Documentation - [Dremio Data Connector](/docs/v1.5/components/data-connectors/dremio): Dremio Data Connector Documentation - [DuckDB Data Connector](/docs/v1.5/components/data-connectors/duckdb): DuckDB Data Connector Documentation - [DynamoDB Data Connector](/docs/v1.5/components/data-connectors/dynamodb): DynamoDB Data Connector Documentation - [File Data Connector](/docs/v1.5/components/data-connectors/file): File Data Connector Documentation - [Flight SQL Data Connector](/docs/v1.5/components/data-connectors/flightsql): Flight SQL Data Connector Documentation - [FTP/SFTP Data Connector](/docs/v1.5/components/data-connectors/ftp): FTP/SFTP Data Connector Documentation - [GitHub Data Connector](/docs/v1.5/components/data-connectors/github): GitHub Data Connector Documentation - [Glue Data Connector](/docs/v1.5/components/data-connectors/glue): Glue Data Connector Documentation - [GraphQL Data Connector](/docs/v1.5/components/data-connectors/graphql): GraphQL Data Connector Documentation - [HTTP(s) Data Connector](/docs/v1.5/components/data-connectors/https): HTTP(s) Data Connector Documentation - [Iceberg Data Connector](/docs/v1.5/components/data-connectors/iceberg): Connect to and query Apache Iceberg tables - [IMAP Data Connector](/docs/v1.5/components/data-connectors/imap): IMAP Data Connector Documentation - [Localpod Data Connector](/docs/v1.5/components/data-connectors/localpod): Localpod Data Connector Documentation - [Memory Data Connector](/docs/v1.5/components/data-connectors/memory): Memory Data Connector Documentation - [Microsoft SQL Server Data Connector](/docs/v1.5/components/data-connectors/mssql): Microsoft SQL Server Data Connector - [MySQL Data Connector](/docs/v1.5/components/data-connectors/mysql): MySQL Data Connector Documentation - [Pull the latest official Spice image](/docs/v1.5/components/data-connectors/odbc): ODBC Data Connector Documentation - [Oracle Data Connector](/docs/v1.5/components/data-connectors/oracle): Oracle Data Connector Documentation - [PostgreSQL Data Connector](/docs/v1.5/components/data-connectors/postgres): PostgreSQL Data Connector Documentation - [S3 Data Connector](/docs/v1.5/components/data-connectors/s3): S3 Data Connector Documentation - [SharePoint Data Connector](/docs/v1.5/components/data-connectors/sharepoint): SharePoint Data Connector Documentation - [Snowflake Data Connector](/docs/v1.5/components/data-connectors/snowflake): Snowflake Data Connector Documentation - [Apache Spark Connector](/docs/v1.5/components/data-connectors/spark): Apache Spark Connector Documentation - [Spice.ai Data Connector](/docs/v1.5/components/data-connectors/spiceai): Spice.ai Data Connector Documentation - [Embedding Models](/docs/v1.5/components/embeddings) - [Azure OpenAI Embedding Models](/docs/v1.5/components/embeddings/azure): To use an embedding model hosted on Azure OpenAI, specify the azure path in the from field and the following parameters from the Azure OpenAI Model Deployment page: - [Amazon Bedrock Model Provider](/docs/v1.5/components/embeddings/bedrock): Instructions for using Amazon Bedrock embedding models - [Databricks Model Provider](/docs/v1.5/components/embeddings/databricks): Instructions for using Databricks Mosaic AI Models - [HuggingFace Text Embedding Models](/docs/v1.5/components/embeddings/huggingface): To use an embedding model from HuggingFace with Spice, specify the huggingface path in the from field of your configuration. The model and its related files will be automatically downloaded, loaded, and served locally by Spice. - [Local Filesystem Embedding Models](/docs/v1.5/components/embeddings/local): Embedding models can be run with files stored locally. This method is useful for using models that are not hosted on remote services. - [OpenAI (or Compatible) Embedding Models](/docs/v1.5/components/embeddings/openai): To use a hosted OpenAI (or compatible) embedding model, specify the openai path in the from field of your configuration. - [Model Providers](/docs/v1.5/components/models): Overview of supported model providers for ML and LLMs in Spice. - [Anthropic Models](/docs/v1.5/components/models/anthropic): Instructions for using language models hosted on Anthropic with Spice. - [Azure OpenAI Models](/docs/v1.5/components/models/azure): Instructions for using Azure OpenAI models - [Databricks Model Provider](/docs/v1.5/components/models/databricks): Instructions for using Databricks Mosaic AI Models - [Filesystem Hosted Models](/docs/v1.5/components/models/filesystem): Instructions for using models hosted on a filesystem with Spice. - [HuggingFace](/docs/v1.5/components/models/huggingface): Instructions for using machine learning models hosted on HuggingFace with Spice. - [OpenAI (or Compatible) Language Models](/docs/v1.5/components/models/openai): Instructions for using language models hosted on OpenAI or compatible services with Spice. - [Perplexity Models](/docs/v1.5/components/models/perplexity): Instructions for using language models hosted on Perplexity with Spice. - [Spice Cloud Platform](/docs/v1.5/components/models/spiceai): Instructions for using models hosted on the Spice Cloud Platform with Spice. - [xAI Models](/docs/v1.5/components/models/xai): Instructions for using xAI models - [Secret Stores](/docs/v1.5/components/secret-stores) - [AWS Secrets Manager Secret Store](/docs/v1.5/components/secret-stores/aws-secrets-manager): AWS Secrets Manager Secret Store Documentation - [Environment Secret Store](/docs/v1.5/components/secret-stores/env): Environment Variables Secret Store Documentation - [Keyring Secret Store](/docs/v1.5/components/secret-stores/keyring): Keyring Secret Store Documentation - [Kubernetes Secret Store](/docs/v1.5/components/secret-stores/kubernetes): Kubernetes Secret Store Documentation - [LLM Tools (Function Calling)](/docs/v1.5/components/tools): Overview of supported LLM tools (function calling) and how to define new tools - [Model Context Protocol Tools](/docs/v1.5/components/tools/mcp): Spice integrates with tools and services using the Model Context Protocol (MCP). MCP tools can be configured to run internally or connect to external servers over HTTP using the Server-Sent Events (SSE) protocol. - [Web Search Tool](/docs/v1.5/components/tools/websearch): The Web Search Tool enables Spice models to search the web for information. The tool is available through the websearch tool, and backed by different search engines. - [Vector Engines](/docs/v1.5/components/vectors) - [AWS S3 Vectors Engine](/docs/v1.5/components/vectors/s3_vectors): AWS S3 Vectors Engine Documentation - [Views](/docs/v1.5/components/views): Documentation for defining Views in Spice - [Workers Overview](/docs/v1.5/components/workers): Detailed documentation for workers in the Spice runtime. - [Deployment](/docs/v1.5/deployment): Deploy Spice.ai in your environment - [Deployment Architectures](/docs/v1.5/deployment/architectures): Spice.ai Open Source Deployment architectures - [Cluster-Based Deployment (Spice.ai Enterprise)](/docs/v1.5/deployment/architectures/cluster): Deploying Spice as a cluster - [Cloud Hosted](/docs/v1.5/deployment/architectures/hosted): Deploying Spice cloud hosted in the Spice Cloud Platform - [Microservice Deployment (Single or Multiple Replicas)](/docs/v1.5/deployment/architectures/microservice): Deploying Spice as a microservice - [Sharded](/docs/v1.5/deployment/architectures/sharded): Deploying Spice with shards - [Sidecar Deployment](/docs/v1.5/deployment/architectures/sidecar): Deploying Spice as a application sidecar - [Tiered Deployment](/docs/v1.5/deployment/architectures/tiered): Deploying Spice in tiers - [AWS Deployment Options](/docs/v1.5/deployment/aws): Guide to deploying Spice.ai applications on Amazon Web Services (AWS) - [Spice Cloud Platform Deployment](/docs/v1.5/deployment/cloud): Guide to deploying data and AI applications using the managed Spice Cloud Platform - [Docker - Kubernetes](/docs/v1.5/deployment/docker): Running Spice.ai as Docker container - [Docker Sandbox Guide - v1.3.0](/docs/v1.5/deployment/docker/sandbox): Migrating to v1.3.0 - [Helm - Kubernetes](/docs/v1.5/deployment/kubernetes): Deploy Spice.ai in Kubernetes using Helm. - [Frequently Asked Questions](/docs/v1.5/faq): Get answers to common questions about Spice.ai, including its features, differences from other tools, and use cases - [Features](/docs/v1.5/features): Features - [Caching](/docs/v1.5/features/caching): Learn how to use Spice in-memory caching - [Change Data Capture (CDC)](/docs/v1.5/features/cdc): Learn how to use Change Data Capture (CDC) in Spice. - [Data Acceleration](/docs/v1.5/features/data-acceleration): Learn how to use local data acceleration in Spice. - [Constraints](/docs/v1.5/features/data-acceleration/constraints): Learn how to add/configure constraints on local acceleration tables in Spice. - [Data Refresh](/docs/v1.5/features/data-acceleration/data-refresh): Data refresh for accelerated datasets - [Indexes](/docs/v1.5/features/data-acceleration/indexes): Learn how to add indexes to local acceleration tables in Spice. - [Partitioning](/docs/v1.5/features/data-acceleration/partitioning): Partitioning for accelerated datasets - [Data Ingestion](/docs/v1.5/features/data-ingestion): Learn how to ingest data in Spice. - [Embedding Datasets](/docs/v1.5/features/embeddings): Learn how to define, or augment existing datasets with embedding column(s). - [Large Language Models](/docs/v1.5/features/large-language-models): Learn how to configure large language models (LLMs) - [Evaluating Language Models](/docs/v1.5/features/large-language-models/evals): Learn how Spice evaluates, tracks, compares, and improves language model performance for specific tasks - [Model Context Protocol (MCP)](/docs/v1.5/features/large-language-models/mcp): Learn how to use the Model Context Protocol (MCP) with Spice. - [Language Model Memory](/docs/v1.5/features/large-language-models/memory): Learn how to provide LLMs with memory - [Language Model Overrides](/docs/v1.5/features/large-language-models/parameter_overrides): Learn how to override default LLM hyperparameters in Spice. - [System Prompt parameterization](/docs/v1.5/features/large-language-models/parameterized_prompts): Learn how to update system prompts for each request with Jinja-styled templating. - [Load and Serve Models Locally](/docs/v1.5/features/large-language-models/serving): Learn how to load and serve large learning models. - [Language Models Tools](/docs/v1.5/features/large-language-models/tools): Learn how LLMs interact with the Spice runtime. - [Machine Learning Models](/docs/v1.5/features/machine-learning-models): Spice supports loading and serving ONNX models for inference, from sources including local filesystems, Hugging Face, and the Spice.ai Cloud platform. - [Observability & Monitoring](/docs/v1.5/features/observability): Learn how to use Spice telemetry. - [Component Metrics](/docs/v1.5/features/observability/component_metrics): Learn how to enable optional component metrics. - [Query Federation](/docs/v1.5/features/query-federation): Learn how to use federated SQL queries in Spice.ai Open Source - [Search Functionality](/docs/v1.5/features/search): Learn how Spice can search across datasets using database-native and vector-search methods. - [Full-Text Search](/docs/v1.5/features/search/full-text): Learn how Spice can perform full text search - [Vector-Based Search](/docs/v1.5/features/search/vector-search): Learn how Spice can perform searches using vector-based methods. - [Semantic Model](/docs/v1.5/features/semantic-model): Learn how to define and use semantic data models with Spice. - [Getting started with Spice.ai OSS](/docs/v1.5/getting-started): Get started with Spice in 5 minutes - [Community Data](/docs/v1.5/getting-started/spiceai): Connect to the Spice.ai Cloud Platform to access community datasets. - [Spicepods](/docs/v1.5/getting-started/spicepods): An introduction to Spicepods - [Telemetry](/docs/v1.5/getting-started/telemetry): Learn how Spice AI uses anonymous telemetry. - [Spice.ai OSS Installation](/docs/v1.5/installation): Instructions for installing Spice.ai OSS - [Intelligent Applications](/docs/v1.5/intelligent-applications): Building intelligent data and AI-driven applications with Spice.ai - [Spice.ai OSS Reference Docs](/docs/v1.5/reference): Reference documentation on the Spice API, CLI and Pod manifest syntax. - [Cron Schedules](/docs/v1.5/reference/cron): The Runtime supports cron expressions with optional seconds, like /10 which evaluates to every 10th second (10, 20, 30, etc). - [Data Types Reference](/docs/v1.5/reference/datatypes) - [Accelerator Data Types](/docs/v1.5/reference/datatypes/accelerators): Spice adheres to Apache Arrow data types. Data accelerators do not support all Arrow data types. The table below outlines the data type compatibility for each accelerator, and datatype used within the accelerator. - [Object Store Data Types](/docs/v1.5/reference/datatypes/object_store): Spice adheres to Apache Arrow data types. The table below lists the types of supported file type from object stores and their corresponding Apache Arrow type mappings in Spice. - [Duration](/docs/v1.5/reference/duration): Durations are represented as integers with a time unit suffix. - [File Formats](/docs/v1.5/reference/file_format): Spice currently supports CSV and Parquet data file-formats for data connectors that can read files from a file system or cloud object storage (i.e. s3//, file://, etc.). Support for Iceberg and other file-formats are on the roadmap. - [Managing Memory Usage](/docs/v1.5/reference/memory): Guidelines and best practices for managing memory usage and optimizing performance in Spice.ai Open Source deployments. - [Models Grade Report](/docs/v1.5/reference/models): Spice AI graded Large-Language-Model (LLM) evaluation report - [YAML syntax for Spicepod manifests](/docs/v1.5/reference/spicepod): Detailed documentation on the Spicepod manifest syntax (spicepod.yaml) - [catalogs](/docs/v1.5/reference/spicepod/catalogs): Catalogs YAML reference - [Datasets](/docs/v1.5/reference/spicepod/datasets): Datasets YAML reference - [Embeddings](/docs/v1.5/reference/spicepod/embeddings): Embeddings YAML reference - [evals](/docs/v1.5/reference/spicepod/evals): Evaluations YAML reference - [Reserved Keywords](/docs/v1.5/reference/spicepod/keywords): Reserved keywords for datasets - [Models](/docs/v1.5/reference/spicepod/models): Models YAML reference - [Runtime](/docs/v1.5/reference/spicepod/runtime): Runtime YAML reference - [Tools (Function Calling)](/docs/v1.5/reference/spicepod/tools): Tools YAML reference - [Workers](/docs/v1.5/reference/spicepod/workers): Workers YAML reference - [SQL Reference](/docs/v1.5/reference/sql) - [EXPLAIN](/docs/v1.5/reference/sql/explain): Spice is built on Apache DataFusion and uses the PostgreSQL dialect, even when querying datasources with different SQL dialects. - [Information Schema](/docs/v1.5/reference/sql/information_schema): Spice is built on Apache DataFusion and uses the PostgreSQL dialect, even when querying datasources with different SQL dialects. - [Operators](/docs/v1.5/reference/sql/operators): Spice is built on Apache DataFusion and uses the PostgreSQL dialect, even when querying datasources with different SQL dialects. - [Prepared Statements](/docs/v1.5/reference/sql/prepared_statements): Positional Arguments - [SELECT](/docs/v1.5/reference/sql/select): Spice is built on Apache DataFusion and uses the PostgreSQL dialect, even when querying datasources with different SQL dialects. - [Subqueries](/docs/v1.5/reference/sql/subqueries): Spice is built on Apache DataFusion and uses the PostgreSQL dialect, even when querying datasources with different SQL dialects. - [Spice.ai Open Source System Requirements](/docs/v1.5/reference/system_requirements): System requirements for running Spice.ai Open Source - [Task History](/docs/v1.5/reference/task_history): The Spice runtime stores information about completed tasks in the spice.runtime.task_history table. Each task represents a single unit of execution within the runtime, such as a SQL query or an AI chat completion, and is represented by a unique span. - [Timestamps](/docs/v1.5/reference/timestamp): In Spice all timestamps are represented as an integer value denoting the number of seconds that have passed since the Unix epoch in UTC time. The Unix epoch is defined as 1970-01-01T0000Z. - [SDKs](/docs/v1.5/sdks): Connect to spice, using official Spice SDKs - [Dotnet SDK for Spice.ai](/docs/v1.5/sdks/dotnet): Connect to Spice using Spice Dotnet SDK - [Go SDK](/docs/v1.5/sdks/golang): Connect to spice using spice go SDK - [Java SDK](/docs/v1.5/sdks/java): Connect to Spice using Spice Java SDK - [JavaScript SDK](/docs/v1.5/sdks/javascript): Connect to spice using Spice.js SDK - [Python SDK](/docs/v1.5/sdks/python): Connect to spice using spice python SDK - [Rust SDK](/docs/v1.5/sdks/rust): Connect to spice using spice rust SDK - [Troubleshooting Spice](/docs/v1.5/troubleshooting): Review and debug runtime tasks, logs, and diagnostic steps in Spice. - [Use Cases](/docs/v1.5/use-cases): Examples and use cases for Spice' - [Using Spice.ai for Agentic AI Applications](/docs/v1.5/use-cases/agentic-apps): Build intelligent autonomous agents that act contextually by grounding AI models in secure, full-knowledge datasets with fast, iterative feedback loops. - [Spice for SQL Query Mesh/Federation](/docs/v1.5/use-cases/data-mesh): Spice for SQL Query Mesh/Federation - [Spice as a CDN for Databases](/docs/v1.5/use-cases/database-cdn): Use Spice as a CDN for Databases - [Spice for Enterprise Search](/docs/v1.5/use-cases/enterprise-search): Use Spice for Enterprise Search - [Spice for Retrieval-Augmented-Generation (RAG)](/docs/v1.5/use-cases/rag): Use Spice for Retrieval-Augmented-Generation (RAG) ### v1.6 Spice is a SQL query, search, and LLM-inference engine, written in Rust, for data-driven applications and AI agents. - [Spice.ai Open Source](/docs/v1.6): Spice is a SQL query, search, and LLM-inference engine, written in Rust, for data-driven applications and AI agents. - [Tags](/docs/v1.6/tags) - [One doc tagged with "Acknowledgements"](/docs/v1.6/tags/acknowledgements): Project acknowledgements, credits, and attributions. - [One doc tagged with "ADBC"](/docs/v1.6/tags/adbc): Arrow Database Connectivity driver configuration and usage. - [4 docs tagged with "API"](/docs/v1.6/tags/api): HTTP, Arrow Flight SQL, ODBC, JDBC, and ADBC API reference. - [One doc tagged with "Arrow"](/docs/v1.6/tags/arrow): Apache Arrow columnar data format integration. - [One doc tagged with "Arrow Flight SQL"](/docs/v1.6/tags/arrow-flight-sql): Arrow Flight SQL protocol implementation and configuration. - [One doc tagged with "Auth"](/docs/v1.6/tags/auth): Authentication and authorization mechanisms. - [One doc tagged with "Authentication"](/docs/v1.6/tags/authentication): User authentication methods and security protocols. - [2 docs tagged with "Azure"](/docs/v1.6/tags/azure): Microsoft Azure cloud services and integrations. - [One doc tagged with "Blob Storage"](/docs/v1.6/tags/blob-storage): Object storage services and blob data access. - [One doc tagged with "Caching"](/docs/v1.6/tags/caching): Data caching strategies and performance optimization. - [5 docs tagged with "Catalogs"](/docs/v1.6/tags/catalogs): Data catalog connectors and metadata management. - [2 docs tagged with "CLI"](/docs/v1.6/tags/cli): Spice command-line interface commands and usage. - [2 docs tagged with "Component Metrics"](/docs/v1.6/tags/component-metrics): Runtime component performance metrics and monitoring. - [One doc tagged with "Components"](/docs/v1.6/tags/components): Runtime components including catalogs, data connectors, and models. - [2 docs tagged with "Configuration"](/docs/v1.6/tags/configuration): System configuration files and runtime settings. - [15 docs tagged with "Data Connectors"](/docs/v1.6/tags/data-connectors): Data source connectors and integration patterns. - [One doc tagged with "Data Lake"](/docs/v1.6/tags/data-lake): Data lake architectures and storage solutions. - [2 docs tagged with "Databricks"](/docs/v1.6/tags/databricks): Databricks platform integration and Unity Catalog support. - [2 docs tagged with "Datasets"](/docs/v1.6/tags/datasets): Dataset definitions and data source configurations. - [One doc tagged with "Debugging"](/docs/v1.6/tags/debugging): Debugging techniques and troubleshooting tools. - [2 docs tagged with "Delta Lake"](/docs/v1.6/tags/delta-lake): Delta Lake open table format support. - [One doc tagged with "Dependencies"](/docs/v1.6/tags/dependencies): Third-party dependencies and software requirements. - [3 docs tagged with "Deployment"](/docs/v1.6/tags/deployment): Production deployment using Docker and Kubernetes. - [2 docs tagged with "Docker"](/docs/v1.6/tags/docker): Docker containerization and deployment configurations. - [One doc tagged with "DynamoDB"](/docs/v1.6/tags/dynamodb): Amazon DynamoDB NoSQL database integration. - [3 docs tagged with "Embeddings"](/docs/v1.6/tags/embeddings): Vector embeddings and semantic similarity operations. - [One doc tagged with "Evaluation"](/docs/v1.6/tags/evaluation): Model evaluation metrics and assessment frameworks. - [One doc tagged with "Features"](/docs/v1.6/tags/features): Core platform features including acceleration, caching, and search. - [One doc tagged with "Federation"](/docs/v1.6/tags/federation): Cross-database queries and federated data access. - [One doc tagged with "Getting Started"](/docs/v1.6/tags/getting-started): Installation guides and quickstart tutorials. - [One doc tagged with "GitHub"](/docs/v1.6/tags/github): GitHub repository data connector and integration. - [One doc tagged with "Glue"](/docs/v1.6/tags/glue): AWS Glue ETL service and data catalog integration. - [One doc tagged with "Iceberg"](/docs/v1.6/tags/iceberg): Apache Iceberg open table format support. - [One doc tagged with "In-Memory"](/docs/v1.6/tags/in-memory): In-memory data processing and temporary storage. - [One doc tagged with "Integration"](/docs/v1.6/tags/integration): Third-party system integrations and connectivity patterns. - [One doc tagged with "JDBC"](/docs/v1.6/tags/jdbc): Java Database Connectivity driver configuration. - [2 docs tagged with "Kubernetes"](/docs/v1.6/tags/kubernetes): Kubernetes orchestration and secret management. - [One doc tagged with "Logging"](/docs/v1.6/tags/logging): Application logging configuration and log management. - [One doc tagged with "Login"](/docs/v1.6/tags/login): User login processes and session management. - [One doc tagged with "Manifest"](/docs/v1.6/tags/manifest): Configuration manifest files and schema definitions. - [One doc tagged with "MCP"](/docs/v1.6/tags/mcp): Model Context Protocol for AI tool integration. - [2 docs tagged with "Memory"](/docs/v1.6/tags/memory): In-memory data connectors and volatile storage. - [12 docs tagged with "Models"](/docs/v1.6/tags/models): Machine learning models and AI inference engines. - [One doc tagged with "MongoDB"](/docs/v1.6/tags/mongodb): MongoDB NoSQL document database integration. - [One doc tagged with "MySQL"](/docs/v1.6/tags/mysql): MySQL relational database integration. - [One doc tagged with "NoSQL"](/docs/v1.6/tags/nosql): NoSQL database systems and document stores. - [One doc tagged with "ODBC"](/docs/v1.6/tags/odbc): Open Database Connectivity driver configuration. - [One doc tagged with "Open Source"](/docs/v1.6/tags/open-source): Open source licenses and community contributions. - [One doc tagged with "OpenAI"](/docs/v1.6/tags/openai): OpenAI API integration and GPT model access. - [One doc tagged with "Oracle"](/docs/v1.6/tags/oracle): Documentation related to Oracle database integration. - [2 docs tagged with "Overrides"](/docs/v1.6/tags/overrides): Parameter overrides and configuration customization. - [2 docs tagged with "Overview"](/docs/v1.6/tags/overview): High-level component and feature overviews. - [2 docs tagged with "Parameters"](/docs/v1.6/tags/parameters): Configuration parameters and runtime options. - [One doc tagged with "Performance"](/docs/v1.6/tags/performance): Performance optimization and benchmarking. - [One doc tagged with "Persistence"](/docs/v1.6/tags/persistence): Data persistence and durable storage mechanisms. - [3 docs tagged with "Reference"](/docs/v1.6/tags/reference): API reference, CLI commands, and configuration syntax. - [One doc tagged with "Relational"](/docs/v1.6/tags/relational): Relational database systems and SQL operations. - [One doc tagged with "Runtime"](/docs/v1.6/tags/runtime): Runtime behavior and execution environment. - [One doc tagged with "Sandbox"](/docs/v1.6/tags/sandbox): Sandbox environments and isolated testing. - [4 docs tagged with "Search"](/docs/v1.6/tags/search): Vector search, semantic search, and ranking capabilities. - [One doc tagged with "Security"](/docs/v1.6/tags/security): Security features and data protection mechanisms. - [2 docs tagged with "SpiceAI"](/docs/v1.6/tags/spiceai): SpiceAI cloud platform and managed services. - [4 docs tagged with "Spicepod"](/docs/v1.6/tags/spicepod): Spicepod configuration files, manifest syntax, and package management. - [2 docs tagged with "SQL"](/docs/v1.6/tags/sql): SQL query language support and database operations. - [3 docs tagged with "Tools"](/docs/v1.6/tags/tools): Development tools and utility integrations. - [One doc tagged with "Tracing"](/docs/v1.6/tags/tracing): Distributed tracing and request monitoring. - [One doc tagged with "Troubleshooting"](/docs/v1.6/tags/troubleshooting): Problem diagnosis and resolution guides. - [One doc tagged with "Unity Catalog"](/docs/v1.6/tags/unity-catalog): Databricks Unity Catalog data governance integration. - [One doc tagged with "YAML"](/docs/v1.6/tags/yaml): YAML configuration syntax and file formats. - [Open Source Acknowledgements](/docs/v1.6/acknowledgements): Spice AI acknowledges the following open source projects for making this project possible: - [API](/docs/v1.6/api): API - [ADBC: Arrow Database Connectivity](/docs/v1.6/api/adbc): ADBC API Documentation - [Arrow Flight SQL API](/docs/v1.6/api/arrow-flight-sql): Query Spice using JDBC/ODBC/ADBC - [Authentication](/docs/v1.6/api/auth): Authentication documentation - [Generate Package](/docs/v1.6/api/HTTP/generate-package): This endpoint generates a zip package from a specified GitHub source. - [List Catalogs](/docs/v1.6/api/HTTP/get-catalogs): List Catalogs - [Get Iceberg API config](/docs/v1.6/api/HTTP/get-config): This endpoint returns the Iceberg Catalog API configuration, including details about overrides, defaults, and available endpoints. - [List Datasets](/docs/v1.6/api/HTTP/get-datasets): This endpoint returns a list of configured datasets. The response can be formatted as **JSON** or **CSV**, - [List Iceberg namespaces](/docs/v1.6/api/HTTP/get-iceberg-namespaces): This endpoint retrieves namespaces available in the Iceberg catalog. - [ML Prediction](/docs/v1.6/api/HTTP/get-model-predict): Make a ML prediction using a specific model. - [List Models](/docs/v1.6/api/HTTP/get-models): List all models, both machine learning and language models, available in the runtime. - [List Spicepods](/docs/v1.6/api/HTTP/get-spicepods): Get a list of spicepods and their details. In CSV format, it will return a summarised form. - [Check Runtime Status](/docs/v1.6/api/HTTP/get-status): Return the status of all connections (http, flight, metrics, opentelemetry) in the runtime. - [Check Namespace exists](/docs/v1.6/api/HTTP/head-namespace): This endpoint returns a 200 OK response if the namespace exists, otherwise it returns a 404 Not Found response. - [List Evals](/docs/v1.6/api/HTTP/list): Return all evals available to run in the runtime. - [Send message to MCP server](/docs/v1.6/api/HTTP/mcp-event): Send message to the MCP endoint, for a given session. - [Establish an MCP SSE Connection](/docs/v1.6/api/HTTP/operation-id): Initiates a Server-Sent Events (SSE) connection using the Model Context Protocol (MCP) to interact with Spice tools. - [Update Refresh SQL](/docs/v1.6/api/HTTP/patch-dataset-acceleration): Update the refresh SQL for a dataset's acceleration. - [Run Tool](/docs/v1.6/api/HTTP/post): The request body and JSON response formats match the tool’s specification. - [Batch ML Predictions](/docs/v1.6/api/HTTP/post-batch-predict): Perform a batch of ML predictions, using multiple models, in one request. This is useful for ensembling or A/B testing different models. - [Create Chat Completion](/docs/v1.6/api/HTTP/post-chat-completions): Creates a model response for the given chat conversation. - [Refresh Dataset](/docs/v1.6/api/HTTP/post-dataset-refresh): Trigger an on-demand refresh for an accelerated dataset. - [Create Embeddings](/docs/v1.6/api/HTTP/post-embeddings): Creates an embedding vector representing the input text. - [Run Eval](/docs/v1.6/api/HTTP/post-eval): Evaluate a model against a eval spice specification - [Text-to-SQL (NSQL)](/docs/v1.6/api/HTTP/post-nsql): Generate and optionally execute a natural-language text-to-SQL (NSQL) query. - [Search](/docs/v1.6/api/HTTP/post-search): Perform a vector similarity search (VSS) operation on a dataset. - [SQL Query](/docs/v1.6/api/HTTP/post-sql): Execute a SQL query and return the results. - [Check Readiness](/docs/v1.6/api/HTTP/ready): Check the runtime status of all the components of the runtime. If the service is ready, it returns an HTTP 200 status with the message 'ready'. If not, it returns a 503 status with the message 'not ready'. - [runtime](/docs/v1.6/api/HTTP/runtime): The spiced runtime - [JDBC: Java Database Connectivity](/docs/v1.6/api/jdbc): JDBC API Documentation - [ODBC: Open Database Connectivity](/docs/v1.6/api/odbc): ODBC API Documentation - [API Overview](/docs/v1.6/api/overview): Spice.ai API overview, including SQL query interfaces, OpenAI-compatible endpoints, Iceberg catalog REST APIs, and the Model Context Protocol (MCP) for integrating external tools. - [TLS: Transport Layer Security](/docs/v1.6/api/tls): Encryption in transit with TLS documentation - [Spice.ai OSS CLI documentation](/docs/v1.6/cli): Detailed documentation on the Spice.ai OSS CLI - [Spice.ai OSS CLI command reference](/docs/v1.6/cli/reference): Spice CLI command reference - [add](/docs/v1.6/cli/reference/add): Add a Spicepod to the project. - [catalogs](/docs/v1.6/cli/reference/catalogs): List catalogs currently loaded by the Spice runtime. - [chat](/docs/v1.6/cli/reference/chat): spice chat CLI documentation - [Completion](/docs/v1.6/cli/reference/completion): Generate the autocompletion script for spice for the specified shell. - [connect](/docs/v1.6/cli/reference/connect): Connect to an app on the Spice.ai Cloud Platform. - [dataset](/docs/v1.6/cli/reference/dataset): Configure a Spice dataset. - [datasets](/docs/v1.6/cli/reference/datasets): Lists datasets loaded by the Spice runtime - [init](/docs/v1.6/cli/reference/init): Initialize Spice app in the current working directory. - [install](/docs/v1.6/cli/reference/install): Download and install the latest version of the Spice runtime. - [login](/docs/v1.6/cli/reference/login): Login to the Spice.ai Platform, or other services with sub-commands. - [models](/docs/v1.6/cli/reference/models): Lists models loaded by the Spice runtime - [pods](/docs/v1.6/cli/reference/pods): Lists Spicepods loaded by the Spice runtime - [refresh](/docs/v1.6/cli/reference/refresh): Refreshes an accelerated dataset loaded by the Spice runtime - [run](/docs/v1.6/cli/reference/run): Run Spice - starts the Spice runtime, installing if necessary. - [search](/docs/v1.6/cli/reference/search): Performs embeddings-based searches across search configured datasets. Note: Search requires the ai feature to be installed. - [sql](/docs/v1.6/cli/reference/sql): Start an interactive SQL query session against the Spice runtime - [status](/docs/v1.6/cli/reference/status): Spice runtime status - [trace](/docs/v1.6/cli/reference/trace): Provides a user-friendly trace stack into an operation that occurred in Spice. This command retrieves and displays task execution traces from the runtime.task_history table. - [upgrade](/docs/v1.6/cli/reference/upgrade): Upgrades the Spice CLI & Runtime to the latest release - [version](/docs/v1.6/cli/reference/version): Outputs the current version of the Spice CLI and runtime - [Configuring Trace Levels](/docs/v1.6/cli/tracing): Configuring Spice.ai OSS trace output verbosity levels - [Clients and Tools](/docs/v1.6/clients): Client and tools - [Datadog](/docs/v1.6/clients/datadog): Monitoring Spice with Datadog - [DBeaver](/docs/v1.6/clients/dbeaver): Configure DBeaver to query Spice via JDBC - [Grafana & Prometheus](/docs/v1.6/clients/grafana): Monitoring Spice instances with Grafana & Prometheus - [JetBrains DataGrip](/docs/v1.6/clients/jetbrains-datagrip): Configure JetBrains Datagrip to query Spice via JDBC - [Microsoft Power BI Connector](/docs/v1.6/clients/powerbi): Use Microsoft Power BI to access, visualize and analyze Spice datasets. - [Apache Superset](/docs/v1.6/clients/superset): Use Apache Superset to query and visualize datasets loaded in Spice. - [Tableau](/docs/v1.6/clients/tableau): Use Tableau to to access, visualise and analyse datasets loaded in Spice. - [Runtime Components](/docs/v1.6/components): Runtime components' - [Catalog Connectors](/docs/v1.6/components/catalogs) - [Databricks Catalog Connector](/docs/v1.6/components/catalogs/databricks): Connect to a Databricks Unity Catalog provider. - [Glue Catalog Connector](/docs/v1.6/components/catalogs/glue): Connect to an AWS Glue Data Catalog. - [Iceberg Catalog Connector](/docs/v1.6/components/catalogs/iceberg): Connect to an Iceberg catalog provider. - [Spice.ai Catalog Connector](/docs/v1.6/components/catalogs/spiceai): Connect to the Spice.ai built-in catalog. - [Unity Catalog Catalog Connector](/docs/v1.6/components/catalogs/unity-catalog): Connect to a Unity Catalog provider. - [Data Accelerators](/docs/v1.6/components/data-accelerators) - [In-Memory Arrow Data Accelerator](/docs/v1.6/components/data-accelerators/arrow): In-Memory Arrow Data Accelerator Documentation - [DuckDB Data Accelerator](/docs/v1.6/components/data-accelerators/duckdb): DuckDB Data Accelerator Documentation - [PostgreSQL Data Accelerator](/docs/v1.6/components/data-accelerators/postgres): PostgreSQL Data Accelerator Documentation - [SQLite Data Accelerator](/docs/v1.6/components/data-accelerators/sqlite): SQLite Data Accelerator Documentation - [Data Connectors](/docs/v1.6/components/data-connectors): Learn how to use Data Connector to query external data. - [Azure BlobFS Data Connector](/docs/v1.6/components/data-connectors/abfs): Azure BlobFS Data Connector Documentation - [ClickHouse Data Connector](/docs/v1.6/components/data-connectors/clickhouse): ClickHouse Data Connector Documentation - [Databricks Data Connector](/docs/v1.6/components/data-connectors/databricks): Databricks Data Connector Documentation - [Debezium Data Connector](/docs/v1.6/components/data-connectors/debezium): Debezium Data Connector Documentation - [Delta Lake Data Connector](/docs/v1.6/components/data-connectors/delta-lake): Delta Lake Data Connector Documentation - [Dremio Data Connector](/docs/v1.6/components/data-connectors/dremio): Dremio Data Connector Documentation - [DuckDB Data Connector](/docs/v1.6/components/data-connectors/duckdb): DuckDB Data Connector Documentation - [DynamoDB Data Connector](/docs/v1.6/components/data-connectors/dynamodb): DynamoDB Data Connector Documentation - [File Data Connector](/docs/v1.6/components/data-connectors/file): File Data Connector Documentation - [Flight SQL Data Connector](/docs/v1.6/components/data-connectors/flightsql): Flight SQL Data Connector Documentation - [FTP/SFTP Data Connector](/docs/v1.6/components/data-connectors/ftp): FTP/SFTP Data Connector Documentation - [GitHub Data Connector](/docs/v1.6/components/data-connectors/github): GitHub Data Connector Documentation - [Glue Data Connector](/docs/v1.6/components/data-connectors/glue): Glue Data Connector Documentation - [GraphQL Data Connector](/docs/v1.6/components/data-connectors/graphql): GraphQL Data Connector Documentation - [HTTP(s) Data Connector](/docs/v1.6/components/data-connectors/https): HTTP(s) Data Connector Documentation - [Iceberg Data Connector](/docs/v1.6/components/data-connectors/iceberg): Connect to and query Apache Iceberg tables - [IMAP Data Connector](/docs/v1.6/components/data-connectors/imap): IMAP Data Connector Documentation - [Kafka Data Connector](/docs/v1.6/components/data-connectors/kafka): Kafka Data Connector Documentation - [Localpod Data Connector](/docs/v1.6/components/data-connectors/localpod): Localpod Data Connector Documentation - [Memory Data Connector](/docs/v1.6/components/data-connectors/memory): Memory Data Connector Documentation - [MongoDB Data Connector](/docs/v1.6/components/data-connectors/mongodb): MongoDB Data Connector Documentation - [Microsoft SQL Server Data Connector](/docs/v1.6/components/data-connectors/mssql): Microsoft SQL Server Data Connector - [MySQL Data Connector](/docs/v1.6/components/data-connectors/mysql): MySQL Data Connector Documentation - [Pull the latest official Spice image](/docs/v1.6/components/data-connectors/odbc): ODBC Data Connector Documentation - [Oracle Data Connector](/docs/v1.6/components/data-connectors/oracle): Oracle Data Connector Documentation - [PostgreSQL Data Connector](/docs/v1.6/components/data-connectors/postgres): PostgreSQL Data Connector Documentation - [Amazon Redshift Data Connector](/docs/v1.6/components/data-connectors/redshift): Connect to Amazon Redshift using the PostgreSQL connector in Spice. - [S3 Data Connector](/docs/v1.6/components/data-connectors/s3): S3 Data Connector Documentation - [SharePoint Data Connector](/docs/v1.6/components/data-connectors/sharepoint): SharePoint Data Connector Documentation - [Snowflake Data Connector](/docs/v1.6/components/data-connectors/snowflake): Snowflake Data Connector Documentation - [Apache Spark Connector](/docs/v1.6/components/data-connectors/spark): Apache Spark Connector Documentation - [Spice.ai Data Connector](/docs/v1.6/components/data-connectors/spiceai): Spice.ai Data Connector Documentation - [Embedding Models](/docs/v1.6/components/embeddings): Describes how embedding models are used in Spice to convert text into numerical vectors for machine learning and search applications. - [Azure OpenAI Embedding Models](/docs/v1.6/components/embeddings/azure): To use an embedding model hosted on Azure OpenAI, specify the azure path in the from field and the following parameters from the Azure OpenAI Model Deployment page: - [Amazon Bedrock Model Provider](/docs/v1.6/components/embeddings/bedrock): Instructions for using Amazon Bedrock embedding models - [Databricks Model Provider](/docs/v1.6/components/embeddings/databricks): Instructions for using Databricks Mosaic AI Models - [HuggingFace Text Embedding Models](/docs/v1.6/components/embeddings/huggingface): To use an embedding model from HuggingFace with Spice, specify the huggingface path in the from field of your configuration. The model and its related files will be automatically downloaded, loaded, and served locally by Spice. - [Local Filesystem Embedding Models](/docs/v1.6/components/embeddings/local): Embedding models can be run with files stored locally. This method is useful for using models that are not hosted on remote services. - [Model2Vec Embedding Models](/docs/v1.6/components/embeddings/model2vec): Model2Vec embedding models help generate efficient static word embeddings from sentence transformer models for use in Spice, supporting local and Hugging Face sources with options for private models and performance tuning. - [OpenAI (or Compatible) Embedding Models](/docs/v1.6/components/embeddings/openai): To use a hosted OpenAI (or compatible) embedding model, specify the openai path in the from field of your configuration. - [Model Providers](/docs/v1.6/components/models): Overview of supported model providers for ML and LLMs in Spice. - [Anthropic Models](/docs/v1.6/components/models/anthropic): Instructions for using language models hosted on Anthropic with Spice. - [Azure OpenAI Models](/docs/v1.6/components/models/azure): Instructions for using Azure OpenAI models - [Amazon Bedrock Models](/docs/v1.6/components/models/bedrock): How to use Amazon Bedrock models with Spice. - [Databricks Model Provider](/docs/v1.6/components/models/databricks): Instructions for using Databricks Mosaic AI Models - [Filesystem Hosted Models](/docs/v1.6/components/models/filesystem): Instructions for using models hosted on a filesystem with Spice. - [HuggingFace](/docs/v1.6/components/models/huggingface): Instructions for using machine learning models hosted on HuggingFace with Spice. - [OpenAI (or Compatible) Language Models](/docs/v1.6/components/models/openai): Instructions for using language models hosted on OpenAI or compatible services with Spice. - [Perplexity Models](/docs/v1.6/components/models/perplexity): Instructions for using language models hosted on Perplexity with Spice. - [Spice Cloud Platform](/docs/v1.6/components/models/spiceai): Instructions for using models hosted on the Spice Cloud Platform with Spice. - [xAI Models](/docs/v1.6/components/models/xai): Instructions for using xAI models - [Secret Stores](/docs/v1.6/components/secret-stores) - [AWS Secrets Manager Secret Store](/docs/v1.6/components/secret-stores/aws-secrets-manager): AWS Secrets Manager Secret Store Documentation - [Environment Secret Store](/docs/v1.6/components/secret-stores/env): Environment Variables Secret Store Documentation - [Keyring Secret Store](/docs/v1.6/components/secret-stores/keyring): Keyring Secret Store Documentation - [Kubernetes Secret Store](/docs/v1.6/components/secret-stores/kubernetes): Kubernetes Secret Store Documentation - [LLM Tools (Function Calling)](/docs/v1.6/components/tools): Overview of supported LLM tools (function calling) and how to define new tools - [Model Context Protocol Tools](/docs/v1.6/components/tools/mcp): Spice integrates with tools and services using the Model Context Protocol (MCP). MCP tools can be configured to run internally or connect to external servers over HTTP using the Server-Sent Events (SSE) protocol. - [Web Search Tool](/docs/v1.6/components/tools/websearch): The Web Search Tool enables Spice models to search the web for information. The tool is available through the websearch tool, and backed by different search engines. - [Vector Engines](/docs/v1.6/components/vectors) - [Amazon S3 Vectors Engine](/docs/v1.6/components/vectors/s3_vectors): Amazon S3 Vectors Engine Documentation - [Views](/docs/v1.6/components/views): Documentation for defining Views in Spice - [Workers Overview](/docs/v1.6/components/workers): Detailed documentation for workers in the Spice runtime. - [Deployment](/docs/v1.6/deployment): Deploy Spice.ai in your environment - [Deployment Architectures](/docs/v1.6/deployment/architectures): Spice.ai Open Source Deployment architectures - [Cluster-Based Deployment (Spice.ai Enterprise)](/docs/v1.6/deployment/architectures/cluster): Deploying Spice as a cluster - [Cloud Hosted](/docs/v1.6/deployment/architectures/hosted): Deploying Spice cloud hosted in the Spice Cloud Platform - [Microservice Deployment (Single or Multiple Replicas)](/docs/v1.6/deployment/architectures/microservice): Deploying Spice as a microservice - [Sharded](/docs/v1.6/deployment/architectures/sharded): Deploying Spice with shards - [Sidecar Deployment](/docs/v1.6/deployment/architectures/sidecar): Deploying Spice as a application sidecar - [Tiered Deployment](/docs/v1.6/deployment/architectures/tiered): Deploying Spice in tiers - [AWS Deployment Options](/docs/v1.6/deployment/aws): Guide to deploying Spice.ai applications on Amazon Web Services (AWS) - [Spice Cloud Platform Deployment](/docs/v1.6/deployment/cloud): Guide to deploying data and AI applications using the managed Spice Cloud Platform - [Docker - Kubernetes](/docs/v1.6/deployment/docker): Running Spice.ai as Docker container - [Docker Sandbox Guide - v1.3.0](/docs/v1.6/deployment/docker/sandbox): Migrating to v1.3.0 - [Helm - Kubernetes](/docs/v1.6/deployment/kubernetes): Deploy Spice.ai in Kubernetes using Helm. - [Frequently Asked Questions](/docs/v1.6/faq): Get answers to common questions about Spice.ai, including its features, differences from other tools, and use cases - [Features](/docs/v1.6/features): Features - [Caching](/docs/v1.6/features/caching): Learn how to use Spice in-memory caching - [Change Data Capture (CDC)](/docs/v1.6/features/cdc): Learn how to use Change Data Capture (CDC) in Spice. - [Data Acceleration](/docs/v1.6/features/data-acceleration): Learn how to use local data acceleration in Spice. - [Constraints](/docs/v1.6/features/data-acceleration/constraints): Learn how to add/configure constraints on local acceleration tables in Spice. - [Data Refresh](/docs/v1.6/features/data-acceleration/data-refresh): Data refresh for accelerated datasets - [Indexes](/docs/v1.6/features/data-acceleration/indexes): Learn how to add indexes to local acceleration tables in Spice. - [Partitioning](/docs/v1.6/features/data-acceleration/partitioning): Partitioning for accelerated datasets - [Data Ingestion](/docs/v1.6/features/data-ingestion): Learn how to ingest data in Spice. - [Embedding Datasets](/docs/v1.6/features/embeddings): Learn how to define, or augment existing datasets with embedding column(s). - [Large Language Models](/docs/v1.6/features/large-language-models): Learn how to configure large language models (LLMs) - [Evaluating Language Models](/docs/v1.6/features/large-language-models/evals): Learn how Spice evaluates, tracks, compares, and improves language model performance for specific tasks - [Model Context Protocol (MCP)](/docs/v1.6/features/large-language-models/mcp): Learn how to use the Model Context Protocol (MCP) with Spice. - [Language Model Memory](/docs/v1.6/features/large-language-models/memory): Learn how to provide LLMs with memory - [Language Model Overrides](/docs/v1.6/features/large-language-models/parameter_overrides): Learn how to override default LLM hyperparameters in Spice. - [System Prompt parameterization](/docs/v1.6/features/large-language-models/parameterized_prompts): Learn how to update system prompts for each request with Jinja-styled templating. - [Load and Serve Models Locally](/docs/v1.6/features/large-language-models/serving): Learn how to load and serve large learning models. - [Language Models Tools](/docs/v1.6/features/large-language-models/tools): Learn how LLMs interact with the Spice runtime. - [Machine Learning Models](/docs/v1.6/features/machine-learning-models): Spice supports loading and serving ONNX models for inference, from sources including local filesystems, Hugging Face, and the Spice.ai Cloud platform. - [Observability & Monitoring](/docs/v1.6/features/observability): Learn how to use Spice telemetry. - [Component Metrics](/docs/v1.6/features/observability/component_metrics): Learn how to enable optional component metrics. - [Query Federation](/docs/v1.6/features/query-federation): Learn how to use federated SQL queries in Spice.ai Open Source - [Search Functionality](/docs/v1.6/features/search): Learn how Spice can search across datasets using database-native and vector-search methods. - [Full-Text Search](/docs/v1.6/features/search/full-text): Learn how Spice can perform full text search - [Vector-Based Search](/docs/v1.6/features/search/vector-search): Learn how Spice can perform searches using vector-based methods. - [Semantic Model](/docs/v1.6/features/semantic-model): Learn how to define and use semantic data models with Spice. - [Getting started with Spice.ai OSS](/docs/v1.6/getting-started): Get started with Spice in 5 minutes - [Community Data](/docs/v1.6/getting-started/spiceai): Connect to the Spice.ai Cloud Platform to access community datasets. - [Spicepods](/docs/v1.6/getting-started/spicepods): An introduction to Spicepods - [Telemetry](/docs/v1.6/getting-started/telemetry): Learn how Spice AI uses anonymous telemetry. - [Spice.ai OSS Installation](/docs/v1.6/installation): Instructions for installing Spice.ai OSS - [Intelligent Applications](/docs/v1.6/intelligent-applications): Building intelligent data and AI-driven applications with Spice.ai - [Spice.ai OSS Reference Docs](/docs/v1.6/reference): Reference documentation on the Spice API, CLI and Pod manifest syntax. - [Cron Schedules](/docs/v1.6/reference/cron): The Runtime supports cron expressions with optional seconds, like /10 which evaluates to every 10th second (10, 20, 30, etc). - [Data Types Reference](/docs/v1.6/reference/datatypes) - [Accelerator Data Types](/docs/v1.6/reference/datatypes/accelerators): Spice adheres to Apache Arrow data types. Data accelerators do not support all Arrow data types. The table below outlines the data type compatibility for each accelerator, and datatype used within the accelerator. - [Object Store Data Types](/docs/v1.6/reference/datatypes/object_store): Spice adheres to Apache Arrow data types. The table below lists the types of supported file type from object stores and their corresponding Apache Arrow type mappings in Spice. - [Duration](/docs/v1.6/reference/duration): Durations are represented as integers with a time unit suffix. - [File Formats](/docs/v1.6/reference/file_format): Spice currently supports CSV and Parquet data file-formats for data connectors that can read files from a file system or cloud object storage (i.e. s3//, file://, etc.). Support for Iceberg and other file-formats are on the roadmap. - [Managing Memory Usage](/docs/v1.6/reference/memory): Guidelines and best practices for managing memory usage and optimizing performance in Spice.ai Open Source deployments. - [Models Grade Report](/docs/v1.6/reference/models): Spice AI graded Large-Language-Model (LLM) evaluation report - [YAML syntax for Spicepod manifests](/docs/v1.6/reference/spicepod): Detailed documentation on the Spicepod manifest syntax (spicepod.yaml) - [catalogs](/docs/v1.6/reference/spicepod/catalogs): Catalogs YAML reference - [Datasets](/docs/v1.6/reference/spicepod/datasets): Datasets YAML reference - [Embeddings](/docs/v1.6/reference/spicepod/embeddings): Embeddings YAML reference - [evals](/docs/v1.6/reference/spicepod/evals): Evaluations YAML reference - [Reserved Keywords](/docs/v1.6/reference/spicepod/keywords): Reserved keywords for datasets - [Models](/docs/v1.6/reference/spicepod/models): Models YAML reference - [Runtime](/docs/v1.6/reference/spicepod/runtime): Runtime YAML reference - [Tools (Function Calling)](/docs/v1.6/reference/spicepod/tools): Tools YAML reference - [Workers](/docs/v1.6/reference/spicepod/workers): Workers YAML reference - [SQL Reference](/docs/v1.6/reference/sql): This section provides a comprehensive reference for SQL support in Spice.ai, including syntax, data types, operators, functions, and system features. The reference is organized by topic for ease of navigation. - [Explain](/docs/v1.6/reference/sql/explain): Spice is built on Apache DataFusion and uses the PostgreSQL dialect, even when querying datasources with different SQL dialects. - [Information Schema](/docs/v1.6/reference/sql/information_schema): Spice is built on Apache DataFusion and uses the PostgreSQL dialect, even when querying datasources with different SQL dialects. - [Operators](/docs/v1.6/reference/sql/operators): Spice is built on Apache DataFusion and uses the PostgreSQL dialect, even when querying datasources with different SQL dialects. - [Prepared Statements](/docs/v1.6/reference/sql/prepared_statements): Spice is built on Apache DataFusion and uses the PostgreSQL dialect, even when querying datasources with different SQL dialects. - [Scalar Functions](/docs/v1.6/reference/sql/scalar_functions): Spice is built on Apache DataFusion and uses the PostgreSQL dialect, even when querying datasources with different SQL dialects. - [Search in SQL](/docs/v1.6/reference/sql/search): Reference for search functions and filtering in Spice SQL. - [SELECT](/docs/v1.6/reference/sql/select): Spice is built on Apache DataFusion and uses the PostgreSQL dialect, even when querying datasources with different SQL dialects. - [Subqueries](/docs/v1.6/reference/sql/subqueries): Spice is built on Apache DataFusion and uses the PostgreSQL dialect, even when querying datasources with different SQL dialects. - [Spice.ai Open Source System Requirements](/docs/v1.6/reference/system_requirements): System requirements for running Spice.ai Open Source - [Task History](/docs/v1.6/reference/task_history): The Spice runtime stores information about completed tasks in the spice.runtime.task_history table. Each task represents a single unit of execution within the runtime, such as a SQL query or an AI chat completion, and is represented by a unique span. - [SDKs](/docs/v1.6/sdks): Connect to spice, using official Spice SDKs - [Dotnet SDK for Spice.ai](/docs/v1.6/sdks/dotnet): Connect to Spice using Spice Dotnet SDK - [Go SDK](/docs/v1.6/sdks/golang): Connect to spice using spice go SDK - [Java SDK](/docs/v1.6/sdks/java): Connect to Spice using Spice Java SDK - [JavaScript SDK](/docs/v1.6/sdks/javascript): Connect to spice using Spice.js SDK - [Python SDK](/docs/v1.6/sdks/python): Connect to spice using spice python SDK - [Rust SDK](/docs/v1.6/sdks/rust): Connect to spice using spice rust SDK - [Troubleshooting Spice](/docs/v1.6/troubleshooting): Review and debug runtime tasks, logs, and diagnostic steps in Spice. - [Spice.ai Use Cases](/docs/v1.6/use-cases): Use cases for Spice.ai' - [AI Applications and Agents](/docs/v1.6/use-cases/ai): AI Applications and Agents - [Agentic AI Applications and Agents](/docs/v1.6/use-cases/ai/agentic-apps): Spice.ai builds intelligent, autonomous agents for SaaS applications, enabling context-aware automation and decision-making. - [Edge-Enabled AI Applications and Agents](/docs/v1.6/use-cases/ai/edge-ai): Spice.ai deploys AI applications and agents across cloud and edge for low-latency decisions in security IoT use cases. - [Federated MCP Client for Distributed Tool Ecosystems](/docs/v1.6/use-cases/ai/federated-mcp-server): Spice.ai federates external MCP servers for scalable, tool-driven AI applications in security, enhancing threat analysis. - [Object-Store Based SQL Query, Search, and LLM Inference Engine](/docs/v1.6/use-cases/ai/object-store-ai-engine): Spice.ai enables SQL queries, hybrid search, and LLM inference on object-store data for security applications, delivering real-time insights. - [Real-Time Decision-Making for Intelligent Applications](/docs/v1.6/use-cases/ai/real-time-decision-making): Spice.ai powers instant, context-aware decisions for applications like security recommendations by grounding AI in federated, low-latency datasets. - [Tool-Augmented AI with Model Context Protocol Server](/docs/v1.6/use-cases/ai/tool-calling-ai): Spice.ai extends AI with custom tools via MCP server in finserv, integrating domain-specific APIs for enhanced functionality. - [Data Federation, Acceleration, and SQL Query](/docs/v1.6/use-cases/data): Data Federation, Acceleration, and SQL Query - [Application Resilience and Performance Optimization](/docs/v1.6/use-cases/data/application-resilence-and-acceleration): Spice.ai colocates dynamic data with SaaS applications as a database CDN, ensuring resilience and high performance. - [Data Mesh for Unified Data Access](/docs/v1.6/use-cases/data/data-mesh): Spice.ai enables unified data access across disparate sources for health-tech applications, fostering a data mesh architecture. - [Database CDN for Enhanced Performance](/docs/v1.6/use-cases/data/database-cdn): Spice.ai acts as a database CDN for SaaS applications, caching dynamic data to ensure high performance and resilience. - [ETL-free Workflows and Data Migrations](/docs/v1.6/use-cases/data/etl-free-workflows): Spice.ai enables data migrations and workflows without ETL by federating legacy and modern systems for seamless transitions. - [Object-Store Data Engine](/docs/v1.6/use-cases/data/object-store-data-engine): Spice.ai federates, accelerates, and queries object-store data for finserv applications, enabling real-time data access without centralized warehouses. - [Reverse-ETL for Operational Workflows](/docs/v1.6/use-cases/data/reverse-etl): Spice.ai serves enriched data from warehouses to operational systems for real-time actions, eliminating complex ETL pipelines. - [Retrieval-Augmented-Generation (RAG)](/docs/v1.6/use-cases/rag): Retrieval-Augmented-Generation (RAG) - [Spice for Retrieval-Augmented-Generation (RAG)](/docs/v1.6/use-cases/rag/applications): Use Spice for Retrieval-Augmented-Generation (RAG) - [Retrieval-Augmented Generation for AI-Powered Reporting](/docs/v1.6/use-cases/rag/reporting): Spice.ai generates dynamic, context-aware AI-driven reports for operational insights in health-tech, ensuring compliance and precision. - [Search & Retrieval](/docs/v1.6/use-cases/search): Search & Retrieval - [Simplifying Real-Time Data Collection and Search](/docs/v1.6/use-cases/search/data-collection-and-search): Spice.ai processes streaming and static data with integrated search for real-time insights, focusing on application logic. - [Enterprise Search and Retrieval](/docs/v1.6/use-cases/search/enterprise-search): Spice.ai powers semantic and precise search for finserv knowledge bases with hybrid vector and keyword capabilities. - [Object-Store Native Search Engine](/docs/v1.6/use-cases/search/object-store-search-engine): Spice.ai powers a cloud-native embedded search engine on object-store data for security applications, enabling semantic and precise search. ### v1.7 Spice is a SQL query, search, and LLM-inference engine, written in Rust, for data-driven applications and AI agents. - [Spice.ai Open Source](/docs/v1.7): Spice is a SQL query, search, and LLM-inference engine, written in Rust, for data-driven applications and AI agents. - [Tags](/docs/v1.7/tags) - [One doc tagged with "Acknowledgements"](/docs/v1.7/tags/acknowledgements): Project acknowledgements, credits, and attributions. - [One doc tagged with "ADBC"](/docs/v1.7/tags/adbc): Arrow Database Connectivity driver configuration and usage. - [4 docs tagged with "API"](/docs/v1.7/tags/api): HTTP, Arrow Flight SQL, ODBC, JDBC, and ADBC API reference. - [One doc tagged with "Arrow"](/docs/v1.7/tags/arrow): Apache Arrow columnar data format integration. - [One doc tagged with "Arrow Flight SQL"](/docs/v1.7/tags/arrow-flight-sql): Arrow Flight SQL protocol implementation and configuration. - [One doc tagged with "Auth"](/docs/v1.7/tags/auth): Authentication and authorization mechanisms. - [One doc tagged with "Authentication"](/docs/v1.7/tags/authentication): User authentication methods and security protocols. - [2 docs tagged with "Azure"](/docs/v1.7/tags/azure): Microsoft Azure cloud services and integrations. - [One doc tagged with "Blob Storage"](/docs/v1.7/tags/blob-storage): Object storage services and blob data access. - [One doc tagged with "Caching"](/docs/v1.7/tags/caching): Data caching strategies and performance optimization. - [5 docs tagged with "Catalogs"](/docs/v1.7/tags/catalogs): Data catalog connectors and metadata management. - [2 docs tagged with "CLI"](/docs/v1.7/tags/cli): Spice command-line interface commands and usage. - [4 docs tagged with "Component Metrics"](/docs/v1.7/tags/component-metrics): Runtime component performance metrics and monitoring. - [One doc tagged with "Components"](/docs/v1.7/tags/components): Runtime components including catalogs, data connectors, and models. - [2 docs tagged with "Configuration"](/docs/v1.7/tags/configuration): System configuration files and runtime settings. - [17 docs tagged with "Data Connectors"](/docs/v1.7/tags/data-connectors): Data source connectors and integration patterns. - [One doc tagged with "Data Lake"](/docs/v1.7/tags/data-lake): Data lake architectures and storage solutions. - [2 docs tagged with "Databricks"](/docs/v1.7/tags/databricks): Databricks platform integration and Unity Catalog support. - [2 docs tagged with "Datasets"](/docs/v1.7/tags/datasets): Dataset definitions and data source configurations. - [One doc tagged with "Debezium"](/docs/v1.7/tags/debezium): Debezium change data capture integration. - [One doc tagged with "Debugging"](/docs/v1.7/tags/debugging): Debugging techniques and troubleshooting tools. - [2 docs tagged with "Delta Lake"](/docs/v1.7/tags/delta-lake): Delta Lake open table format support. - [One doc tagged with "Dependencies"](/docs/v1.7/tags/dependencies): Third-party dependencies and software requirements. - [3 docs tagged with "Deployment"](/docs/v1.7/tags/deployment): Production deployment using Docker and Kubernetes. - [2 docs tagged with "Docker"](/docs/v1.7/tags/docker): Docker containerization and deployment configurations. - [One doc tagged with "DynamoDB"](/docs/v1.7/tags/dynamodb): Amazon DynamoDB NoSQL database integration. - [3 docs tagged with "Embeddings"](/docs/v1.7/tags/embeddings): Vector embeddings and semantic similarity operations. - [One doc tagged with "Evaluation"](/docs/v1.7/tags/evaluation): Model evaluation metrics and assessment frameworks. - [One doc tagged with "Features"](/docs/v1.7/tags/features): Core platform features including acceleration, caching, and search. - [One doc tagged with "Federation"](/docs/v1.7/tags/federation): Cross-database queries and federated data access. - [One doc tagged with "Getting Started"](/docs/v1.7/tags/getting-started): Installation guides and quickstart tutorials. - [One doc tagged with "GitHub"](/docs/v1.7/tags/github): GitHub repository data connector and integration. - [One doc tagged with "Glue"](/docs/v1.7/tags/glue): AWS Glue ETL service and data catalog integration. - [One doc tagged with "Iceberg"](/docs/v1.7/tags/iceberg): Apache Iceberg open table format support. - [One doc tagged with "In-Memory"](/docs/v1.7/tags/in-memory): In-memory data processing and temporary storage. - [One doc tagged with "Integration"](/docs/v1.7/tags/integration): Third-party system integrations and connectivity patterns. - [One doc tagged with "JDBC"](/docs/v1.7/tags/jdbc): Java Database Connectivity driver configuration. - [One doc tagged with "Kafka"](/docs/v1.7/tags/kafka): Apache Kafka event streaming platform integration. - [2 docs tagged with "Kubernetes"](/docs/v1.7/tags/kubernetes): Kubernetes orchestration and secret management. - [One doc tagged with "Logging"](/docs/v1.7/tags/logging): Application logging configuration and log management. - [One doc tagged with "Login"](/docs/v1.7/tags/login): User login processes and session management. - [One doc tagged with "Manifest"](/docs/v1.7/tags/manifest): Configuration manifest files and schema definitions. - [One doc tagged with "MCP"](/docs/v1.7/tags/mcp): Model Context Protocol for AI tool integration. - [2 docs tagged with "Memory"](/docs/v1.7/tags/memory): In-memory data connectors and volatile storage. - [13 docs tagged with "Models"](/docs/v1.7/tags/models): Machine learning models and AI inference engines. - [One doc tagged with "MongoDB"](/docs/v1.7/tags/mongodb): MongoDB NoSQL document database integration. - [One doc tagged with "MySQL"](/docs/v1.7/tags/mysql): MySQL relational database integration. - [One doc tagged with "NoSQL"](/docs/v1.7/tags/nosql): NoSQL database systems and document stores. - [One doc tagged with "Observability"](/docs/v1.7/tags/observability): Monitoring, tracing, and metrics for system visibility. - [One doc tagged with "ODBC"](/docs/v1.7/tags/odbc): Open Database Connectivity driver configuration. - [One doc tagged with "Open Source"](/docs/v1.7/tags/open-source): Open source licenses and community contributions. - [One doc tagged with "OpenAI"](/docs/v1.7/tags/openai): OpenAI API integration and GPT model access. - [One doc tagged with "Oracle"](/docs/v1.7/tags/oracle): Documentation related to Oracle database integration. - [2 docs tagged with "Overrides"](/docs/v1.7/tags/overrides): Parameter overrides and configuration customization. - [2 docs tagged with "Overview"](/docs/v1.7/tags/overview): High-level component and feature overviews. - [2 docs tagged with "Parameters"](/docs/v1.7/tags/parameters): Configuration parameters and runtime options. - [One doc tagged with "Performance"](/docs/v1.7/tags/performance): Performance optimization and benchmarking. - [One doc tagged with "Persistence"](/docs/v1.7/tags/persistence): Data persistence and durable storage mechanisms. - [3 docs tagged with "Reference"](/docs/v1.7/tags/reference): API reference, CLI commands, and configuration syntax. - [One doc tagged with "Relational"](/docs/v1.7/tags/relational): Relational database systems and SQL operations. - [One doc tagged with "Runtime"](/docs/v1.7/tags/runtime): Runtime behavior and execution environment. - [One doc tagged with "Sandbox"](/docs/v1.7/tags/sandbox): Sandbox environments and isolated testing. - [5 docs tagged with "Search"](/docs/v1.7/tags/search): Vector search, semantic search, and ranking capabilities. - [One doc tagged with "Security"](/docs/v1.7/tags/security): Security features and data protection mechanisms. - [2 docs tagged with "SpiceAI"](/docs/v1.7/tags/spiceai): SpiceAI cloud platform and managed services. - [4 docs tagged with "Spicepod"](/docs/v1.7/tags/spicepod): Spicepod configuration files, manifest syntax, and package management. - [2 docs tagged with "SQL"](/docs/v1.7/tags/sql): SQL query language support and database operations. - [3 docs tagged with "Tools"](/docs/v1.7/tags/tools): Development tools and utility integrations. - [2 docs tagged with "Tracing"](/docs/v1.7/tags/tracing): Distributed tracing and request monitoring. - [One doc tagged with "Troubleshooting"](/docs/v1.7/tags/troubleshooting): Problem diagnosis and resolution guides. - [One doc tagged with "Unity Catalog"](/docs/v1.7/tags/unity-catalog): Databricks Unity Catalog data governance integration. - [One doc tagged with "YAML"](/docs/v1.7/tags/yaml): YAML configuration syntax and file formats. - [One doc tagged with "Zipkin"](/docs/v1.7/tags/zipkin): Zipkin distributed tracing system integration. - [Open Source Acknowledgements](/docs/v1.7/acknowledgements): Spice AI acknowledges the following open source projects for making this project possible: - [API](/docs/v1.7/api): API - [ADBC: Arrow Database Connectivity](/docs/v1.7/api/adbc): ADBC API Documentation - [Arrow Flight SQL API](/docs/v1.7/api/arrow-flight-sql): Query Spice using JDBC/ODBC/ADBC - [Authentication](/docs/v1.7/api/auth): Authentication documentation - [Generate Package](/docs/v1.7/api/HTTP/generate-package): This endpoint generates a zip package from a specified GitHub source. - [List Catalogs](/docs/v1.7/api/HTTP/get-catalogs): List Catalogs - [Get Iceberg API config](/docs/v1.7/api/HTTP/get-config): This endpoint returns the Iceberg Catalog API configuration, including details about overrides, defaults, and available endpoints. - [List Datasets](/docs/v1.7/api/HTTP/get-datasets): This endpoint returns a list of configured datasets. The response can be formatted as **JSON** or **CSV**, - [List Iceberg namespaces](/docs/v1.7/api/HTTP/get-iceberg-namespaces): This endpoint retrieves namespaces available in the Iceberg catalog. - [ML Prediction](/docs/v1.7/api/HTTP/get-model-predict): Make a ML prediction using a specific model. - [List Models](/docs/v1.7/api/HTTP/get-models): List all models, both machine learning and language models, available in the runtime. - [List Spicepods](/docs/v1.7/api/HTTP/get-spicepods): Get a list of spicepods and their details. In CSV format, it will return a summarised form. - [Check Runtime Status](/docs/v1.7/api/HTTP/get-status): Return the status of all connections (http, flight, metrics, opentelemetry) in the runtime. - [Check Namespace exists](/docs/v1.7/api/HTTP/head-namespace): This endpoint returns a 200 OK response if the namespace exists, otherwise it returns a 404 Not Found response. - [List Evals](/docs/v1.7/api/HTTP/list): Return all evals available to run in the runtime. - [Send message to MCP server](/docs/v1.7/api/HTTP/mcp-event): Send message to the MCP endoint, for a given session. - [Establish an MCP SSE Connection](/docs/v1.7/api/HTTP/operation-id): Initiates a Server-Sent Events (SSE) connection using the Model Context Protocol (MCP) to interact with Spice tools. - [Update Refresh SQL](/docs/v1.7/api/HTTP/patch-dataset-acceleration): Update the refresh SQL for a dataset's acceleration. - [Run Tool](/docs/v1.7/api/HTTP/post): The request body and JSON response formats match the tool’s specification. - [Batch ML Predictions](/docs/v1.7/api/HTTP/post-batch-predict): Perform a batch of ML predictions, using multiple models, in one request. This is useful for ensembling or A/B testing different models. - [Create Chat Completion](/docs/v1.7/api/HTTP/post-chat-completions): Creates a model response for the given chat conversation. - [Refresh Dataset](/docs/v1.7/api/HTTP/post-dataset-refresh): Trigger an on-demand refresh for an accelerated dataset. - [Create Embeddings](/docs/v1.7/api/HTTP/post-embeddings): Creates an embedding vector representing the input text. - [Run Eval](/docs/v1.7/api/HTTP/post-eval): Evaluate a model against a eval spice specification - [Text-to-SQL (NSQL)](/docs/v1.7/api/HTTP/post-nsql): Generate and optionally execute a natural-language text-to-SQL (NSQL) query. - [Search](/docs/v1.7/api/HTTP/post-search): Perform a vector similarity search (VSS) operation on a dataset. - [SQL Query](/docs/v1.7/api/HTTP/post-sql): Execute a SQL query and return the results. - [Check Readiness](/docs/v1.7/api/HTTP/ready): Check the runtime status of all the components of the runtime. If the service is ready, it returns an HTTP 200 status with the message 'ready'. If not, it returns a 503 status with the message 'not ready'. - [runtime](/docs/v1.7/api/HTTP/runtime): The spiced runtime - [JDBC: Java Database Connectivity](/docs/v1.7/api/jdbc): JDBC API Documentation - [ODBC: Open Database Connectivity](/docs/v1.7/api/odbc): ODBC API Documentation - [API Overview](/docs/v1.7/api/overview): Spice.ai API overview, including SQL query interfaces, OpenAI-compatible endpoints, Iceberg catalog REST APIs, and the Model Context Protocol (MCP) for integrating external tools. - [TLS: Transport Layer Security](/docs/v1.7/api/tls): Encryption in transit with TLS documentation - [Spice.ai OSS CLI documentation](/docs/v1.7/cli): Detailed documentation on the Spice.ai OSS CLI - [Spice.ai OSS CLI command reference](/docs/v1.7/cli/reference): Spice CLI command reference - [add](/docs/v1.7/cli/reference/add): Add a Spicepod to the project. - [catalogs](/docs/v1.7/cli/reference/catalogs): List catalogs currently loaded by the Spice runtime. - [chat](/docs/v1.7/cli/reference/chat): spice chat CLI documentation - [Completion](/docs/v1.7/cli/reference/completion): Generate the autocompletion script for spice for the specified shell. - [connect](/docs/v1.7/cli/reference/connect): Connect to an app on the Spice.ai Cloud Platform. - [dataset](/docs/v1.7/cli/reference/dataset): Configure a Spice dataset. - [datasets](/docs/v1.7/cli/reference/datasets): Lists datasets loaded by the Spice runtime - [init](/docs/v1.7/cli/reference/init): Initialize Spice app in the current working directory. - [install](/docs/v1.7/cli/reference/install): Download and install the latest version of the Spice runtime. - [login](/docs/v1.7/cli/reference/login): Login to the Spice.ai Platform, or other services with sub-commands. - [models](/docs/v1.7/cli/reference/models): Lists models loaded by the Spice runtime - [pods](/docs/v1.7/cli/reference/pods): Lists Spicepods loaded by the Spice runtime - [refresh](/docs/v1.7/cli/reference/refresh): Refreshes an accelerated dataset loaded by the Spice runtime - [run](/docs/v1.7/cli/reference/run): Run Spice - starts the Spice runtime, installing if necessary. - [search](/docs/v1.7/cli/reference/search): Performs embeddings-based searches across search configured datasets. Note: Search requires the ai feature to be installed. - [sql](/docs/v1.7/cli/reference/sql): Start an interactive SQL query session against the Spice runtime - [status](/docs/v1.7/cli/reference/status): Spice runtime status - [trace](/docs/v1.7/cli/reference/trace): Provides a user-friendly trace stack into an operation that occurred in Spice. This command retrieves and displays task execution traces from the runtime.task_history table. - [upgrade](/docs/v1.7/cli/reference/upgrade): Upgrades the Spice CLI & Runtime to the latest release - [version](/docs/v1.7/cli/reference/version): Outputs the current version of the Spice CLI and runtime - [Configuring Trace Levels](/docs/v1.7/cli/tracing): Configuring Spice.ai OSS trace output verbosity levels - [Clients and Tools](/docs/v1.7/clients): Client and tools - [DBeaver](/docs/v1.7/clients/dbeaver): Configure DBeaver to query Spice via JDBC - [JetBrains DataGrip](/docs/v1.7/clients/jetbrains-datagrip): Configure JetBrains Datagrip to query Spice via JDBC - [Microsoft Power BI Connector](/docs/v1.7/clients/powerbi): Use Microsoft Power BI to access, visualize and analyze Spice datasets. - [Apache Superset](/docs/v1.7/clients/superset): Use Apache Superset to query and visualize datasets loaded in Spice. - [Tableau](/docs/v1.7/clients/tableau): Use Tableau to to access, visualise and analyse datasets loaded in Spice. - [Runtime Components](/docs/v1.7/components): Runtime components' - [Catalog Connectors](/docs/v1.7/components/catalogs) - [Databricks Catalog Connector](/docs/v1.7/components/catalogs/databricks): Connect to a Databricks Unity Catalog provider. - [Glue Catalog Connector](/docs/v1.7/components/catalogs/glue): Connect to an AWS Glue Data Catalog. - [Iceberg Catalog Connector](/docs/v1.7/components/catalogs/iceberg): Connect to an Iceberg catalog provider. - [Spice.ai Catalog Connector](/docs/v1.7/components/catalogs/spiceai): Connect to the Spice.ai built-in catalog. - [Unity Catalog Catalog Connector](/docs/v1.7/components/catalogs/unity-catalog): Connect to a Unity Catalog provider. - [Data Accelerators](/docs/v1.7/components/data-accelerators) - [In-Memory Arrow Data Accelerator](/docs/v1.7/components/data-accelerators/arrow): In-Memory Arrow Data Accelerator Documentation - [DuckDB Data Accelerator](/docs/v1.7/components/data-accelerators/duckdb): DuckDB Data Accelerator Documentation - [PostgreSQL Data Accelerator](/docs/v1.7/components/data-accelerators/postgres): PostgreSQL Data Accelerator Documentation - [SQLite Data Accelerator](/docs/v1.7/components/data-accelerators/sqlite): SQLite Data Accelerator Documentation - [Data Connectors](/docs/v1.7/components/data-connectors): Learn how to use Data Connector to query external data. - [Azure BlobFS Data Connector](/docs/v1.7/components/data-connectors/abfs): Azure BlobFS Data Connector Documentation - [ClickHouse Data Connector](/docs/v1.7/components/data-connectors/clickhouse): ClickHouse Data Connector Documentation - [Databricks Data Connector](/docs/v1.7/components/data-connectors/databricks): Databricks Data Connector Documentation - [Debezium Data Connector](/docs/v1.7/components/data-connectors/debezium): Debezium Data Connector Documentation - [Delta Lake Data Connector](/docs/v1.7/components/data-connectors/delta-lake): Delta Lake Data Connector Documentation - [Dremio Data Connector](/docs/v1.7/components/data-connectors/dremio): Dremio Data Connector Documentation - [DuckDB Data Connector](/docs/v1.7/components/data-connectors/duckdb): DuckDB Data Connector Documentation - [DynamoDB Data Connector](/docs/v1.7/components/data-connectors/dynamodb): DynamoDB Data Connector Documentation - [File Data Connector](/docs/v1.7/components/data-connectors/file): File Data Connector Documentation - [Flight SQL Data Connector](/docs/v1.7/components/data-connectors/flightsql): Flight SQL Data Connector Documentation - [FTP/SFTP Data Connector](/docs/v1.7/components/data-connectors/ftp): FTP/SFTP Data Connector Documentation - [GitHub Data Connector](/docs/v1.7/components/data-connectors/github): GitHub Data Connector Documentation - [Glue Data Connector](/docs/v1.7/components/data-connectors/glue): Glue Data Connector Documentation - [GraphQL Data Connector](/docs/v1.7/components/data-connectors/graphql): GraphQL Data Connector Documentation - [HTTP(s) Data Connector](/docs/v1.7/components/data-connectors/https): HTTP(s) Data Connector Documentation - [Iceberg Data Connector](/docs/v1.7/components/data-connectors/iceberg): Connect to and query Apache Iceberg tables - [IMAP Data Connector](/docs/v1.7/components/data-connectors/imap): IMAP Data Connector Documentation - [Kafka Data Connector](/docs/v1.7/components/data-connectors/kafka): Kafka Data Connector Documentation - [Localpod Data Connector](/docs/v1.7/components/data-connectors/localpod): Localpod Data Connector Documentation - [Memory Data Connector](/docs/v1.7/components/data-connectors/memory): Memory Data Connector Documentation - [MongoDB Data Connector](/docs/v1.7/components/data-connectors/mongodb): MongoDB Data Connector Documentation - [Microsoft SQL Server Data Connector](/docs/v1.7/components/data-connectors/mssql): Microsoft SQL Server Data Connector - [MySQL Data Connector](/docs/v1.7/components/data-connectors/mysql): MySQL Data Connector Documentation - [Pull the latest official Spice image](/docs/v1.7/components/data-connectors/odbc): ODBC Data Connector Documentation - [Oracle Data Connector](/docs/v1.7/components/data-connectors/oracle): Oracle Data Connector Documentation - [PostgreSQL Data Connector](/docs/v1.7/components/data-connectors/postgres): PostgreSQL Data Connector Documentation - [Amazon Redshift Data Connector](/docs/v1.7/components/data-connectors/redshift): Connect to Amazon Redshift using the PostgreSQL connector in Spice. - [S3 Data Connector](/docs/v1.7/components/data-connectors/s3): S3 Data Connector Documentation - [SharePoint Data Connector](/docs/v1.7/components/data-connectors/sharepoint): SharePoint Data Connector Documentation - [Snowflake Data Connector](/docs/v1.7/components/data-connectors/snowflake): Snowflake Data Connector Documentation - [Apache Spark Connector](/docs/v1.7/components/data-connectors/spark): Apache Spark Connector Documentation - [Spice.ai Data Connector](/docs/v1.7/components/data-connectors/spiceai): Spice.ai Data Connector Documentation - [Embedding Models](/docs/v1.7/components/embeddings): Describes how embedding models are used in Spice to convert text into numerical vectors for machine learning and search applications. - [Azure OpenAI Embedding Models](/docs/v1.7/components/embeddings/azure): To use an embedding model hosted on Azure OpenAI, specify the azure path in the from field and the following parameters from the Azure OpenAI Model Deployment page: - [Amazon Bedrock Model Provider](/docs/v1.7/components/embeddings/bedrock): Instructions for using Amazon Bedrock embedding models - [Databricks Model Provider](/docs/v1.7/components/embeddings/databricks): Instructions for using Databricks Mosaic AI Models - [HuggingFace Text Embedding Models](/docs/v1.7/components/embeddings/huggingface): To use an embedding model from HuggingFace with Spice, specify the huggingface path in the from field of your configuration. The model and its related files will be automatically downloaded, loaded, and served locally by Spice. - [Local Filesystem Embedding Models](/docs/v1.7/components/embeddings/local): Embedding models can be run with files stored locally. This method is useful for using models that are not hosted on remote services. - [Model2Vec Embedding Models](/docs/v1.7/components/embeddings/model2vec): Model2Vec embedding models help generate efficient static word embeddings from sentence transformer models for use in Spice, supporting local and Hugging Face sources with options for private models and performance tuning. - [OpenAI (or Compatible) Embedding Models](/docs/v1.7/components/embeddings/openai): To use a hosted OpenAI (or compatible) embedding model, specify the openai path in the from field of your configuration. - [Model Providers](/docs/v1.7/components/models): Overview of supported model providers for ML and LLMs in Spice. - [Anthropic Models](/docs/v1.7/components/models/anthropic): Instructions for using language models hosted on Anthropic with Spice. - [Azure OpenAI Models](/docs/v1.7/components/models/azure): Instructions for using Azure OpenAI models - [Amazon Bedrock Models](/docs/v1.7/components/models/bedrock): How to use Amazon Bedrock models with Spice. - [Databricks Model Provider](/docs/v1.7/components/models/databricks): Instructions for using Databricks Mosaic AI Models - [Filesystem Hosted Models](/docs/v1.7/components/models/filesystem): Instructions for using models hosted on a filesystem with Spice. - [HuggingFace](/docs/v1.7/components/models/huggingface): Instructions for using machine learning models hosted on HuggingFace with Spice. - [OpenAI (or Compatible) Language Models](/docs/v1.7/components/models/openai): Instructions for using language models hosted on OpenAI or compatible services with Spice. - [Perplexity Models](/docs/v1.7/components/models/perplexity): Instructions for using language models hosted on Perplexity with Spice. - [Spice Cloud Platform](/docs/v1.7/components/models/spiceai): Instructions for using models hosted on the Spice Cloud Platform with Spice. - [xAI Models](/docs/v1.7/components/models/xai): Instructions for using xAI models - [Secret Stores](/docs/v1.7/components/secret-stores) - [AWS Secrets Manager Secret Store](/docs/v1.7/components/secret-stores/aws-secrets-manager): AWS Secrets Manager Secret Store Documentation - [Environment Secret Store](/docs/v1.7/components/secret-stores/env): Environment Variables Secret Store Documentation - [Keyring Secret Store](/docs/v1.7/components/secret-stores/keyring): Keyring Secret Store Documentation - [Kubernetes Secret Store](/docs/v1.7/components/secret-stores/kubernetes): Kubernetes Secret Store Documentation - [LLM Tools (Function Calling)](/docs/v1.7/components/tools): Overview of supported LLM tools (function calling) and how to define new tools - [Model Context Protocol Tools](/docs/v1.7/components/tools/mcp): Spice integrates with tools and services using the Model Context Protocol (MCP). MCP tools can be configured to run internally or connect to external servers over HTTP using the Server-Sent Events (SSE) protocol. - [Web Search Tool](/docs/v1.7/components/tools/websearch): The Web Search Tool enables Spice models to search the web for information. The tool is available through the websearch tool, and backed by different search engines. - [Vector Engines](/docs/v1.7/components/vectors) - [Amazon S3 Vectors Engine](/docs/v1.7/components/vectors/s3_vectors): Amazon S3 Vectors Engine Documentation - [Views](/docs/v1.7/components/views): Documentation for defining Views in Spice - [Workers Overview](/docs/v1.7/components/workers): Detailed documentation for workers in the Spice runtime. - [Deployment](/docs/v1.7/deployment): Deploy Spice.ai in your environment - [Deployment Architectures](/docs/v1.7/deployment/architectures): Spice.ai Open Source Deployment architectures - [Cluster-Based Deployment (Spice.ai Enterprise)](/docs/v1.7/deployment/architectures/cluster): Deploying Spice as a cluster - [Cloud Hosted](/docs/v1.7/deployment/architectures/hosted): Deploying Spice cloud hosted in the Spice Cloud Platform - [Microservice Deployment (Single or Multiple Replicas)](/docs/v1.7/deployment/architectures/microservice): Deploying Spice as a microservice - [Sharded](/docs/v1.7/deployment/architectures/sharded): Deploying Spice with shards - [Sidecar Deployment](/docs/v1.7/deployment/architectures/sidecar): Deploying Spice as a application sidecar - [Tiered Deployment](/docs/v1.7/deployment/architectures/tiered): Deploying Spice in tiers - [AWS Deployment Options](/docs/v1.7/deployment/aws): Guide to deploying Spice.ai applications on Amazon Web Services (AWS) - [Spice Cloud Platform Deployment](/docs/v1.7/deployment/cloud): Guide to deploying data and AI applications using the managed Spice Cloud Platform - [Docker - Kubernetes](/docs/v1.7/deployment/docker): Running Spice.ai as Docker container - [Docker Sandbox Guide - v1.3.0](/docs/v1.7/deployment/docker/sandbox): Migrating to v1.3.0 - [Helm - Kubernetes](/docs/v1.7/deployment/kubernetes): Deploy Spice.ai in Kubernetes using Helm. - [Frequently Asked Questions](/docs/v1.7/faq): Get answers to common questions about Spice.ai, including its features, differences from other tools, and use cases - [Features](/docs/v1.7/features): Features - [Caching](/docs/v1.7/features/caching): Learn how to use Spice in-memory caching - [Change Data Capture (CDC)](/docs/v1.7/features/cdc): Learn how to use Change Data Capture (CDC) in Spice. - [Data Acceleration](/docs/v1.7/features/data-acceleration): Learn how to use local data acceleration in Spice. - [Constraints](/docs/v1.7/features/data-acceleration/constraints): Learn how to add/configure constraints on local acceleration tables in Spice. - [Data Refresh](/docs/v1.7/features/data-acceleration/data-refresh): Data refresh for accelerated datasets - [Indexes](/docs/v1.7/features/data-acceleration/indexes): Learn how to add indexes to local acceleration tables in Spice. - [Partitioning](/docs/v1.7/features/data-acceleration/partitioning): Partitioning for accelerated datasets - [Data Ingestion](/docs/v1.7/features/data-ingestion): Learn how to ingest data in Spice. - [Embedding Datasets](/docs/v1.7/features/embeddings): Learn how to define, or augment existing datasets with embedding column(s). - [Large Language Models](/docs/v1.7/features/large-language-models): Learn how to configure large language models (LLMs) - [Evaluating Language Models](/docs/v1.7/features/large-language-models/evals): Learn how Spice evaluates, tracks, compares, and improves language model performance for specific tasks - [Model Context Protocol (MCP)](/docs/v1.7/features/large-language-models/mcp): Learn how to use the Model Context Protocol (MCP) with Spice. - [Language Model Memory](/docs/v1.7/features/large-language-models/memory): Learn how to provide LLMs with memory - [Language Model Overrides](/docs/v1.7/features/large-language-models/parameter_overrides): Learn how to override default LLM hyperparameters in Spice. - [System Prompt parameterization](/docs/v1.7/features/large-language-models/parameterized_prompts): Learn how to update system prompts for each request with Jinja-styled templating. - [Load and Serve Models Locally](/docs/v1.7/features/large-language-models/serving): Learn how to load and serve large learning models. - [Language Models Tools](/docs/v1.7/features/large-language-models/tools): Learn how LLMs interact with the Spice runtime. - [Machine Learning Models](/docs/v1.7/features/machine-learning-models): Spice supports loading and serving ONNX models for inference, from sources including local filesystems, Hugging Face, and the Spice.ai Cloud platform. - [Observability & Monitoring](/docs/v1.7/features/observability): Learn how to use Spice telemetry. - [Component Metrics](/docs/v1.7/features/observability/component_metrics): Learn how to enable optional component metrics. - [Query Federation](/docs/v1.7/features/query-federation): Learn how to use federated SQL queries in Spice.ai Open Source - [Search Functionality](/docs/v1.7/features/search): Learn how Spice can search across datasets using database-native and vector-search methods. - [Full-Text Search](/docs/v1.7/features/search/full-text): Learn how Spice can perform full text search - [Vector-Based Search](/docs/v1.7/features/search/vector-search): Learn how Spice can perform searches using vector-based methods. - [Semantic Model](/docs/v1.7/features/semantic-model): Learn how to define and use semantic data models with Spice. - [Web Search](/docs/v1.7/features/web-search): Learn how Spice can perform web search - [Getting started with Spice.ai OSS](/docs/v1.7/getting-started): Get started with Spice in 5 minutes - [Community Data](/docs/v1.7/getting-started/spiceai): Connect to the Spice.ai Cloud Platform to access community datasets. - [Spicepods](/docs/v1.7/getting-started/spicepods): An introduction to Spicepods - [Telemetry](/docs/v1.7/getting-started/telemetry): Learn how Spice AI uses anonymous telemetry. - [Spice.ai OSS Installation](/docs/v1.7/installation): Instructions for installing Spice.ai OSS - [Intelligent Applications](/docs/v1.7/intelligent-applications): Building intelligent data and AI-driven applications with Spice.ai - [Monitoring](/docs/v1.7/monitoring): Monitoring Spice.ai deployments - [Datadog](/docs/v1.7/monitoring/datadog): Monitoring Spice with Datadog - [Grafana & Prometheus](/docs/v1.7/monitoring/grafana): Monitoring Spice instances with Grafana & Prometheus - [Zipkin Integration](/docs/v1.7/monitoring/zipkin): Learn how to integrate Spice with Zipkin tracing. - [Spice.ai OSS Reference Docs](/docs/v1.7/reference): Reference documentation on the Spice API, CLI and Pod manifest syntax. - [Cron Schedules](/docs/v1.7/reference/cron): The Runtime supports cron expressions with optional seconds, like /10 which evaluates to every 10th second (10, 20, 30, etc). - [Data Types Reference](/docs/v1.7/reference/datatypes) - [Accelerator Data Types](/docs/v1.7/reference/datatypes/accelerators): Spice adheres to Apache Arrow data types. Data accelerators do not support all Arrow data types. The table below outlines the data type compatibility for each accelerator, and datatype used within the accelerator. - [Object Store Data Types](/docs/v1.7/reference/datatypes/object_store): Spice adheres to Apache Arrow data types. The table below lists the types of supported file type from object stores and their corresponding Apache Arrow type mappings in Spice. - [Duration](/docs/v1.7/reference/duration): Durations are represented as integers with a time unit suffix. - [File Formats](/docs/v1.7/reference/file_format): Spice currently supports CSV, JSON, and Parquet data file-formats for data connectors that can read files from a file system or cloud object storage (i.e. s3//, file://, etc.). Support for Iceberg and other file-formats are on the roadmap. - [Managing Memory Usage](/docs/v1.7/reference/memory): Guidelines and best practices for managing memory usage and optimizing performance in Spice.ai Open Source deployments. - [Models Grade Report](/docs/v1.7/reference/models): Spice AI graded Large-Language-Model (LLM) evaluation report - [YAML syntax for Spicepod manifests](/docs/v1.7/reference/spicepod): Detailed documentation on the Spicepod manifest syntax (spicepod.yaml) - [catalogs](/docs/v1.7/reference/spicepod/catalogs): Catalogs YAML reference - [Datasets](/docs/v1.7/reference/spicepod/datasets): Datasets YAML reference - [Embeddings](/docs/v1.7/reference/spicepod/embeddings): Embeddings YAML reference - [evals](/docs/v1.7/reference/spicepod/evals): Evaluations YAML reference - [Reserved Keywords](/docs/v1.7/reference/spicepod/keywords): Reserved keywords for datasets - [Models](/docs/v1.7/reference/spicepod/models): Models YAML reference - [Runtime](/docs/v1.7/reference/spicepod/runtime): Runtime YAML reference - [Tools (Function Calling)](/docs/v1.7/reference/spicepod/tools): Tools YAML reference - [Workers](/docs/v1.7/reference/spicepod/workers): Workers YAML reference - [SQL Reference](/docs/v1.7/reference/sql): This section provides a comprehensive reference for SQL support in Spice.ai, including syntax, data types, operators, functions, and system features. The reference is organized by topic for ease of navigation. - [Aggregate Functions](/docs/v1.7/reference/sql/aggregate_functions): Spice is built on Apache DataFusion and uses the PostgreSQL dialect, even when querying datasources with different SQL dialects. Note, when using a data accelerator like DuckDB, function support is specific to each acceleration engine, and not all functions are supported by all acceleration engines. - [Explain](/docs/v1.7/reference/sql/explain): Spice is built on Apache DataFusion and uses the PostgreSQL dialect, even when querying datasources with different SQL dialects. - [Information Schema](/docs/v1.7/reference/sql/information_schema): Spice is built on Apache DataFusion and uses the PostgreSQL dialect, even when querying datasources with different SQL dialects. - [JSON Functions and Operators](/docs/v1.7/reference/sql/json): Reference for JSON functions and operators in Spice SQL - [Operators](/docs/v1.7/reference/sql/operators): Spice is built on Apache DataFusion and uses the PostgreSQL dialect, even when querying datasources with different SQL dialects. - [Prepared Statements](/docs/v1.7/reference/sql/prepared_statements): Spice is built on Apache DataFusion and uses the PostgreSQL dialect, even when querying datasources with different SQL dialects. - [Scalar Functions](/docs/v1.7/reference/sql/scalar_functions): Spice is built on Apache DataFusion and uses the PostgreSQL dialect, even when querying datasources with different SQL dialects. Note, when using a data accelerator like DuckDB, function support is specific to each acceleration engine, and not all functions are supported by all acceleration engines. - [Search in SQL](/docs/v1.7/reference/sql/search): Reference for search functions and filtering in Spice SQL. - [SELECT](/docs/v1.7/reference/sql/select): Spice is built on Apache DataFusion and uses the PostgreSQL dialect, even when querying datasources with different SQL dialects. - [Subqueries](/docs/v1.7/reference/sql/subqueries): Spice is built on Apache DataFusion and uses the PostgreSQL dialect, even when querying datasources with different SQL dialects. - [Spice.ai Open Source System Requirements](/docs/v1.7/reference/system_requirements): System requirements for running Spice.ai Open Source - [Task History](/docs/v1.7/reference/task_history): The Spice runtime stores information about completed tasks in the spice.runtime.task_history table. Each task represents a single unit of execution within the runtime, such as a SQL query or an AI chat completion, and is represented by a unique span. - [SDKs](/docs/v1.7/sdks): Connect to spice, using official Spice SDKs - [Dotnet SDK for Spice.ai](/docs/v1.7/sdks/dotnet): Connect to Spice using Spice Dotnet SDK - [Go SDK](/docs/v1.7/sdks/golang): Connect to spice using spice go SDK - [Java SDK](/docs/v1.7/sdks/java): Connect to Spice using Spice Java SDK - [JavaScript SDK](/docs/v1.7/sdks/javascript): Connect to spice using Spice.js SDK - [Python SDK](/docs/v1.7/sdks/python): Connect to spice using spice python SDK - [Rust SDK](/docs/v1.7/sdks/rust): Connect to spice using spice rust SDK - [Troubleshooting Spice](/docs/v1.7/troubleshooting): Review and debug runtime tasks, logs, and diagnostic steps in Spice. - [Spice.ai Use Cases](/docs/v1.7/use-cases): Use cases for Spice.ai' - [AI Applications and Agents](/docs/v1.7/use-cases/ai): AI Applications and Agents - [Agentic AI Applications and Agents](/docs/v1.7/use-cases/ai/agentic-apps): Spice.ai builds intelligent, autonomous agents for SaaS applications, enabling context-aware automation and decision-making. - [Edge-Enabled AI Applications and Agents](/docs/v1.7/use-cases/ai/edge-ai): Spice.ai deploys AI applications and agents across cloud and edge for low-latency decisions in security IoT use cases. - [Federated MCP Client for Distributed Tool Ecosystems](/docs/v1.7/use-cases/ai/federated-mcp-server): Spice.ai federates external MCP servers for scalable, tool-driven AI applications in security, enhancing threat analysis. - [Object-Store Based SQL Query, Search, and LLM Inference Engine](/docs/v1.7/use-cases/ai/object-store-ai-engine): Spice.ai enables SQL queries, hybrid search, and LLM inference on object-store data for security applications, delivering real-time insights. - [Real-Time Decision-Making for Intelligent Applications](/docs/v1.7/use-cases/ai/real-time-decision-making): Spice.ai powers instant, context-aware decisions for applications like security recommendations by grounding AI in federated, low-latency datasets. - [Tool-Augmented AI with Model Context Protocol Server](/docs/v1.7/use-cases/ai/tool-calling-ai): Spice.ai extends AI with custom tools via MCP server in finserv, integrating domain-specific APIs for enhanced functionality. - [Data Federation, Acceleration, and SQL Query](/docs/v1.7/use-cases/data): Data Federation, Acceleration, and SQL Query - [Application Resilience and Performance Optimization](/docs/v1.7/use-cases/data/application-resilence-and-acceleration): Spice.ai colocates dynamic data with SaaS applications as a database CDN, ensuring resilience and high performance. - [Data Mesh for Unified Data Access](/docs/v1.7/use-cases/data/data-mesh): Spice.ai enables unified data access across disparate sources for health-tech applications, fostering a data mesh architecture. - [Database CDN for Enhanced Performance](/docs/v1.7/use-cases/data/database-cdn): Spice.ai acts as a database CDN for SaaS applications, caching dynamic data to ensure high performance and resilience. - [ETL-free Workflows and Data Migrations](/docs/v1.7/use-cases/data/etl-free-workflows): Spice.ai enables data migrations and workflows without ETL by federating legacy and modern systems for seamless transitions. - [Object-Store Data Engine](/docs/v1.7/use-cases/data/object-store-data-engine): Spice.ai federates, accelerates, and queries object-store data for finserv applications, enabling real-time data access without centralized warehouses. - [Reverse-ETL for Operational Workflows](/docs/v1.7/use-cases/data/reverse-etl): Spice.ai serves enriched data from warehouses to operational systems for real-time actions, eliminating complex ETL pipelines. - [Retrieval-Augmented-Generation (RAG)](/docs/v1.7/use-cases/rag): Retrieval-Augmented-Generation (RAG) - [Spice for Retrieval-Augmented-Generation (RAG)](/docs/v1.7/use-cases/rag/applications): Use Spice for Retrieval-Augmented-Generation (RAG) - [Retrieval-Augmented Generation for AI-Powered Reporting](/docs/v1.7/use-cases/rag/reporting): Spice.ai generates dynamic, context-aware AI-driven reports for operational insights in health-tech, ensuring compliance and precision. - [Search & Retrieval](/docs/v1.7/use-cases/search): Search & Retrieval - [Simplifying Real-Time Data Collection and Search](/docs/v1.7/use-cases/search/data-collection-and-search): Spice.ai processes streaming and static data with integrated search for real-time insights, focusing on application logic. - [Enterprise Search and Retrieval](/docs/v1.7/use-cases/search/enterprise-search): Spice.ai powers semantic and precise search for finserv knowledge bases with hybrid vector and keyword capabilities. - [Object-Store Native Search Engine](/docs/v1.7/use-cases/search/object-store-search-engine): Spice.ai powers a cloud-native embedded search engine on object-store data for security applications, enabling semantic and precise search. ### v1.8 Spice is a SQL query, search, and LLM-inference engine, written in Rust, for data-driven applications and AI agents. - [Spice.ai Open Source](/docs/v1.8): Spice is a SQL query, search, and LLM-inference engine, written in Rust, for data-driven applications and AI agents. - [Tags](/docs/v1.8/tags) - [One doc tagged with "Acknowledgements"](/docs/v1.8/tags/acknowledgements): Project acknowledgements, credits, and attributions. - [One doc tagged with "ADBC"](/docs/v1.8/tags/adbc): Arrow Database Connectivity driver configuration and usage. - [4 docs tagged with "API"](/docs/v1.8/tags/api): HTTP, Arrow Flight SQL, ODBC, JDBC, and ADBC API reference. - [One doc tagged with "Arrow"](/docs/v1.8/tags/arrow): Apache Arrow columnar data format integration. - [One doc tagged with "Arrow Flight SQL"](/docs/v1.8/tags/arrow-flight-sql): Arrow Flight SQL protocol implementation and configuration. - [One doc tagged with "Auth"](/docs/v1.8/tags/auth): Authentication and authorization mechanisms. - [One doc tagged with "Authentication"](/docs/v1.8/tags/authentication): User authentication methods and security protocols. - [2 docs tagged with "Azure"](/docs/v1.8/tags/azure): Microsoft Azure cloud services and integrations. - [One doc tagged with "Blob Storage"](/docs/v1.8/tags/blob-storage): Object storage services and blob data access. - [One doc tagged with "Caching"](/docs/v1.8/tags/caching): Data caching strategies and performance optimization. - [5 docs tagged with "Catalogs"](/docs/v1.8/tags/catalogs): Data catalog connectors and metadata management. - [2 docs tagged with "CLI"](/docs/v1.8/tags/cli): Spice command-line interface commands and usage. - [4 docs tagged with "Component Metrics"](/docs/v1.8/tags/component-metrics): Runtime component performance metrics and monitoring. - [One doc tagged with "Components"](/docs/v1.8/tags/components): Runtime components including catalogs, data connectors, and models. - [2 docs tagged with "Configuration"](/docs/v1.8/tags/configuration): System configuration files and runtime settings. - [19 docs tagged with "Data Connectors"](/docs/v1.8/tags/data-connectors): Data source connectors and integration patterns. - [One doc tagged with "Data Lake"](/docs/v1.8/tags/data-lake): Data lake architectures and storage solutions. - [2 docs tagged with "Databricks"](/docs/v1.8/tags/databricks): Databricks platform integration and Unity Catalog support. - [2 docs tagged with "Datasets"](/docs/v1.8/tags/datasets): Dataset definitions and data source configurations. - [One doc tagged with "Debezium"](/docs/v1.8/tags/debezium): Debezium change data capture integration. - [One doc tagged with "Debugging"](/docs/v1.8/tags/debugging): Debugging techniques and troubleshooting tools. - [2 docs tagged with "Delta Lake"](/docs/v1.8/tags/delta-lake): Delta Lake open table format support. - [One doc tagged with "Dependencies"](/docs/v1.8/tags/dependencies): Third-party dependencies and software requirements. - [3 docs tagged with "Deployment"](/docs/v1.8/tags/deployment): Production deployment using Docker and Kubernetes. - [2 docs tagged with "Docker"](/docs/v1.8/tags/docker): Docker containerization and deployment configurations. - [One doc tagged with "DynamoDB"](/docs/v1.8/tags/dynamodb): Amazon DynamoDB NoSQL database integration. - [3 docs tagged with "Embeddings"](/docs/v1.8/tags/embeddings): Vector embeddings and semantic similarity operations. - [One doc tagged with "Evaluation"](/docs/v1.8/tags/evaluation): Model evaluation metrics and assessment frameworks. - [2 docs tagged with "Features"](/docs/v1.8/tags/features): Core platform features including acceleration, caching, and search. - [One doc tagged with "Federation"](/docs/v1.8/tags/federation): Cross-database queries and federated data access. - [One doc tagged with "Getting Started"](/docs/v1.8/tags/getting-started): Installation guides and quickstart tutorials. - [One doc tagged with "GitHub"](/docs/v1.8/tags/github): GitHub repository data connector and integration. - [2 docs tagged with "Glue"](/docs/v1.8/tags/glue): AWS Glue ETL service and data catalog integration. - [2 docs tagged with "Iceberg"](/docs/v1.8/tags/iceberg): Apache Iceberg open table format support. - [One doc tagged with "In-Memory"](/docs/v1.8/tags/in-memory): In-memory data processing and temporary storage. - [One doc tagged with "Integration"](/docs/v1.8/tags/integration): Third-party system integrations and connectivity patterns. - [One doc tagged with "JDBC"](/docs/v1.8/tags/jdbc): Java Database Connectivity driver configuration. - [One doc tagged with "Kafka"](/docs/v1.8/tags/kafka): Apache Kafka event streaming platform integration. - [2 docs tagged with "Kubernetes"](/docs/v1.8/tags/kubernetes): Kubernetes orchestration and secret management. - [One doc tagged with "Logging"](/docs/v1.8/tags/logging): Application logging configuration and log management. - [One doc tagged with "Login"](/docs/v1.8/tags/login): User login processes and session management. - [One doc tagged with "Manifest"](/docs/v1.8/tags/manifest): Configuration manifest files and schema definitions. - [One doc tagged with "MCP"](/docs/v1.8/tags/mcp): Model Context Protocol for AI tool integration. - [2 docs tagged with "Memory"](/docs/v1.8/tags/memory): In-memory data connectors and volatile storage. - [13 docs tagged with "Models"](/docs/v1.8/tags/models): Machine learning models and AI inference engines. - [One doc tagged with "MongoDB"](/docs/v1.8/tags/mongodb): MongoDB NoSQL document database integration. - [One doc tagged with "MySQL"](/docs/v1.8/tags/mysql): MySQL relational database integration. - [One doc tagged with "NoSQL"](/docs/v1.8/tags/nosql): NoSQL database systems and document stores. - [One doc tagged with "Observability"](/docs/v1.8/tags/observability): Monitoring, tracing, and metrics for system visibility. - [One doc tagged with "ODBC"](/docs/v1.8/tags/odbc): Open Database Connectivity driver configuration. - [One doc tagged with "Open Source"](/docs/v1.8/tags/open-source): Open source licenses and community contributions. - [One doc tagged with "OpenAI"](/docs/v1.8/tags/openai): OpenAI API integration and GPT model access. - [One doc tagged with "Oracle"](/docs/v1.8/tags/oracle): Documentation related to Oracle database integration. - [2 docs tagged with "Overrides"](/docs/v1.8/tags/overrides): Parameter overrides and configuration customization. - [2 docs tagged with "Overview"](/docs/v1.8/tags/overview): High-level component and feature overviews. - [2 docs tagged with "Parameters"](/docs/v1.8/tags/parameters): Configuration parameters and runtime options. - [One doc tagged with "Performance"](/docs/v1.8/tags/performance): Performance optimization and benchmarking. - [One doc tagged with "Persistence"](/docs/v1.8/tags/persistence): Data persistence and durable storage mechanisms. - [3 docs tagged with "Reference"](/docs/v1.8/tags/reference): API reference, CLI commands, and configuration syntax. - [One doc tagged with "Relational"](/docs/v1.8/tags/relational): Relational database systems and SQL operations. - [One doc tagged with "Runtime"](/docs/v1.8/tags/runtime): Runtime behavior and execution environment. - [One doc tagged with "Sandbox"](/docs/v1.8/tags/sandbox): Sandbox environments and isolated testing. - [5 docs tagged with "Search"](/docs/v1.8/tags/search): Vector search, semantic search, and ranking capabilities. - [One doc tagged with "Security"](/docs/v1.8/tags/security): Security features and data protection mechanisms. - [2 docs tagged with "SpiceAI"](/docs/v1.8/tags/spiceai): SpiceAI cloud platform and managed services. - [4 docs tagged with "Spicepod"](/docs/v1.8/tags/spicepod): Spicepod configuration files, manifest syntax, and package management. - [2 docs tagged with "SQL"](/docs/v1.8/tags/sql): SQL query language support and database operations. - [3 docs tagged with "Tools"](/docs/v1.8/tags/tools): Development tools and utility integrations. - [2 docs tagged with "Tracing"](/docs/v1.8/tags/tracing): Distributed tracing and request monitoring. - [One doc tagged with "Troubleshooting"](/docs/v1.8/tags/troubleshooting): Problem diagnosis and resolution guides. - [One doc tagged with "Unity Catalog"](/docs/v1.8/tags/unity-catalog): Databricks Unity Catalog data governance integration. - [6 docs tagged with "Write"](/docs/v1.8/tags/write): Data connectors and catalogs that support write operations. - [One doc tagged with "YAML"](/docs/v1.8/tags/yaml): YAML configuration syntax and file formats. - [One doc tagged with "Zipkin"](/docs/v1.8/tags/zipkin): Zipkin distributed tracing system integration. - [Open Source Acknowledgements](/docs/v1.8/acknowledgements): Spice AI acknowledges the following open source projects for making this project possible: - [API](/docs/v1.8/api): API - [ADBC: Arrow Database Connectivity](/docs/v1.8/api/adbc): ADBC API Documentation - [Arrow Flight SQL API](/docs/v1.8/api/arrow-flight-sql): Query Spice using JDBC/ODBC/ADBC - [Authentication](/docs/v1.8/api/auth): Authentication documentation - [Generate Package](/docs/v1.8/api/HTTP/generate-package): This endpoint generates a zip package from a specified GitHub source. - [List Catalogs](/docs/v1.8/api/HTTP/get-catalogs): List Catalogs - [Get Iceberg API config](/docs/v1.8/api/HTTP/get-config): This endpoint returns the Iceberg Catalog API configuration, including details about overrides, defaults, and available endpoints. - [List Datasets](/docs/v1.8/api/HTTP/get-datasets): This endpoint returns a list of configured datasets. The response can be formatted as **JSON** or **CSV**, - [List Iceberg namespaces](/docs/v1.8/api/HTTP/get-iceberg-namespaces): This endpoint retrieves namespaces available in the Iceberg catalog. - [ML Prediction](/docs/v1.8/api/HTTP/get-model-predict): Make a ML prediction using a specific model. - [List Models](/docs/v1.8/api/HTTP/get-models): List all models, both machine learning and language models, available in the runtime. - [List Spicepods](/docs/v1.8/api/HTTP/get-spicepods): Get a list of spicepods and their details. In CSV format, it will return a summarised form. - [Check Runtime Status](/docs/v1.8/api/HTTP/get-status): Return the status of all connections (http, flight, metrics, opentelemetry) in the runtime. - [Check Namespace exists](/docs/v1.8/api/HTTP/head-namespace): This endpoint returns a 200 OK response if the namespace exists, otherwise it returns a 404 Not Found response. - [List Evals](/docs/v1.8/api/HTTP/list): Return all evals available to run in the runtime. - [Send message to MCP server](/docs/v1.8/api/HTTP/mcp-event): Send message to the MCP endoint, for a given session. - [Establish an MCP SSE Connection](/docs/v1.8/api/HTTP/operation-id): Initiates a Server-Sent Events (SSE) connection using the Model Context Protocol (MCP) to interact with Spice tools. - [Update Refresh SQL](/docs/v1.8/api/HTTP/patch-dataset-acceleration): Update the refresh SQL for a dataset's acceleration. - [Run Tool](/docs/v1.8/api/HTTP/post): The request body and JSON response formats match the tool’s specification. - [Batch ML Predictions](/docs/v1.8/api/HTTP/post-batch-predict): Perform a batch of ML predictions, using multiple models, in one request. This is useful for ensembling or A/B testing different models. - [Create Chat Completion](/docs/v1.8/api/HTTP/post-chat-completions): Creates a model response for the given chat conversation. - [Refresh Dataset](/docs/v1.8/api/HTTP/post-dataset-refresh): Trigger an on-demand refresh for an accelerated dataset. - [Create Embeddings](/docs/v1.8/api/HTTP/post-embeddings): Creates an embedding vector representing the input text. - [Run Eval](/docs/v1.8/api/HTTP/post-eval): Evaluate a model against a eval spice specification - [Text-to-SQL (NSQL)](/docs/v1.8/api/HTTP/post-nsql): Generate and optionally execute a natural-language text-to-SQL (NSQL) query. - [Search](/docs/v1.8/api/HTTP/post-search): Perform a vector similarity search (VSS) operation on a dataset. - [SQL Query](/docs/v1.8/api/HTTP/post-sql): Execute a SQL query and return the results. - [Check Readiness](/docs/v1.8/api/HTTP/ready): Check the runtime status of all the components of the runtime. If the service is ready, it returns an HTTP 200 status with the message 'ready'. If not, it returns a 503 status with the message 'not ready'. - [runtime](/docs/v1.8/api/HTTP/runtime): The spiced runtime - [JDBC: Java Database Connectivity](/docs/v1.8/api/jdbc): JDBC API Documentation - [ODBC: Open Database Connectivity](/docs/v1.8/api/odbc): ODBC API Documentation - [API Overview](/docs/v1.8/api/overview): Spice.ai API overview, including SQL query interfaces, OpenAI-compatible endpoints, Iceberg catalog REST APIs, and the Model Context Protocol (MCP) for integrating external tools. - [TLS: Transport Layer Security](/docs/v1.8/api/tls): Encryption in transit with TLS documentation - [Spice.ai OSS CLI documentation](/docs/v1.8/cli): Detailed documentation on the Spice.ai OSS CLI - [Spice.ai OSS CLI command reference](/docs/v1.8/cli/reference): Spice CLI command reference - [add](/docs/v1.8/cli/reference/add): Add a Spicepod to the project. - [catalogs](/docs/v1.8/cli/reference/catalogs): List catalogs currently loaded by the Spice runtime. - [chat](/docs/v1.8/cli/reference/chat): spice chat CLI documentation - [Completion](/docs/v1.8/cli/reference/completion): Generate the autocompletion script for spice for the specified shell. - [connect](/docs/v1.8/cli/reference/connect): Connect to an app on the Spice.ai Cloud Platform. - [dataset](/docs/v1.8/cli/reference/dataset): Configure a Spice dataset. - [datasets](/docs/v1.8/cli/reference/datasets): Lists datasets loaded by the Spice runtime - [init](/docs/v1.8/cli/reference/init): Initialize Spice app in the current working directory. - [install](/docs/v1.8/cli/reference/install): Download and install the latest version of the Spice runtime. - [login](/docs/v1.8/cli/reference/login): Login to the Spice.ai Platform, or other services with sub-commands. - [models](/docs/v1.8/cli/reference/models): Lists models loaded by the Spice runtime - [pods](/docs/v1.8/cli/reference/pods): Lists Spicepods loaded by the Spice runtime - [refresh](/docs/v1.8/cli/reference/refresh): Refreshes an accelerated dataset loaded by the Spice runtime - [run](/docs/v1.8/cli/reference/run): Run Spice - starts the Spice runtime, installing if necessary. - [search](/docs/v1.8/cli/reference/search): Performs embeddings-based searches across search configured datasets. Note: Search requires the ai feature to be installed. - [sql](/docs/v1.8/cli/reference/sql): Start an interactive SQL query session against the Spice runtime - [status](/docs/v1.8/cli/reference/status): Spice runtime status - [trace](/docs/v1.8/cli/reference/trace): Provides a user-friendly trace stack into an operation that occurred in Spice. This command retrieves and displays task execution traces from the runtime.task_history table. - [upgrade](/docs/v1.8/cli/reference/upgrade): Upgrades the Spice CLI & Runtime to the latest release - [version](/docs/v1.8/cli/reference/version): Outputs the current version of the Spice CLI and runtime - [Configuring Trace Levels](/docs/v1.8/cli/tracing): Configuring Spice.ai OSS trace output verbosity levels - [Clients and Tools](/docs/v1.8/clients): Client and tools - [DBeaver](/docs/v1.8/clients/dbeaver): Configure DBeaver to query Spice via JDBC - [JetBrains DataGrip](/docs/v1.8/clients/jetbrains-datagrip): Configure JetBrains Datagrip to query Spice via JDBC - [Microsoft Power BI Connector](/docs/v1.8/clients/powerbi): Use Microsoft Power BI to access, visualize and analyze Spice datasets. - [Apache Superset](/docs/v1.8/clients/superset): Use Apache Superset to query and visualize datasets loaded in Spice. - [Tableau](/docs/v1.8/clients/tableau): Use Tableau to to access, visualise and analyse datasets loaded in Spice. - [Runtime Components](/docs/v1.8/components): Runtime components' - [Catalog Connectors](/docs/v1.8/components/catalogs) - [Databricks Catalog Connector](/docs/v1.8/components/catalogs/databricks): Connect to a Databricks Unity Catalog provider. - [Glue Catalog Connector](/docs/v1.8/components/catalogs/glue): Connect to an AWS Glue Data Catalog. - [Iceberg Catalog Connector](/docs/v1.8/components/catalogs/iceberg): Connect to an Iceberg catalog provider. - [Spice.ai Catalog Connector](/docs/v1.8/components/catalogs/spiceai): Connect to the Spice.ai built-in catalog. - [Unity Catalog Catalog Connector](/docs/v1.8/components/catalogs/unity-catalog): Connect to a Unity Catalog provider. - [Data Accelerators](/docs/v1.8/components/data-accelerators) - [In-Memory Arrow Data Accelerator](/docs/v1.8/components/data-accelerators/arrow): In-Memory Arrow Data Accelerator Documentation - [DuckDB Data Accelerator](/docs/v1.8/components/data-accelerators/duckdb): DuckDB Data Accelerator Documentation - [PostgreSQL Data Accelerator](/docs/v1.8/components/data-accelerators/postgres): PostgreSQL Data Accelerator Documentation - [SQLite Data Accelerator](/docs/v1.8/components/data-accelerators/sqlite): SQLite Data Accelerator Documentation - [Data Connectors](/docs/v1.8/components/data-connectors): Learn how to use Data Connector to query external data. - [Azure BlobFS Data Connector](/docs/v1.8/components/data-connectors/abfs): Azure BlobFS Data Connector Documentation - [ClickHouse Data Connector](/docs/v1.8/components/data-connectors/clickhouse): ClickHouse Data Connector Documentation - [Databricks Data Connector](/docs/v1.8/components/data-connectors/databricks): Databricks Data Connector Documentation - [Debezium Data Connector](/docs/v1.8/components/data-connectors/debezium): Debezium Data Connector Documentation - [Delta Lake Data Connector](/docs/v1.8/components/data-connectors/delta-lake): Delta Lake Data Connector Documentation - [Dremio Data Connector](/docs/v1.8/components/data-connectors/dremio): Dremio Data Connector Documentation - [DuckDB Data Connector](/docs/v1.8/components/data-connectors/duckdb): DuckDB Data Connector Documentation - [DynamoDB Data Connector](/docs/v1.8/components/data-connectors/dynamodb): DynamoDB Data Connector Documentation - [File Data Connector](/docs/v1.8/components/data-connectors/file): File Data Connector Documentation - [Flight SQL Data Connector](/docs/v1.8/components/data-connectors/flightsql): Flight SQL Data Connector Documentation - [FTP/SFTP Data Connector](/docs/v1.8/components/data-connectors/ftp): FTP/SFTP Data Connector Documentation - [GitHub Data Connector](/docs/v1.8/components/data-connectors/github): GitHub Data Connector Documentation - [Glue Data Connector](/docs/v1.8/components/data-connectors/glue): Glue Data Connector Documentation - [GraphQL Data Connector](/docs/v1.8/components/data-connectors/graphql): GraphQL Data Connector Documentation - [HTTP(s) Data Connector](/docs/v1.8/components/data-connectors/https): HTTP(s) Data Connector Documentation - [Iceberg Data Connector](/docs/v1.8/components/data-connectors/iceberg): Connect to and query Apache Iceberg tables - [IMAP Data Connector](/docs/v1.8/components/data-connectors/imap): IMAP Data Connector Documentation - [Kafka Data Connector](/docs/v1.8/components/data-connectors/kafka): Kafka Data Connector Documentation - [Localpod Data Connector](/docs/v1.8/components/data-connectors/localpod): Localpod Data Connector Documentation - [Memory Data Connector](/docs/v1.8/components/data-connectors/memory): Memory Data Connector Documentation - [MongoDB Data Connector](/docs/v1.8/components/data-connectors/mongodb): MongoDB Data Connector Documentation - [Microsoft SQL Server Data Connector](/docs/v1.8/components/data-connectors/mssql): Microsoft SQL Server Data Connector - [MySQL Data Connector](/docs/v1.8/components/data-connectors/mysql): MySQL Data Connector Documentation - [Pull the latest official Spice image](/docs/v1.8/components/data-connectors/odbc): ODBC Data Connector Documentation - [Oracle Data Connector](/docs/v1.8/components/data-connectors/oracle): Oracle Data Connector Documentation - [PostgreSQL Data Connector](/docs/v1.8/components/data-connectors/postgres): PostgreSQL Data Connector Documentation - [Amazon Redshift Data Connector](/docs/v1.8/components/data-connectors/redshift): Connect to Amazon Redshift using the PostgreSQL connector in Spice. - [S3 Data Connector](/docs/v1.8/components/data-connectors/s3): S3 Data Connector Documentation - [SharePoint Data Connector](/docs/v1.8/components/data-connectors/sharepoint): SharePoint Data Connector Documentation - [Snowflake Data Connector](/docs/v1.8/components/data-connectors/snowflake): Snowflake Data Connector Documentation - [Apache Spark Connector](/docs/v1.8/components/data-connectors/spark): Apache Spark Connector Documentation - [Spice.ai Data Connector](/docs/v1.8/components/data-connectors/spiceai): Spice.ai Data Connector Documentation - [Embedding Models](/docs/v1.8/components/embeddings): Describes how embedding models are used in Spice to convert text into numerical vectors for machine learning and search applications. - [Azure OpenAI Embedding Models](/docs/v1.8/components/embeddings/azure): To use an embedding model hosted on Azure OpenAI, specify the azure path in the from field and the following parameters from the Azure OpenAI Model Deployment page: - [Amazon Bedrock Model Provider](/docs/v1.8/components/embeddings/bedrock): Instructions for using Amazon Bedrock embedding models - [Databricks Model Provider](/docs/v1.8/components/embeddings/databricks): Instructions for using Databricks Mosaic AI Models - [HuggingFace Text Embedding Models](/docs/v1.8/components/embeddings/huggingface): To use an embedding model from HuggingFace with Spice, specify the huggingface path in the from field of your configuration. The model and its related files will be automatically downloaded, loaded, and served locally by Spice. - [Local Filesystem Embedding Models](/docs/v1.8/components/embeddings/local): Embedding models can be run with files stored locally. This method is useful for using models that are not hosted on remote services. - [Model2Vec Embedding Models](/docs/v1.8/components/embeddings/model2vec): Model2Vec embedding models help generate efficient static word embeddings from sentence transformer models for use in Spice, supporting local and Hugging Face sources with options for private models and performance tuning. - [OpenAI (or Compatible) Embedding Models](/docs/v1.8/components/embeddings/openai): To use a hosted OpenAI (or compatible) embedding model, specify the openai path in the from field of your configuration. - [Model Providers](/docs/v1.8/components/models): Overview of supported model providers for ML and LLMs in Spice. - [Anthropic Models](/docs/v1.8/components/models/anthropic): Instructions for using language models hosted on Anthropic with Spice. - [Azure OpenAI Models](/docs/v1.8/components/models/azure): Instructions for using Azure OpenAI models - [Amazon Bedrock Models](/docs/v1.8/components/models/bedrock): How to use Amazon Bedrock models with Spice. - [Databricks Model Provider](/docs/v1.8/components/models/databricks): Instructions for using Databricks Mosaic AI Models - [Filesystem Hosted Models](/docs/v1.8/components/models/filesystem): Instructions for using models hosted on a filesystem with Spice. - [HuggingFace](/docs/v1.8/components/models/huggingface): Instructions for using machine learning models hosted on HuggingFace with Spice. - [OpenAI (or Compatible) Language Models](/docs/v1.8/components/models/openai): Instructions for using language models hosted on OpenAI or compatible services with Spice. - [Perplexity Models](/docs/v1.8/components/models/perplexity): Instructions for using language models hosted on Perplexity with Spice. - [Spice Cloud Platform](/docs/v1.8/components/models/spiceai): Instructions for using models hosted on the Spice Cloud Platform with Spice. - [xAI Models](/docs/v1.8/components/models/xai): Instructions for using xAI models - [Secret Stores](/docs/v1.8/components/secret-stores) - [AWS Secrets Manager Secret Store](/docs/v1.8/components/secret-stores/aws-secrets-manager): AWS Secrets Manager Secret Store Documentation - [Environment Secret Store](/docs/v1.8/components/secret-stores/env): Environment Variables Secret Store Documentation - [Keyring Secret Store](/docs/v1.8/components/secret-stores/keyring): Keyring Secret Store Documentation - [Kubernetes Secret Store](/docs/v1.8/components/secret-stores/kubernetes): Kubernetes Secret Store Documentation - [LLM Tools (Function Calling)](/docs/v1.8/components/tools): Overview of supported LLM tools (function calling) and how to define new tools - [Model Context Protocol Tools](/docs/v1.8/components/tools/mcp): Spice integrates with tools and services using the Model Context Protocol (MCP). MCP tools can be configured to run internally or connect to external servers over HTTP using the Server-Sent Events (SSE) protocol. - [Web Search Tool](/docs/v1.8/components/tools/websearch): The Web Search Tool enables Spice models to search the web for information. The tool is available through the websearch tool, and backed by different search engines. - [Vector Engines](/docs/v1.8/components/vectors) - [Amazon S3 Vectors Engine](/docs/v1.8/components/vectors/s3_vectors): Amazon S3 Vectors Engine Documentation - [Views](/docs/v1.8/components/views): Documentation for defining Views in Spice - [Workers Overview](/docs/v1.8/components/workers): Detailed documentation for workers in the Spice runtime. - [Deployment](/docs/v1.8/deployment): Deploy Spice.ai in your environment - [Deployment Architectures](/docs/v1.8/deployment/architectures): Spice.ai Open Source Deployment architectures - [Cluster-Based Deployment (Spice.ai Enterprise)](/docs/v1.8/deployment/architectures/cluster): Deploying Spice as a cluster - [Cloud Hosted](/docs/v1.8/deployment/architectures/hosted): Deploying Spice cloud hosted in the Spice Cloud Platform - [Microservice Deployment (Single or Multiple Replicas)](/docs/v1.8/deployment/architectures/microservice): Deploying Spice as a microservice - [Sharded](/docs/v1.8/deployment/architectures/sharded): Deploying Spice with shards - [Sidecar Deployment](/docs/v1.8/deployment/architectures/sidecar): Deploying Spice as a application sidecar - [Tiered Deployment](/docs/v1.8/deployment/architectures/tiered): Deploying Spice in tiers - [AWS Deployment Options](/docs/v1.8/deployment/aws): Guide to deploying Spice.ai applications on Amazon Web Services (AWS) - [Spice Cloud Platform Deployment](/docs/v1.8/deployment/cloud): Guide to deploying data and AI applications using the managed Spice Cloud Platform - [Docker - Kubernetes](/docs/v1.8/deployment/docker): Running Spice.ai as Docker container - [Docker Sandbox Guide - v1.3.0](/docs/v1.8/deployment/docker/sandbox): Migrating to v1.3.0 - [Helm - Kubernetes](/docs/v1.8/deployment/kubernetes): Deploy Spice.ai in Kubernetes using Helm. - [Frequently Asked Questions](/docs/v1.8/faq): Get answers to common questions about Spice.ai, including its features, differences from other tools, and use cases - [Features](/docs/v1.8/features): Features - [Caching](/docs/v1.8/features/caching): Learn how to use Spice in-memory caching - [Change Data Capture (CDC)](/docs/v1.8/features/cdc): Learn how to use Change Data Capture (CDC) in Spice. - [Data Acceleration](/docs/v1.8/features/data-acceleration): Learn how to use local data acceleration in Spice. - [Constraints](/docs/v1.8/features/data-acceleration/constraints): Learn how to add/configure constraints on local acceleration tables in Spice. - [Data Refresh](/docs/v1.8/features/data-acceleration/data-refresh): Data refresh for accelerated datasets - [Indexes](/docs/v1.8/features/data-acceleration/indexes): Learn how to add indexes to local acceleration tables in Spice. - [Partitioning](/docs/v1.8/features/data-acceleration/partitioning): Partitioning for accelerated datasets - [Snapshots](/docs/v1.8/features/data-acceleration/snapshots): Bootstrap file-mode accelerations from managed snapshots to eliminate cold starts. - [Data Ingestion](/docs/v1.8/features/data-ingestion): Learn how to ingest data in Spice. - [Embedding Datasets](/docs/v1.8/features/embeddings): Learn how to define, or augment existing datasets with embedding column(s). - [Large Language Models](/docs/v1.8/features/large-language-models): Learn how to configure large language models (LLMs) - [Evaluating Language Models](/docs/v1.8/features/large-language-models/evals): Learn how Spice evaluates, tracks, compares, and improves language model performance for specific tasks - [Model Context Protocol (MCP)](/docs/v1.8/features/large-language-models/mcp): Learn how to use the Model Context Protocol (MCP) with Spice. - [Language Model Memory](/docs/v1.8/features/large-language-models/memory): Learn how to provide LLMs with memory - [Language Model Overrides](/docs/v1.8/features/large-language-models/parameter_overrides): Learn how to override default LLM hyperparameters in Spice. - [System Prompt parameterization](/docs/v1.8/features/large-language-models/parameterized_prompts): Learn how to update system prompts for each request with Jinja-styled templating. - [Load and Serve Models Locally](/docs/v1.8/features/large-language-models/serving): Learn how to load and serve large learning models. - [Language Models Tools](/docs/v1.8/features/large-language-models/tools): Learn how LLMs interact with the Spice runtime. - [Machine Learning Models](/docs/v1.8/features/machine-learning-models): Spice supports loading and serving ONNX models for inference, from sources including local filesystems, Hugging Face, and the Spice.ai Cloud platform. - [Observability & Monitoring](/docs/v1.8/features/observability): Learn how to use Spice telemetry. - [Component Metrics](/docs/v1.8/features/observability/component_metrics): Learn how to enable optional component metrics. - [Query Federation](/docs/v1.8/features/query-federation): Learn how to use federated SQL queries in Spice.ai Open Source - [Search Functionality](/docs/v1.8/features/search): Learn how Spice can search across datasets using database-native and vector-search methods. - [Full-Text Search](/docs/v1.8/features/search/full-text): Learn how Spice can perform full text search - [Vector-Based Search](/docs/v1.8/features/search/vector-search): Learn how Spice can perform searches using vector-based methods. - [Semantic Model](/docs/v1.8/features/semantic-model): Learn how to define and use semantic data models with Spice. - [Web Search](/docs/v1.8/features/web-search): Learn how Spice can perform web search - [Getting started with Spice.ai OSS](/docs/v1.8/getting-started): Get started with Spice in 5 minutes - [Community Data](/docs/v1.8/getting-started/spiceai): Connect to the Spice.ai Cloud Platform to access community datasets. - [Spicepods](/docs/v1.8/getting-started/spicepods): An introduction to Spicepods - [Telemetry](/docs/v1.8/getting-started/telemetry): Learn how Spice AI uses anonymous telemetry. - [Spice.ai OSS Installation](/docs/v1.8/installation): Instructions for installing Spice.ai OSS - [Intelligent Applications](/docs/v1.8/intelligent-applications): Building intelligent data and AI-driven applications with Spice.ai - [Monitoring](/docs/v1.8/monitoring): Monitoring Spice.ai deployments - [Datadog](/docs/v1.8/monitoring/datadog): Monitoring Spice with Datadog - [Grafana & Prometheus](/docs/v1.8/monitoring/grafana): Monitoring Spice instances with Grafana & Prometheus - [Zipkin Integration](/docs/v1.8/monitoring/zipkin): Learn how to integrate Spice with Zipkin tracing. - [Spice.ai OSS Reference Docs](/docs/v1.8/reference): Reference documentation on the Spice API, CLI and Pod manifest syntax. - [Cron Schedules](/docs/v1.8/reference/cron): The Runtime supports cron expressions with optional seconds, like /10 which evaluates to every 10th second (10, 20, 30, etc). - [Data Types Reference](/docs/v1.8/reference/datatypes) - [Accelerator Data Types](/docs/v1.8/reference/datatypes/accelerators): Spice adheres to Apache Arrow data types. Data accelerators do not support all Arrow data types. The table below outlines the data type compatibility for each accelerator, and datatype used within the accelerator. - [Object Store Data Types](/docs/v1.8/reference/datatypes/object_store): Spice adheres to Apache Arrow data types. The table below lists the types of supported file type from object stores and their corresponding Apache Arrow type mappings in Spice. - [Duration](/docs/v1.8/reference/duration): Durations are represented as integers with a time unit suffix. - [File Formats](/docs/v1.8/reference/file_format): Spice currently supports CSV, JSON, and Parquet data file-formats for data connectors that can read files from a file system or cloud object storage (i.e. s3//, file://, etc.). Support for Iceberg and other file-formats are on the roadmap. - [Managing Memory Usage](/docs/v1.8/reference/memory): Guidelines and best practices for managing memory usage and optimizing performance in Spice.ai Open Source deployments. - [Models Grade Report](/docs/v1.8/reference/models): Spice AI graded Large-Language-Model (LLM) evaluation report - [YAML syntax for Spicepod manifests](/docs/v1.8/reference/spicepod): Detailed documentation on the Spicepod manifest syntax (spicepod.yaml) - [catalogs](/docs/v1.8/reference/spicepod/catalogs): Catalogs YAML reference - [Datasets](/docs/v1.8/reference/spicepod/datasets): Datasets YAML reference - [Embeddings](/docs/v1.8/reference/spicepod/embeddings): Embeddings YAML reference - [evals](/docs/v1.8/reference/spicepod/evals): Evaluations YAML reference - [Reserved Keywords](/docs/v1.8/reference/spicepod/keywords): Reserved keywords for datasets - [Models](/docs/v1.8/reference/spicepod/models): Models YAML reference - [Runtime](/docs/v1.8/reference/spicepod/runtime): Runtime YAML reference - [Tools (Function Calling)](/docs/v1.8/reference/spicepod/tools): Tools YAML reference - [Workers](/docs/v1.8/reference/spicepod/workers): Workers YAML reference - [SQL Reference](/docs/v1.8/reference/sql): This section provides a comprehensive reference for SQL support in Spice.ai, including syntax, data types, operators, functions, and system features. The reference is organized by topic for ease of navigation. - [Aggregate Functions](/docs/v1.8/reference/sql/aggregate_functions): Spice is built on Apache DataFusion and uses the PostgreSQL dialect, even when querying datasources with different SQL dialects. Note, when using a data accelerator like DuckDB, function support is specific to each acceleration engine, and not all functions are supported by all acceleration engines. - [AI Functions](/docs/v1.8/reference/sql/ai): AI functions in Spice provide direct integration with large language models (LLMs) and embedding models within SQL queries. These functions process text through configured model providers and return generated responses or vector embeddings. - [DML (Data Manipulation Language)](/docs/v1.8/reference/sql/dml): Data Manipulation Language (DML) statements for inserting and modifying data in Spice. - [Explain](/docs/v1.8/reference/sql/explain): Spice is built on Apache DataFusion and uses the PostgreSQL dialect, even when querying datasources with different SQL dialects. - [Information Schema](/docs/v1.8/reference/sql/information_schema): Spice is built on Apache DataFusion and uses the PostgreSQL dialect, even when querying datasources with different SQL dialects. - [JSON Functions and Operators](/docs/v1.8/reference/sql/json): Reference for JSON functions and operators in Spice SQL - [Operators](/docs/v1.8/reference/sql/operators): Spice is built on Apache DataFusion and uses the PostgreSQL dialect, even when querying datasources with different SQL dialects. - [Prepared Statements](/docs/v1.8/reference/sql/prepared_statements): Spice is built on Apache DataFusion and uses the PostgreSQL dialect, even when querying datasources with different SQL dialects. - [Scalar Functions](/docs/v1.8/reference/sql/scalar_functions): Spice is built on Apache DataFusion and uses the PostgreSQL dialect, even when querying datasources with different SQL dialects. Note, when using a data accelerator like DuckDB, function support is specific to each acceleration engine, and not all functions are supported by all acceleration engines. - [Search in SQL](/docs/v1.8/reference/sql/search): Reference for search functions and filtering in Spice SQL. - [SELECT](/docs/v1.8/reference/sql/select): Spice is built on Apache DataFusion and uses the PostgreSQL dialect, even when querying datasources with different SQL dialects. - [Subqueries](/docs/v1.8/reference/sql/subqueries): Spice is built on Apache DataFusion and uses the PostgreSQL dialect, even when querying datasources with different SQL dialects. - [Spice.ai Open Source System Requirements](/docs/v1.8/reference/system_requirements): System requirements for running Spice.ai Open Source - [Task History](/docs/v1.8/reference/task_history): The Spice runtime stores information about completed tasks in the spice.runtime.task_history table. Each task represents a single unit of execution within the runtime, such as a SQL query or an AI chat completion, and is represented by a unique span. - [SDKs](/docs/v1.8/sdks): Connect to spice, using official Spice SDKs - [Dotnet SDK for Spice.ai](/docs/v1.8/sdks/dotnet): Connect to Spice using Spice Dotnet SDK - [Go SDK](/docs/v1.8/sdks/golang): Connect to spice using spice go SDK - [Java SDK](/docs/v1.8/sdks/java): Connect to Spice using Spice Java SDK - [JavaScript SDK](/docs/v1.8/sdks/javascript): Connect to spice using Spice.js SDK - [Python SDK](/docs/v1.8/sdks/python): Connect to spice using spice python SDK - [Rust SDK](/docs/v1.8/sdks/rust): Connect to spice using spice rust SDK - [Troubleshooting Spice](/docs/v1.8/troubleshooting): Review and debug runtime tasks, logs, and diagnostic steps in Spice. - [Spice.ai Use Cases](/docs/v1.8/use-cases): Use cases for Spice.ai' - [AI Applications and Agents](/docs/v1.8/use-cases/ai): AI Applications and Agents - [Agentic AI Applications and Agents](/docs/v1.8/use-cases/ai/agentic-apps): Spice.ai builds intelligent, autonomous agents for SaaS applications, enabling context-aware automation and decision-making. - [Edge-Enabled AI Applications and Agents](/docs/v1.8/use-cases/ai/edge-ai): Spice.ai deploys AI applications and agents across cloud and edge for low-latency decisions in security IoT use cases. - [Federated MCP Client for Distributed Tool Ecosystems](/docs/v1.8/use-cases/ai/federated-mcp-server): Spice.ai federates external MCP servers for scalable, tool-driven AI applications in security, enhancing threat analysis. - [Object-Store Based SQL Query, Search, and LLM Inference Engine](/docs/v1.8/use-cases/ai/object-store-ai-engine): Spice.ai enables SQL queries, hybrid search, and LLM inference on object-store data for security applications, delivering real-time insights. - [Real-Time Decision-Making for Intelligent Applications](/docs/v1.8/use-cases/ai/real-time-decision-making): Spice.ai powers instant, context-aware decisions for applications like security recommendations by grounding AI in federated, low-latency datasets. - [Tool-Augmented AI with Model Context Protocol Server](/docs/v1.8/use-cases/ai/tool-calling-ai): Spice.ai extends AI with custom tools via MCP server in finserv, integrating domain-specific APIs for enhanced functionality. - [Data Federation, Acceleration, and SQL Query](/docs/v1.8/use-cases/data): Data Federation, Acceleration, and SQL Query - [Application Resilience and Performance Optimization](/docs/v1.8/use-cases/data/application-resilence-and-acceleration): Spice.ai colocates dynamic data with SaaS applications as a database CDN, ensuring resilience and high performance. - [Data Mesh for Unified Data Access](/docs/v1.8/use-cases/data/data-mesh): Spice.ai enables unified data access across disparate sources for health-tech applications, fostering a data mesh architecture. - [Database CDN for Enhanced Performance](/docs/v1.8/use-cases/data/database-cdn): Spice.ai acts as a database CDN for SaaS applications, caching dynamic data to ensure high performance and resilience. - [ETL-free Workflows and Data Migrations](/docs/v1.8/use-cases/data/etl-free-workflows): Spice.ai enables data migrations and workflows without ETL by federating legacy and modern systems for seamless transitions. - [Object-Store Data Engine](/docs/v1.8/use-cases/data/object-store-data-engine): Spice.ai federates, accelerates, and queries object-store data for finserv applications, enabling real-time data access without centralized warehouses. - [Reverse-ETL for Operational Workflows](/docs/v1.8/use-cases/data/reverse-etl): Spice.ai serves enriched data from warehouses to operational systems for real-time actions, eliminating complex ETL pipelines. - [Retrieval-Augmented-Generation (RAG)](/docs/v1.8/use-cases/rag): Retrieval-Augmented-Generation (RAG) - [Spice for Retrieval-Augmented-Generation (RAG)](/docs/v1.8/use-cases/rag/applications): Use Spice for Retrieval-Augmented-Generation (RAG) - [Retrieval-Augmented Generation for AI-Powered Reporting](/docs/v1.8/use-cases/rag/reporting): Spice.ai generates dynamic, context-aware AI-driven reports for operational insights in health-tech, ensuring compliance and precision. - [Search & Retrieval](/docs/v1.8/use-cases/search): Search & Retrieval - [Simplifying Real-Time Data Collection and Search](/docs/v1.8/use-cases/search/data-collection-and-search): Spice.ai processes streaming and static data with integrated search for real-time insights, focusing on application logic. - [Enterprise Search and Retrieval](/docs/v1.8/use-cases/search/enterprise-search): Spice.ai powers semantic and precise search for finserv knowledge bases with hybrid vector and keyword capabilities. - [Object-Store Native Search Engine](/docs/v1.8/use-cases/search/object-store-search-engine): Spice.ai powers a cloud-native embedded search engine on object-store data for security applications, enabling semantic and precise search. ### v1.9 Spice is a SQL query, search, and LLM-inference engine, written in Rust, for data-driven applications and AI agents. - [Spice.ai Open Source](/docs/v1.9): Spice is a SQL query, search, and LLM-inference engine, written in Rust, for data-driven applications and AI agents. - [Tags](/docs/v1.9/tags) - [One doc tagged with "Acknowledgements"](/docs/v1.9/tags/acknowledgements): Project acknowledgements, credits, and attributions. - [One doc tagged with "ADBC"](/docs/v1.9/tags/adbc): Arrow Database Connectivity driver configuration and usage. - [4 docs tagged with "API"](/docs/v1.9/tags/api): HTTP, Arrow Flight SQL, ODBC, JDBC, and ADBC API reference. - [One doc tagged with "Arrow"](/docs/v1.9/tags/arrow): Apache Arrow columnar data format integration. - [One doc tagged with "Arrow Flight SQL"](/docs/v1.9/tags/arrow-flight-sql): Arrow Flight SQL protocol implementation and configuration. - [One doc tagged with "Auth"](/docs/v1.9/tags/auth): Authentication and authorization mechanisms. - [One doc tagged with "Authentication"](/docs/v1.9/tags/authentication): User authentication methods and security protocols. - [2 docs tagged with "Azure"](/docs/v1.9/tags/azure): Microsoft Azure cloud services and integrations. - [One doc tagged with "Blob Storage"](/docs/v1.9/tags/blob-storage): Object storage services and blob data access. - [One doc tagged with "Caching"](/docs/v1.9/tags/caching): Data caching strategies and performance optimization. - [5 docs tagged with "Catalogs"](/docs/v1.9/tags/catalogs): Data catalog connectors and metadata management. - [One doc tagged with "Cayenne"](/docs/v1.9/tags/cayenne): Cayenne (Vortex) data accelerator built on Vortex columnar format. - [2 docs tagged with "CLI"](/docs/v1.9/tags/cli): Spice command-line interface commands and usage. - [4 docs tagged with "Component Metrics"](/docs/v1.9/tags/component-metrics): Runtime component performance metrics and monitoring. - [One doc tagged with "Components"](/docs/v1.9/tags/components): Runtime components including catalogs, data connectors, and models. - [2 docs tagged with "Configuration"](/docs/v1.9/tags/configuration): System configuration files and runtime settings. - [One doc tagged with "Data Accelerators"](/docs/v1.9/tags/data-accelerators): Data acceleration engines for high-performance query execution. - [19 docs tagged with "Data Connectors"](/docs/v1.9/tags/data-connectors): Data source connectors and integration patterns. - [One doc tagged with "Data Lake"](/docs/v1.9/tags/data-lake): Data lake architectures and storage solutions. - [2 docs tagged with "Databricks"](/docs/v1.9/tags/databricks): Databricks platform integration and Unity Catalog support. - [2 docs tagged with "Datasets"](/docs/v1.9/tags/datasets): Dataset definitions and data source configurations. - [One doc tagged with "Debezium"](/docs/v1.9/tags/debezium): Debezium change data capture integration. - [One doc tagged with "Debugging"](/docs/v1.9/tags/debugging): Debugging techniques and troubleshooting tools. - [2 docs tagged with "Delta Lake"](/docs/v1.9/tags/delta-lake): Delta Lake open table format support. - [One doc tagged with "Dependencies"](/docs/v1.9/tags/dependencies): Third-party dependencies and software requirements. - [3 docs tagged with "Deployment"](/docs/v1.9/tags/deployment): Production deployment using Docker and Kubernetes. - [2 docs tagged with "Docker"](/docs/v1.9/tags/docker): Docker containerization and deployment configurations. - [One doc tagged with "DynamoDB"](/docs/v1.9/tags/dynamodb): Amazon DynamoDB NoSQL database integration. - [3 docs tagged with "Embeddings"](/docs/v1.9/tags/embeddings): Vector embeddings and semantic similarity operations. - [One doc tagged with "Evaluation"](/docs/v1.9/tags/evaluation): Model evaluation metrics and assessment frameworks. - [2 docs tagged with "Features"](/docs/v1.9/tags/features): Core platform features including acceleration, caching, and search. - [One doc tagged with "Federation"](/docs/v1.9/tags/federation): Cross-database queries and federated data access. - [One doc tagged with "Getting Started"](/docs/v1.9/tags/getting-started): Installation guides and quickstart tutorials. - [One doc tagged with "GitHub"](/docs/v1.9/tags/github): GitHub repository data connector and integration. - [2 docs tagged with "Glue"](/docs/v1.9/tags/glue): AWS Glue ETL service and data catalog integration. - [2 docs tagged with "Iceberg"](/docs/v1.9/tags/iceberg): Apache Iceberg open table format support. - [One doc tagged with "In-Memory"](/docs/v1.9/tags/in-memory): In-memory data processing and temporary storage. - [One doc tagged with "Integration"](/docs/v1.9/tags/integration): Third-party system integrations and connectivity patterns. - [One doc tagged with "JDBC"](/docs/v1.9/tags/jdbc): Java Database Connectivity driver configuration. - [One doc tagged with "Kafka"](/docs/v1.9/tags/kafka): Apache Kafka event streaming platform integration. - [2 docs tagged with "Kubernetes"](/docs/v1.9/tags/kubernetes): Kubernetes orchestration and secret management. - [One doc tagged with "Logging"](/docs/v1.9/tags/logging): Application logging configuration and log management. - [One doc tagged with "Login"](/docs/v1.9/tags/login): User login processes and session management. - [One doc tagged with "Manifest"](/docs/v1.9/tags/manifest): Configuration manifest files and schema definitions. - [One doc tagged with "MCP"](/docs/v1.9/tags/mcp): Model Context Protocol for AI tool integration. - [2 docs tagged with "Memory"](/docs/v1.9/tags/memory): In-memory data connectors and volatile storage. - [13 docs tagged with "Models"](/docs/v1.9/tags/models): Machine learning models and AI inference engines. - [One doc tagged with "MongoDB"](/docs/v1.9/tags/mongodb): MongoDB NoSQL document database integration. - [One doc tagged with "MySQL"](/docs/v1.9/tags/mysql): MySQL relational database integration. - [One doc tagged with "NoSQL"](/docs/v1.9/tags/nosql): NoSQL database systems and document stores. - [One doc tagged with "Observability"](/docs/v1.9/tags/observability): Monitoring, tracing, and metrics for system visibility. - [One doc tagged with "ODBC"](/docs/v1.9/tags/odbc): Open Database Connectivity driver configuration. - [One doc tagged with "Open Source"](/docs/v1.9/tags/open-source): Open source licenses and community contributions. - [One doc tagged with "OpenAI"](/docs/v1.9/tags/openai): OpenAI API integration and GPT model access. - [One doc tagged with "Oracle"](/docs/v1.9/tags/oracle): Documentation related to Oracle database integration. - [2 docs tagged with "Overrides"](/docs/v1.9/tags/overrides): Parameter overrides and configuration customization. - [2 docs tagged with "Overview"](/docs/v1.9/tags/overview): High-level component and feature overviews. - [2 docs tagged with "Parameters"](/docs/v1.9/tags/parameters): Configuration parameters and runtime options. - [2 docs tagged with "Performance"](/docs/v1.9/tags/performance): Performance optimization and benchmarking. - [One doc tagged with "Persistence"](/docs/v1.9/tags/persistence): Data persistence and durable storage mechanisms. - [4 docs tagged with "Reference"](/docs/v1.9/tags/reference): API reference, CLI commands, and configuration syntax. - [One doc tagged with "Relational"](/docs/v1.9/tags/relational): Relational database systems and SQL operations. - [One doc tagged with "Runtime"](/docs/v1.9/tags/runtime): Runtime behavior and execution environment. - [One doc tagged with "Sandbox"](/docs/v1.9/tags/sandbox): Sandbox environments and isolated testing. - [5 docs tagged with "Search"](/docs/v1.9/tags/search): Vector search, semantic search, and ranking capabilities. - [One doc tagged with "Security"](/docs/v1.9/tags/security): Security features and data protection mechanisms. - [2 docs tagged with "SpiceAI"](/docs/v1.9/tags/spiceai): SpiceAI cloud platform and managed services. - [5 docs tagged with "Spicepod"](/docs/v1.9/tags/spicepod): Spicepod configuration files, manifest syntax, and package management. - [2 docs tagged with "SQL"](/docs/v1.9/tags/sql): SQL query language support and database operations. - [3 docs tagged with "Tools"](/docs/v1.9/tags/tools): Development tools and utility integrations. - [2 docs tagged with "Tracing"](/docs/v1.9/tags/tracing): Distributed tracing and request monitoring. - [One doc tagged with "Troubleshooting"](/docs/v1.9/tags/troubleshooting): Problem diagnosis and resolution guides. - [One doc tagged with "Unity Catalog"](/docs/v1.9/tags/unity-catalog): Databricks Unity Catalog data governance integration. - [One doc tagged with "Views"](/docs/v1.9/tags/views): Virtual views and data transformation layers. - [One doc tagged with "Vortex"](/docs/v1.9/tags/vortex): Vortex columnar file format and storage engine. - [6 docs tagged with "Write"](/docs/v1.9/tags/write): Data connectors and catalogs that support write operations. - [One doc tagged with "YAML"](/docs/v1.9/tags/yaml): YAML configuration syntax and file formats. - [One doc tagged with "Zipkin"](/docs/v1.9/tags/zipkin): Zipkin distributed tracing system integration. - [Open Source Acknowledgements](/docs/v1.9/acknowledgements): Spice AI acknowledges the following open source projects for making this project possible: - [API](/docs/v1.9/api): API - [ADBC: Arrow Database Connectivity](/docs/v1.9/api/adbc): ADBC API Documentation - [Arrow Flight SQL API](/docs/v1.9/api/arrow-flight-sql): Query Spice using JDBC/ODBC/ADBC - [Authentication](/docs/v1.9/api/auth): Authentication documentation - [Generate Package](/docs/v1.9/api/HTTP/generate-package): This endpoint generates a zip package from a specified GitHub source. - [List Catalogs](/docs/v1.9/api/HTTP/get-catalogs): List Catalogs - [Get Iceberg API config](/docs/v1.9/api/HTTP/get-config): This endpoint returns the Iceberg Catalog API configuration, including details about overrides, defaults, and available endpoints. - [List Datasets](/docs/v1.9/api/HTTP/get-datasets): This endpoint returns a list of configured datasets. The response can be formatted as **JSON** or **CSV**, - [List Iceberg namespaces](/docs/v1.9/api/HTTP/get-iceberg-namespaces): This endpoint retrieves namespaces available in the Iceberg catalog. - [ML Prediction](/docs/v1.9/api/HTTP/get-model-predict): Make a ML prediction using a specific model. - [List Models](/docs/v1.9/api/HTTP/get-models): List all models, both machine learning and language models, available in the runtime. - [List Spicepods](/docs/v1.9/api/HTTP/get-spicepods): Get a list of spicepods and their details. In CSV format, it will return a summarised form. - [Check Runtime Status](/docs/v1.9/api/HTTP/get-status): Return the status of all connections (http, flight, metrics, opentelemetry) in the runtime. - [Check Namespace exists](/docs/v1.9/api/HTTP/head-namespace): This endpoint returns a 200 OK response if the namespace exists, otherwise it returns a 404 Not Found response. - [List Evals](/docs/v1.9/api/HTTP/list): Return all evals available to run in the runtime. - [Send message to MCP server](/docs/v1.9/api/HTTP/mcp-event): Send message to the MCP endoint, for a given session. - [Establish an MCP SSE Connection](/docs/v1.9/api/HTTP/operation-id): Initiates a Server-Sent Events (SSE) connection using the Model Context Protocol (MCP) to interact with Spice tools. - [Update Refresh SQL](/docs/v1.9/api/HTTP/patch-dataset-acceleration): Update the refresh SQL for a dataset's acceleration. - [Run Tool](/docs/v1.9/api/HTTP/post): The request body and JSON response formats match the tool’s specification. - [Batch ML Predictions](/docs/v1.9/api/HTTP/post-batch-predict): Perform a batch of ML predictions, using multiple models, in one request. This is useful for ensembling or A/B testing different models. - [Create Chat Completion](/docs/v1.9/api/HTTP/post-chat-completions): Creates a model response for the given chat conversation. - [Refresh Dataset](/docs/v1.9/api/HTTP/post-dataset-refresh): Trigger an on-demand refresh for an accelerated dataset. - [Create Embeddings](/docs/v1.9/api/HTTP/post-embeddings): Creates an embedding vector representing the input text. - [Run Eval](/docs/v1.9/api/HTTP/post-eval): Evaluate a model against a eval spice specification - [Text-to-SQL (NSQL)](/docs/v1.9/api/HTTP/post-nsql): Generate and optionally execute a natural-language text-to-SQL (NSQL) query. - [Search](/docs/v1.9/api/HTTP/post-search): Perform a vector similarity search (VSS) operation on a dataset. - [SQL Query](/docs/v1.9/api/HTTP/post-sql): Execute a SQL query and return the results. - [Check Readiness](/docs/v1.9/api/HTTP/ready): Check the runtime status of all the components of the runtime. If the service is ready, it returns an HTTP 200 status with the message 'ready'. If not, it returns a 503 status with the message 'not ready'. - [runtime](/docs/v1.9/api/HTTP/runtime): The spiced runtime - [JDBC: Java Database Connectivity](/docs/v1.9/api/jdbc): JDBC API Documentation - [ODBC: Open Database Connectivity](/docs/v1.9/api/odbc): ODBC API Documentation - [API Overview](/docs/v1.9/api/overview): Spice.ai API overview, including SQL query interfaces, OpenAI-compatible endpoints, Iceberg catalog REST APIs, and the Model Context Protocol (MCP) for integrating external tools. - [TLS: Transport Layer Security](/docs/v1.9/api/tls): Encryption in transit with TLS documentation - [Spice.ai OSS CLI documentation](/docs/v1.9/cli): Detailed documentation on the Spice.ai OSS CLI - [Spice.ai OSS CLI command reference](/docs/v1.9/cli/reference): Spice CLI command reference - [add](/docs/v1.9/cli/reference/add): Add a Spicepod to the project. - [catalogs](/docs/v1.9/cli/reference/catalogs): List catalogs currently loaded by the Spice runtime. - [chat](/docs/v1.9/cli/reference/chat): spice chat CLI documentation - [Completion](/docs/v1.9/cli/reference/completion): Generate the autocompletion script for spice for the specified shell. - [connect](/docs/v1.9/cli/reference/connect): Connect to an app on the Spice.ai Cloud Platform. - [dataset](/docs/v1.9/cli/reference/dataset): Configure a Spice dataset. - [datasets](/docs/v1.9/cli/reference/datasets): Lists datasets loaded by the Spice runtime - [init](/docs/v1.9/cli/reference/init): Initialize Spice app in the current working directory. - [install](/docs/v1.9/cli/reference/install): Download and install the latest version of the Spice runtime. - [login](/docs/v1.9/cli/reference/login): Login to the Spice.ai Platform, or other services with sub-commands. - [models](/docs/v1.9/cli/reference/models): Lists models loaded by the Spice runtime - [pods](/docs/v1.9/cli/reference/pods): Lists Spicepods loaded by the Spice runtime - [refresh](/docs/v1.9/cli/reference/refresh): Refreshes an accelerated dataset loaded by the Spice runtime - [run](/docs/v1.9/cli/reference/run): Run Spice - starts the Spice runtime, installing if necessary. - [search](/docs/v1.9/cli/reference/search): Performs embeddings-based searches across search configured datasets. Note: Search requires the ai feature to be installed. - [sql](/docs/v1.9/cli/reference/sql): Start an interactive SQL query session against the Spice runtime - [status](/docs/v1.9/cli/reference/status): Spice runtime status - [trace](/docs/v1.9/cli/reference/trace): Provides a user-friendly trace stack into an operation that occurred in Spice. This command retrieves and displays task execution traces from the runtime.task_history table. - [upgrade](/docs/v1.9/cli/reference/upgrade): Upgrades the Spice CLI & Runtime to the latest release - [version](/docs/v1.9/cli/reference/version): Outputs the current version of the Spice CLI and runtime - [Configuring Trace Levels](/docs/v1.9/cli/tracing): Configuring Spice.ai OSS trace output verbosity levels - [Clients and Tools](/docs/v1.9/clients): Client and tools - [DBeaver](/docs/v1.9/clients/dbeaver): Configure DBeaver to query Spice via JDBC - [JetBrains DataGrip](/docs/v1.9/clients/jetbrains-datagrip): Configure JetBrains Datagrip to query Spice via JDBC - [Microsoft Power BI Connector](/docs/v1.9/clients/powerbi): Use Microsoft Power BI to access, visualize and analyze Spice datasets. - [Apache Superset](/docs/v1.9/clients/superset): Use Apache Superset to query and visualize datasets loaded in Spice. - [Tableau](/docs/v1.9/clients/tableau): Use Tableau to to access, visualise and analyse datasets loaded in Spice. - [Runtime Components](/docs/v1.9/components): Runtime components' - [Catalog Connectors](/docs/v1.9/components/catalogs) - [Databricks Catalog Connector](/docs/v1.9/components/catalogs/databricks): Connect to a Databricks Unity Catalog provider. - [Glue Catalog Connector](/docs/v1.9/components/catalogs/glue): Connect to an AWS Glue Data Catalog. - [Iceberg Catalog Connector](/docs/v1.9/components/catalogs/iceberg): Connect to an Iceberg catalog provider. - [Spice.ai Catalog Connector](/docs/v1.9/components/catalogs/spiceai): Connect to the Spice.ai built-in catalog. - [Unity Catalog Catalog Connector](/docs/v1.9/components/catalogs/unity-catalog): Connect to a Unity Catalog provider. - [Data Accelerators](/docs/v1.9/components/data-accelerators) - [In-Memory Arrow Data Accelerator](/docs/v1.9/components/data-accelerators/arrow): In-Memory Arrow Data Accelerator Documentation - [Cayenne Data Accelerator](/docs/v1.9/components/data-accelerators/cayenne): Cayenne Data Accelerator (Vortex) Documentation - [DuckDB Data Accelerator](/docs/v1.9/components/data-accelerators/duckdb): DuckDB Data Accelerator Documentation - [PostgreSQL Data Accelerator](/docs/v1.9/components/data-accelerators/postgres): PostgreSQL Data Accelerator Documentation - [SQLite Data Accelerator](/docs/v1.9/components/data-accelerators/sqlite): SQLite Data Accelerator Documentation - [Data Connectors](/docs/v1.9/components/data-connectors): Learn how to use Data Connector to query external data. - [Azure BlobFS Data Connector](/docs/v1.9/components/data-connectors/abfs): Azure BlobFS Data Connector Documentation - [ClickHouse Data Connector](/docs/v1.9/components/data-connectors/clickhouse): ClickHouse Data Connector Documentation - [Databricks Data Connector](/docs/v1.9/components/data-connectors/databricks): Databricks Data Connector Documentation - [Debezium Data Connector](/docs/v1.9/components/data-connectors/debezium): Debezium Data Connector Documentation - [Delta Lake Data Connector](/docs/v1.9/components/data-connectors/delta-lake): Delta Lake Data Connector Documentation - [Dremio Data Connector](/docs/v1.9/components/data-connectors/dremio): Dremio Data Connector Documentation - [DuckDB Data Connector](/docs/v1.9/components/data-connectors/duckdb): DuckDB Data Connector Documentation - [DynamoDB Data Connector](/docs/v1.9/components/data-connectors/dynamodb): DynamoDB Data Connector Documentation - [File Data Connector](/docs/v1.9/components/data-connectors/file): File Data Connector Documentation - [Flight SQL Data Connector](/docs/v1.9/components/data-connectors/flightsql): Flight SQL Data Connector Documentation - [FTP/SFTP Data Connector](/docs/v1.9/components/data-connectors/ftp): FTP/SFTP Data Connector Documentation - [GitHub Data Connector](/docs/v1.9/components/data-connectors/github): GitHub Data Connector Documentation - [Glue Data Connector](/docs/v1.9/components/data-connectors/glue): Glue Data Connector Documentation - [GraphQL Data Connector](/docs/v1.9/components/data-connectors/graphql): GraphQL Data Connector Documentation - [HTTP(s) Data Connector](/docs/v1.9/components/data-connectors/https): HTTP(s) Data Connector Documentation - [Iceberg Data Connector](/docs/v1.9/components/data-connectors/iceberg): Connect to and query Apache Iceberg tables - [IMAP Data Connector](/docs/v1.9/components/data-connectors/imap): IMAP Data Connector Documentation - [Kafka Data Connector](/docs/v1.9/components/data-connectors/kafka): Kafka Data Connector Documentation - [Localpod Data Connector](/docs/v1.9/components/data-connectors/localpod): Localpod Data Connector Documentation - [Memory Data Connector](/docs/v1.9/components/data-connectors/memory): Memory Data Connector Documentation - [MongoDB Data Connector](/docs/v1.9/components/data-connectors/mongodb): MongoDB Data Connector Documentation - [Microsoft SQL Server Data Connector](/docs/v1.9/components/data-connectors/mssql): Microsoft SQL Server Data Connector - [MySQL Data Connector](/docs/v1.9/components/data-connectors/mysql): MySQL Data Connector Documentation - [Pull the latest official Spice image](/docs/v1.9/components/data-connectors/odbc): ODBC Data Connector Documentation - [Oracle Data Connector](/docs/v1.9/components/data-connectors/oracle): Oracle Data Connector Documentation - [PostgreSQL Data Connector](/docs/v1.9/components/data-connectors/postgres): PostgreSQL Data Connector Documentation - [Amazon Redshift Data Connector](/docs/v1.9/components/data-connectors/redshift): Connect to Amazon Redshift using the PostgreSQL connector in Spice. - [S3 Data Connector](/docs/v1.9/components/data-connectors/s3): S3 Data Connector Documentation - [SharePoint Data Connector](/docs/v1.9/components/data-connectors/sharepoint): SharePoint Data Connector Documentation - [Snowflake Data Connector](/docs/v1.9/components/data-connectors/snowflake): Snowflake Data Connector Documentation - [Apache Spark Connector](/docs/v1.9/components/data-connectors/spark): Apache Spark Connector Documentation - [Spice.ai Data Connector](/docs/v1.9/components/data-connectors/spiceai): Spice.ai Data Connector Documentation - [Embedding Models](/docs/v1.9/components/embeddings): Describes how embedding models are used in Spice to convert text into numerical vectors for machine learning and search applications. - [Azure OpenAI Embedding Models](/docs/v1.9/components/embeddings/azure): To use an embedding model hosted on Azure OpenAI, specify the azure path in the from field and the following parameters from the Azure OpenAI Model Deployment page: - [Amazon Bedrock Model Provider](/docs/v1.9/components/embeddings/bedrock): Instructions for using Amazon Bedrock embedding models - [Databricks Model Provider](/docs/v1.9/components/embeddings/databricks): Instructions for using Databricks Mosaic AI Models - [HuggingFace Text Embedding Models](/docs/v1.9/components/embeddings/huggingface): To use an embedding model from HuggingFace with Spice, specify the huggingface path in the from field of your configuration. The model and its related files will be automatically downloaded, loaded, and served locally by Spice. - [Local Filesystem Embedding Models](/docs/v1.9/components/embeddings/local): Embedding models can be run with files stored locally. This method is useful for using models that are not hosted on remote services. - [Model2Vec Embedding Models](/docs/v1.9/components/embeddings/model2vec): Model2Vec embedding models help generate efficient static word embeddings from sentence transformer models for use in Spice, supporting local and Hugging Face sources with options for private models and performance tuning. - [OpenAI (or Compatible) Embedding Models](/docs/v1.9/components/embeddings/openai): To use a hosted OpenAI (or compatible) embedding model, specify the openai path in the from field of your configuration. - [Model Providers](/docs/v1.9/components/models): Overview of supported model providers for ML and LLMs in Spice. - [Anthropic Models](/docs/v1.9/components/models/anthropic): Instructions for using language models hosted on Anthropic with Spice. - [Azure OpenAI Models](/docs/v1.9/components/models/azure): Instructions for using Azure OpenAI models - [Amazon Bedrock Models](/docs/v1.9/components/models/bedrock): How to use Amazon Bedrock models with Spice. - [Databricks Model Provider](/docs/v1.9/components/models/databricks): Instructions for using Databricks Mosaic AI Models - [Filesystem Hosted Models](/docs/v1.9/components/models/filesystem): Instructions for using models hosted on a filesystem with Spice. - [HuggingFace](/docs/v1.9/components/models/huggingface): Instructions for using machine learning models hosted on HuggingFace with Spice. - [OpenAI (or Compatible) Language Models](/docs/v1.9/components/models/openai): Instructions for using language models hosted on OpenAI or compatible services with Spice. - [Perplexity Models](/docs/v1.9/components/models/perplexity): Instructions for using language models hosted on Perplexity with Spice. - [Spice Cloud Platform](/docs/v1.9/components/models/spiceai): Instructions for using models hosted on the Spice Cloud Platform with Spice. - [xAI Models](/docs/v1.9/components/models/xai): Instructions for using xAI models - [Secret Stores](/docs/v1.9/components/secret-stores) - [AWS Secrets Manager Secret Store](/docs/v1.9/components/secret-stores/aws-secrets-manager): AWS Secrets Manager Secret Store Documentation - [Environment Secret Store](/docs/v1.9/components/secret-stores/env): Environment Variables Secret Store Documentation - [Keyring Secret Store](/docs/v1.9/components/secret-stores/keyring): Keyring Secret Store Documentation - [Kubernetes Secret Store](/docs/v1.9/components/secret-stores/kubernetes): Kubernetes Secret Store Documentation - [LLM Tools (Function Calling)](/docs/v1.9/components/tools): Overview of supported LLM tools (function calling) and how to define new tools - [Model Context Protocol Tools](/docs/v1.9/components/tools/mcp): Spice integrates with tools and services using the Model Context Protocol (MCP). MCP tools can be configured to run internally or connect to external servers over HTTP using the Server-Sent Events (SSE) protocol. - [Web Search Tool](/docs/v1.9/components/tools/websearch): The Web Search Tool enables Spice models to search the web for information. The tool is available through the websearch tool, and backed by different search engines. - [Vector Engines](/docs/v1.9/components/vectors) - [Amazon S3 Vectors Engine](/docs/v1.9/components/vectors/s3_vectors): Amazon S3 Vectors Engine Documentation - [Views](/docs/v1.9/components/views): Documentation for defining Views in Spice - [Workers Overview](/docs/v1.9/components/workers): Detailed documentation for workers in the Spice runtime. - [Deployment](/docs/v1.9/deployment): Deploy Spice.ai in your environment - [Deployment Architectures](/docs/v1.9/deployment/architectures): Spice.ai Open Source Deployment architectures - [Cluster-Based Deployment (Spice.ai Enterprise)](/docs/v1.9/deployment/architectures/cluster): Deploying Spice as a cluster - [Cloud Hosted](/docs/v1.9/deployment/architectures/hosted): Deploying Spice cloud hosted in the Spice Cloud Platform - [Microservice Deployment (Single or Multiple Replicas)](/docs/v1.9/deployment/architectures/microservice): Deploying Spice as a microservice - [Sharded](/docs/v1.9/deployment/architectures/sharded): Deploying Spice with shards - [Sidecar Deployment](/docs/v1.9/deployment/architectures/sidecar): Deploying Spice as a application sidecar - [Tiered Deployment](/docs/v1.9/deployment/architectures/tiered): Deploying Spice in tiers - [AWS Deployment Options](/docs/v1.9/deployment/aws): Guide to deploying Spice.ai applications on Amazon Web Services (AWS) - [Spice Cloud Platform Deployment](/docs/v1.9/deployment/cloud): Guide to deploying data and AI applications using the managed Spice Cloud Platform - [Docker - Kubernetes](/docs/v1.9/deployment/docker): Running Spice.ai as Docker container - [Docker Sandbox Guide - v1.3.0](/docs/v1.9/deployment/docker/sandbox): Migrating to v1.3.0 - [Helm - Kubernetes](/docs/v1.9/deployment/kubernetes): Deploy Spice.ai in Kubernetes using Helm. - [Frequently Asked Questions](/docs/v1.9/faq): Get answers to common questions about Spice.ai, including its features, differences from other tools, and use cases - [Features](/docs/v1.9/features): Features - [Caching](/docs/v1.9/features/caching): Learn how to use Spice in-memory caching - [Change Data Capture (CDC)](/docs/v1.9/features/cdc): Learn how to use Change Data Capture (CDC) in Spice. - [Data Acceleration](/docs/v1.9/features/data-acceleration): Learn how to use local data acceleration in Spice. - [Constraints](/docs/v1.9/features/data-acceleration/constraints): Learn how to add/configure constraints on local acceleration tables in Spice. - [Data Refresh](/docs/v1.9/features/data-acceleration/data-refresh): Data refresh for accelerated datasets - [Indexes](/docs/v1.9/features/data-acceleration/indexes): Learn how to add indexes to local acceleration tables in Spice. - [Partitioning](/docs/v1.9/features/data-acceleration/partitioning): Partitioning for accelerated datasets - [Snapshots](/docs/v1.9/features/data-acceleration/snapshots): Bootstrap file-mode accelerations from managed snapshots to eliminate cold starts. - [Data Ingestion](/docs/v1.9/features/data-ingestion): Learn how to ingest data in Spice. - [Distributed Query](/docs/v1.9/features/distributed-query): Learn how to run Spice in distributed mode for larger scale queries. - [Embedding Datasets](/docs/v1.9/features/embeddings): Learn how to define, or augment existing datasets with embedding column(s). - [Large Language Models](/docs/v1.9/features/large-language-models): Learn how to configure large language models (LLMs) - [Evaluating Language Models](/docs/v1.9/features/large-language-models/evals): Learn how Spice evaluates, tracks, compares, and improves language model performance for specific tasks - [Model Context Protocol (MCP)](/docs/v1.9/features/large-language-models/mcp): Learn how to use the Model Context Protocol (MCP) with Spice. - [Language Model Memory](/docs/v1.9/features/large-language-models/memory): Learn how to provide LLMs with memory - [Language Model Overrides](/docs/v1.9/features/large-language-models/parameter_overrides): Learn how to override default LLM hyperparameters in Spice. - [System Prompt parameterization](/docs/v1.9/features/large-language-models/parameterized_prompts): Learn how to update system prompts for each request with Jinja-styled templating. - [Load and Serve Models Locally](/docs/v1.9/features/large-language-models/serving): Learn how to load and serve large learning models. - [Language Models Tools](/docs/v1.9/features/large-language-models/tools): Learn how LLMs interact with the Spice runtime. - [Machine Learning Models](/docs/v1.9/features/machine-learning-models): Spice supports loading and serving ONNX models for inference, from sources including local filesystems, Hugging Face, and the Spice.ai Cloud platform. - [Observability & Monitoring](/docs/v1.9/features/observability): Learn how to use Spice telemetry. - [Component Metrics](/docs/v1.9/features/observability/component_metrics): Learn how to enable optional component metrics. - [Query Federation](/docs/v1.9/features/query-federation): Learn how to use federated SQL queries in Spice.ai Open Source - [Search Functionality](/docs/v1.9/features/search): Learn how Spice can search across datasets using database-native and vector-search methods. - [Full-Text Search](/docs/v1.9/features/search/full-text): Learn how Spice can perform full text search - [Vector-Based Search](/docs/v1.9/features/search/vector-search): Learn how Spice can perform searches using vector-based methods. - [Semantic Model](/docs/v1.9/features/semantic-model): Learn how to define and use semantic data models with Spice. - [Web Search](/docs/v1.9/features/web-search): Learn how Spice can perform web search - [Getting started with Spice.ai OSS](/docs/v1.9/getting-started): Get started with Spice in 5 minutes - [Community Data](/docs/v1.9/getting-started/spiceai): Connect to the Spice.ai Cloud Platform to access community datasets. - [Spicepods](/docs/v1.9/getting-started/spicepods): An introduction to Spicepods - [Telemetry](/docs/v1.9/getting-started/telemetry): Learn how Spice AI uses anonymous telemetry. - [Spice.ai OSS Installation](/docs/v1.9/installation): Instructions for installing Spice.ai OSS - [Intelligent Applications](/docs/v1.9/intelligent-applications): Building intelligent data and AI-driven applications with Spice.ai - [Monitoring](/docs/v1.9/monitoring): Monitoring Spice.ai deployments - [Datadog](/docs/v1.9/monitoring/datadog): Monitoring Spice with Datadog - [Grafana & Prometheus](/docs/v1.9/monitoring/grafana): Monitoring Spice instances with Grafana & Prometheus - [Zipkin Integration](/docs/v1.9/monitoring/zipkin): Learn how to integrate Spice with Zipkin tracing. - [Spice.ai OSS Reference Docs](/docs/v1.9/reference): Reference documentation on the Spice API, CLI and Pod manifest syntax. - [Cron Schedules](/docs/v1.9/reference/cron): The Runtime supports cron expressions with optional seconds, like /10 which evaluates to every 10th second (10, 20, 30, etc). - [Data Types Reference](/docs/v1.9/reference/datatypes) - [Accelerator Data Types](/docs/v1.9/reference/datatypes/accelerators): Spice adheres to Apache Arrow data types. Data accelerators do not support all Arrow data types. The table below outlines the data type compatibility for each accelerator, and datatype used within the accelerator. - [Object Store Data Types](/docs/v1.9/reference/datatypes/object_store): Spice adheres to Apache Arrow data types. The table below lists the types of supported file type from object stores and their corresponding Apache Arrow type mappings in Spice. - [Duration](/docs/v1.9/reference/duration): Durations are represented as integers with a time unit suffix. - [File Formats](/docs/v1.9/reference/file_format): Spice currently supports CSV, JSON, and Parquet data file-formats for data connectors that can read files from a file system or cloud object storage (i.e. s3//, file://, etc.). Support for Iceberg and other file-formats are on the roadmap. - [Managing Memory Usage](/docs/v1.9/reference/memory): Guidelines and best practices for managing memory usage and optimizing performance in Spice.ai Open Source deployments. - [Models Grade Report](/docs/v1.9/reference/models): Spice AI graded Large-Language-Model (LLM) evaluation report - [YAML syntax for Spicepod manifests](/docs/v1.9/reference/spicepod): Detailed documentation on the Spicepod manifest syntax (spicepod.yaml) - [catalogs](/docs/v1.9/reference/spicepod/catalogs): Catalogs YAML reference - [Datasets](/docs/v1.9/reference/spicepod/datasets): Datasets YAML reference - [Embeddings](/docs/v1.9/reference/spicepod/embeddings): Embeddings YAML reference - [evals](/docs/v1.9/reference/spicepod/evals): Evaluations YAML reference - [Reserved Keywords](/docs/v1.9/reference/spicepod/keywords): Reserved keywords for datasets - [Models](/docs/v1.9/reference/spicepod/models): Models YAML reference - [Runtime](/docs/v1.9/reference/spicepod/runtime): Runtime YAML reference - [Tools (Function Calling)](/docs/v1.9/reference/spicepod/tools): Tools YAML reference - [Views](/docs/v1.9/reference/spicepod/views): Views YAML reference - [Workers](/docs/v1.9/reference/spicepod/workers): Workers YAML reference - [SQL Reference](/docs/v1.9/reference/sql): This section provides a comprehensive reference for SQL support in Spice.ai, including syntax, data types, operators, functions, and system features. The reference is organized by topic for ease of navigation. - [Aggregate Functions](/docs/v1.9/reference/sql/aggregate_functions): Spice is built on Apache DataFusion and uses the PostgreSQL dialect, even when querying datasources with different SQL dialects. Note, when using a data accelerator like DuckDB, function support is specific to each acceleration engine, and not all functions are supported by all acceleration engines. - [AI Functions](/docs/v1.9/reference/sql/ai): AI functions in Spice provide direct integration with large language models (LLMs) and embedding models within SQL queries. These functions process text through configured model providers and return generated responses or vector embeddings. - [DML (Data Manipulation Language)](/docs/v1.9/reference/sql/dml): Data Manipulation Language (DML) statements for inserting and modifying data in Spice. - [Explain](/docs/v1.9/reference/sql/explain): Spice is built on Apache DataFusion and uses the PostgreSQL dialect, even when querying datasources with different SQL dialects. - [Information Schema](/docs/v1.9/reference/sql/information_schema): Spice is built on Apache DataFusion and uses the PostgreSQL dialect, even when querying datasources with different SQL dialects. - [JSON Functions and Operators](/docs/v1.9/reference/sql/json): Reference for JSON functions and operators in Spice SQL - [Operators](/docs/v1.9/reference/sql/operators): Spice is built on Apache DataFusion and uses the PostgreSQL dialect, even when querying datasources with different SQL dialects. - [Prepared Statements](/docs/v1.9/reference/sql/prepared_statements): Spice is built on Apache DataFusion and uses the PostgreSQL dialect, even when querying datasources with different SQL dialects. - [Scalar Functions](/docs/v1.9/reference/sql/scalar_functions): Spice is built on Apache DataFusion and uses the PostgreSQL dialect, even when querying datasources with different SQL dialects. Note, when using a data accelerator like DuckDB, function support is specific to each acceleration engine, and not all functions are supported by all acceleration engines. - [Search in SQL](/docs/v1.9/reference/sql/search): Reference for search functions and filtering in Spice SQL. - [SELECT](/docs/v1.9/reference/sql/select): Spice is built on Apache DataFusion and uses the PostgreSQL dialect, even when querying datasources with different SQL dialects. - [Subqueries](/docs/v1.9/reference/sql/subqueries): Spice is built on Apache DataFusion and uses the PostgreSQL dialect, even when querying datasources with different SQL dialects. - [Spice.ai Open Source System Requirements](/docs/v1.9/reference/system_requirements): System requirements for running Spice.ai Open Source - [Task History](/docs/v1.9/reference/task_history): The Spice runtime stores information about completed tasks in the spice.runtime.task_history table. Each task represents a single unit of execution within the runtime, such as a SQL query or an AI chat completion, and is represented by a unique span. - [SDKs](/docs/v1.9/sdks): Connect to spice, using official Spice SDKs - [Dotnet SDK for Spice.ai](/docs/v1.9/sdks/dotnet): Connect to Spice using Spice Dotnet SDK - [Go SDK](/docs/v1.9/sdks/golang): Connect to spice using spice go SDK - [Java SDK](/docs/v1.9/sdks/java): Connect to Spice using Spice Java SDK - [JavaScript SDK](/docs/v1.9/sdks/javascript): Connect to spice using Spice.js SDK - [Python SDK](/docs/v1.9/sdks/python): Connect to spice using spice python SDK - [Rust SDK](/docs/v1.9/sdks/rust): Connect to spice using spice rust SDK - [Troubleshooting Spice](/docs/v1.9/troubleshooting): Review and debug runtime tasks, logs, and diagnostic steps in Spice. - [Spice.ai Use Cases](/docs/v1.9/use-cases): Use cases for Spice.ai' - [AI Applications and Agents](/docs/v1.9/use-cases/ai): AI Applications and Agents - [Agentic AI Applications and Agents](/docs/v1.9/use-cases/ai/agentic-apps): Spice.ai builds intelligent, autonomous agents for SaaS applications, enabling context-aware automation and decision-making. - [Edge-Enabled AI Applications and Agents](/docs/v1.9/use-cases/ai/edge-ai): Spice.ai deploys AI applications and agents across cloud and edge for low-latency decisions in security IoT use cases. - [Federated MCP Client for Distributed Tool Ecosystems](/docs/v1.9/use-cases/ai/federated-mcp-server): Spice.ai federates external MCP servers for scalable, tool-driven AI applications in security, enhancing threat analysis. - [Object-Store Based SQL Query, Search, and LLM Inference Engine](/docs/v1.9/use-cases/ai/object-store-ai-engine): Spice.ai enables SQL queries, hybrid search, and LLM inference on object-store data for security applications, delivering real-time insights. - [Real-Time Decision-Making for Intelligent Applications](/docs/v1.9/use-cases/ai/real-time-decision-making): Spice.ai powers instant, context-aware decisions for applications like security recommendations by grounding AI in federated, low-latency datasets. - [Tool-Augmented AI with Model Context Protocol Server](/docs/v1.9/use-cases/ai/tool-calling-ai): Spice.ai extends AI with custom tools via MCP server in finserv, integrating domain-specific APIs for enhanced functionality. - [Data Federation, Acceleration, and SQL Query](/docs/v1.9/use-cases/data): Data Federation, Acceleration, and SQL Query - [Application Resilience and Performance Optimization](/docs/v1.9/use-cases/data/application-resilence-and-acceleration): Spice.ai colocates dynamic data with SaaS applications as a database CDN, ensuring resilience and high performance. - [Data Mesh for Unified Data Access](/docs/v1.9/use-cases/data/data-mesh): Spice.ai enables unified data access across disparate sources for health-tech applications, fostering a data mesh architecture. - [Database CDN for Enhanced Performance](/docs/v1.9/use-cases/data/database-cdn): Spice.ai acts as a database CDN for SaaS applications, caching dynamic data to ensure high performance and resilience. - [ETL-free Workflows and Data Migrations](/docs/v1.9/use-cases/data/etl-free-workflows): Spice.ai enables data migrations and workflows without ETL by federating legacy and modern systems for seamless transitions. - [Object-Store Data Engine](/docs/v1.9/use-cases/data/object-store-data-engine): Spice.ai federates, accelerates, and queries object-store data for finserv applications, enabling real-time data access without centralized warehouses. - [Reverse-ETL for Operational Workflows](/docs/v1.9/use-cases/data/reverse-etl): Spice.ai serves enriched data from warehouses to operational systems for real-time actions, eliminating complex ETL pipelines. - [Retrieval-Augmented-Generation (RAG)](/docs/v1.9/use-cases/rag): Retrieval-Augmented-Generation (RAG) - [Spice for Retrieval-Augmented-Generation (RAG)](/docs/v1.9/use-cases/rag/applications): Use Spice for Retrieval-Augmented-Generation (RAG) - [Retrieval-Augmented Generation for AI-Powered Reporting](/docs/v1.9/use-cases/rag/reporting): Spice.ai generates dynamic, context-aware AI-driven reports for operational insights in health-tech, ensuring compliance and precision. - [Search & Retrieval](/docs/v1.9/use-cases/search): Search & Retrieval - [Simplifying Real-Time Data Collection and Search](/docs/v1.9/use-cases/search/data-collection-and-search): Spice.ai processes streaming and static data with integrated search for real-time insights, focusing on application logic. - [Enterprise Search and Retrieval](/docs/v1.9/use-cases/search/enterprise-search): Spice.ai powers semantic and precise search for finserv knowledge bases with hybrid vector and keyword capabilities. - [Object-Store Native Search Engine](/docs/v1.9/use-cases/search/object-store-search-engine): Spice.ai powers a cloud-native embedded search engine on object-store data for security applications, enabling semantic and precise search. ### v2.0 Spice is an open-source SQL query and AI compute engine, written in Rust, for data-driven applications and AI agents. Learn about data federation, acceleration, RAG, and building intelligent apps. - [Spice.ai Open Source](/docs/v2.0): Spice is an open-source SQL query and AI compute engine, written in Rust, for data-driven applications and AI agents. Learn about data federation, acceleration, RAG, and building intelligent apps. - [Tags](/docs/v2.0/tags) - [One doc tagged with "Acknowledgements"](/docs/v2.0/tags/acknowledgements): Project acknowledgements, credits, and attributions. - [3 docs tagged with "ADBC"](/docs/v2.0/tags/adbc): Arrow Database Connectivity driver configuration and usage. - [4 docs tagged with "API"](/docs/v2.0/tags/api): HTTP, Arrow Flight SQL, ODBC, JDBC, and ADBC API reference. - [One doc tagged with "Argo CD"](/docs/v2.0/tags/argocd): Argo CD declarative GitOps continuous delivery for Kubernetes. - [2 docs tagged with "Arrow"](/docs/v2.0/tags/arrow): Apache Arrow columnar data format integration. - [One doc tagged with "Arrow Flight SQL"](/docs/v2.0/tags/arrow-flight-sql): Arrow Flight SQL protocol implementation and configuration. - [One doc tagged with "Auth"](/docs/v2.0/tags/auth): Authentication and authorization mechanisms. - [2 docs tagged with "Authentication"](/docs/v2.0/tags/authentication): User authentication methods and security protocols. - [5 docs tagged with "Azure"](/docs/v2.0/tags/azure): Microsoft Azure cloud services and integrations. - [2 docs tagged with "Blob Storage"](/docs/v2.0/tags/blob-storage): Object storage services and blob data access. - [One doc tagged with "Caching"](/docs/v2.0/tags/caching): Data caching strategies and performance optimization. - [13 docs tagged with "Catalogs"](/docs/v2.0/tags/catalogs): Data catalog connectors and metadata management. - [2 docs tagged with "Cayenne"](/docs/v2.0/tags/cayenne): Cayenne (Vortex) data accelerator built on Vortex columnar format. - [2 docs tagged with "CLI"](/docs/v2.0/tags/cli): Spice command-line interface commands and usage. - [5 docs tagged with "Component Metrics"](/docs/v2.0/tags/component-metrics): Runtime component performance metrics and monitoring. - [One doc tagged with "Components"](/docs/v2.0/tags/components): Runtime components including catalogs, data connectors, and models. - [2 docs tagged with "Configuration"](/docs/v2.0/tags/configuration): System configuration files and runtime settings. - [2 docs tagged with "Cosmos DB"](/docs/v2.0/tags/cosmosdb): Azure Cosmos DB (NoSQL / Core SQL) data connector. - [One doc tagged with "C#"](/docs/v2.0/tags/csharp): C# programming language topics. - [7 docs tagged with "Data Accelerators"](/docs/v2.0/tags/data-accelerators): Data acceleration engines for high-performance query execution. - [48 docs tagged with "Data Connectors"](/docs/v2.0/tags/data-connectors): Data source connectors and integration patterns. - [One doc tagged with "Data Lake"](/docs/v2.0/tags/data-lake): Data lake architectures and storage solutions. - [3 docs tagged with "Databricks"](/docs/v2.0/tags/databricks): Databricks platform integration and Unity Catalog support. - [2 docs tagged with "Datasets"](/docs/v2.0/tags/datasets): Dataset definitions and data source configurations. - [One doc tagged with "Debezium"](/docs/v2.0/tags/debezium): Debezium change data capture integration. - [One doc tagged with "Debugging"](/docs/v2.0/tags/debugging): Debugging techniques and troubleshooting tools. - [3 docs tagged with "Delta Lake"](/docs/v2.0/tags/delta-lake): Delta Lake open table format support. - [One doc tagged with "Dependencies"](/docs/v2.0/tags/dependencies): Third-party dependencies and software requirements. - [8 docs tagged with "Deployment"](/docs/v2.0/tags/deployment): Production deployment using Docker and Kubernetes. - [2 docs tagged with "Docker"](/docs/v2.0/tags/docker): Docker containerization and deployment configurations. - [One doc tagged with ".NET"](/docs/v2.0/tags/dotnet): .NET framework topics. - [One doc tagged with "Dremio"](/docs/v2.0/tags/dremio): Dremio data lake engine integration. - [2 docs tagged with "DuckDB"](/docs/v2.0/tags/duckdb): DuckDB embedded analytical database integration. - [2 docs tagged with "DuckLake"](/docs/v2.0/tags/ducklake): DuckLake catalog integration. - [2 docs tagged with "DynamoDB"](/docs/v2.0/tags/dynamodb): Amazon DynamoDB NoSQL database integration. - [2 docs tagged with "Elasticsearch"](/docs/v2.0/tags/elasticsearch): Elasticsearch data connector and vector engine integration. - [7 docs tagged with "Embeddings"](/docs/v2.0/tags/embeddings): Vector embeddings and semantic similarity operations. - [6 docs tagged with "Features"](/docs/v2.0/tags/features): Core platform features including acceleration, caching, and search. - [One doc tagged with "Federation"](/docs/v2.0/tags/federation): Cross-database queries and federated data access. - [One doc tagged with "File"](/docs/v2.0/tags/file): File-based data connectors and local file access. - [One doc tagged with "Flux"](/docs/v2.0/tags/flux): Flux CD GitOps toolkit for Kubernetes. - [One doc tagged with "Flux CD"](/docs/v2.0/tags/fluxcd): Flux CD GitOps toolkit for Kubernetes. - [2 docs tagged with "Functions"](/docs/v2.0/tags/functions): User-defined SQL scalar functions and remote function endpoints. - [One doc tagged with "Getting Started"](/docs/v2.0/tags/getting-started): Installation guides and quickstart tutorials. - [3 docs tagged with "GitHub"](/docs/v2.0/tags/github): GitHub repository data connector and integration. - [3 docs tagged with "GitOps"](/docs/v2.0/tags/gitops): GitOps continuous delivery patterns for Kubernetes. - [2 docs tagged with "Glue"](/docs/v2.0/tags/glue): AWS Glue ETL service and data catalog integration. - [One doc tagged with "Go"](/docs/v2.0/tags/go): Go programming language topics. - [One doc tagged with "Golang"](/docs/v2.0/tags/golang): Go (Golang) programming language topics. - [One doc tagged with "GraphQL"](/docs/v2.0/tags/graphql): GraphQL API data connectors and query language support. - [3 docs tagged with "Helm"](/docs/v2.0/tags/helm): Helm package manager for deploying Spice.ai on Kubernetes. - [One doc tagged with "HTTPS"](/docs/v2.0/tags/https): HTTPS data connectors and secure web API access. - [2 docs tagged with "Hugging Face"](/docs/v2.0/tags/huggingface): Hugging Face model hub and transformer model integration. - [2 docs tagged with "Iceberg"](/docs/v2.0/tags/iceberg): Apache Iceberg open table format support. - [One doc tagged with "In-Memory"](/docs/v2.0/tags/in-memory): In-memory data processing and temporary storage. - [One doc tagged with "Integration"](/docs/v2.0/tags/integration): Third-party system integrations and connectivity patterns. - [One doc tagged with "Java"](/docs/v2.0/tags/java): Java programming language topics. - [One doc tagged with "JavaScript"](/docs/v2.0/tags/javascript): JavaScript programming language topics. - [One doc tagged with "JDBC"](/docs/v2.0/tags/jdbc): Java Database Connectivity driver configuration. - [One doc tagged with "Kafka"](/docs/v2.0/tags/kafka): Apache Kafka event streaming platform integration. - [6 docs tagged with "Kubernetes"](/docs/v2.0/tags/kubernetes): Kubernetes orchestration and secret management. - [One doc tagged with "libSQL"](/docs/v2.0/tags/libsql): libSQL database topics. - [One doc tagged with "Local"](/docs/v2.0/tags/local): Local model execution and on-premise services. - [One doc tagged with "Logging"](/docs/v2.0/tags/logging): Application logging configuration and log management. - [One doc tagged with "Login"](/docs/v2.0/tags/login): User login processes and session management. - [One doc tagged with "Manifest"](/docs/v2.0/tags/manifest): Configuration manifest files and schema definitions. - [One doc tagged with "MCP"](/docs/v2.0/tags/mcp): Model Context Protocol for AI tool integration. - [2 docs tagged with "Memory"](/docs/v2.0/tags/memory): In-memory data connectors and volatile storage. - [16 docs tagged with "Models"](/docs/v2.0/tags/models): Machine learning models and AI inference engines. - [One doc tagged with "MongoDB"](/docs/v2.0/tags/mongodb): MongoDB NoSQL document database integration. - [One doc tagged with "MSSQL"](/docs/v2.0/tags/mssql): Microsoft SQL Server database integration. - [3 docs tagged with "MySQL"](/docs/v2.0/tags/mysql): MySQL relational database integration. - [One doc tagged with "Node.js"](/docs/v2.0/tags/nodejs): Node.js runtime environment topics. - [3 docs tagged with "NoSQL"](/docs/v2.0/tags/nosql): NoSQL database systems and document stores. - [29 docs tagged with "Observability"](/docs/v2.0/tags/observability): Monitoring, tracing, and metrics for system visibility. - [One doc tagged with "ODBC"](/docs/v2.0/tags/odbc): Open Database Connectivity driver configuration. - [One doc tagged with "Open Source"](/docs/v2.0/tags/open-source): Open source licenses and community contributions. - [3 docs tagged with "OpenAI"](/docs/v2.0/tags/openai): OpenAI API integration and GPT model access. - [2 docs tagged with "Oracle"](/docs/v2.0/tags/oracle): Documentation related to Oracle database integration. - [2 docs tagged with "Overrides"](/docs/v2.0/tags/overrides): Parameter overrides and configuration customization. - [2 docs tagged with "Overview"](/docs/v2.0/tags/overview): High-level component and feature overviews. - [2 docs tagged with "Parameters"](/docs/v2.0/tags/parameters): Configuration parameters and runtime options. - [One doc tagged with "Performance"](/docs/v2.0/tags/performance): Performance optimization and benchmarking. - [One doc tagged with "Persistence"](/docs/v2.0/tags/persistence): Data persistence and durable storage mechanisms. - [4 docs tagged with "Postgres"](/docs/v2.0/tags/postgres): PostgreSQL database integration and configuration. - [One doc tagged with "Python"](/docs/v2.0/tags/python): Python programming language topics. - [3 docs tagged with "Query"](/docs/v2.0/tags/query): SQL query execution, parameterized queries, and prepared statements. - [4 docs tagged with "Reference"](/docs/v2.0/tags/reference): API reference, CLI commands, and configuration syntax. - [One doc tagged with "Relational"](/docs/v2.0/tags/relational): Relational database systems and SQL operations. - [3 docs tagged with "Runtime"](/docs/v2.0/tags/runtime): Runtime behavior and execution environment. - [One doc tagged with "Rust"](/docs/v2.0/tags/rust): Rust programming language topics. - [2 docs tagged with "S3"](/docs/v2.0/tags/s3): Amazon S3 object storage integration. - [One doc tagged with "S3 Express"](/docs/v2.0/tags/s3-express): Amazon S3 Express One Zone storage. - [One doc tagged with "Sandbox"](/docs/v2.0/tags/sandbox): Sandbox environments and isolated testing. - [One doc tagged with "ScyllaDB"](/docs/v2.0/tags/scylladb): ScyllaDB database integration. - [6 docs tagged with "SDK"](/docs/v2.0/tags/sdk): Software Development Kit topics and usage. - [10 docs tagged with "Search"](/docs/v2.0/tags/search): Vector search, semantic search, and ranking capabilities. - [2 docs tagged with "Security"](/docs/v2.0/tags/security): Security features and data protection mechanisms. - [One doc tagged with "Snowflake"](/docs/v2.0/tags/snowflake): Snowflake cloud data warehouse integration. - [7 docs tagged with "SpiceAI"](/docs/v2.0/tags/spiceai): SpiceAI cloud platform and managed services. - [5 docs tagged with "Spicepod"](/docs/v2.0/tags/spicepod): Spicepod configuration files, manifest syntax, and package management. - [6 docs tagged with "SQL"](/docs/v2.0/tags/sql): SQL query language support and database operations. - [5 docs tagged with "Tools"](/docs/v2.0/tags/tools): Development tools and utility integrations. - [2 docs tagged with "Tracing"](/docs/v2.0/tags/tracing): Distributed tracing and request monitoring. - [One doc tagged with "Troubleshooting"](/docs/v2.0/tags/troubleshooting): Problem diagnosis and resolution guides. - [One doc tagged with "Turso"](/docs/v2.0/tags/turso): Turso data accelerator integration. - [2 docs tagged with "UDF"](/docs/v2.0/tags/udf): User-defined functions registered with the SQL engine. - [2 docs tagged with "Unity Catalog"](/docs/v2.0/tags/unity-catalog): Databricks Unity Catalog data governance integration. - [One doc tagged with "Views"](/docs/v2.0/tags/views): Virtual views and data transformation layers. - [One doc tagged with "Vortex"](/docs/v2.0/tags/vortex): Vortex columnar file format and storage engine. - [10 docs tagged with "Write"](/docs/v2.0/tags/write): Data connectors and catalogs that support write operations. - [One doc tagged with "YAML"](/docs/v2.0/tags/yaml): YAML configuration syntax and file formats. - [One doc tagged with "Zipkin"](/docs/v2.0/tags/zipkin): Zipkin distributed tracing system integration. - [Open Source Acknowledgements](/docs/v2.0/acknowledgements): Spice AI acknowledges the following open source projects for making this project possible: - [Spice.ai API Reference](/docs/v2.0/api): Spice.ai API reference including HTTP REST API, Arrow Flight SQL, JDBC, ODBC, ADBC connectors, authentication, and TLS configuration. - [ADBC: Arrow Database Connectivity](/docs/v2.0/api/adbc): ADBC API Documentation - [Arrow Flight SQL API](/docs/v2.0/api/arrow-flight-sql): Query Spice using JDBC/ODBC/ADBC - [Authentication](/docs/v2.0/api/auth): Authentication documentation - [Generate Package](/docs/v2.0/api/HTTP/generate-package): This endpoint generates a zip package from a specified GitHub source. - [List Catalogs](/docs/v2.0/api/HTTP/get-catalogs): Returns a list of all registered catalogs (data sources). Catalogs provide metadata about schemas and tables available from external data sources. - [Get Iceberg API config](/docs/v2.0/api/HTTP/get-config): This endpoint returns the Iceberg Catalog API configuration, including details about overrides, defaults, and available endpoints. - [List Datasets](/docs/v2.0/api/HTTP/get-datasets): This endpoint returns a list of configured datasets. The response can be formatted as **JSON** or **CSV**, - [List Iceberg namespaces](/docs/v2.0/api/HTTP/get-iceberg-namespaces): This endpoint retrieves namespaces available in the Iceberg catalog. - [ML Prediction](/docs/v2.0/api/HTTP/get-model-predict): Make a ML prediction using a specific model. - [List Models](/docs/v2.0/api/HTTP/get-models): List all models, both machine learning and language models, available in the runtime. - [Check if a namespace exists.](/docs/v2.0/api/HTTP/get-namespace): This endpoint returns a 200 OK response if the namespace exists, otherwise it returns a 404 Not Found response. - [List Spicepods](/docs/v2.0/api/HTTP/get-spicepods): Get a list of spicepods and their summary details. - [Check Runtime Status](/docs/v2.0/api/HTTP/get-status): Return the status of all connections (http, flight, metrics, opentelemetry) in the runtime. - [Get a table.](/docs/v2.0/api/HTTP/get-table): This endpoint returns the table if it exists, otherwise it returns a 404 Not Found response. - [List Workers](/docs/v2.0/api/HTTP/get-workers): Returns a list of all registered workers in the runtime. Workers are configurable processing units that can perform tasks like load balancing between models or implementing fallback strategies. - [Check Namespace exists](/docs/v2.0/api/HTTP/head-namespace): This endpoint returns a 200 OK response if the namespace exists, otherwise it returns a 404 Not Found response. - [Check if a table exists.](/docs/v2.0/api/HTTP/head-table): This endpoint returns a 200 OK response if the table exists, otherwise it returns a 404 Not Found response. - [list_tables](/docs/v2.0/api/HTTP/list-tables): list_tables - [List Tools](/docs/v2.0/api/HTTP/list-tools): Returns a list of all available tools in the Spice runtime. Tools provide reusable functionality that can be invoked programmatically or by AI agents. - [Send message to MCP server](/docs/v2.0/api/HTTP/mcp-event): Send message to the MCP endoint, for a given session. - [Establish an MCP SSE Connection](/docs/v2.0/api/HTTP/operation-id): Initiates a Server-Sent Events (SSE) connection using the Model Context Protocol (MCP) to interact with Spice tools. - [Update Refresh SQL](/docs/v2.0/api/HTTP/patch-dataset-acceleration): Update the refresh SQL for a dataset's acceleration. - [Batch ML Predictions](/docs/v2.0/api/HTTP/post-batch-predict): Perform a batch of ML predictions, using multiple models, in one request. This is useful for ensembling or A/B testing different models. - [Create Chat Completion](/docs/v2.0/api/HTTP/post-chat-completions): Creates a model response for the given chat conversation. - [Refresh Dataset](/docs/v2.0/api/HTTP/post-dataset-refresh): Trigger an on-demand refresh for an accelerated dataset. - [Create Embeddings](/docs/v2.0/api/HTTP/post-embeddings): Creates an embedding vector representing the input text. - [Text-to-SQL (NSQL)](/docs/v2.0/api/HTTP/post-nsql): Generate and optionally execute a natural-language text-to-SQL (NSQL) query. - [post_responses](/docs/v2.0/api/HTTP/post-responses): post_responses - [Search](/docs/v2.0/api/HTTP/post-search): Perform a vector similarity search (VSS) operation on a dataset. - [SQL Query](/docs/v2.0/api/HTTP/post-sql): Execute a SQL query and return the results. - [Check Readiness](/docs/v2.0/api/HTTP/ready): Check the runtime status of all the components of the runtime. If the service is ready, it returns an HTTP 200 status with the message 'ready'. If not, it returns a 503 status with the message 'not ready'. - [Run Tool](/docs/v2.0/api/HTTP/run-tool): Execute a specific tool by name. The request body schema and response format are defined by each individual tool's specification. Use `GET /v1/tools` to discover available tools and their parameter schemas. - [runtime](/docs/v2.0/api/HTTP/runtime): The spiced runtime - [JDBC: Java Database Connectivity](/docs/v2.0/api/jdbc): JDBC API Documentation - [ODBC: Open Database Connectivity](/docs/v2.0/api/odbc): ODBC API Documentation - [API Overview](/docs/v2.0/api/overview): Spice.ai API overview, including SQL query interfaces, OpenAI-compatible endpoints, Iceberg catalog REST APIs, and the Model Context Protocol (MCP) for integrating external tools. - [TLS: Transport Layer Security](/docs/v2.0/api/tls): Encryption in transit with TLS documentation - [Spice.ai CLI Reference](/docs/v2.0/cli): Complete CLI reference for Spice.ai including commands to create, manage Spicepods, run queries, and interact with the Spice runtime. - [Spice.ai OSS CLI command reference](/docs/v2.0/cli/reference): Spice CLI command reference - [add](/docs/v2.0/cli/reference/add): Add a Spicepod to the project. - [catalogs](/docs/v2.0/cli/reference/catalogs): List catalogs currently loaded by the Spice runtime. - [chat](/docs/v2.0/cli/reference/chat): spice chat CLI documentation - [completions](/docs/v2.0/cli/reference/completions): Generate shell completions for the Spice CLI. - [connect](/docs/v2.0/cli/reference/connect): Connect to an app on the Spice.ai Cloud Platform. - [dataset](/docs/v2.0/cli/reference/dataset): Configure a Spice dataset. - [datasets](/docs/v2.0/cli/reference/datasets): Lists datasets loaded by the Spice runtime - [feedback](/docs/v2.0/cli/reference/feedback): Open the Spice.ai community Slack in the default browser to share feedback. - [init](/docs/v2.0/cli/reference/init): Initialize Spice app in the current working directory. - [install](/docs/v2.0/cli/reference/install): Download and install the latest version of the Spice runtime. - [login](/docs/v2.0/cli/reference/login): Login to the Spice.ai Platform, or other services with sub-commands. - [models](/docs/v2.0/cli/reference/models): Lists models loaded by the Spice runtime - [nsql](/docs/v2.0/cli/reference/nsql): spice nsql CLI documentation - [pods](/docs/v2.0/cli/reference/pods): Lists Spicepods loaded by the Spice runtime - [query](/docs/v2.0/cli/reference/query): Submit an async query or start an interactive async query REPL against the Spice runtime's distributed query engine. - [refresh](/docs/v2.0/cli/reference/refresh): Refreshes an accelerated dataset loaded by the Spice runtime - [run](/docs/v2.0/cli/reference/run): Run Spice - starts the Spice runtime, installing if necessary. - [search](/docs/v2.0/cli/reference/search): Performs embeddings-based searches across search-configured datasets. - [spiced](/docs/v2.0/cli/reference/spiced): Command-line reference for the spiced runtime binary — flags, defaults, and differences from spice run. - [sql](/docs/v2.0/cli/reference/sql): Start an interactive SQL query session against the Spice runtime - [status](/docs/v2.0/cli/reference/status): Spice runtime status - [trace](/docs/v2.0/cli/reference/trace): Provides a user-friendly trace stack into an operation that occurred in Spice. This command retrieves and displays task execution traces from the runtime.task_history table. - [upgrade](/docs/v2.0/cli/reference/upgrade): Upgrades the Spice CLI & Runtime to the latest release - [validate](/docs/v2.0/cli/reference/validate): Validate a spicepod.yaml without starting the runtime. - [version](/docs/v2.0/cli/reference/version): Outputs the current version of the Spice CLI and runtime - [Configuring Trace Levels](/docs/v2.0/cli/tracing): Configuring Spice.ai OSS trace output verbosity levels - [Clients and Tools](/docs/v2.0/clients): Client and tools for connecting to Spice - [DBeaver](/docs/v2.0/clients/dbeaver): Configure DBeaver to query Spice via JDBC - [JetBrains DataGrip](/docs/v2.0/clients/jetbrains-datagrip): Configure JetBrains Datagrip to query Spice via JDBC - [Microsoft Power BI Connector](/docs/v2.0/clients/powerbi): Use Microsoft Power BI to access, visualize and analyze Spice datasets. - [Apache Superset](/docs/v2.0/clients/superset): Use Apache Superset to query and visualize datasets loaded in Spice. - [Tableau](/docs/v2.0/clients/tableau): Use Tableau to to access, visualise and analyse datasets loaded in Spice. - [How Spice Compares](/docs/v2.0/comparison): Compare Spice.ai with data platforms (Databricks, Snowflake), query engines (Trino, Dremio, ClickHouse), vector databases (Turbopuffer, LanceDB), search engines (Elasticsearch), and AI frameworks (LangChain, LlamaIndex, Ollama). - [Spice.ai Runtime Components](/docs/v2.0/components): Configure Spice.ai runtime components including data connectors, data accelerators, catalog connectors, model providers, embedding models, and secret stores. - [Catalog Connectors](/docs/v2.0/components/catalogs): Connect to external catalog providers like Unity Catalog, Databricks, Iceberg, AWS Glue, Snowflake, ADBC, PostgreSQL, MySQL, MSSQL, Oracle, and more for federated SQL query in Spice. - [ADBC Catalog Connector](/docs/v2.0/components/catalogs/adbc): Connect to databases via ADBC for automatic schema and table discovery. - [Databricks Catalog Connector](/docs/v2.0/components/catalogs/databricks): Connect to a Databricks Unity Catalog provider. - [DuckLake Catalog Connector](/docs/v2.0/components/catalogs/ducklake): Connect to a DuckLake catalog for federated SQL query. - [Glue Catalog Connector](/docs/v2.0/components/catalogs/glue): Connect to an AWS Glue Data Catalog. - [Iceberg Catalog Connector](/docs/v2.0/components/catalogs/iceberg): Connect to an Iceberg catalog provider. - [Microsoft SQL Server Catalog Connector](/docs/v2.0/components/catalogs/mssql): Connect to a Microsoft SQL Server database as a catalog provider for federated SQL query. - [MySQL Catalog Connector](/docs/v2.0/components/catalogs/mysql): Connect to a MySQL database as a catalog provider for federated SQL query. - [Oracle Catalog Connector](/docs/v2.0/components/catalogs/oracle): Connect to an Oracle database as a catalog provider for federated SQL query. - [PostgreSQL Catalog Connector](/docs/v2.0/components/catalogs/postgres): Connect to a PostgreSQL database as a catalog provider for federated SQL query. - [Snowflake Catalog Connector](/docs/v2.0/components/catalogs/snowflake): Connect to a Snowflake database as a catalog provider for federated SQL query. - [Spice.ai Catalog Connector](/docs/v2.0/components/catalogs/spiceai): Connect to the Spice.ai built-in catalog. - [Unity Catalog Catalog Connector](/docs/v2.0/components/catalogs/unity-catalog): Connect to a Unity Catalog provider. - [Unity Catalog Catalog Connector Deployment Guide](/docs/v2.0/components/catalogs/unity-catalog/deployment): Operating guide for the Unity Catalog catalog connector in production: workspace authentication, table-type filtering, effective-permissions flow, and observability. - [Data Accelerators](/docs/v2.0/components/data-accelerators): Data acceleration engines for local materialization and query acceleration in Spice - [In-Memory Arrow Data Accelerator](/docs/v2.0/components/data-accelerators/arrow): In-Memory Arrow Data Accelerator Documentation - [Arrow Data Accelerator Deployment Guide](/docs/v2.0/components/data-accelerators/arrow/deployment): Operating guide for the Arrow (in-memory) data accelerator in production: memory sizing, indexes, and observability. - [Spice Cayenne Data Accelerator](/docs/v2.0/components/data-accelerators/cayenne): Spice Cayenne Data Accelerator (Vortex) Documentation - [Cayenne Data Accelerator Deployment Guide](/docs/v2.0/components/data-accelerators/cayenne/deployment): Operating guide for Spice Cayenne in production: footer and segment caches, S3 Express, metastore durability, and observability. - [DuckDB Data Accelerator](/docs/v2.0/components/data-accelerators/duckdb): DuckDB Data Accelerator Documentation - [DuckDB Data Accelerator Deployment Guide](/docs/v2.0/components/data-accelerators/duckdb/deployment): Operating guide for the DuckDB data accelerator in production: memory vs file mode, checkpointing, spill, pool sizing, and observability. - [PostgreSQL Data Accelerator](/docs/v2.0/components/data-accelerators/postgres): PostgreSQL Data Accelerator Documentation - [PostgreSQL Data Accelerator Deployment Guide](/docs/v2.0/components/data-accelerators/postgres/deployment): Operating guide for the PostgreSQL data accelerator in production: authentication, connection pooling, and observability. - [SQLite Data Accelerator](/docs/v2.0/components/data-accelerators/sqlite): SQLite Data Accelerator Documentation - [SQLite Data Accelerator Deployment Guide](/docs/v2.0/components/data-accelerators/sqlite/deployment): Operating guide for the SQLite data accelerator in production: file mode, busy timeout, pool, and observability. - [Turso Data Accelerator](/docs/v2.0/components/data-accelerators/turso): Turso (libSQL) Data Accelerator Documentation - [Data Connectors](/docs/v2.0/components/data-connectors): Learn how to use Data Connector to query external data. - [Azure BlobFS Data Connector](/docs/v2.0/components/data-connectors/abfs): Azure BlobFS Data Connector Documentation - [ADBC Data Connector](/docs/v2.0/components/data-connectors/adbc): ADBC Data Connector Documentation - [ClickHouse Data Connector](/docs/v2.0/components/data-connectors/clickhouse): ClickHouse Data Connector Documentation - [Azure Cosmos DB Data Connector](/docs/v2.0/components/data-connectors/cosmosdb): Query Azure Cosmos DB (NoSQL / Core SQL API) containers as SQL tables in Spice. Read-only scan with schema inferred from a sample of documents. - [Azure Cosmos DB Data Connector Deployment Guide](/docs/v2.0/components/data-connectors/cosmosdb/deployment): Operating guide for the Azure Cosmos DB data connector in production: authentication, RU sizing, resilience, metrics, and observability. - [Databricks Data Connector](/docs/v2.0/components/data-connectors/databricks): Databricks Data Connector Documentation - [Databricks Deployment Guide](/docs/v2.0/components/data-connectors/databricks/deployment): Operating guide for the Databricks connector in production: resilience controls, Unity Catalog behavior, metrics, and observability. - [Debezium Data Connector](/docs/v2.0/components/data-connectors/debezium): Debezium Data Connector Documentation - [Delta Lake Data Connector](/docs/v2.0/components/data-connectors/delta-lake): Delta Lake Data Connector Documentation - [Delta Lake Data Connector Deployment Guide](/docs/v2.0/components/data-connectors/delta-lake/deployment): Operating guide for the Delta Lake data connector in production: object store auth, metadata caching, metrics, and observability. - [Dremio Data Connector](/docs/v2.0/components/data-connectors/dremio): Dremio Data Connector Documentation - [Dremio Data Connector Deployment Guide](/docs/v2.0/components/data-connectors/dremio/deployment): Operating guide for the Dremio data connector in production: authentication, Flight SQL transport, and observability. - [DuckDB Data Connector](/docs/v2.0/components/data-connectors/duckdb): DuckDB Data Connector Documentation - [DuckDB Data Connector Deployment Guide](/docs/v2.0/components/data-connectors/duckdb/deployment): Operating guide for the DuckDB data connector in production: file vs memory mode, durability, and observability. - [DuckLake Data Connector](/docs/v2.0/components/data-connectors/ducklake): DuckLake Data Connector Documentation - [DynamoDB Data Connector](/docs/v2.0/components/data-connectors/dynamodb): DynamoDB Data Connector Documentation - [DynamoDB Data Connector Deployment Guide](/docs/v2.0/components/data-connectors/dynamodb/deployment): Operating guide for the DynamoDB data connector in production: IAM, streams, checkpointing, lag behavior, and observability. - [Elasticsearch Data Connector](/docs/v2.0/components/data-connectors/elasticsearch): Query Elasticsearch indexes as SQL tables in Spice, including kNN vector search, full-text search, and hybrid search. - [Elasticsearch Data Connector Deployment Guide](/docs/v2.0/components/data-connectors/elasticsearch/deployment): Operating guide for the Elasticsearch data connector in production: authentication, TLS, resilience, and operational tuning. - [File Data Connector](/docs/v2.0/components/data-connectors/file): File Data Connector Documentation - [File Data Connector Deployment Guide](/docs/v2.0/components/data-connectors/file/deployment): Operating guide for the File data connector in production: permissions, formats, performance, and observability. - [Flight SQL Data Connector](/docs/v2.0/components/data-connectors/flightsql): Flight SQL Data Connector Documentation - [FTP/SFTP Data Connector](/docs/v2.0/components/data-connectors/ftp): FTP/SFTP Data Connector Documentation - [GCS Data Connector](/docs/v2.0/components/data-connectors/gcs): GCS (Google Cloud Storage) Data Connector Documentation - [GitHub Data Connector](/docs/v2.0/components/data-connectors/github): GitHub Data Connector Documentation - [GitHub Data Connector Deployment Guide](/docs/v2.0/components/data-connectors/github/deployment): Operating guide for the GitHub data connector in production: PATs, rate limits, pagination, and observability. - [Glue Data Connector](/docs/v2.0/components/data-connectors/glue): Connect to and query tables in an AWS Glue Data Catalog - [GraphQL Data Connector](/docs/v2.0/components/data-connectors/graphql): GraphQL Data Connector Documentation - [GraphQL Data Connector Deployment Guide](/docs/v2.0/components/data-connectors/graphql/deployment): Operating guide for the GraphQL data connector in production: authentication, pagination, rate limits, and observability. - [HTTP(s) Data Connector](/docs/v2.0/components/data-connectors/https): HTTP(s) Data Connector Documentation - [HTTP(s) Data Connector Deployment Guide](/docs/v2.0/components/data-connectors/https/deployment): Operating guide for the HTTP(s) data connector in production: authentication, rate control, retries, and observability. - [Iceberg Data Connector](/docs/v2.0/components/data-connectors/iceberg): Connect to and query Apache Iceberg tables - [IMAP Data Connector](/docs/v2.0/components/data-connectors/imap): IMAP Data Connector Documentation - [Kafka Data Connector](/docs/v2.0/components/data-connectors/kafka): Kafka Data Connector Documentation - [Localpod Data Connector](/docs/v2.0/components/data-connectors/localpod): Localpod Data Connector Documentation - [Memory Data Connector](/docs/v2.0/components/data-connectors/memory): Memory Data Connector Documentation - [MongoDB Data Connector](/docs/v2.0/components/data-connectors/mongodb): MongoDB Data Connector Documentation - [Microsoft SQL Server Data Connector](/docs/v2.0/components/data-connectors/mssql): Microsoft SQL Server Data Connector - [MySQL Data Connector](/docs/v2.0/components/data-connectors/mysql): MySQL Data Connector Documentation - [MySQL Data Connector Deployment Guide](/docs/v2.0/components/data-connectors/mysql/deployment): Operating guide for the MySQL data connector in production: authentication, connection pooling, TLS, metrics, and observability. - [NFS Data Connector](/docs/v2.0/components/data-connectors/nfs): NFS Data Connector Documentation - [Pull the latest official Spice image](/docs/v2.0/components/data-connectors/odbc): ODBC Data Connector Documentation - [Oracle Data Connector](/docs/v2.0/components/data-connectors/oracle): Oracle Data Connector Documentation - [PostgreSQL Data Connector](/docs/v2.0/components/data-connectors/postgres): PostgreSQL Data Connector Documentation - [PostgreSQL Data Connector Deployment Guide](/docs/v2.0/components/data-connectors/postgres/deployment): Operating guide for the PostgreSQL data connector in production: authentication, connection pooling, TLS, metrics, and observability. - [Amazon Redshift Data Connector](/docs/v2.0/components/data-connectors/redshift): Connect to Amazon Redshift using the PostgreSQL connector in Spice. - [S3 Data Connector](/docs/v2.0/components/data-connectors/s3): S3 Data Connector Documentation - [S3 Data Connector Deployment Guide](/docs/v2.0/components/data-connectors/s3/deployment): Operating guide for the S3 data connector in production: IAM, credential chains, file formats, metrics, and observability. - [ScyllaDB Data Connector](/docs/v2.0/components/data-connectors/scylladb): ScyllaDB Data Connector Documentation - [SharePoint Data Connector](/docs/v2.0/components/data-connectors/sharepoint): SharePoint Data Connector Documentation - [SMB Data Connector](/docs/v2.0/components/data-connectors/smb): SMB Data Connector Documentation - [Snowflake Data Connector](/docs/v2.0/components/data-connectors/snowflake): Snowflake Data Connector Documentation - [Apache Spark Connector](/docs/v2.0/components/data-connectors/spark): Apache Spark Connector Documentation - [Spice.ai Data Connector](/docs/v2.0/components/data-connectors/spiceai): Federated SQL across Spice runtimes — Spice Cloud Platform datasets and self-hosted Spice instances (cluster-sidecar pattern). - [Spice.ai Data Connector Deployment Guide](/docs/v2.0/components/data-connectors/spiceai/deployment): Operating guide for the Spice.ai connector in production: API keys, Flight endpoints, message sizing, sidecar topology, and observability. - [Embedding Models](/docs/v2.0/components/embeddings): Describes how embedding models are used in Spice to convert text into numerical vectors for machine learning and search applications. - [Azure OpenAI Embedding Models](/docs/v2.0/components/embeddings/azure): To use an embedding model hosted on Azure OpenAI, specify the azure path in the from field and the following parameters from the Azure OpenAI Model Deployment page: - [Amazon Bedrock Model Provider](/docs/v2.0/components/embeddings/bedrock): Instructions for using Amazon Bedrock embedding models - [Databricks Model Provider](/docs/v2.0/components/embeddings/databricks): Instructions for using Databricks Mosaic AI Models - [Google AI Embedding Models](/docs/v2.0/components/embeddings/google): To use a hosted Google AI embedding model, specify the google path in the from field of your configuration. - [HuggingFace Text Embedding Models](/docs/v2.0/components/embeddings/huggingface): To use an embedding model from HuggingFace with Spice, specify the huggingface path in the from field of your configuration. The model and its related files will be automatically downloaded, loaded, and served locally by Spice. - [Hugging Face Embedding Deployment Guide](/docs/v2.0/components/embeddings/huggingface/deployment): Operating guide for Hugging Face embeddings in production: tokens, download cache, pooling, device selection, and observability. - [Local Filesystem Embedding Models](/docs/v2.0/components/embeddings/local): Embedding models can be run with files stored locally. This method is useful for using models that are not hosted on remote services. - [Local Embedding Deployment Guide](/docs/v2.0/components/embeddings/local/deployment): Operating guide for filesystem-loaded embedding models in production: formats, pooling, device selection, and observability. - [Model2Vec Embedding Models](/docs/v2.0/components/embeddings/model2vec): Model2Vec embedding models help generate efficient static word embeddings from sentence transformer models for use in Spice, supporting local and Hugging Face sources with options for private models and performance tuning. - [OpenAI (or Compatible) Embedding Models](/docs/v2.0/components/embeddings/openai): To use a hosted OpenAI (or compatible) embedding model, specify the openai path in the from field of your configuration. - [OpenAI Embedding Deployment Guide](/docs/v2.0/components/embeddings/openai/deployment): Operating guide for the OpenAI embedding provider in production: API keys, usage tiers, batching, retries, metrics, and observability. - [Model Providers](/docs/v2.0/components/models): Overview of supported model providers for ML and LLMs in Spice. - [Anthropic Models](/docs/v2.0/components/models/anthropic): Instructions for using language models hosted on Anthropic with Spice. - [Azure OpenAI Models](/docs/v2.0/components/models/azure): Instructions for using Azure OpenAI models - [Amazon Bedrock Models](/docs/v2.0/components/models/bedrock): How to use Amazon Bedrock models with Spice. - [Databricks Model Provider](/docs/v2.0/components/models/databricks): Instructions for using Databricks Mosaic AI Models - [Filesystem Hosted Models](/docs/v2.0/components/models/filesystem): Instructions for using models hosted on a filesystem with Spice. - [Filesystem Model Deployment Guide](/docs/v2.0/components/models/filesystem/deployment): Operating guide for filesystem-loaded models in production: formats, device selection, memory footprint, and observability. - [Google AI Models](/docs/v2.0/components/models/google): Instructions for using language models hosted on Google AI with Spice. - [HuggingFace](/docs/v2.0/components/models/huggingface): Instructions for using machine learning models hosted on HuggingFace with Spice. - [Hugging Face Model Deployment Guide](/docs/v2.0/components/models/huggingface/deployment): Operating guide for the Hugging Face model in production: tokens, download cache, device selection, local inference footprint, and observability. - [OpenAI (or Compatible) Language Models](/docs/v2.0/components/models/openai): Instructions for using language models hosted on OpenAI or compatible services with Spice. - [OpenAI Model Deployment Guide](/docs/v2.0/components/models/openai/deployment): Operating guide for the OpenAI model in production: API keys, usage tiers, rate limiting, Responses API, metrics, and observability. - [Perplexity Models (Deprecated)](/docs/v2.0/components/models/perplexity): Perplexity model support is no longer supported in Spice. - [Spice Cloud Platform](/docs/v2.0/components/models/spiceai): Instructions for using models hosted on the Spice Cloud Platform with Spice. - [xAI Models](/docs/v2.0/components/models/xai): Instructions for using xAI models - [Secret Stores](/docs/v2.0/components/secret-stores): Configure secret stores to manage sensitive data like passwords, tokens, and API keys. - [AWS Secrets Manager Secret Store](/docs/v2.0/components/secret-stores/aws-secrets-manager): AWS Secrets Manager Secret Store Documentation - [Azure Key Vault Secret Store](/docs/v2.0/components/secret-stores/azure-keyvault): Azure Key Vault Secret Store Documentation - [Environment Secret Store](/docs/v2.0/components/secret-stores/env): Environment Variables Secret Store Documentation - [HashiCorp Vault Secret Store](/docs/v2.0/components/secret-stores/hashicorp-vault): HashiCorp Vault Secret Store Documentation - [Keyring Secret Store](/docs/v2.0/components/secret-stores/keyring): Keyring Secret Store Documentation - [Kubernetes Secret Store](/docs/v2.0/components/secret-stores/kubernetes): Kubernetes Secret Store Documentation - [LLM Tools (Function Calling)](/docs/v2.0/components/tools): Overview of supported LLM tools (function calling) and how to define new tools - [Model Context Protocol Tools](/docs/v2.0/components/tools/mcp): Spice integrates with tools and services using the Model Context Protocol (MCP). MCP tools can be configured to run internally or connect to external servers over HTTP using the Streamable HTTP transport. - [Web Search Tool (Deprecated)](/docs/v2.0/components/tools/websearch): The websearch tool is no longer supported in Spice. - [Vector Engines](/docs/v2.0/components/vectors): Configure vector engines for efficient embedding storage and similarity search in Spice. - [DuckDB Vector Engine](/docs/v2.0/components/vectors/duckdb): Use DuckDB as a vector engine in Spice for HNSW-based vector search via the DuckDB VSS extension. - [Elasticsearch Vector Engine](/docs/v2.0/components/vectors/elasticsearch): Use Elasticsearch as a vector engine in Spice for kNN vector search, full-text search, and hybrid search. - [Amazon S3 Vectors Engine](/docs/v2.0/components/vectors/s3_vectors): Amazon S3 Vectors Engine Documentation - [Spice.ai Deployment Guide](/docs/v2.0/deployment): Deploy Spice.ai in your environment using Docker, Kubernetes, AWS, Azure, or the Spice Cloud Platform. Learn about sidecar, microservice, tiered, and cluster deployment architectures. - [Deployment Architectures](/docs/v2.0/deployment/architectures): Explore Spice deployment architectures including sidecar, microservice, tiered, sharded, and cluster configurations. - [Cluster-Based Deployment (Spice.ai Enterprise)](/docs/v2.0/deployment/architectures/cluster): Deploying Spice as a cluster - [Cluster-Sidecar Deployment](/docs/v2.0/deployment/architectures/cluster-sidecar): Deploying Spice with sidecar caching backed by a centralized cluster for acceleration, distributed query, and ingestion. - [Cloud Hosted](/docs/v2.0/deployment/architectures/hosted): Deploying Spice cloud hosted in the Spice Cloud Platform - [Microservice Deployment (Single or Multiple Replicas)](/docs/v2.0/deployment/architectures/microservice): Deploying Spice as a microservice - [Sharded](/docs/v2.0/deployment/architectures/sharded): Deploying Spice with shards - [Sidecar Deployment](/docs/v2.0/deployment/architectures/sidecar): Deploying Spice as a application sidecar - [Tiered Deployment](/docs/v2.0/deployment/architectures/tiered): Deploying Spice in tiers - [AWS Deployment Options](/docs/v2.0/deployment/aws): Guide to deploying Spice.ai applications on Amazon Web Services (AWS) - [AWS Integrations](/docs/v2.0/deployment/aws/integrations): Complete guide to Spice.ai integrations with Amazon Web Services, including data connectors, AI models, vector stores, and secret management. - [Azure Deployment Options](/docs/v2.0/deployment/azure): Guide to deploying Spice.ai applications on Microsoft Azure - [Azure Integrations](/docs/v2.0/deployment/azure/integrations): Spice.ai integrations with Microsoft Azure, including data connectors, AI models, embeddings, and authentication. - [CI/CD Deployment](/docs/v2.0/deployment/ci-cd): Deploy Spice.ai applications using continuous integration and delivery pipelines, including Helm, Kubernetes GitOps with Argo CD or Flux, GitHub Actions, and the Spice Cloud deploy action. - [Spice Cloud Platform Deployment](/docs/v2.0/deployment/cloud): Guide to deploying data and AI applications using the managed Spice Cloud Platform - [Docker](/docs/v2.0/deployment/docker): Run Spice.ai as a Docker container. - [Docker Sandbox Guide - v1.3.0](/docs/v2.0/deployment/docker/sandbox): Migrating to v1.3.0 - [Google Cloud Deployment Options](/docs/v2.0/deployment/gcp): Guide to deploying Spice.ai applications on Google Cloud Platform (GCP). - [GCP Integrations](/docs/v2.0/deployment/gcp/integrations): Spice.ai integrations with Google Cloud Platform, including data connectors, AI models, embeddings, and authentication. - [Kubernetes Deployment](/docs/v2.0/deployment/kubernetes): Deploy Spice.ai on Kubernetes using Helm, Argo CD, or Flux. - [Kubernetes - Argo CD](/docs/v2.0/deployment/kubernetes/argocd): Deploy Spice.ai on self-hosted Kubernetes using Argo CD and the Spice Helm chart. - [Kubernetes - Flux](/docs/v2.0/deployment/kubernetes/flux): Deploy Spice.ai on Kubernetes using Flux CD and the Spice Helm chart. - [Kubernetes - Helm](/docs/v2.0/deployment/kubernetes/helm): Deploy Spice.ai in Kubernetes using Helm. - [Read/Write Separation](/docs/v2.0/deployment/read-write-separation): Separate write/ingest workloads (cluster) from read workloads (application sidecars, agents) using shared snapshots and live query delegation. - [Spice.ai FAQ](/docs/v2.0/faq): Answers to frequently asked questions about Spice.ai including features, use cases, differences from Trino/Presto/Dremio, federated queries, caching, and AI capabilities. - [Spice.ai Features](/docs/v2.0/features): Explore Spice.ai features including data federation, data acceleration, caching, search, LLM integration, embeddings, observability, and more for building data-driven AI applications. - [Caching](/docs/v2.0/features/caching): Learn how to use Spice in-memory caching - [Change Data Capture (CDC)](/docs/v2.0/features/cdc): Learn how to use Change Data Capture (CDC) in Spice. - [Debezium (CDC over Kafka)](/docs/v2.0/features/cdc/debezium): Consume Debezium change events from Kafka into a Spice-accelerated dataset for sources without a native Spice CDC path. - [DynamoDB Streams (Native CDC)](/docs/v2.0/features/cdc/dynamodb-streams): Stream INSERT, UPDATE, and DELETE events from Amazon DynamoDB directly into a Spice-accelerated dataset using DynamoDB Streams. - [MongoDB Change Streams (Native CDC)](/docs/v2.0/features/cdc/mongodb-streams): Stream insert, update, replace, and delete events from MongoDB directly into a Spice-accelerated dataset using MongoDB Change Streams. - [PostgreSQL Logical Replication (Native CDC)](/docs/v2.0/features/cdc/postgres-replication): Stream INSERT, UPDATE, and DELETE events from PostgreSQL directly into a Spice-accelerated dataset using native logical replication. - [Data Acceleration](/docs/v2.0/features/data-acceleration): Learn how to use local data acceleration in Spice. - [Constraints](/docs/v2.0/features/data-acceleration/constraints): Learn how to add/configure constraints on local acceleration tables in Spice. - [Data Refresh](/docs/v2.0/features/data-acceleration/data-refresh): Data refresh for accelerated datasets - [Hash Index for Arrow Acceleration](/docs/v2.0/features/data-acceleration/hash-index): Learn how to use hash indexes for O(1) point lookups on Arrow-accelerated datasets. - [Indexes](/docs/v2.0/features/data-acceleration/indexes): Learn how to add indexes to local acceleration tables in Spice. - [Partitioning](/docs/v2.0/features/data-acceleration/partitioning): Partition accelerated datasets to make filtered queries faster by reading only the relevant partitions. - [Refresh Modes](/docs/v2.0/features/data-acceleration/refresh-modes): Refresh modes for accelerated datasets in Spice. - [Append Refresh Mode](/docs/v2.0/features/data-acceleration/refresh-modes/append): Incrementally append new rows to an accelerated dataset. - [Caching Refresh Mode](/docs/v2.0/features/data-acceleration/refresh-modes/caching): Learn how to use caching refresh mode for HTTP-based datasets - [Changes Refresh Mode](/docs/v2.0/features/data-acceleration/refresh-modes/changes): Apply incremental inserts, updates, and deletes via Change Data Capture. - [Full Refresh Mode](/docs/v2.0/features/data-acceleration/refresh-modes/full): Replace the entire accelerated dataset on each refresh. - [Snapshot Refresh Mode](/docs/v2.0/features/data-acceleration/refresh-modes/snapshot): Reload acceleration data exclusively from the snapshot store. - [Snapshots](/docs/v2.0/features/data-acceleration/snapshots): Bootstrap file-mode accelerations from managed snapshots to eliminate cold starts. - [Data Ingestion](/docs/v2.0/features/data-ingestion): Learn how to ingest data in Spice. - [Distributed Query](/docs/v2.0/features/distributed-query): Learn how to run Spice in distributed mode for larger scale queries, including the async queries API. - [Embedding Datasets](/docs/v2.0/features/embeddings): Learn how to define, or augment existing datasets with embedding column(s). - [Functions](/docs/v2.0/features/functions): Define custom scalar and table SQL functions inline (SQL tier) or by calling remote HTTP services (Remote tier), automatically exposed as SQL functions and LLM tools. - [Large Language Models](/docs/v2.0/features/large-language-models): Learn how to configure large language models (LLMs) - [Evaluating Language Models (Deprecated)](/docs/v2.0/features/large-language-models/evals): Language model evals are no longer supported in Spice. - [Model Context Protocol (MCP)](/docs/v2.0/features/large-language-models/mcp): Learn how to use the Model Context Protocol (MCP) with Spice. - [Language Model Memory](/docs/v2.0/features/large-language-models/memory): Learn how to provide LLMs with memory - [Language Model Overrides](/docs/v2.0/features/large-language-models/parameter_overrides): Learn how to override default LLM hyperparameters in Spice. - [System Prompt parameterization](/docs/v2.0/features/large-language-models/parameterized_prompts): Learn how to update system prompts for each request with Jinja-styled templating. - [Load and Serve Models Locally](/docs/v2.0/features/large-language-models/serving): Learn how to load and serve large learning models. - [Language Models Tools](/docs/v2.0/features/large-language-models/tools): Learn how LLMs interact with the Spice runtime. - [Machine Learning Models](/docs/v2.0/features/machine-learning-models): Spice supports loading and serving ONNX models for inference, from sources including local filesystems, Hugging Face, and the Spice.ai Cloud platform. - [Observability & Monitoring](/docs/v2.0/features/observability): Monitor Spice with Prometheus metrics, OpenTelemetry, and distributed tracing. - [Component Metrics](/docs/v2.0/features/observability/component_metrics): Learn how to enable optional component metrics. - [Query Federation](/docs/v2.0/features/query-federation): Learn how to use federated SQL queries in Spice.ai Open Source - [Parameterized Queries](/docs/v2.0/features/query-federation/parameterized-queries): Learn how to use prepared statements and parameterized queries in Spice for improved security and performance. - [URL Tables](/docs/v2.0/features/query-federation/url-tables): Query object store files directly using URLs without pre-registering datasets - [Search Functionality](/docs/v2.0/features/search): Learn how Spice can search across datasets using database-native and vector-search methods. - [Full-Text Search](/docs/v2.0/features/search/full-text): Learn how Spice can perform full text search - [Multi-Vector Search](/docs/v2.0/features/search/multi-vector): Embed list-of-strings columns as a column of vectors and use ColBERT-style late-interaction search in Spice. - [Reranking](/docs/v2.0/features/search/rerank): Rerank search results using dedicated reranker models or LLM-as-reranker for improved relevance. - [Vector-Based Search](/docs/v2.0/features/search/vector-search): Learn how Spice can perform searches using vector-based methods. - [Semantic Model](/docs/v2.0/features/semantic-model): Attach descriptions and metadata to datasets, views, and columns in Spice so LLMs, SQL functions, and humans share the same understanding of your data. - [Tool Registry](/docs/v2.0/features/tool-registry): Reduce per-turn token cost and improve LLM tool selection accuracy by replacing individual tool definitions with searchable tool_search and tool_invoke meta-tools backed by hybrid full-text, keyword, schema, and vector search. - [Views](/docs/v2.0/features/views): Documentation for defining Views in Spice - [Web Search](/docs/v2.0/features/web-search): Learn how Spice can perform web search - [Workers](/docs/v2.0/features/workers): Configure workers in the Spice runtime to coordinate interactions between LLMs and tools, with load-balancing, round-robin, and fallback strategies. - [Getting Started with Spice.ai OSS](/docs/v2.0/getting-started): Get started with Spice.ai in 5 minutes. Install the CLI, connect to datasets, run SQL queries, and use AI models with OpenAI-compatible APIs. - [Community Data](/docs/v2.0/getting-started/spiceai): Connect to the Spice.ai Cloud Platform to access community datasets. - [Spicepods](/docs/v2.0/getting-started/spicepods): An introduction to Spicepods - [Telemetry](/docs/v2.0/getting-started/telemetry): Learn how Spice AI uses anonymous telemetry. - [Install Spice.ai OSS](/docs/v2.0/installation): Install Spice.ai OSS on macOS, Linux, Windows, or WSL using the install script, Homebrew, PowerShell, or direct download from GitHub releases. - [Building Intelligent AI Applications with Spice.ai](/docs/v2.0/intelligent-applications): Learn how to build intelligent, data-driven AI applications and agents with Spice.ai. Explore patterns for RAG, LLM integration, and real-time AI inference. - [Monitoring](/docs/v2.0/monitoring): Monitor Spice.ai deployments with Datadog, Grafana, New Relic, Prometheus, and Zipkin integrations. - [Datadog](/docs/v2.0/monitoring/datadog): Monitoring Spice with Datadog - [Grafana & Prometheus](/docs/v2.0/monitoring/grafana): Monitoring Spice instances with Grafana & Prometheus - [New Relic](/docs/v2.0/monitoring/new-relic): Monitoring Spice with New Relic - [Spice Cloud Platform](/docs/v2.0/monitoring/spice-cloud): Connect a self-hosted Spice runtime to the Spice Cloud Platform to centralize task history and runtime observability across deployments. - [Zipkin Integration](/docs/v2.0/monitoring/zipkin): Learn how to integrate Spice with Zipkin tracing. - [Spice.ai OSS Reference Docs](/docs/v2.0/reference): Reference documentation for Spice.ai including API reference, CLI commands, Spicepod configuration syntax, SQL reference, and data type specifications. - [Cron Schedules](/docs/v2.0/reference/cron): The Runtime supports cron expressions with optional seconds, like /10 which evaluates to every 10th second (10, 20, 30, etc). - [Data Types Reference](/docs/v2.0/reference/datatypes): Spice uses Apache Arrow data types internally, providing consistent type handling across different data sources and accelerators. This section documents how Arrow types map to specific accelerators and object store formats. - [Accelerator Data Types](/docs/v2.0/reference/datatypes/accelerators): Spice adheres to Apache Arrow data types. Data accelerators do not support all Arrow data types. The table below outlines the data type compatibility for each accelerator, and datatype used within the accelerator. - [Object Store Data Types](/docs/v2.0/reference/datatypes/object_store): Spice adheres to Apache Arrow data types. The table below lists the types of supported file type from object stores and their corresponding Apache Arrow type mappings in Spice. - [Spice Runtime Distributions](/docs/v2.0/reference/distributions): Distribution variants of the Spice runtime for different use cases and deployment scenarios, including data-only, GPU-accelerated, NAS, and allocator variants. - [Duration](/docs/v2.0/reference/duration): Durations are represented as integers with a time unit suffix. - [File Formats](/docs/v2.0/reference/file_format): File-based data connectors — including s3//, file//, sftp://, and others — support multiple structured and document file formats. This page details the format-specific parameters available for each. - [Managing Memory Usage](/docs/v2.0/reference/memory): Guidelines and best practices for managing memory usage and optimizing performance in Spice deployments. - [Models Grade Report](/docs/v2.0/reference/models): Spice AI graded Large-Language-Model (LLM) evaluation report - [Performance Tuning](/docs/v2.0/reference/performance-tuning): Comprehensive guide to optimizing query performance, acceleration, and resource utilization in Spice deployments. - [YAML syntax for Spicepod manifests](/docs/v2.0/reference/spicepod): Detailed documentation on the Spicepod manifest syntax (spicepod.yaml) - [catalogs](/docs/v2.0/reference/spicepod/catalogs): Catalogs YAML reference - [Datasets](/docs/v2.0/reference/spicepod/datasets): Datasets YAML reference - [Embeddings](/docs/v2.0/reference/spicepod/embeddings): Embeddings YAML reference - [Evals (Deprecated)](/docs/v2.0/reference/spicepod/evals): The evals Spicepod component is no longer supported in Spice. - [Functions (User-Defined Functions)](/docs/v2.0/reference/spicepod/functions): User-defined functions YAML reference - [Reserved Keywords](/docs/v2.0/reference/spicepod/keywords): Reserved keywords for datasets - [Models](/docs/v2.0/reference/spicepod/models): Models YAML reference - [Runtime](/docs/v2.0/reference/spicepod/runtime): Runtime YAML reference - [Tools (Function Calling)](/docs/v2.0/reference/spicepod/tools): Tools YAML reference - [Views](/docs/v2.0/reference/spicepod/views): Views YAML reference - [Workers](/docs/v2.0/reference/spicepod/workers): Workers YAML reference - [SQL Reference](/docs/v2.0/reference/sql): Complete SQL reference for Spice.ai including SELECT syntax, subqueries, DML statements, aggregate functions, AI functions, JSON operators, and search capabilities. - [Aggregate Functions](/docs/v2.0/reference/sql/aggregate_functions): Spice is built on Apache DataFusion and uses the PostgreSQL dialect, even when querying datasources with different SQL dialects. When using a data accelerator like DuckDB, function support is specific to each acceleration engine, and not all functions are supported by all acceleration engines. - [AI Functions](/docs/v2.0/reference/sql/ai): AI functions in Spice provide direct integration with large language models (LLMs) and embedding models within SQL queries. These functions process text through configured model providers and return generated responses or vector embeddings. - [DML (Data Manipulation Language)](/docs/v2.0/reference/sql/dml): Data Manipulation Language (DML) statements for inserting and modifying data in Spice. - [Explain](/docs/v2.0/reference/sql/explain): Spice is built on Apache DataFusion and uses the PostgreSQL dialect, even when querying datasources with different SQL dialects. - [Information Schema](/docs/v2.0/reference/sql/information_schema): Spice is built on Apache DataFusion and uses the PostgreSQL dialect, even when querying datasources with different SQL dialects. - [JSON Functions and Operators](/docs/v2.0/reference/sql/json): Reference for JSON functions and operators in Spice SQL - [Operators](/docs/v2.0/reference/sql/operators): Spice is built on Apache DataFusion and uses the PostgreSQL dialect, even when querying datasources with different SQL dialects. - [Prepared Statements](/docs/v2.0/reference/sql/prepared_statements): Spice is built on Apache DataFusion and uses the PostgreSQL dialect, even when querying datasources with different SQL dialects. - [Scalar Functions](/docs/v2.0/reference/sql/scalar_functions): Spice is built on Apache DataFusion and uses the PostgreSQL dialect, even when querying datasources with different SQL dialects. When using a data accelerator like DuckDB, function support is specific to each acceleration engine, and not all functions are supported by all acceleration engines. - [Search in SQL](/docs/v2.0/reference/sql/search): Reference for search functions and filtering in Spice SQL. - [SELECT](/docs/v2.0/reference/sql/select): Spice is built on Apache DataFusion and uses the PostgreSQL dialect, even when querying datasources with different SQL dialects. - [Subqueries](/docs/v2.0/reference/sql/subqueries): Spice is built on Apache DataFusion and uses the PostgreSQL dialect, even when querying datasources with different SQL dialects. - [Spice.ai Open Source System Requirements](/docs/v2.0/reference/system_requirements): System requirements for running Spice.ai Open Source - [Task History](/docs/v2.0/reference/task_history): The Spice runtime stores information about completed tasks in the spice.runtime.task_history table. Each task represents a single unit of execution within the runtime, such as a SQL query or an AI chat completion, and is represented by a unique span. - [SDKs](/docs/v2.0/sdks): Connect to Spice using official SDKs - [Dotnet SDK](/docs/v2.0/sdks/dotnet): Connect to Spice using the Dotnet SDK - [Go SDK](/docs/v2.0/sdks/golang): Connect to Spice using the Go SDK - [Java SDK](/docs/v2.0/sdks/java): Connect to Spice using the Java SDK - [JavaScript SDK](/docs/v2.0/sdks/javascript): Connect to Spice using the JavaScript SDK - [Python SDK](/docs/v2.0/sdks/python): Connect to Spice using the Python SDK - [Rust SDK](/docs/v2.0/sdks/rust): Connect to Spice using the Rust SDK - [Troubleshooting Spice](/docs/v2.0/troubleshooting): Review and debug runtime tasks, logs, and diagnostic steps in Spice. - [Spice.ai Use Cases](/docs/v2.0/use-cases): Discover how to use Spice.ai for data federation, reverse-ETL, database CDN, enterprise search, RAG, and building AI-powered applications and agents. - [AI Applications and Agents](/docs/v2.0/use-cases/ai): AI Applications and Agents - [Agentic AI Applications and Agents](/docs/v2.0/use-cases/ai/agentic-apps): Spice.ai builds intelligent, autonomous agents for SaaS applications, enabling context-aware automation and decision-making. - [Edge-Enabled AI Applications and Agents](/docs/v2.0/use-cases/ai/edge-ai): Spice.ai deploys AI applications and agents across cloud and edge for low-latency decisions in security IoT use cases. - [Federated MCP Client for Distributed Tool Ecosystems](/docs/v2.0/use-cases/ai/federated-mcp-server): Spice.ai federates external MCP servers for scalable, tool-driven AI applications in security, improving threat analysis. - [Multi-Tenant AI Agents](/docs/v2.0/use-cases/ai/multi-tenant-agents): Deploy AI agents across many SaaS tenants with strict isolation and no per-tenant ETL pipelines. - [Object-Store Based SQL Query, Search, and LLM Inference Engine](/docs/v2.0/use-cases/ai/object-store-ai-engine): Spice.ai enables SQL queries, hybrid search, and LLM inference on object-store data for security applications, delivering real-time insights. - [Real-Time Decision-Making for Intelligent Applications](/docs/v2.0/use-cases/ai/real-time-decision-making): Spice.ai powers instant, context-aware decisions for applications like security recommendations by grounding AI in federated, low-latency datasets. - [Tool-Augmented AI with Model Context Protocol Server](/docs/v2.0/use-cases/ai/tool-calling-ai): Spice.ai extends AI with custom tools via MCP server in finserv, integrating domain-specific APIs for enhanced functionality. - [Caching](/docs/v2.0/use-cases/caching): Caching use cases with Spice.ai, including write-through, read-through, SQL, S3, and HTTP caching. - [HTTP Cache](/docs/v2.0/use-cases/caching/http-cache): Use Spice.ai to cache HTTP API responses locally, reducing API call frequency and providing fast, SQL-queryable access to external API data. - [Read-Through Cache](/docs/v2.0/use-cases/caching/read-through-cache): Use Spice.ai as a read-through cache with the SQL results cache for federated data sources and HTTP APIs. - [S3 Cache](/docs/v2.0/use-cases/caching/s3-cache): Use Spice.ai to cache S3 and object store data locally for fast, repeatable SQL queries without re-reading from remote storage. - [SQL and Database Cache](/docs/v2.0/use-cases/caching/sql-database-cache): Use Spice.ai to cache SQL database tables and query results locally for low-latency access and reduced load on upstream databases. - [Write-Through Cache](/docs/v2.0/use-cases/caching/write-through-cache): Use Spice.ai as a write-through cache that writes data to both a local accelerator and the upstream data source. - [Data Federation, Acceleration, and SQL Query](/docs/v2.0/use-cases/data): Data Federation, Acceleration, and SQL Query - [Application Resilience and Performance Optimization](/docs/v2.0/use-cases/data/application-resilence-and-acceleration): Spice.ai colocates dynamic data with SaaS applications as a database CDN, ensuring resilience and high performance. - [Data Mesh for Unified Data Access](/docs/v2.0/use-cases/data/data-mesh): Give domain teams decentralized, real-time data ownership and access across disparate sources through a unified SQL interface. - [Database CDN for Enhanced Performance](/docs/v2.0/use-cases/data/database-cdn): Spice.ai acts as a database CDN for SaaS applications, caching dynamic data to ensure high performance and resilience. - [ETL-free Workflows and Data Migrations](/docs/v2.0/use-cases/data/etl-free-workflows): Federate legacy and modern data systems without ETL for faster migrations, lower overhead, and zero application downtime. - [Object-Store Data Engine](/docs/v2.0/use-cases/data/object-store-data-engine): Spice.ai federates, accelerates, and queries object-store data for finserv applications, enabling real-time data access without centralized warehouses. - [Reverse-ETL for Operational Workflows](/docs/v2.0/use-cases/data/reverse-etl): Serve enriched data from warehouses and data lakes to operational systems and applications, eliminating complex pipelines. - [Spice for Retrieval-Augmented-Generation (RAG)](/docs/v2.0/use-cases/rag): Use Spice for Retrieval-Augmented-Generation (RAG) - [RAG for Contextual Applications](/docs/v2.0/use-cases/rag/applications): Build context-rich AI applications using Spice for Retrieval-Augmented Generation (RAG). - [Retrieval-Augmented Generation for AI-Powered Reporting](/docs/v2.0/use-cases/rag/reporting): Spice.ai generates dynamic, context-aware AI-driven reports for operational insights in health-tech, ensuring compliance and precision. - [Search & Retrieval](/docs/v2.0/use-cases/search): Search & Retrieval - [Simplifying Real-Time Data Collection and Search](/docs/v2.0/use-cases/search/data-collection-and-search): Spice.ai processes streaming and static data with integrated search for real-time insights, focusing on application logic. - [Enterprise Search and Retrieval](/docs/v2.0/use-cases/search/enterprise-search): Spice.ai powers semantic and precise search for finserv knowledge bases with hybrid vector and keyword capabilities. - [Object-Store Native Search Engine](/docs/v2.0/use-cases/search/object-store-search-engine): Spice.ai powers a cloud-native embedded search engine on object-store data for security applications, enabling semantic and precise search. ### tags - [Tags](/docs/tags) - [One doc tagged with "Acknowledgements"](/docs/tags/acknowledgements): Project acknowledgements, credits, and attributions. - [3 docs tagged with "ADBC"](/docs/tags/adbc): Arrow Database Connectivity driver configuration and usage. - [4 docs tagged with "API"](/docs/tags/api): HTTP, Arrow Flight SQL, ODBC, JDBC, and ADBC API reference. - [One doc tagged with "Argo CD"](/docs/tags/argocd): Argo CD declarative GitOps continuous delivery for Kubernetes. - [2 docs tagged with "Arrow"](/docs/tags/arrow): Apache Arrow columnar data format integration. - [One doc tagged with "Arrow Flight SQL"](/docs/tags/arrow-flight-sql): Arrow Flight SQL protocol implementation and configuration. - [One doc tagged with "Auth"](/docs/tags/auth): Authentication and authorization mechanisms. - [2 docs tagged with "Authentication"](/docs/tags/authentication): User authentication methods and security protocols. - [5 docs tagged with "Azure"](/docs/tags/azure): Microsoft Azure cloud services and integrations. - [2 docs tagged with "Blob Storage"](/docs/tags/blob-storage): Object storage services and blob data access. - [One doc tagged with "Caching"](/docs/tags/caching): Data caching strategies and performance optimization. - [13 docs tagged with "Catalogs"](/docs/tags/catalogs): Data catalog connectors and metadata management. - [2 docs tagged with "Cayenne"](/docs/tags/cayenne): Cayenne (Vortex) data accelerator built on Vortex columnar format. - [2 docs tagged with "CLI"](/docs/tags/cli): Spice command-line interface commands and usage. - [5 docs tagged with "Component Metrics"](/docs/tags/component-metrics): Runtime component performance metrics and monitoring. - [One doc tagged with "Components"](/docs/tags/components): Runtime components including catalogs, data connectors, and models. - [2 docs tagged with "Configuration"](/docs/tags/configuration): System configuration files and runtime settings. - [2 docs tagged with "Cosmos DB"](/docs/tags/cosmosdb): Azure Cosmos DB (NoSQL / Core SQL) data connector. - [One doc tagged with "C#"](/docs/tags/csharp): C# programming language topics. - [7 docs tagged with "Data Accelerators"](/docs/tags/data-accelerators): Data acceleration engines for high-performance query execution. - [48 docs tagged with "Data Connectors"](/docs/tags/data-connectors): Data source connectors and integration patterns. - [One doc tagged with "Data Lake"](/docs/tags/data-lake): Data lake architectures and storage solutions. - [3 docs tagged with "Databricks"](/docs/tags/databricks): Databricks platform integration and Unity Catalog support. - [2 docs tagged with "Datasets"](/docs/tags/datasets): Dataset definitions and data source configurations. - [One doc tagged with "Debezium"](/docs/tags/debezium): Debezium change data capture integration. - [One doc tagged with "Debugging"](/docs/tags/debugging): Debugging techniques and troubleshooting tools. - [3 docs tagged with "Delta Lake"](/docs/tags/delta-lake): Delta Lake open table format support. - [One doc tagged with "Dependencies"](/docs/tags/dependencies): Third-party dependencies and software requirements. - [8 docs tagged with "Deployment"](/docs/tags/deployment): Production deployment using Docker and Kubernetes. - [2 docs tagged with "Docker"](/docs/tags/docker): Docker containerization and deployment configurations. - [One doc tagged with ".NET"](/docs/tags/dotnet): .NET framework topics. - [One doc tagged with "Dremio"](/docs/tags/dremio): Dremio data lake engine integration. - [2 docs tagged with "DuckDB"](/docs/tags/duckdb): DuckDB embedded analytical database integration. - [2 docs tagged with "DuckLake"](/docs/tags/ducklake): DuckLake catalog integration. - [2 docs tagged with "DynamoDB"](/docs/tags/dynamodb): Amazon DynamoDB NoSQL database integration. - [2 docs tagged with "Elasticsearch"](/docs/tags/elasticsearch): Elasticsearch data connector and vector engine integration. - [7 docs tagged with "Embeddings"](/docs/tags/embeddings): Vector embeddings and semantic similarity operations. - [6 docs tagged with "Features"](/docs/tags/features): Core platform features including acceleration, caching, and search. - [One doc tagged with "Federation"](/docs/tags/federation): Cross-database queries and federated data access. - [One doc tagged with "File"](/docs/tags/file): File-based data connectors and local file access. - [One doc tagged with "Flux"](/docs/tags/flux): Flux CD GitOps toolkit for Kubernetes. - [One doc tagged with "Flux CD"](/docs/tags/fluxcd): Flux CD GitOps toolkit for Kubernetes. - [2 docs tagged with "Functions"](/docs/tags/functions): User-defined SQL scalar functions and remote function endpoints. - [One doc tagged with "Getting Started"](/docs/tags/getting-started): Installation guides and quickstart tutorials. - [3 docs tagged with "GitHub"](/docs/tags/github): GitHub repository data connector and integration. - [3 docs tagged with "GitOps"](/docs/tags/gitops): GitOps continuous delivery patterns for Kubernetes. - [2 docs tagged with "Glue"](/docs/tags/glue): AWS Glue ETL service and data catalog integration. - [One doc tagged with "Go"](/docs/tags/go): Go programming language topics. - [One doc tagged with "Golang"](/docs/tags/golang): Go (Golang) programming language topics. - [One doc tagged with "GraphQL"](/docs/tags/graphql): GraphQL API data connectors and query language support. - [3 docs tagged with "Helm"](/docs/tags/helm): Helm package manager for deploying Spice.ai on Kubernetes. - [One doc tagged with "HTTPS"](/docs/tags/https): HTTPS data connectors and secure web API access. - [2 docs tagged with "Hugging Face"](/docs/tags/huggingface): Hugging Face model hub and transformer model integration. - [2 docs tagged with "Iceberg"](/docs/tags/iceberg): Apache Iceberg open table format support. - [One doc tagged with "In-Memory"](/docs/tags/in-memory): In-memory data processing and temporary storage. - [One doc tagged with "Integration"](/docs/tags/integration): Third-party system integrations and connectivity patterns. - [One doc tagged with "Java"](/docs/tags/java): Java programming language topics. - [One doc tagged with "JavaScript"](/docs/tags/javascript): JavaScript programming language topics. - [One doc tagged with "JDBC"](/docs/tags/jdbc): Java Database Connectivity driver configuration. - [One doc tagged with "Kafka"](/docs/tags/kafka): Apache Kafka event streaming platform integration. - [6 docs tagged with "Kubernetes"](/docs/tags/kubernetes): Kubernetes orchestration and secret management. - [One doc tagged with "libSQL"](/docs/tags/libsql): libSQL database topics. - [One doc tagged with "Local"](/docs/tags/local): Local model execution and on-premise services. - [One doc tagged with "Logging"](/docs/tags/logging): Application logging configuration and log management. - [One doc tagged with "Login"](/docs/tags/login): User login processes and session management. - [One doc tagged with "Manifest"](/docs/tags/manifest): Configuration manifest files and schema definitions. - [One doc tagged with "MCP"](/docs/tags/mcp): Model Context Protocol for AI tool integration. - [2 docs tagged with "Memory"](/docs/tags/memory): In-memory data connectors and volatile storage. - [16 docs tagged with "Models"](/docs/tags/models): Machine learning models and AI inference engines. - [One doc tagged with "MongoDB"](/docs/tags/mongodb): MongoDB NoSQL document database integration. - [One doc tagged with "MSSQL"](/docs/tags/mssql): Microsoft SQL Server database integration. - [3 docs tagged with "MySQL"](/docs/tags/mysql): MySQL relational database integration. - [One doc tagged with "Node.js"](/docs/tags/nodejs): Node.js runtime environment topics. - [3 docs tagged with "NoSQL"](/docs/tags/nosql): NoSQL database systems and document stores. - [29 docs tagged with "Observability"](/docs/tags/observability): Monitoring, tracing, and metrics for system visibility. - [One doc tagged with "ODBC"](/docs/tags/odbc): Open Database Connectivity driver configuration. - [One doc tagged with "Open Source"](/docs/tags/open-source): Open source licenses and community contributions. - [3 docs tagged with "OpenAI"](/docs/tags/openai): OpenAI API integration and GPT model access. - [2 docs tagged with "Oracle"](/docs/tags/oracle): Documentation related to Oracle database integration. - [2 docs tagged with "Overrides"](/docs/tags/overrides): Parameter overrides and configuration customization. - [2 docs tagged with "Overview"](/docs/tags/overview): High-level component and feature overviews. - [2 docs tagged with "Parameters"](/docs/tags/parameters): Configuration parameters and runtime options. - [One doc tagged with "Performance"](/docs/tags/performance): Performance optimization and benchmarking. - [One doc tagged with "Persistence"](/docs/tags/persistence): Data persistence and durable storage mechanisms. - [4 docs tagged with "Postgres"](/docs/tags/postgres): PostgreSQL database integration and configuration. - [One doc tagged with "Python"](/docs/tags/python): Python programming language topics. - [3 docs tagged with "Query"](/docs/tags/query): SQL query execution, parameterized queries, and prepared statements. - [4 docs tagged with "Reference"](/docs/tags/reference): API reference, CLI commands, and configuration syntax. - [One doc tagged with "Relational"](/docs/tags/relational): Relational database systems and SQL operations. - [3 docs tagged with "Runtime"](/docs/tags/runtime): Runtime behavior and execution environment. - [One doc tagged with "Rust"](/docs/tags/rust): Rust programming language topics. - [2 docs tagged with "S3"](/docs/tags/s3): Amazon S3 object storage integration. - [One doc tagged with "S3 Express"](/docs/tags/s3-express): Amazon S3 Express One Zone storage. - [One doc tagged with "Sandbox"](/docs/tags/sandbox): Sandbox environments and isolated testing. - [One doc tagged with "ScyllaDB"](/docs/tags/scylladb): ScyllaDB database integration. - [6 docs tagged with "SDK"](/docs/tags/sdk): Software Development Kit topics and usage. - [10 docs tagged with "Search"](/docs/tags/search): Vector search, semantic search, and ranking capabilities. - [2 docs tagged with "Security"](/docs/tags/security): Security features and data protection mechanisms. - [One doc tagged with "Snowflake"](/docs/tags/snowflake): Snowflake cloud data warehouse integration. - [7 docs tagged with "SpiceAI"](/docs/tags/spiceai): SpiceAI cloud platform and managed services. - [5 docs tagged with "Spicepod"](/docs/tags/spicepod): Spicepod configuration files, manifest syntax, and package management. - [6 docs tagged with "SQL"](/docs/tags/sql): SQL query language support and database operations. - [5 docs tagged with "Tools"](/docs/tags/tools): Development tools and utility integrations. - [2 docs tagged with "Tracing"](/docs/tags/tracing): Distributed tracing and request monitoring. - [One doc tagged with "Troubleshooting"](/docs/tags/troubleshooting): Problem diagnosis and resolution guides. - [One doc tagged with "Turso"](/docs/tags/turso): Turso data accelerator integration. - [2 docs tagged with "UDF"](/docs/tags/udf): User-defined functions registered with the SQL engine. - [2 docs tagged with "Unity Catalog"](/docs/tags/unity-catalog): Databricks Unity Catalog data governance integration. - [One doc tagged with "Views"](/docs/tags/views): Virtual views and data transformation layers. - [One doc tagged with "Vortex"](/docs/tags/vortex): Vortex columnar file format and storage engine. - [10 docs tagged with "Write"](/docs/tags/write): Data connectors and catalogs that support write operations. - [One doc tagged with "YAML"](/docs/tags/yaml): YAML configuration syntax and file formats. - [One doc tagged with "Zipkin"](/docs/tags/zipkin): Zipkin distributed tracing system integration. ### acknowledgements Spice AI acknowledges the following open source projects for making this project possible: - [Open Source Acknowledgements](/docs/acknowledgements): Spice AI acknowledges the following open source projects for making this project possible: ### api Spice.ai API reference including HTTP REST API, Arrow Flight SQL, JDBC, ODBC, ADBC connectors, authentication, and TLS configuration. - [Spice.ai API Reference](/docs/api): Spice.ai API reference including HTTP REST API, Arrow Flight SQL, JDBC, ODBC, ADBC connectors, authentication, and TLS configuration. - [ADBC: Arrow Database Connectivity](/docs/api/adbc): ADBC API Documentation - [Arrow Flight SQL API](/docs/api/arrow-flight-sql): Query Spice using JDBC/ODBC/ADBC - [Authentication](/docs/api/auth): Authentication documentation - [Generate Package](/docs/api/HTTP/generate-package): This endpoint generates a zip package from a specified GitHub source. - [List Catalogs](/docs/api/HTTP/get-catalogs): Returns a list of all registered catalogs (data sources). Catalogs provide metadata about schemas and tables available from external data sources. - [Get Iceberg API config](/docs/api/HTTP/get-config): This endpoint returns the Iceberg Catalog API configuration, including details about overrides, defaults, and available endpoints. - [List Datasets](/docs/api/HTTP/get-datasets): This endpoint returns a list of configured datasets. The response can be formatted as **JSON** or **CSV**, - [List Iceberg namespaces](/docs/api/HTTP/get-iceberg-namespaces): This endpoint retrieves namespaces available in the Iceberg catalog. - [ML Prediction](/docs/api/HTTP/get-model-predict): Make a ML prediction using a specific model. - [List Models](/docs/api/HTTP/get-models): List all models, both machine learning and language models, available in the runtime. - [Check if a namespace exists.](/docs/api/HTTP/get-namespace): This endpoint returns a 200 OK response if the namespace exists, otherwise it returns a 404 Not Found response. - [List Spicepods](/docs/api/HTTP/get-spicepods): Get a list of spicepods and their summary details. - [Check Runtime Status](/docs/api/HTTP/get-status): Return the status of all connections (http, flight, metrics, opentelemetry) in the runtime. - [Get a table.](/docs/api/HTTP/get-table): This endpoint returns the table if it exists, otherwise it returns a 404 Not Found response. - [List Workers](/docs/api/HTTP/get-workers): Returns a list of all registered workers in the runtime. Workers are configurable processing units that can perform tasks like load balancing between models or implementing fallback strategies. - [Check Namespace exists](/docs/api/HTTP/head-namespace): This endpoint returns a 200 OK response if the namespace exists, otherwise it returns a 404 Not Found response. - [Check if a table exists.](/docs/api/HTTP/head-table): This endpoint returns a 200 OK response if the table exists, otherwise it returns a 404 Not Found response. - [list_tables](/docs/api/HTTP/list-tables): list_tables - [List Tools](/docs/api/HTTP/list-tools): Returns a list of all available tools in the Spice runtime. Tools provide reusable functionality that can be invoked programmatically or by AI agents. - [Send message to MCP server](/docs/api/HTTP/mcp-event): Send message to the MCP endoint, for a given session. - [Establish an MCP SSE Connection](/docs/api/HTTP/operation-id): Initiates a Server-Sent Events (SSE) connection using the Model Context Protocol (MCP) to interact with Spice tools. - [Update Refresh SQL](/docs/api/HTTP/patch-dataset-acceleration): Update the refresh SQL for a dataset's acceleration. - [Batch ML Predictions](/docs/api/HTTP/post-batch-predict): Perform a batch of ML predictions, using multiple models, in one request. This is useful for ensembling or A/B testing different models. - [Create Chat Completion](/docs/api/HTTP/post-chat-completions): Creates a model response for the given chat conversation. - [Refresh Dataset](/docs/api/HTTP/post-dataset-refresh): Trigger an on-demand refresh for an accelerated dataset. - [Create Embeddings](/docs/api/HTTP/post-embeddings): Creates an embedding vector representing the input text. - [Text-to-SQL (NSQL)](/docs/api/HTTP/post-nsql): Generate and optionally execute a natural-language text-to-SQL (NSQL) query. - [post_responses](/docs/api/HTTP/post-responses): post_responses - [Search](/docs/api/HTTP/post-search): Perform a vector similarity search (VSS) operation on a dataset. - [SQL Query](/docs/api/HTTP/post-sql): Execute a SQL query and return the results. - [Check Readiness](/docs/api/HTTP/ready): Check the runtime status of all the components of the runtime. If the service is ready, it returns an HTTP 200 status with the message 'ready'. If not, it returns a 503 status with the message 'not ready'. - [Run Tool](/docs/api/HTTP/run-tool): Execute a specific tool by name. The request body schema and response format are defined by each individual tool's specification. Use `GET /v1/tools` to discover available tools and their parameter schemas. - [runtime](/docs/api/HTTP/runtime): The spiced runtime - [JDBC: Java Database Connectivity](/docs/api/jdbc): JDBC API Documentation - [ODBC: Open Database Connectivity](/docs/api/odbc): ODBC API Documentation - [API Overview](/docs/api/overview): Spice.ai API overview, including SQL query interfaces, OpenAI-compatible endpoints, Iceberg catalog REST APIs, and the Model Context Protocol (MCP) for integrating external tools. - [TLS: Transport Layer Security](/docs/api/tls): Encryption in transit with TLS documentation ### cli Complete CLI reference for Spice.ai including commands to create, manage Spicepods, run queries, and interact with the Spice runtime. - [Spice.ai CLI Reference](/docs/cli): Complete CLI reference for Spice.ai including commands to create, manage Spicepods, run queries, and interact with the Spice runtime. - [Spice.ai OSS CLI command reference](/docs/cli/reference): Spice CLI command reference - [add](/docs/cli/reference/add): Add a Spicepod to the project. - [catalogs](/docs/cli/reference/catalogs): List catalogs currently loaded by the Spice runtime. - [chat](/docs/cli/reference/chat): spice chat CLI documentation - [completions](/docs/cli/reference/completions): Generate shell completions for the Spice CLI. - [connect](/docs/cli/reference/connect): Connect to an app on the Spice.ai Cloud Platform. - [dataset](/docs/cli/reference/dataset): Configure a Spice dataset. - [datasets](/docs/cli/reference/datasets): Lists datasets loaded by the Spice runtime - [feedback](/docs/cli/reference/feedback): Open the Spice.ai community Slack in the default browser to share feedback. - [init](/docs/cli/reference/init): Initialize Spice app in the current working directory. - [install](/docs/cli/reference/install): Download and install the latest version of the Spice runtime. - [login](/docs/cli/reference/login): Login to the Spice.ai Platform, or other services with sub-commands. - [models](/docs/cli/reference/models): Lists models loaded by the Spice runtime - [nsql](/docs/cli/reference/nsql): spice nsql CLI documentation - [pods](/docs/cli/reference/pods): Lists Spicepods loaded by the Spice runtime - [query](/docs/cli/reference/query): Submit an async query or start an interactive async query REPL against the Spice runtime's distributed query engine. - [refresh](/docs/cli/reference/refresh): Refreshes an accelerated dataset loaded by the Spice runtime - [run](/docs/cli/reference/run): Run Spice - starts the Spice runtime, installing if necessary. - [search](/docs/cli/reference/search): Performs embeddings-based searches across search-configured datasets. - [spiced](/docs/cli/reference/spiced): Command-line reference for the spiced runtime binary — flags, defaults, and differences from spice run. - [sql](/docs/cli/reference/sql): Start an interactive SQL query session against the Spice runtime - [status](/docs/cli/reference/status): Spice runtime status - [trace](/docs/cli/reference/trace): Provides a user-friendly trace stack into an operation that occurred in Spice. This command retrieves and displays task execution traces from the runtime.task_history table. - [upgrade](/docs/cli/reference/upgrade): Upgrades the Spice CLI & Runtime to the latest release - [validate](/docs/cli/reference/validate): Validate a spicepod.yaml without starting the runtime. - [version](/docs/cli/reference/version): Outputs the current version of the Spice CLI and runtime - [Configuring Trace Levels](/docs/cli/tracing): Configuring Spice.ai OSS trace output verbosity levels ### clients Client and tools for connecting to Spice - [Clients and Tools](/docs/clients): Client and tools for connecting to Spice - [DBeaver](/docs/clients/dbeaver): Configure DBeaver to query Spice via JDBC - [JetBrains DataGrip](/docs/clients/jetbrains-datagrip): Configure JetBrains Datagrip to query Spice via JDBC - [Microsoft Power BI Connector](/docs/clients/powerbi): Use Microsoft Power BI to access, visualize and analyze Spice datasets. - [Apache Superset](/docs/clients/superset): Use Apache Superset to query and visualize datasets loaded in Spice. - [Tableau](/docs/clients/tableau): Use Tableau to to access, visualise and analyse datasets loaded in Spice. ### comparison Compare Spice.ai with data platforms (Databricks, Snowflake), query engines (Trino, Dremio, ClickHouse), vector databases (Turbopuffer, LanceDB), search engines (Elasticsearch), and AI frameworks (LangChain, LlamaIndex, Ollama). - [How Spice Compares](/docs/comparison): Compare Spice.ai with data platforms (Databricks, Snowflake), query engines (Trino, Dremio, ClickHouse), vector databases (Turbopuffer, LanceDB), search engines (Elasticsearch), and AI frameworks (LangChain, LlamaIndex, Ollama). ### components Configure Spice.ai runtime components including data connectors, data accelerators, catalog connectors, model providers, embedding models, and secret stores. - [Spice.ai Runtime Components](/docs/components): Configure Spice.ai runtime components including data connectors, data accelerators, catalog connectors, model providers, embedding models, and secret stores. - [Catalog Connectors](/docs/components/catalogs): Connect to external catalog providers like Unity Catalog, Databricks, Iceberg, AWS Glue, Snowflake, ADBC, PostgreSQL, MySQL, MSSQL, Oracle, and more for federated SQL query in Spice. - [ADBC Catalog Connector](/docs/components/catalogs/adbc): Connect to databases via ADBC for automatic schema and table discovery. - [Databricks Catalog Connector](/docs/components/catalogs/databricks): Connect to a Databricks Unity Catalog provider. - [DuckLake Catalog Connector](/docs/components/catalogs/ducklake): Connect to a DuckLake catalog for federated SQL query. - [Glue Catalog Connector](/docs/components/catalogs/glue): Connect to an AWS Glue Data Catalog. - [Iceberg Catalog Connector](/docs/components/catalogs/iceberg): Connect to an Iceberg catalog provider. - [Microsoft SQL Server Catalog Connector](/docs/components/catalogs/mssql): Connect to a Microsoft SQL Server database as a catalog provider for federated SQL query. - [MySQL Catalog Connector](/docs/components/catalogs/mysql): Connect to a MySQL database as a catalog provider for federated SQL query. - [Oracle Catalog Connector](/docs/components/catalogs/oracle): Connect to an Oracle database as a catalog provider for federated SQL query. - [PostgreSQL Catalog Connector](/docs/components/catalogs/postgres): Connect to a PostgreSQL database as a catalog provider for federated SQL query. - [Snowflake Catalog Connector](/docs/components/catalogs/snowflake): Connect to a Snowflake database as a catalog provider for federated SQL query. - [Spice.ai Catalog Connector](/docs/components/catalogs/spiceai): Connect to the Spice.ai built-in catalog. - [Unity Catalog Catalog Connector](/docs/components/catalogs/unity-catalog): Connect to a Unity Catalog provider. - [Unity Catalog Catalog Connector Deployment Guide](/docs/components/catalogs/unity-catalog/deployment): Operating guide for the Unity Catalog catalog connector in production: workspace authentication, table-type filtering, effective-permissions flow, and observability. - [Data Accelerators](/docs/components/data-accelerators): Data acceleration engines for local materialization and query acceleration in Spice - [In-Memory Arrow Data Accelerator](/docs/components/data-accelerators/arrow): In-Memory Arrow Data Accelerator Documentation - [Arrow Data Accelerator Deployment Guide](/docs/components/data-accelerators/arrow/deployment): Operating guide for the Arrow (in-memory) data accelerator in production: memory sizing, indexes, and observability. - [Spice Cayenne Data Accelerator](/docs/components/data-accelerators/cayenne): Spice Cayenne Data Accelerator (Vortex) Documentation - [Cayenne Data Accelerator Deployment Guide](/docs/components/data-accelerators/cayenne/deployment): Operating guide for Spice Cayenne in production: footer and segment caches, S3 Express, metastore durability, and observability. - [DuckDB Data Accelerator](/docs/components/data-accelerators/duckdb): DuckDB Data Accelerator Documentation - [DuckDB Data Accelerator Deployment Guide](/docs/components/data-accelerators/duckdb/deployment): Operating guide for the DuckDB data accelerator in production: memory vs file mode, checkpointing, spill, pool sizing, and observability. - [PostgreSQL Data Accelerator](/docs/components/data-accelerators/postgres): PostgreSQL Data Accelerator Documentation - [PostgreSQL Data Accelerator Deployment Guide](/docs/components/data-accelerators/postgres/deployment): Operating guide for the PostgreSQL data accelerator in production: authentication, connection pooling, and observability. - [SQLite Data Accelerator](/docs/components/data-accelerators/sqlite): SQLite Data Accelerator Documentation - [SQLite Data Accelerator Deployment Guide](/docs/components/data-accelerators/sqlite/deployment): Operating guide for the SQLite data accelerator in production: file mode, busy timeout, pool, and observability. - [Turso Data Accelerator](/docs/components/data-accelerators/turso): Turso (libSQL) Data Accelerator Documentation - [Data Connectors](/docs/components/data-connectors): Learn how to use Data Connector to query external data. - [Azure BlobFS Data Connector](/docs/components/data-connectors/abfs): Azure BlobFS Data Connector Documentation - [ADBC Data Connector](/docs/components/data-connectors/adbc): ADBC Data Connector Documentation - [ClickHouse Data Connector](/docs/components/data-connectors/clickhouse): ClickHouse Data Connector Documentation - [Azure Cosmos DB Data Connector](/docs/components/data-connectors/cosmosdb): Query Azure Cosmos DB (NoSQL / Core SQL API) containers as SQL tables in Spice. Read-only scan with schema inferred from a sample of documents. - [Azure Cosmos DB Data Connector Deployment Guide](/docs/components/data-connectors/cosmosdb/deployment): Operating guide for the Azure Cosmos DB data connector in production: authentication, RU sizing, resilience, metrics, and observability. - [Databricks Data Connector](/docs/components/data-connectors/databricks): Databricks Data Connector Documentation - [Databricks Deployment Guide](/docs/components/data-connectors/databricks/deployment): Operating guide for the Databricks connector in production: resilience controls, Unity Catalog behavior, metrics, and observability. - [Debezium Data Connector](/docs/components/data-connectors/debezium): Debezium Data Connector Documentation - [Delta Lake Data Connector](/docs/components/data-connectors/delta-lake): Delta Lake Data Connector Documentation - [Delta Lake Data Connector Deployment Guide](/docs/components/data-connectors/delta-lake/deployment): Operating guide for the Delta Lake data connector in production: object store auth, metadata caching, metrics, and observability. - [Dremio Data Connector](/docs/components/data-connectors/dremio): Dremio Data Connector Documentation - [Dremio Data Connector Deployment Guide](/docs/components/data-connectors/dremio/deployment): Operating guide for the Dremio data connector in production: authentication, Flight SQL transport, and observability. - [DuckDB Data Connector](/docs/components/data-connectors/duckdb): DuckDB Data Connector Documentation - [DuckDB Data Connector Deployment Guide](/docs/components/data-connectors/duckdb/deployment): Operating guide for the DuckDB data connector in production: file vs memory mode, durability, and observability. - [DuckLake Data Connector](/docs/components/data-connectors/ducklake): DuckLake Data Connector Documentation - [DynamoDB Data Connector](/docs/components/data-connectors/dynamodb): DynamoDB Data Connector Documentation - [DynamoDB Data Connector Deployment Guide](/docs/components/data-connectors/dynamodb/deployment): Operating guide for the DynamoDB data connector in production: IAM, streams, checkpointing, lag behavior, and observability. - [Elasticsearch Data Connector](/docs/components/data-connectors/elasticsearch): Query Elasticsearch indexes as SQL tables in Spice, including kNN vector search, full-text search, and hybrid search. - [Elasticsearch Data Connector Deployment Guide](/docs/components/data-connectors/elasticsearch/deployment): Operating guide for the Elasticsearch data connector in production: authentication, TLS, resilience, and operational tuning. - [File Data Connector](/docs/components/data-connectors/file): File Data Connector Documentation - [File Data Connector Deployment Guide](/docs/components/data-connectors/file/deployment): Operating guide for the File data connector in production: permissions, formats, performance, and observability. - [Flight SQL Data Connector](/docs/components/data-connectors/flightsql): Flight SQL Data Connector Documentation - [FTP/SFTP Data Connector](/docs/components/data-connectors/ftp): FTP/SFTP Data Connector Documentation - [GCS Data Connector](/docs/components/data-connectors/gcs): GCS (Google Cloud Storage) Data Connector Documentation - [GitHub Data Connector](/docs/components/data-connectors/github): GitHub Data Connector Documentation - [GitHub Data Connector Deployment Guide](/docs/components/data-connectors/github/deployment): Operating guide for the GitHub data connector in production: PATs, rate limits, pagination, and observability. - [Glue Data Connector](/docs/components/data-connectors/glue): Connect to and query tables in an AWS Glue Data Catalog - [GraphQL Data Connector](/docs/components/data-connectors/graphql): GraphQL Data Connector Documentation - [GraphQL Data Connector Deployment Guide](/docs/components/data-connectors/graphql/deployment): Operating guide for the GraphQL data connector in production: authentication, pagination, rate limits, and observability. - [HTTP(s) Data Connector](/docs/components/data-connectors/https): HTTP(s) Data Connector Documentation - [HTTP(s) Data Connector Deployment Guide](/docs/components/data-connectors/https/deployment): Operating guide for the HTTP(s) data connector in production: authentication, rate control, retries, and observability. - [Iceberg Data Connector](/docs/components/data-connectors/iceberg): Connect to and query Apache Iceberg tables - [IMAP Data Connector](/docs/components/data-connectors/imap): IMAP Data Connector Documentation - [Kafka Data Connector](/docs/components/data-connectors/kafka): Kafka Data Connector Documentation - [Localpod Data Connector](/docs/components/data-connectors/localpod): Localpod Data Connector Documentation - [Memory Data Connector](/docs/components/data-connectors/memory): Memory Data Connector Documentation - [MongoDB Data Connector](/docs/components/data-connectors/mongodb): MongoDB Data Connector Documentation - [Microsoft SQL Server Data Connector](/docs/components/data-connectors/mssql): Microsoft SQL Server Data Connector - [MySQL Data Connector](/docs/components/data-connectors/mysql): MySQL Data Connector Documentation - [MySQL Data Connector Deployment Guide](/docs/components/data-connectors/mysql/deployment): Operating guide for the MySQL data connector in production: authentication, connection pooling, TLS, metrics, and observability. - [NFS Data Connector](/docs/components/data-connectors/nfs): NFS Data Connector Documentation - [Pull the latest official Spice image](/docs/components/data-connectors/odbc): ODBC Data Connector Documentation - [Oracle Data Connector](/docs/components/data-connectors/oracle): Oracle Data Connector Documentation - [PostgreSQL Data Connector](/docs/components/data-connectors/postgres): PostgreSQL Data Connector Documentation - [PostgreSQL Data Connector Deployment Guide](/docs/components/data-connectors/postgres/deployment): Operating guide for the PostgreSQL data connector in production: authentication, connection pooling, TLS, metrics, and observability. - [Amazon Redshift Data Connector](/docs/components/data-connectors/redshift): Connect to Amazon Redshift using the PostgreSQL connector in Spice. - [S3 Data Connector](/docs/components/data-connectors/s3): S3 Data Connector Documentation - [S3 Data Connector Deployment Guide](/docs/components/data-connectors/s3/deployment): Operating guide for the S3 data connector in production: IAM, credential chains, file formats, metrics, and observability. - [ScyllaDB Data Connector](/docs/components/data-connectors/scylladb): ScyllaDB Data Connector Documentation - [SharePoint Data Connector](/docs/components/data-connectors/sharepoint): SharePoint Data Connector Documentation - [SMB Data Connector](/docs/components/data-connectors/smb): SMB Data Connector Documentation - [Snowflake Data Connector](/docs/components/data-connectors/snowflake): Snowflake Data Connector Documentation - [Apache Spark Connector](/docs/components/data-connectors/spark): Apache Spark Connector Documentation - [Spice.ai Data Connector](/docs/components/data-connectors/spiceai): Federated SQL across Spice runtimes — Spice Cloud Platform datasets and self-hosted Spice instances (cluster-sidecar pattern). - [Spice.ai Data Connector Deployment Guide](/docs/components/data-connectors/spiceai/deployment): Operating guide for the Spice.ai connector in production: API keys, Flight endpoints, message sizing, sidecar topology, and observability. - [Embedding Models](/docs/components/embeddings): Describes how embedding models are used in Spice to convert text into numerical vectors for machine learning and search applications. - [Azure OpenAI Embedding Models](/docs/components/embeddings/azure): To use an embedding model hosted on Azure OpenAI, specify the azure path in the from field and the following parameters from the Azure OpenAI Model Deployment page: - [Amazon Bedrock Model Provider](/docs/components/embeddings/bedrock): Instructions for using Amazon Bedrock embedding models - [Databricks Model Provider](/docs/components/embeddings/databricks): Instructions for using Databricks Mosaic AI Models - [Google AI Embedding Models](/docs/components/embeddings/google): To use a hosted Google AI embedding model, specify the google path in the from field of your configuration. - [HuggingFace Text Embedding Models](/docs/components/embeddings/huggingface): To use an embedding model from HuggingFace with Spice, specify the huggingface path in the from field of your configuration. The model and its related files will be automatically downloaded, loaded, and served locally by Spice. - [Hugging Face Embedding Deployment Guide](/docs/components/embeddings/huggingface/deployment): Operating guide for Hugging Face embeddings in production: tokens, download cache, pooling, device selection, and observability. - [Local Filesystem Embedding Models](/docs/components/embeddings/local): Embedding models can be run with files stored locally. This method is useful for using models that are not hosted on remote services. - [Local Embedding Deployment Guide](/docs/components/embeddings/local/deployment): Operating guide for filesystem-loaded embedding models in production: formats, pooling, device selection, and observability. - [Model2Vec Embedding Models](/docs/components/embeddings/model2vec): Model2Vec embedding models help generate efficient static word embeddings from sentence transformer models for use in Spice, supporting local and Hugging Face sources with options for private models and performance tuning. - [OpenAI (or Compatible) Embedding Models](/docs/components/embeddings/openai): To use a hosted OpenAI (or compatible) embedding model, specify the openai path in the from field of your configuration. - [OpenAI Embedding Deployment Guide](/docs/components/embeddings/openai/deployment): Operating guide for the OpenAI embedding provider in production: API keys, usage tiers, batching, retries, metrics, and observability. - [Model Providers](/docs/components/models): Overview of supported model providers for ML and LLMs in Spice. - [Anthropic Models](/docs/components/models/anthropic): Instructions for using language models hosted on Anthropic with Spice. - [Azure OpenAI Models](/docs/components/models/azure): Instructions for using Azure OpenAI models - [Amazon Bedrock Models](/docs/components/models/bedrock): How to use Amazon Bedrock models with Spice. - [Databricks Model Provider](/docs/components/models/databricks): Instructions for using Databricks Mosaic AI Models - [Filesystem Hosted Models](/docs/components/models/filesystem): Instructions for using models hosted on a filesystem with Spice. - [Filesystem Model Deployment Guide](/docs/components/models/filesystem/deployment): Operating guide for filesystem-loaded models in production: formats, device selection, memory footprint, and observability. - [Google AI Models](/docs/components/models/google): Instructions for using language models hosted on Google AI with Spice. - [HuggingFace](/docs/components/models/huggingface): Instructions for using machine learning models hosted on HuggingFace with Spice. - [Hugging Face Model Deployment Guide](/docs/components/models/huggingface/deployment): Operating guide for the Hugging Face model in production: tokens, download cache, device selection, local inference footprint, and observability. - [OpenAI (or Compatible) Language Models](/docs/components/models/openai): Instructions for using language models hosted on OpenAI or compatible services with Spice. - [OpenAI Model Deployment Guide](/docs/components/models/openai/deployment): Operating guide for the OpenAI model in production: API keys, usage tiers, rate limiting, Responses API, metrics, and observability. - [Perplexity Models (Deprecated)](/docs/components/models/perplexity): Perplexity model support is no longer supported in Spice. - [Spice Cloud Platform](/docs/components/models/spiceai): Instructions for using models hosted on the Spice Cloud Platform with Spice. - [xAI Models](/docs/components/models/xai): Instructions for using xAI models - [Secret Stores](/docs/components/secret-stores): Configure secret stores to manage sensitive data like passwords, tokens, and API keys. - [AWS Secrets Manager Secret Store](/docs/components/secret-stores/aws-secrets-manager): AWS Secrets Manager Secret Store Documentation - [Azure Key Vault Secret Store](/docs/components/secret-stores/azure-keyvault): Azure Key Vault Secret Store Documentation - [Environment Secret Store](/docs/components/secret-stores/env): Environment Variables Secret Store Documentation - [HashiCorp Vault Secret Store](/docs/components/secret-stores/hashicorp-vault): HashiCorp Vault Secret Store Documentation - [Keyring Secret Store](/docs/components/secret-stores/keyring): Keyring Secret Store Documentation - [Kubernetes Secret Store](/docs/components/secret-stores/kubernetes): Kubernetes Secret Store Documentation - [LLM Tools (Function Calling)](/docs/components/tools): Overview of supported LLM tools (function calling) and how to define new tools - [Model Context Protocol Tools](/docs/components/tools/mcp): Spice integrates with tools and services using the Model Context Protocol (MCP). MCP tools can be configured to run internally or connect to external servers over HTTP using the Streamable HTTP transport. - [Web Search Tool (Deprecated)](/docs/components/tools/websearch): The websearch tool is no longer supported in Spice. - [Vector Engines](/docs/components/vectors): Configure vector engines for efficient embedding storage and similarity search in Spice. - [DuckDB Vector Engine](/docs/components/vectors/duckdb): Use DuckDB as a vector engine in Spice for HNSW-based vector search via the DuckDB VSS extension. - [Elasticsearch Vector Engine](/docs/components/vectors/elasticsearch): Use Elasticsearch as a vector engine in Spice for kNN vector search, full-text search, and hybrid search. - [Amazon S3 Vectors Engine](/docs/components/vectors/s3_vectors): Amazon S3 Vectors Engine Documentation ### deployment Deploy Spice.ai in your environment using Docker, Kubernetes, AWS, Azure, or the Spice Cloud Platform. Learn about sidecar, microservice, tiered, and cluster deployment architectures. - [Spice.ai Deployment Guide](/docs/deployment): Deploy Spice.ai in your environment using Docker, Kubernetes, AWS, Azure, or the Spice Cloud Platform. Learn about sidecar, microservice, tiered, and cluster deployment architectures. - [Deployment Architectures](/docs/deployment/architectures): Explore Spice deployment architectures including sidecar, microservice, tiered, sharded, and cluster configurations. - [Cluster-Based Deployment (Spice.ai Enterprise)](/docs/deployment/architectures/cluster): Deploying Spice as a cluster - [Cluster-Sidecar Deployment](/docs/deployment/architectures/cluster-sidecar): Deploying Spice with sidecar caching backed by a centralized cluster for acceleration, distributed query, and ingestion. - [Cloud Hosted](/docs/deployment/architectures/hosted): Deploying Spice cloud hosted in the Spice Cloud Platform - [Microservice Deployment (Single or Multiple Replicas)](/docs/deployment/architectures/microservice): Deploying Spice as a microservice - [Sharded](/docs/deployment/architectures/sharded): Deploying Spice with shards - [Sidecar Deployment](/docs/deployment/architectures/sidecar): Deploying Spice as a application sidecar - [Tiered Deployment](/docs/deployment/architectures/tiered): Deploying Spice in tiers - [AWS Deployment Options](/docs/deployment/aws): Guide to deploying Spice.ai applications on Amazon Web Services (AWS) - [AWS Integrations](/docs/deployment/aws/integrations): Complete guide to Spice.ai integrations with Amazon Web Services, including data connectors, AI models, vector stores, and secret management. - [Azure Deployment Options](/docs/deployment/azure): Guide to deploying Spice.ai applications on Microsoft Azure - [Azure Integrations](/docs/deployment/azure/integrations): Spice.ai integrations with Microsoft Azure, including data connectors, AI models, embeddings, and authentication. - [CI/CD Deployment](/docs/deployment/ci-cd): Deploy Spice.ai applications using continuous integration and delivery pipelines, including Helm, Kubernetes GitOps with Argo CD or Flux, GitHub Actions, and the Spice Cloud deploy action. - [Spice Cloud Platform Deployment](/docs/deployment/cloud): Guide to deploying data and AI applications using the managed Spice Cloud Platform - [Docker](/docs/deployment/docker): Run Spice.ai as a Docker container. - [Docker Sandbox Guide - v1.3.0](/docs/deployment/docker/sandbox): Migrating to v1.3.0 - [Google Cloud Deployment Options](/docs/deployment/gcp): Guide to deploying Spice.ai applications on Google Cloud Platform (GCP). - [GCP Integrations](/docs/deployment/gcp/integrations): Spice.ai integrations with Google Cloud Platform, including data connectors, AI models, embeddings, and authentication. - [Kubernetes Deployment](/docs/deployment/kubernetes): Deploy Spice.ai on Kubernetes using Helm, Argo CD, or Flux. - [Kubernetes - Argo CD](/docs/deployment/kubernetes/argocd): Deploy Spice.ai on self-hosted Kubernetes using Argo CD and the Spice Helm chart. - [Kubernetes - Flux](/docs/deployment/kubernetes/flux): Deploy Spice.ai on Kubernetes using Flux CD and the Spice Helm chart. - [Kubernetes - Helm](/docs/deployment/kubernetes/helm): Deploy Spice.ai in Kubernetes using Helm. - [Read/Write Separation](/docs/deployment/read-write-separation): Separate write/ingest workloads (cluster) from read workloads (application sidecars, agents) using shared snapshots and live query delegation. ### faq Answers to frequently asked questions about Spice.ai including features, use cases, differences from Trino/Presto/Dremio, federated queries, caching, and AI capabilities. - [Spice.ai FAQ](/docs/faq): Answers to frequently asked questions about Spice.ai including features, use cases, differences from Trino/Presto/Dremio, federated queries, caching, and AI capabilities. ### features Explore Spice.ai features including data federation, data acceleration, caching, search, LLM integration, embeddings, observability, and more for building data-driven AI applications. - [Spice.ai Features](/docs/features): Explore Spice.ai features including data federation, data acceleration, caching, search, LLM integration, embeddings, observability, and more for building data-driven AI applications. - [Caching](/docs/features/caching): Learn how to use Spice in-memory caching - [Change Data Capture (CDC)](/docs/features/cdc): Learn how to use Change Data Capture (CDC) in Spice. - [Debezium (CDC over Kafka)](/docs/features/cdc/debezium): Consume Debezium change events from Kafka into a Spice-accelerated dataset for sources without a native Spice CDC path. - [DynamoDB Streams (Native CDC)](/docs/features/cdc/dynamodb-streams): Stream INSERT, UPDATE, and DELETE events from Amazon DynamoDB directly into a Spice-accelerated dataset using DynamoDB Streams. - [MongoDB Change Streams (Native CDC)](/docs/features/cdc/mongodb-streams): Stream insert, update, replace, and delete events from MongoDB directly into a Spice-accelerated dataset using MongoDB Change Streams. - [PostgreSQL Logical Replication (Native CDC)](/docs/features/cdc/postgres-replication): Stream INSERT, UPDATE, and DELETE events from PostgreSQL directly into a Spice-accelerated dataset using native logical replication. - [Data Acceleration](/docs/features/data-acceleration): Learn how to use local data acceleration in Spice. - [Constraints](/docs/features/data-acceleration/constraints): Learn how to add/configure constraints on local acceleration tables in Spice. - [Data Refresh](/docs/features/data-acceleration/data-refresh): Data refresh for accelerated datasets - [Hash Index for Arrow Acceleration](/docs/features/data-acceleration/hash-index): Learn how to use hash indexes for O(1) point lookups on Arrow-accelerated datasets. - [Indexes](/docs/features/data-acceleration/indexes): Learn how to add indexes to local acceleration tables in Spice. - [Partitioning](/docs/features/data-acceleration/partitioning): Partition accelerated datasets to make filtered queries faster by reading only the relevant partitions. - [Refresh Modes](/docs/features/data-acceleration/refresh-modes): Refresh modes for accelerated datasets in Spice. - [Append Refresh Mode](/docs/features/data-acceleration/refresh-modes/append): Incrementally append new rows to an accelerated dataset. - [Caching Refresh Mode](/docs/features/data-acceleration/refresh-modes/caching): Learn how to use caching refresh mode for HTTP-based datasets - [Changes Refresh Mode](/docs/features/data-acceleration/refresh-modes/changes): Apply incremental inserts, updates, and deletes via Change Data Capture. - [Full Refresh Mode](/docs/features/data-acceleration/refresh-modes/full): Replace the entire accelerated dataset on each refresh. - [Snapshot Refresh Mode](/docs/features/data-acceleration/refresh-modes/snapshot): Reload acceleration data exclusively from the snapshot store. - [Snapshots](/docs/features/data-acceleration/snapshots): Bootstrap file-mode accelerations from managed snapshots to eliminate cold starts. - [Data Ingestion](/docs/features/data-ingestion): Learn how to ingest data in Spice. - [Distributed Query](/docs/features/distributed-query): Learn how to run Spice in distributed mode for larger scale queries, including the async queries API. - [Embedding Datasets](/docs/features/embeddings): Learn how to define, or augment existing datasets with embedding column(s). - [Functions](/docs/features/functions): Define custom scalar and table SQL functions inline (SQL tier) or by calling remote HTTP services (Remote tier), automatically exposed as SQL functions and LLM tools. - [Large Language Models](/docs/features/large-language-models): Learn how to configure large language models (LLMs) - [Evaluating Language Models (Deprecated)](/docs/features/large-language-models/evals): Language model evals are no longer supported in Spice. - [Model Context Protocol (MCP)](/docs/features/large-language-models/mcp): Learn how to use the Model Context Protocol (MCP) with Spice. - [Language Model Memory](/docs/features/large-language-models/memory): Learn how to provide LLMs with memory - [Language Model Overrides](/docs/features/large-language-models/parameter_overrides): Learn how to override default LLM hyperparameters in Spice. - [System Prompt parameterization](/docs/features/large-language-models/parameterized_prompts): Learn how to update system prompts for each request with Jinja-styled templating. - [Load and Serve Models Locally](/docs/features/large-language-models/serving): Learn how to load and serve large learning models. - [Language Models Tools](/docs/features/large-language-models/tools): Learn how LLMs interact with the Spice runtime. - [Machine Learning Models](/docs/features/machine-learning-models): Spice supports loading and serving ONNX models for inference, from sources including local filesystems, Hugging Face, and the Spice.ai Cloud platform. - [Observability & Monitoring](/docs/features/observability): Monitor Spice with Prometheus metrics, OpenTelemetry, and distributed tracing. - [Component Metrics](/docs/features/observability/component_metrics): Learn how to enable optional component metrics. - [Query Federation](/docs/features/query-federation): Learn how to use federated SQL queries in Spice.ai Open Source - [Parameterized Queries](/docs/features/query-federation/parameterized-queries): Learn how to use prepared statements and parameterized queries in Spice for improved security and performance. - [URL Tables](/docs/features/query-federation/url-tables): Query object store files directly using URLs without pre-registering datasets - [Search Functionality](/docs/features/search): Learn how Spice can search across datasets using database-native and vector-search methods. - [Full-Text Search](/docs/features/search/full-text): Learn how Spice can perform full text search - [Multi-Vector Search](/docs/features/search/multi-vector): Embed list-of-strings columns as a column of vectors and use ColBERT-style late-interaction search in Spice. - [Reranking](/docs/features/search/rerank): Rerank search results using dedicated reranker models or LLM-as-reranker for improved relevance. - [Vector-Based Search](/docs/features/search/vector-search): Learn how Spice can perform searches using vector-based methods. - [Semantic Model](/docs/features/semantic-model): Attach descriptions and metadata to datasets, views, and columns in Spice so LLMs, SQL functions, and humans share the same understanding of your data. - [Tool Registry](/docs/features/tool-registry): Reduce per-turn token cost and improve LLM tool selection accuracy by replacing individual tool definitions with searchable tool_search and tool_invoke meta-tools backed by hybrid full-text, keyword, schema, and vector search. - [Views](/docs/features/views): Documentation for defining Views in Spice - [Web Search](/docs/features/web-search): Learn how Spice can perform web search - [Workers](/docs/features/workers): Configure workers in the Spice runtime to coordinate interactions between LLMs and tools, with load-balancing, round-robin, and fallback strategies. ### getting-started Get started with Spice.ai in 5 minutes. Install the CLI, connect to datasets, run SQL queries, and use AI models with OpenAI-compatible APIs. - [Getting Started with Spice.ai OSS](/docs/getting-started): Get started with Spice.ai in 5 minutes. Install the CLI, connect to datasets, run SQL queries, and use AI models with OpenAI-compatible APIs. - [Community Data](/docs/getting-started/spiceai): Connect to the Spice.ai Cloud Platform to access community datasets. - [Spicepods](/docs/getting-started/spicepods): An introduction to Spicepods - [Telemetry](/docs/getting-started/telemetry): Learn how Spice AI uses anonymous telemetry. ### installation Install Spice.ai OSS on macOS, Linux, Windows, or WSL using the install script, Homebrew, PowerShell, or direct download from GitHub releases. - [Install Spice.ai OSS](/docs/installation): Install Spice.ai OSS on macOS, Linux, Windows, or WSL using the install script, Homebrew, PowerShell, or direct download from GitHub releases. ### intelligent-applications Learn how to build intelligent, data-driven AI applications and agents with Spice.ai. Explore patterns for RAG, LLM integration, and real-time AI inference. - [Building Intelligent AI Applications with Spice.ai](/docs/intelligent-applications): Learn how to build intelligent, data-driven AI applications and agents with Spice.ai. Explore patterns for RAG, LLM integration, and real-time AI inference. ### monitoring Monitor Spice.ai deployments with Datadog, Grafana, New Relic, Prometheus, and Zipkin integrations. - [Monitoring](/docs/monitoring): Monitor Spice.ai deployments with Datadog, Grafana, New Relic, Prometheus, and Zipkin integrations. - [Datadog](/docs/monitoring/datadog): Monitoring Spice with Datadog - [Grafana & Prometheus](/docs/monitoring/grafana): Monitoring Spice instances with Grafana & Prometheus - [New Relic](/docs/monitoring/new-relic): Monitoring Spice with New Relic - [Spice Cloud Platform](/docs/monitoring/spice-cloud): Connect a self-hosted Spice runtime to the Spice Cloud Platform to centralize task history and runtime observability across deployments. - [Zipkin Integration](/docs/monitoring/zipkin): Learn how to integrate Spice with Zipkin tracing. ### reference Reference documentation for Spice.ai including API reference, CLI commands, Spicepod configuration syntax, SQL reference, and data type specifications. - [Spice.ai OSS Reference Docs](/docs/reference): Reference documentation for Spice.ai including API reference, CLI commands, Spicepod configuration syntax, SQL reference, and data type specifications. - [Cron Schedules](/docs/reference/cron): The Runtime supports cron expressions with optional seconds, like /10 which evaluates to every 10th second (10, 20, 30, etc). - [Data Types Reference](/docs/reference/datatypes): Spice uses Apache Arrow data types internally, providing consistent type handling across different data sources and accelerators. This section documents how Arrow types map to specific accelerators and object store formats. - [Accelerator Data Types](/docs/reference/datatypes/accelerators): Spice adheres to Apache Arrow data types. Data accelerators do not support all Arrow data types. The table below outlines the data type compatibility for each accelerator, and datatype used within the accelerator. - [Object Store Data Types](/docs/reference/datatypes/object_store): Spice adheres to Apache Arrow data types. The table below lists the types of supported file type from object stores and their corresponding Apache Arrow type mappings in Spice. - [Spice Runtime Distributions](/docs/reference/distributions): Distribution variants of the Spice runtime for different use cases and deployment scenarios, including data-only, GPU-accelerated, NAS, and allocator variants. - [Duration](/docs/reference/duration): Durations are represented as integers with a time unit suffix. - [File Formats](/docs/reference/file_format): File-based data connectors — including s3//, file//, sftp://, and others — support multiple structured and document file formats. This page details the format-specific parameters available for each. - [Managing Memory Usage](/docs/reference/memory): Guidelines and best practices for managing memory usage and optimizing performance in Spice deployments. - [Models Grade Report](/docs/reference/models): Spice AI graded Large-Language-Model (LLM) evaluation report - [Performance Tuning](/docs/reference/performance-tuning): Comprehensive guide to optimizing query performance, acceleration, and resource utilization in Spice deployments. - [YAML syntax for Spicepod manifests](/docs/reference/spicepod): Detailed documentation on the Spicepod manifest syntax (spicepod.yaml) - [catalogs](/docs/reference/spicepod/catalogs): Catalogs YAML reference - [Datasets](/docs/reference/spicepod/datasets): Datasets YAML reference - [Embeddings](/docs/reference/spicepod/embeddings): Embeddings YAML reference - [Evals (Deprecated)](/docs/reference/spicepod/evals): The evals Spicepod component is no longer supported in Spice. - [Functions (User-Defined Functions)](/docs/reference/spicepod/functions): User-defined functions YAML reference - [Reserved Keywords](/docs/reference/spicepod/keywords): Reserved keywords for datasets - [Models](/docs/reference/spicepod/models): Models YAML reference - [Runtime](/docs/reference/spicepod/runtime): Runtime YAML reference - [Tools (Function Calling)](/docs/reference/spicepod/tools): Tools YAML reference - [Views](/docs/reference/spicepod/views): Views YAML reference - [Workers](/docs/reference/spicepod/workers): Workers YAML reference - [SQL Reference](/docs/reference/sql): Complete SQL reference for Spice.ai including SELECT syntax, subqueries, DML statements, aggregate functions, AI functions, JSON operators, and search capabilities. - [Aggregate Functions](/docs/reference/sql/aggregate_functions): Spice is built on Apache DataFusion and uses the PostgreSQL dialect, even when querying datasources with different SQL dialects. When using a data accelerator like DuckDB, function support is specific to each acceleration engine, and not all functions are supported by all acceleration engines. - [AI Functions](/docs/reference/sql/ai): AI functions in Spice provide direct integration with large language models (LLMs) and embedding models within SQL queries. These functions process text through configured model providers and return generated responses or vector embeddings. - [DML (Data Manipulation Language)](/docs/reference/sql/dml): Data Manipulation Language (DML) statements for inserting and modifying data in Spice. - [Explain](/docs/reference/sql/explain): Spice is built on Apache DataFusion and uses the PostgreSQL dialect, even when querying datasources with different SQL dialects. - [Information Schema](/docs/reference/sql/information_schema): Spice is built on Apache DataFusion and uses the PostgreSQL dialect, even when querying datasources with different SQL dialects. - [JSON Functions and Operators](/docs/reference/sql/json): Reference for JSON functions and operators in Spice SQL - [Operators](/docs/reference/sql/operators): Spice is built on Apache DataFusion and uses the PostgreSQL dialect, even when querying datasources with different SQL dialects. - [Prepared Statements](/docs/reference/sql/prepared_statements): Spice is built on Apache DataFusion and uses the PostgreSQL dialect, even when querying datasources with different SQL dialects. - [Scalar Functions](/docs/reference/sql/scalar_functions): Spice is built on Apache DataFusion and uses the PostgreSQL dialect, even when querying datasources with different SQL dialects. When using a data accelerator like DuckDB, function support is specific to each acceleration engine, and not all functions are supported by all acceleration engines. - [Search in SQL](/docs/reference/sql/search): Reference for search functions and filtering in Spice SQL. - [SELECT](/docs/reference/sql/select): Spice is built on Apache DataFusion and uses the PostgreSQL dialect, even when querying datasources with different SQL dialects. - [Subqueries](/docs/reference/sql/subqueries): Spice is built on Apache DataFusion and uses the PostgreSQL dialect, even when querying datasources with different SQL dialects. - [Spice.ai Open Source System Requirements](/docs/reference/system_requirements): System requirements for running Spice.ai Open Source - [Task History](/docs/reference/task_history): The Spice runtime stores information about completed tasks in the spice.runtime.task_history table. Each task represents a single unit of execution within the runtime, such as a SQL query or an AI chat completion, and is represented by a unique span. ### sdks Connect to Spice using official SDKs - [SDKs](/docs/sdks): Connect to Spice using official SDKs - [Dotnet SDK](/docs/sdks/dotnet): Connect to Spice using the Dotnet SDK - [Go SDK](/docs/sdks/golang): Connect to Spice using the Go SDK - [Java SDK](/docs/sdks/java): Connect to Spice using the Java SDK - [JavaScript SDK](/docs/sdks/javascript): Connect to Spice using the JavaScript SDK - [Python SDK](/docs/sdks/python): Connect to Spice using the Python SDK - [Rust SDK](/docs/sdks/rust): Connect to Spice using the Rust SDK ### troubleshooting Review and debug runtime tasks, logs, and diagnostic steps in Spice. - [Troubleshooting Spice](/docs/troubleshooting): Review and debug runtime tasks, logs, and diagnostic steps in Spice. ### use-cases Discover how to use Spice.ai for data federation, reverse-ETL, database CDN, enterprise search, RAG, and building AI-powered applications and agents. - [Spice.ai Use Cases](/docs/use-cases): Discover how to use Spice.ai for data federation, reverse-ETL, database CDN, enterprise search, RAG, and building AI-powered applications and agents. - [AI Applications and Agents](/docs/use-cases/ai): AI Applications and Agents - [Agentic AI Applications and Agents](/docs/use-cases/ai/agentic-apps): Spice.ai builds intelligent, autonomous agents for SaaS applications, enabling context-aware automation and decision-making. - [Edge-Enabled AI Applications and Agents](/docs/use-cases/ai/edge-ai): Spice.ai deploys AI applications and agents across cloud and edge for low-latency decisions in security IoT use cases. - [Federated MCP Client for Distributed Tool Ecosystems](/docs/use-cases/ai/federated-mcp-server): Spice.ai federates external MCP servers for scalable, tool-driven AI applications in security, improving threat analysis. - [Multi-Tenant AI Agents](/docs/use-cases/ai/multi-tenant-agents): Deploy AI agents across many SaaS tenants with strict isolation and no per-tenant ETL pipelines. - [Object-Store Based SQL Query, Search, and LLM Inference Engine](/docs/use-cases/ai/object-store-ai-engine): Spice.ai enables SQL queries, hybrid search, and LLM inference on object-store data for security applications, delivering real-time insights. - [Real-Time Decision-Making for Intelligent Applications](/docs/use-cases/ai/real-time-decision-making): Spice.ai powers instant, context-aware decisions for applications like security recommendations by grounding AI in federated, low-latency datasets. - [Tool-Augmented AI with Model Context Protocol Server](/docs/use-cases/ai/tool-calling-ai): Spice.ai extends AI with custom tools via MCP server in finserv, integrating domain-specific APIs for enhanced functionality. - [Caching](/docs/use-cases/caching): Caching use cases with Spice.ai, including write-through, read-through, SQL, S3, and HTTP caching. - [HTTP Cache](/docs/use-cases/caching/http-cache): Use Spice.ai to cache HTTP API responses locally, reducing API call frequency and providing fast, SQL-queryable access to external API data. - [Read-Through Cache](/docs/use-cases/caching/read-through-cache): Use Spice.ai as a read-through cache with the SQL results cache for federated data sources and HTTP APIs. - [S3 Cache](/docs/use-cases/caching/s3-cache): Use Spice.ai to cache S3 and object store data locally for fast, repeatable SQL queries without re-reading from remote storage. - [SQL and Database Cache](/docs/use-cases/caching/sql-database-cache): Use Spice.ai to cache SQL database tables and query results locally for low-latency access and reduced load on upstream databases. - [Write-Through Cache](/docs/use-cases/caching/write-through-cache): Use Spice.ai as a write-through cache that writes data to both a local accelerator and the upstream data source. - [Data Federation, Acceleration, and SQL Query](/docs/use-cases/data): Data Federation, Acceleration, and SQL Query - [Application Resilience and Performance Optimization](/docs/use-cases/data/application-resilence-and-acceleration): Spice.ai colocates dynamic data with SaaS applications as a database CDN, ensuring resilience and high performance. - [Data Mesh for Unified Data Access](/docs/use-cases/data/data-mesh): Give domain teams decentralized, real-time data ownership and access across disparate sources through a unified SQL interface. - [Database CDN for Enhanced Performance](/docs/use-cases/data/database-cdn): Spice.ai acts as a database CDN for SaaS applications, caching dynamic data to ensure high performance and resilience. - [ETL-free Workflows and Data Migrations](/docs/use-cases/data/etl-free-workflows): Federate legacy and modern data systems without ETL for faster migrations, lower overhead, and zero application downtime. - [Object-Store Data Engine](/docs/use-cases/data/object-store-data-engine): Spice.ai federates, accelerates, and queries object-store data for finserv applications, enabling real-time data access without centralized warehouses. - [Reverse-ETL for Operational Workflows](/docs/use-cases/data/reverse-etl): Serve enriched data from warehouses and data lakes to operational systems and applications, eliminating complex pipelines. - [Spice for Retrieval-Augmented-Generation (RAG)](/docs/use-cases/rag): Use Spice for Retrieval-Augmented-Generation (RAG) - [RAG for Contextual Applications](/docs/use-cases/rag/applications): Build context-rich AI applications using Spice for Retrieval-Augmented Generation (RAG). - [Retrieval-Augmented Generation for AI-Powered Reporting](/docs/use-cases/rag/reporting): Spice.ai generates dynamic, context-aware AI-driven reports for operational insights in health-tech, ensuring compliance and precision. - [Search & Retrieval](/docs/use-cases/search): Search & Retrieval - [Simplifying Real-Time Data Collection and Search](/docs/use-cases/search/data-collection-and-search): Spice.ai processes streaming and static data with integrated search for real-time insights, focusing on application logic. - [Enterprise Search and Retrieval](/docs/use-cases/search/enterprise-search): Spice.ai powers semantic and precise search for finserv knowledge bases with hybrid vector and keyword capabilities. - [Object-Store Native Search Engine](/docs/use-cases/search/object-store-search-engine): Spice.ai powers a cloud-native embedded search engine on object-store data for security applications, enabling semantic and precise search. ## Optional - [GitHub Repository](https://github.com/spiceai/spiceai): Spice.ai OSS source code and issue tracker - [Cookbook](https://github.com/spiceai/cookbook): Ready-to-use recipes and examples for Spice.ai - [Spice Cloud Platform](https://spice.ai): Managed cloud platform for Spice.ai