16 docs tagged with "Models"

Documentation related to Models including machine learning, LLMs, etc.

Batch ML Predictions

Perform a batch of ML predictions, using multiple models, in one request. This is useful for ensembling or A/B testing different models.

Create Chat Completion

Creates a model response for the given chat conversation.

Embedding Models

Evaluating Language Models

Learn how Spice evaluates, tracks, compares, and improves language model performance for specific tasks

Language Model Memory

Learn how to provide LLMs with memory

Language Model Overrides

Learn how to override default LLM hyperparameters in Spice.

Language Models Tools

Learn how LLMs interact with the Spice runtime.

Large Language Models

Learn how to configure large language models (LLMs)

List Evals

Return all evals available to run in the runtime.

List Models

List all models, both machine learning and language models, available in the runtime.

List Spicepods

Get a list of spicepods and their details. In CSV format, it will return a summarised form.

Load and Serve Models Locally

Learn how to load and serve large learning models.

Machine Learning Models

Spice supports loading and serving ONNX models for inference, from sources including local filesystems, Hugging Face, and the Spice.ai Cloud platform.

ML Prediction

Make a ML prediction using a specific model.

Search Functionality

Learn how Spice can search across datasets using database-native and vector-search methods.

Vector-Based Search

Learn how Spice can perform searches using vector-based methods.