Spice v1.5.1 (July 28, 2025)
Announcing the release of Spice v1.5.1! ๐
Spice v1.5.1 expands the GitHub data connector to include pull-request comments, adds a configurable rate limiting for AWS Bedrock embedding models, expands partition pruning with inequality operators, and adds client-supplied cache keys for granular caching control in the HTTP and Arrow Flight SQL APIs.
What's New in v1.5.1โ
GitHub Data Connector Pull Request Comments: Configure GitHub pulls datasets to include comments.
Example Spicepod.yaml:
datasets:
- from: github:github.com/spiceai/spiceai/pulls
name: spiceai.pulls
params:
github_include_comments: all # 'review', 'discussion', or 'none'. Defaults to 'none'.
github_max_comments_fetched: '25' # Defaults to 100
# ...
For details, see the GitHub Data Connector documentation.
AWS Bedrock Embedding Models Invocation Control: Improved rate limiting control for AWS Bedrock embedding models with max_concurrent_invocations
configuration.
embeddings:
- from: bedrock:cohere.embed-english-v3
name: cohere-embeddings
params:
max_concurrent_invocations: '41'
# ...
For details, see the AWS Bedrock Embeddings Model Provider documentation.
Improved Query Partitioning: Expanded partition pruning support with additional inequality operators (e.g. >
, >=
, <
, <=
).
For details, see the Query Partitioning documentation.
Client-Supplied Cache Keys: Support for a new Spice-Cache-Key
header/metadata-key in the HTTP and Arrow Flight SQL query APIs to for fine-grained client-side caching control.
Example HTTP API usage:
$ curl -vvS -XPOST http://localhost:8090/v1/sql \
-H"spice-cache-key: 1851400_20170216_north_america" \
-d "select * from scihub_journals_accessed
where user_id = '1851400'
and date_trunc('DAY', timestamp) = '2017-02-16'
and city = 'New York';"
Example Response:
< HTTP/1.1 200 OK
< content-type: application/json
< x-cache: Hit from spiceai
< results-cache-status: HIT
< vary: Spice-Cache-Key
< vary: origin, access-control-request-method, access-control-request-headers
< content-length: 604
< date: Wed, 23 Jul 2025 20:26:12 GMT
<
[{
"timestamp": "2017-02-16 09:55:06",
"doi": "10.1155/2012/650929",
"ip_identifier": 1000856,
"user_id": 1851400,
"country": "United States",
"city": "New York",
"longitude": 40.7830603,
"latitude": -73.9712488
},
...
]
For details, see the Cache Control documentation.
Contributorsโ
- @Jeadie
- @Advayp
- @sgrebnov
- @kczimm
- @lukekim
- @phillipleblanc
- @mach-kernel
- @varunguleriaCodes
- @peasee
- @ewgenius
New Contributorsโ
- @varunguleriaCodes made their first contribution in github.com/spiceai/spiceai/pull/6383
Breaking Changesโ
- N/A
Cookbook Updatesโ
No new recipes added in this release.
The Spice Cookbook includes 74 recipes to help you get started with Spice quickly and easily.
Upgradingโ
To upgrade to v1.5.1, use one of the following methods:
CLI:
spice upgrade
Homebrew:
brew upgrade spiceai/spiceai/spice
Docker:
Pull the spiceai/spiceai:1.5.1
image:
docker pull spiceai/spiceai:1.5.1
For available tags, see DockerHub.
Helm:
helm repo update
helm upgrade spiceai spiceai/spiceai
What's Changedโ
Dependenciesโ
No major dependency updates.
Changelogโ
- Fix refresh via Api when dataset is already accelerated and no refresh interval is set by @sgrebnov in #6549
- Add support for custom GraphQL unnesting behavior by @Advayp in #6540
- Regex Update to disallow hyphens dataset names by @varunguleriaCodes in #6383
- Enforce max limit on comments fetched per PR by @Advayp in #6580
- Fix accelerated refresh issue by @Advayp in #6590
- Enable configurations of max invocations for Bedrock models by @Advayp in #6592
- Client-supplied cache keys (Spice-Cache-Key) by @mach-kernel in #6579
- Improved partition pruning by @kczimm in #6582
- Fix retention filter when both retention_sql and period are set by @sgrebnov in #6595
- Initial support for PR comments by @Advayp in #6569
- chore: Update croner by @peasee in #6547
- fix databricks streaming for Claude model by @peasee in #6601
- Remove
FullTextUDTFAnalyzerRule
and move FTS code intosearch
crate by @jeadie in #6596 - Remove download of legacy sentence transformers config by @jeadie in #6605
- re-add snapshot tests by @jeadie
- Embedding column config to support client-specified vector sizes by @mach-kernel in #6610
- Fix mismatch in columns for the GitHub PR table type by @Advayp in #6616
- bump version to 1.5.1 by @phillipleblanc
- fix issues with cherry-picking by @jeadie
- Add integration tests for GitHub PRs with comments by @Advayp in #6581
- Add view name to view creation errors by @lukekim in #6611
- CDC: Compute embeddings on ingest by @mach-kernel in #6612