Variant shredding will soon be enabled by default on new Variant tables

UpdateSep 22, 2026UnverifiedAdded Sep 24, 2026

Starting November 18, 2026, Databricks will automatically add the variantShredding table feature to new tables that contain a column of the VARIANT type when they are created on Databricks Runtime 17.3 or above. Variant shredding stores frequently accessed fields in a typed, columnar layout to improve query performance.

SQL Performance

Read Databricks's release notes

https://docs.databricks.com/aws/en/release-notes/whats-coming#variant-shredding-will-soon-be-enabled-by-default-on-new-variant-tables

Summaries of vendors' own notes. Product names and logos belong to their owners; logos via logo.dev.

More Lakeflow releases

LakeflowSep 22, 2026

Shopify connector (Beta)

The Shopify connector is now available in Lakeflow Connect in Beta . Workspace admins can control access to this feature from the Previews page. The connector ingests e-commerce data such as products, orders, customers, inventory, fulfillments, and discounts from Shopify into Databricks. Authentication uses the Shopify OAuth client credentials grant.

BetaSecurityData integrationSource

LakeflowSep 14, 2026

JAR tasks on serverless compute will soon be available for workspaces with the compliance security profile enabled

In early October 2026, running JAR tasks on serverless compute will be automatically enabled for workspaces with the compliance security profile enabled. Package your Java or Scala Spark code in a JAR and run it as a JAR task on serverless compute in a Lakeflow Job, without provisioning or managing clusters. See Create and run JARs on serverless compute .

UpdateGovernanceSecuritySource

LakeflowSep 11, 2026

Standard performance mode is now available for one-time runs in the Jobs API

You can now set performance_target to STANDARD in the Jobs API. Apache Airflow's DatabricksSubmitRunOperator also supports this. See Create and trigger a one-time run and Select a performance mode .

UpdateDeveloper toolsPerformanceSource

LakeflowSep 11, 2026

Session restore for serverless jobs is in Public Preview

Restore the Python variables and Spark session from a serverless compute job run into a new interactive notebook, so you can debug a failure or explore results without rerunning the entire job. Databricks captures the snapshot automatically for eligible runs. See Session restore for serverless jobs .

PreviewNotebooksSource

LakeflowSep 10, 2026

Managed tables in Lakeflow pipelines (Beta)

You can now create managed tables in Lakeflow pipelines and write to them with one or more append flows. This feature is in Beta . You can also use import_checkpoint on an append flow to migrate an existing Structured Streaming workload into a pipeline without reprocessing the source. See create_table , CREATE TABLE ... FLOW (pipelines) , and append_flow .

BetaStreamingData integrationSource

LakeflowSep 10, 2026

Maintenance windows for continuous pipelines

You can now set a maintenance window on a continuous Lakeflow pipeline to control when Databricks applies platform updates that require a restart, such as new runtime versions and serverless infrastructure maintenance. Select a day of the week, a start hour, and a time zone, and Databricks starts maintenance only within that one-hour window.

UpdateData integrationDeveloper toolsSource

LakeflowSep 9, 2026

Celigo connector (Beta)

The Celigo connector is now available in Lakeflow Connect in Beta . Workspace admins can control access to this feature from the Previews page. The connector ingests audit log events, such as create, update, and delete operations on resources, from Celigo (integrator.io) into Databricks. Authentication uses a Celigo integrator.io API token.

BetaData integrationObservabilityDeveloper toolsSource

LakeflowSep 9, 2026

Anysphere Organization connector (Beta)

The Anysphere Organization connector is now available in Lakeflow Connect in Beta . Workspace admins can control access to this feature from the Previews page. The connector uses the Anysphere (Cursor) Organization Admin API to ingest organization members, groups, and group members into Databricks as daily snapshots.

BetaData integrationDeveloper toolsCoding agentsSource

Also shipped on Sep 22, 2026

AWS Amazon BedrockSep 22, 2026

OpenAI GPT-6 Sol and GPT-6 Luna are now generally available on Amazon Bedrock

Today, AWS announces the general availability of GPT-6 Sol and GPT-6 Luna from OpenAI on Amazon Bedrock. Expanding the GPT-6 family alongside Astra, these two models give teams more ways to balance intelligence, speed, and cost across every workload. Sol is the daily model for recurring complex tasks and software development.

GALLMsGovernanceSecuritySource

Anthropic Claude PlatformSep 22, 2026

Claude Opus 5.5 launches with a 1M token context window and 128k output

Anthropic released Claude Opus 5.5 for long-running agentic coding and knowledge work, with a default 1M token context, 128k max output and always-on adaptive thinking. It costs $4 / $20 per MTok, below Claude Opus 5, and is on the Claude API, Bedrock, Google Cloud and Microsoft Foundry.

GAAI agentsLLMsDeveloper toolsSource

Anthropic Claude PlatformSep 22, 2026

Fast mode research preview available for Claude Opus 5.5 on the Claude API

Fast mode, in research preview, can now be used with Claude Opus 5.5 on the Claude API.

PreviewLLMsDeveloper toolsSource

Anthropic Claude PlatformSep 22, 2026

Claude API beta lets tools be defined inside mid-conversation system messages

With the inline-tools-2026-09-15 beta header, a tool_addition block can carry a full tool definition, so agents can add tools, change schemas or upgrade server tools mid-conversation without invalidating the prompt cache. The same header covers adding and removing tools by reference.

BetaLLMsMCPData integrationSource

Vercel AI SDK and AI GatewaySep 22, 2026

Drives for Vercel Sandbox are now in public beta

Drives for Vercel Sandbox are now available in public beta on Hobby, Pro, and Enterprise. A Drive is persistent storage that you mount as a directory in a Vercel Sandbox. It isn’t tied to a single sandbox, so you can reuse the same Drive across runs and different sandbox instances.

BetaAI agentsPricingRegionsSource

GitHub GitHub Advanced SecuritySep 22, 2026

Deprecation notice: All-platform CodeQL bundle

Starting with CodeQL CLI 2.27.0 , the all-platform CodeQL bundle (i.e., codeql-bundle.tar.gz and codeql-bundle.tar.zst ), which includes the binaries for all supported platforms up to this release, is marked as deprecated. In mid-March 2027, we will remove the all-platform CodeQL bundle.

DeprecationObservabilityDeveloper toolsSource