Pipeline events system table is in Beta

BetaAug 31, 2026VerifiedAdded Sep 22, 2026

The pipeline_events system table is in Beta . This table records Lakeflow pipelines event log entries for pipelines in your account, capturing lifecycle transitions, flow progress, data quality metrics, errors, and other operational data across all pipelines and workspaces in a region.

SQL Data integration Observability Regions

Read Databricks's release notes

https://docs.databricks.com/aws/en/release-notes/product/2026/august#pipeline-events-system-table-is-in-beta

Summaries of vendors' own notes. Product names and logos belong to their owners; logos via logo.dev.

More Lakeflow releases

LakeflowSep 1, 2026

Apache Arrow support for Zerobus Ingest is now generally available

Apache Arrow support for Zerobus Ingest in Lakeflow Connect is now generally available. See Use Arrow Flight with Zerobus Ingest .

GAData integrationSource

LakeflowAug 27, 2026

Lakeflow Designer August Release

The Lakeflow Designer August release adds the Unique operator, expands the Aggregate, Select, and Python operators, and improves the canvas, preview, and version-history experience.

PreviewStreamingGovernanceDeveloper toolsSource

LakeflowAug 27, 2026

Atlassian Audit Logs connector (Beta)

The Atlassian Audit Logs connector is now available in Lakeflow Connect in Beta . Workspace admins can control access to this feature from the Previews page. The connector ingests organization audit log events, such as user, security, and configuration changes, from Atlassian into Databricks. Authentication uses an Atlassian organization API key.

BetaSecurityData integrationObservabilitySource

LakeflowAug 26, 2026

Zerobus Ingest into streaming tables is now generally available

Ingesting into streaming tables with Zerobus Ingest in Lakeflow Connect is now generally available. Writing to a streaming table works the same way as writing to a managed Delta table, with the same limits and quotas. See Create or identify the target table .

GAStreamingPricingData integrationSource

LakeflowAug 25, 2026

Anysphere Audit Logs connector (Beta)

The Anysphere Audit Logs connector is now available in Lakeflow Connect in Beta . Workspace admins can control access to this feature from the Previews page. The connector uses the Anysphere (Cursor) Admin API to incrementally ingest team audit-log events into Databricks. Authentication uses a Cursor Admin API key. See Anysphere Audit Logs connector .

BetaData integrationObservabilityDeveloper toolsSource

LakeflowSep 7, 2026

Zerobus Ingest into default storage is now in Public Preview

Ingesting into tables backed by default storage with Zerobus Ingest in Lakeflow Connect is now in Public Preview . See Create or identify the target table .

PreviewData integrationSource

LakeflowAug 24, 2026

Verkada connector (Beta)

The Verkada connector is now available in Lakeflow Connect in Beta . Workspace admins can control access to this feature from the Previews page. The connector ingests organization audit logs and access users from your Verkada organization into Databricks. Authentication uses a Verkada organization API key. See Verkada connector .

BetaData integrationObservabilityDeveloper toolsSource

LakeflowSep 8, 2026

Incremental ingestion for Salesforce formula fields in Lakeflow Connect will soon be generally available

Incremental ingestion for Salesforce formula fields in Lakeflow Connect will soon be generally available. Today, Lakeflow Connect ingests formula fields by taking a full snapshot on each pipeline run by default. When incremental formula field ingestion is generally available, full snapshots will no longer be the default.

GAPricingData integrationPerformanceSource

Also shipped on Aug 31, 2026

Google Cloud BigQueryAug 31, 2026

You can now create, store , and manage pipelines in Git folders

You can now create, store , and manage pipelines in Git folders. This feature is in Preview .

PreviewData integrationSource

Google Cloud BigQueryAug 31, 2026

BigQuery now supports TabFM , Google's pre-trained foundation model for tabular data

BigQuery now supports TabFM , Google's pre-trained foundation model for tabular data. TabFM enables zero-shot regression and classification through in-context learning. It delivers high-accuracy predictions on structured data without requiring model training or hyperparameter tuning.

PreviewSQLGovernancePerformanceSource

Google Cloud BigQueryAug 31, 2026

Using folders to create, store, and manage pipelines is generally available

Using folders to create, store, and manage pipelines is generally available .

GAData integrationSource

Google Cloud BigQueryAug 31, 2026

You can now create an identity column , sometimes referred to as an auto-incrementing column, on a table

You can now create an identity column , sometimes referred to as an auto-incrementing column, on a table. You can use identity columns to create and maintain primary keys on your tables. When you insert a row into a table that has an identity column, BigQuery generates a unique integer value for that column. This feature is in Preview .

PreviewSQLSecuritySource

Google Cloud BigQueryAug 31, 2026

BigQuery Graph is generally available (GA)

BigQuery Graph is generally available (GA). BigQuery Graph now includes support for the CALL graph query statement , and the following path inspection GQL functions : IS_ACYCLIC IS_SIMPLE IS_TRAIL .

GASQLSource

Snowflake Snowflake Native Apps and MarketplaceAug 31, 2026

app.yml for Snowflake App Runtime (Preview)

Snowflake App Runtime projects use a single app.yml file to describe both deployment and the remote build. Include version: 2 at the top of the file. snow app setup writes this file for new projects.

PreviewSource