Skip to content

Lakeflow Release notes from Databricks

65 releases ยท 13 this month

RSS

Every Lakeflow release

DateRelease
Sep 22Variant shredding will soon be enabled by default on new Variant tablesunverified
LakeflowUpdate
Sep 22Shopify connector (Beta)
Sep 14JAR tasks on serverless compute will soon be available for workspaces with the compliance security profile enabled
LakeflowUpdate
Sep 11Session restore for serverless jobs is in Public Preview
LakeflowPreview
Sep 11Standard performance mode is now available for one-time runs in the Jobs API
LakeflowUpdate
Sep 10Maintenance windows for continuous pipelines
LakeflowUpdate
Sep 10Managed tables in Lakeflow pipelines (Beta)
Sep 9Anaplan connector (Beta)
Sep 9Anysphere Organization connector (Beta)
Sep 9Celigo connector (Beta)
Sep 8Incremental ingestion for Salesforce formula fields in Lakeflow Connect will soon be generally available
Sep 7Zerobus Ingest into default storage is now in Public Preview
LakeflowPreview
Sep 1Apache Arrow support for Zerobus Ingest is now generally available
Aug 31Pipeline events system table is in Beta
Aug 27Atlassian Audit Logs connector (Beta)
Aug 27Lakeflow Designer August Release
LakeflowPreview
Aug 26Zerobus Ingest into streaming tables is now generally available
Aug 25Anysphere Audit Logs connector (Beta)
Aug 24Verkada connector (Beta)
Aug 21Default Python package repositories are GA for Lakeflow pipelines and classic compute
Aug 20Performance mode now applies to materialized view and streaming table refreshes from dbt tasks
LakeflowUpdate
Aug 20Salesforce connector mTLS authentication is now generally available
Aug 17Session restore for serverless jobs is now in Beta
Aug 14Workiva connector (Beta)
Aug 13Gmail connector in Lakeflow Connect (Beta)
Aug 13SQL alert task in Lakeflow Jobs is now available by default for workspaces with the compliance security profile enabled
LakeflowUpdate
Aug 13SendGrid connector (Beta)
Aug 12Amplitude connector (Beta)
Aug 12Glean connector in Lakeflow Connect (Beta)
Aug 12Google Search Console connector is available in Beta
Aug 11REPLACE USING flows for standalone streaming tables (Beta)
Aug 10Notion connector (Beta)
Aug 10Orchestrate continuous pipelines with continuous jobs
LakeflowUpdate
Aug 7Change data feed on materialized views (Beta)
Aug 6JAR tasks on serverless compute are now generally available
Aug 6Zerobus Ingest is now enabled by default for workspaces with the compliance security profile
LakeflowUpdate
Aug 5REPLACE USING flows for pipelines (Beta)
Aug 4Google Drive connector (GA)
Aug 4NetSuite connector (GA)
Aug 4PagerDuty connector (Beta)
Aug 4SharePoint connector (GA)
Aug 3Refresh materialized views and streaming tables without exempting the pipeline owner from ABAC policies
LakeflowUpdate
Aug 3Automatic cost attribution for materialized views and streaming tables in Databricks SQL
LakeflowUpdate
Aug 3Environment variables for serverless jobs are in Beta
Jul 31OpenAI connector (Beta)
Jul 26Unit testing for pipelines (Beta)
Jul 24Lakeflow Designer Summer Release
LakeflowUpdate
Jul 23C++ SDK for the Zerobus Ingest connector is now available in Beta
Jul 22Lakeflow Designer support for compliance security profile standards
LakeflowUpdate
Jul 22Override the REPLACE WHERE predicate for a single refresh
LakeflowUpdate
Jul 21Reddit Ads connector is now available in Beta
Jul 17Anthropic managed ingestion connector (Beta)
Jul 14Query-based connectors in Lakeflow Connect will soon be available by default for workspaces with the compliance security profile enabled
LakeflowUpdate
Jul 9Strac connector (Beta)
Jul 9Change to default pipeline editor for workspaces with the compliance security profile enabled
Jul 8Behavior changes for continuous jobs and pipelines
LakeflowUpdate
Jul 7Excel file format support is now available by default
LakeflowUpdate
Jul 7REPLACE WHERE flows are now generally available
Jul 6Standard performance mode is now supported for materialized view or streaming table refreshes in jobs
LakeflowUpdate
Jul 2Lakeflow Connect row filtering is now generally available

Summaries of vendors' own notes. Product names and logos belong to their owners; logos via logo.dev.

Other Databricks products

Weekly: the week's data and AI releases, Tuesday mornings.