Delta Lake Blogs

Rivian expands the Delta Lake ecosystem with Delta-Go

By Chelsea Jones , Rahul Madnawat , Jason Shiverick

Real-time data ingestion for high-volume transactions, now available in open source

Pros and cons of Hive-style partitioning

By Matthew Powers , Martin Bode

This post discusses the pros and cons of Hive-style partioning.

Structured Spark Streaming with Delta Lake: A Comprehensive Guide

By Delta Lake

The webinar demonstrates how to embrace structured streaming seamlessly from data emission to your final Delta table destination.

High-Performance Querying on Massive Delta Lake Tables with Daft

By Clark Zinzow , Jay Chia

This post introduces the distributed + parallel Delta Lake reader in Daft.

Delta Lake - State of the Project - Part 2

By Tathagata Das , Susan Pierce , Carly Akerly

Delta Lake, a project hosted under The Linux Foundation, has been growing by leaps and bounds. To celebrate the achievements of the project, we’re publishing a 2-part series on Delta Lake.

Delta Lake Announces Pandas Enhancement: Real Pandas to Optimize Data Lakehouse Performance

By Carly Akerly

The Delta Lake project is thrilled to announce its latest and most exciting collaboration with the Pandas community!

Delta Lake - State of the Project - Part 1

By Tathagata Das , Susan Pierce , Carly Akerly

Delta Lake, a project hosted under The Linux Foundation, has been growing by leaps and bounds. To celebrate the achievements of the project, we’re publishing a 2-part series on Delta Lake.

Delta Lake 3.1.0

By Carly Akerly

This post describes the exiting features in the Delta Lake 3.1.0 release

Delta Lake replaceWhere

By Matthew Powers

Selectively overriding rows or partitions of a Delta Lake table with replaceWhere.

Delta Lake Performance

By Joe Harris

This post shows explains why Delta Lake is fast and describes improvements to Delta Lake performance over time.

Writing a Kafka Stream to Delta Lake with Spark Structured Streaming

By Bo Gao , Matthew Powers

This blog post explains how to write a Kafka stream to a Delta table with Spark Structured Streaming.

Using Delta Lake with AWS Glue

By Keerthi Josyula , Matthew Powers

This post shows how to register Delta tables in the AWS Glue Data Catalog with the AWS Glue Crawler.