Amazon adds Iceberg to make S3 a more functional data lake

December 10, 2024

Amazon has added an Iceberg table bucket type to S3 along with S3 Metadata to create an S3 analytics data lake capability competing with Databricks, Dremio, SingleStore and other Iceberg-using data lake suppliers, as well as Iceberg-supporting object storage suppliers

The new S3 Tablesa bucket type and S3 Metadata were announced at the recent re:Invent conference. The announcement involves Apache Iceberg and Parquet and is a means of accelerating datalake activities with “up to 3x faster query performance, up to 10x higher transactions per second (TPS), and automated table maintenance and automation for analytics workloads.” This is in comparison to general S3 buckets.

Read the full article, via Blocks & Files.

get started

Get Started Free

No time limit - totally free - just the way you like it.

Sign Up Now
demo on demand

See Dremio in Action

Not ready to get started today? See the platform in action.

Watch Demo
talk expert

Talk to an Expert

Not sure where to start? Get your questions answered fast.

Contact Us

Ready to Get Started?

Enable the business to create and consume data products powered by Apache Iceberg, accelerating AI and analytics initiatives and dramatically reducing costs.