Amazon has added an Iceberg table bucket type to S3 along with S3 Metadata to create an S3 analytics data lake capability competing with Databricks, Dremio, SingleStore and other Iceberg-using data lake suppliers, as well as Iceberg-supporting object storage suppliers
The new S3 Tablesa bucket type and S3 Metadata were announced at the recent re:Invent conference. The announcement involves Apache Iceberg and Parquet and is a means of accelerating datalake activities with “up to 3x faster query performance, up to 10x higher transactions per second (TPS), and automated table maintenance and automation for analytics workloads.” This is in comparison to general S3 buckets.
Read the full article, via Blocks & Files.