Adopted by Snowflake, Google and Cloudera, we look at why the Netflix-developed table format is important
FEATURE By 2015, Netflix had completed its move from an on-premises data warehouse and analytics stack to one based around AWS S3 object storage. But the environment soon began to hit some snags.
"Let me tell you a little bit about Hive tables and our love/hate relationship with them," said Ted Gooch, former database architect at the streaming service.
While there were some good things about Hive, there were also some performance-based issues and "some very surprising behaviors."
"Because it's not a heterogeneous format or a format that's well defined, different engines supported things in different ways," Gooch – now a software engineer at Stripe and an Iceberg committer – said in an online video posted by data lake company Dremio.
Read the full story here.
