Introducing InfluxDB IOx, a Federated In-Memory Columnar Store Backed by Object Storage
This talk introduces InfluxDB IOx, the future open source core of the InfluxDB time series database. Written in Rust with Apache Arrow, InfluxDB IOx is an in-memory columnar store that uses Parquet files in object storage for persistence. It includes built-in functionality for defining replication and flexible cluster topologies with total operator control over partitioning and replication scheduling. This talk will introduce the architecture and concepts behind InfluxDB IOx. We’ll talk about the technology choices, Arrow and Parquet and the API of the project.
Paul Dix is the creator of InfluxDB and the CTO and founder of InfluxData. He has helped build software for startups, large companies and organizations like Microsoft, Google, McAfee, Thomson Reuters and Air Force Space Command. He is the series editor for Addison Wesley’s Data & Analytics book and video series. In 2010 Paul wrote the book Service-Oriented Design with Ruby and Rails for Addison Wesley. In 2009 he started the NYC Machine Learning Meetup, which now has over 13,000 members. Paul holds a degree in computer science from Columbia University.
Ready to Get Started? Here Are Some Resources to Help
What Is a Data Lakehouse?
The data lakehouse is a new architecture that combines the best parts of data lakes and data warehouses. Learn more about the data lakehouse and its key advantages.read more
Simplifying Data Mesh for Self-Service Analytics on an Open Data Lakehouse
The adoption of data mesh as a decentralized data management approach has become popular in recent years, helping teams overcome challenges associated with centralized data architecture.read more