In this article, Tomer Shiran - Dremio CEO and two other industry experts, predict how data ingestion, analytics, AI, and machine learning will grow and change in 2020.
We would like to share this bit:
“Traditional operational microservices have been designed and optimized for processing small numbers of records, primarily due to bandwidth constraints with existing protocols and transports. But now this long-standing bottleneck issue has been solved with the arrival of Apache Arrow Flight, which provides a high performance, massively parallel protocol for big data transfer across different applications and platforms. We predict that in 2020 Arrow Flight will unleash a new category of data microservices focused on bulk analytical operations with high volumes of records, and in turn, these data microservices will enable loosely coupled analytical architectures that can evolve much faster than traditional monolithic analytical architectures.”
