Data integration has been solved in countless different ways and is constantly being reinvented from scratch at thousands of companies around the globe. While many sectors of technology have made massive strides in simplifying and democratizing their fundamental tasks, moving data from one place to another has somehow taken longer to arrive to the data engineering community.
In this talk, Abhi Vaidyanatha will describe the benefits to the open-source ETL approach, the frameworks that need to be put in place to take advantage of it, and what the future holds for data integration itself
Many agencies today are struggling not only with managing the scale and complexity of cyber data but also with extracting actionable insights from that data. With new data retention regulations, such as M-21-31, compounding this problem further, agencies need a next-generation solution to address these challenges.
read more
