For a few years there, the term “private cloud” had a negative connotation. But as we know, technology is more a wheel than an arrow, and right on cue, the private cloud is getting a ton of attention — it’s all positive. The statistics are clear: Forrester’s 2023 Infrastructure Cloud Survey had 79% of the […]
Is Your Architecture a Marvel or a Disaster? Two of my favorite streaming shows are Engineering Marvels and Engineering Disasters. Engineering Marvels “reveals the extraordinary feats of engineering inside the world’s most spectacular man-made constructions.” Each episode identifies significant challenges and showcases how innovative engineering design and execution overcame them. Engineering Disasters takes the opposite tack, with each […]
By Nik Acheson, Field Chief Data Officer at Dremio In the world of sports, few moments capture the core of false starts better than Usain Bolt’s shocking disqualification at the 2011 World Championships. Bolt’s premature launch in the 100 meters final led to his immediate removal from the race – reminding us that false starts, […]
Data catalogs and metadata catalogs share some similarities, particularly in their nearly identical names. And while they have some common functions, there are also important differences between the two entities that big data practitioners should know about. Metadata catalogs, which are sometimes called metastores or technical data catalogs, have been in the news lately. If […]
While each of the new features adds value for SingleStore customers, the integration with Apache Iceberg stands out, according to Kevin Petrie, an analyst at BARC U.S. Apache Iceberg is now the preferred table storage format for many enterprises, and many of SingleStore’s competitors already support the open source platform. “The announcement enables SingleStore to […]
Organizations often struggle to manage cloud spending due to a historical focus on innovation and scale over cost, says Nik Acheson, field chief data officer at Dremio. Cloud spending has increasingly become a complicated web that organizations struggle to untangle. Forty-nine percent of cloud-based businesses cannot manage their cloud expenses, and 44% say that at […]
If you’re a supporter of open data, it’s hard not to feel good about last week’s news around Apache Iceberg. Customers demanded an open storage format, and the two leading providers, Snowflake and Databricks, are delivering it, in a big way. To recap: Databricks surprised the big data community last Tuesday by throwing its weight behind Apache Iceberg with […]
Solutions Review Executive Editor Tim King curated this list of notable data management news for the week of June 7, 2024. Keeping tabs on all the most relevant big data and data management news can be a time-consuming task. As a result, our editorial team aims to provide a summary of the top headlines from […]
The big data community gained clarity on the future of data lakehouses earlier this week as a result of Snowflake’s open sourcing of its new Polaris metadata catalog and Databricks’ acquisition of Tabular. The actions cemented Apache Iceberg as the winner of the battle of open table formats, which is a big win for customers […]
Today, Snowflake kicked off its annual data cloud summit with the launch of Polaris Catalog, a new, open data catalog implementation for indexing and organizing data conforming to the Apache Iceberg table format. Available in both self and Snowflake-hosted options, the catalog will be open-sourced over the next 90 days and interoperate with other query engines enterprises […]
On the first day of its Data Cloud Summit today, Snowflake unveiled Polaris, a new data catalog for data stored in the Apache Iceberg format. In addition to contributing Polaris to the open source community, the catalog also enables Snowflake customers to use open compute engines with their Iceberg-based Snowflake data, including Apache Spark, Apache […]
Industry leaders share their insights into the future of GenAI applications. Here is a look at some of the opportunities they find that organizations are investing in now. RTInsights attended the Gartner Data & Analytics Summit 2024 to hear about the most recent research the firm had done, the insights and recommendations it had distilled […]
These 10 capabilities that can be found in the modern data lake reference architecture, along with vendor tools and libraries for each one. 2. OTF-Based Data Warehouse Object storage is also the underlying storage solution for an OTF-Bbased data warehouse. Using object storage for a data warehouse may sound odd, but a data warehouse built […]
Snowflake says it will open up the source code to its new Polaris Catalog, a strategy that suggests it wants to lure data catalog users away from rival Databricks’ Unity Catalog while bolstering the attractiveness of its own offering, analysts said. “The move to launch Polaris Catalog provides a competitive response to Databricks’s Unity Catalog, thereby […]
Snowflake Inc. is expanding its support for the Apache Iceberg open-source table format with today’s announcement of Polaris Catalog, described as a vendor-neutral, open catalog implementation for Iceberg and other data architectures. Polaris is intended to provide centralized, cross-engine access to data. Snowflake said the catalog, which will be released to open source within the next […]
