Dremio is always striving to abstract away the physical concerns of data, whether the storage location, partitioning schema, or file size optimisation. Thanks to features such as Data Federation, Iceberg Clustering, and Autonomous Performance functionalities, Dremio users get highly-performant access to their data no matter where it lives. One of the components that delivers this […]
Caching dramatically reduces latency and computational costs by storing frequently accessed data closer to where it’s needed. Instead of repeated expensive operations – such as fetching from object storage, planning complex queries, or executing SQL – the data you need is provided in fast, local memory. To deliver on this, Dremio implements different layers of […]
Agentic AI is an artificial intelligence system that is designed to operate autonomously. With minimal human supervision it can be expected to make decisions and perform tasks with specifically trained agents. This is thanks in large part to Large Language Models (LLMs) which provide agentic AI with enhanced reasoning and the ability to understand context. […]
Reflections are a query acceleration functionality unique to Dremio, that work by minimising data processing times and reducing computational workloads. Debuting in the early days of Dremio, Reflections accelerate data lake queries by creating optimised Apache Iceberg data structures from file-based datasets, delivering orders-of-magnitude performance improvements. However, the game-changing aspect of this technology was not […]
A promise of self-service data platforms, such as the Data Lakehouse, is to democratise data. The idea is that they empower business users (BUs), those with little or no technical expertise, to access, prep, and analyse data for themselves. With the right platform and tools your subject matter experts can take work away from your […]
At the time of writing this blog, pulsemcp has over 5,000 MCP servers registered and available to download. These servers provide LLMs the tools to control diverse software and applications – from online shopping and web scrapers to music streaming, cloud infrastructure, and image generation. The list goes on and on. MCP is evidently finding […]
Back in April of this year Dremio debuted its own MCP server, giving the LLM of your choice intelligent access to Dremio’s powerful lakehouse platform. With the Dremio MCP Server the LLM knows how to interact with Dremio; facilitating authentication, executing requests against the Dremio environment, and returning results to the LLM. The intention is […]
Join the Dremio/dbt community by joining the dbt slack community and joining the #db-dremio channel to meet other dremio-dbt users and seek support. The data management strategy of the data lakehouse is to combine the key strengths of data lakes and data warehouses into one, unified platform. From data lakes it utilises low-cost and scalable […]
Join the Dremio/dbt community by joining the dbt slack community and joining the #db-dremio channel to meet other dremio-dbt users and seek support. Documentation is a critical component of any product, from food to furniture to software. Whether you are looking at a t-shirt or a supermarket chicken it will come with something explaining what […]
Join the Dremio/dbt community by joining the dbt slack community and joining the #db-dremio channel to meet other dremio-dbt users and seek support. A major data trend in 2024, and carrying on into this year, was the move to self-service analytics. According to our recent survey of IT and data decision-makers, 80% of companies we […]
Join the Dremio/dbt community by joining the dbt slack community and joining the #db-dremio channel to meet other dremio-dbt users and seek support. The boom in AI witnessed both in the performance of available models and in the appetite of businesses in utilising them has been unprecedented in the last couple of years. There are […]
