Imply announces a major open source contribution for Apache Druid, a new financial guarantee for Druid users


BURLINGAME, Calif., September 21, 2022 – Imply, the company founded by the original creators of Apache Druid, unveiled at a virtual event the second stage of Project Shapeshift, the 12-month initiative designed to solve the most pressures developers face when building analytics applications.

This milestone introduces the following:

  • A multi-stage query engine for Apache Druid, representing the largest expansion of Druid’s architecture since its inception.
  • Imply’s Total Value Guarantee, a global guarantee for Apache Druid users that shows how Imply membership is effectively free for qualified participants.
  • Continued momentum for Imply Polaris, the cloud database service built from Apache Druid.

Imply is specifically designed for the intersection of analytics and applications. Increasingly, enterprises are building modern analytics applications that combine analytics on big data with application characteristics including sub-second response, high concurrency, and operational usability. Developers at large enterprises including Atlassian, Reddit, and TrueCar build these apps to support their digital businesses, and Apache Druid with Imply is their database of choice.

“Snowflake is great for analyzing BI reports, and MongoDB is a great transactional database for applications,” said FJ Yang, CEO and co-founder of Imply. “But where analytics meets applications, you need a new kind of database. This is where Apache Druid with Imply comes in.

“There is a great market opportunity for database companies at the intersection of analytics and applications,” said Eric Kavanagh, CEO and co-founder of The Bloor Group. “What excites me about Imply is their particular focus on rewriting the end-to-end process of discovering, building, and deploying next-generation analytics applications.”

After showcasing Project Shapeshift at Druid Summit 2021, Imply launched Polaris at the first milestone event in March. This week, for Stage 2, Imply featured three major announcements that help make Druid even better, accelerate developer success, and improve the Imply Polaris cloud service.

Groundbreaking Apache Druid expansion

One of the sources of Apache Druid’s performance for large-scale interactive analysis is its highly efficient and optimized one-step query engine. A second engine – a multi-step query engine optimized for more complex data flow – was introduced in a private preview by Imply in March. The new engine was designed to radically transform data ingestion and extend querying capabilities.

“We always thought of Druid as a shapeshifter when we originally designed it to support analytics applications of any scale,” said Gian Merlino, CTO and co-founder of the Imply and PMC Chair for Apache Druid. . “Now we’re excited to show the world just how agile it can be with the addition of multi-step queries and SQL-based ingestion.”

This week, Imply announced its contribution to the Apache Druid 24.0 multi-step query engine. In this release, the multi-step query engine enables the following:

  • Simplified and accelerated batch ingestion – Like any database, data must be ingested before it can be used. Now ingesting into Druid uses common SQL queries that benefit from new Druid extensions, making data ingestion easier and up to 65% faster. With many Druid deployments ingesting hundreds of terabytes daily, this saves time and money.
  • SQL-Based Database Transformation – Previously, Druid supported a limited set of table transformation features in the database. Now Druid supports any database transformation without tuning or expertise using SQL, allowing data enhancement, data enrichment, easy experimentation with aggregates, approximations (including hyperloglogs and theta sketches), and more with the same ease of use and performance improvements as SQL-based ingest.
  • Foundation for Broader Ecosystem Support – With the addition of SQL-based ingestion and transformation, Druid has built a foundation for integration with a range of open source and commercial data tools, covering transformation (dbt), integration of data (Informatica, FiveTran, Matillion, Nexla,, data quality (Great Expectations, Monte Carlo, Bigeye) and others.

Imply Total Value Guarantee for Apache Druid Users

Imply offers a complete development experience for Druid through its commercial distribution, cloud services and expertise. With Imply, developers can save time on database management and save money on infrastructure, where time and money contribute to total cost of ownership (TCO). Paytm, for example, saved an additional 12 engineering hours per week and reduced infrastructure costs by 50% with Imply.

Imply enables Apache Druid users to efficiently get the full value of partnering with Imply for free and lower their total cost of ownership for Druid. Imply introduces the Total Value Guarantee for qualified participants which guarantees that the total cost of ownership (TCO) to run Druid with Imply – measured across software, support and infrastructure – will be lower than the TCO while running of Apache Druid by themselves.

“At Imply, we love creating and using open source software, but having a partner can also be helpful,” said Vadim Ogievetsky, CXO and co-founder of Imply. “Now, with Imply’s Total Value Guarantee, developers can get a partner for Druid who will help them get the full benefits of Imply’s products and services and be there in the middle of the night when needed, with Imply efficiently. free. “

Follow Imply Polaris Momentum

Imply Polaris, a database as a service built from Apache Druid, was introduced in March. This cloud database was designed to do more than cloudify Druid; it also optimizes data operations and provides end-to-end service, from feed ingestion to data visualization. In five months, Polaris added over 250 accounts, representing companies in a wide range of industries.

“As the market leader in weather information and data solutions and with a global audience of over 50 million consumers, we are committed to providing advertisers with the information they need to optimize their campaigns on our platforms, while remaining committed to protecting the privacy of our users,” said Radu Nicolae, technical product manager for Pelmorex’s DSP. “With Imply Polaris as our internal analytics powerhouse, we can track changes in traffic and allow our operations team to adjust strategies in real time.As a cloud database service, Polaris was the fastest, most affordable and secure way to build our Apache Druid-based service .

This week, Imply announced a series of product updates for Polaris that improve the developer experience, including:

  • More flexible data ingestion – Polaris adds support for schemaless ingestion to support nested columns, allowing arbitrary nesting of typed data such as JSON or Avro. DataSketches are now supported on ingest for faster approximate queries in less than a second.
  • Easier Polaris operations – Polaris adds performance monitoring alerts to ensure consistent performance for ultra-low latency queries and greater security with resource-based access control and row-level security. Finally, updates to Polaris’ built-in visualization allow for faster slicing and dicing.
  • More flexible pricing – Polaris adds new node types to flexibly meet any price/performance requirement at any scale. Comprehensive new consumption and billing metrics have been added for instant usage visibility.

About Imply

At Imply, we’re on a mission to help developers become the new heroes of analytics. Powered by Apache Druid, Imply’s real-time analytics database is designed for the intersection of analytics and applications. With Imply, developers can build analytics applications that deliver interactive data experiences on real-time and historical data with unlimited scale and at the best price. Backed by leading investors including Thoma Bravo, a16z and Bessemer Venture Partners, Imply is on a rapid growth trajectory – disrupting the $100 billion database market – with clients including Atlassian, Reddit and TrueCar.

Source: Involve


Comments are closed.