Tech | Visa | Scholarship/School | Info Place

Redpanda acquires Benthos to expand its end-to-end streaming data platform

Redpanda, a well-funded Kafka-compatible streaming data platform that competes with the likes of Confluent, announced on Thursday that it has acquired open source stream processing platform Benthos.

The companies did not disclose the acquisition price, but it is worth noting that Redpanda is in a position to make such a move now that it raised $150 million in Series C funding a year ago. This is Redpanda’s second acquisition following its 2022 purchase of CloudHut, which built a web-based user interface for its streaming data platform.

Benthos helps enterprises with common data engineering tasks, such as setting up pipelines to connect more than 200 data sources and services, and in the process transforming and filtering their data streams to power real-time applications. One of the company’s most recent product launches is Benthos Studio, a low-code interface for building data pipelines and transformations.

Image Source: Red Panda

Redpanda CEO Alexander Gallego told me that the acquisition makes Redpanda’s platform even more complete. “What Benthos does for us is create the most complete end-to-end streaming platform for data-intensive applications,” he said. “Benthos and Redpanda are the only products that can be deployed from an edge device from a technical perspective. […] All the way to the largest cloud workloads.” That’s because Benthos is delivered as a single binary that can run on low-power devices with only a few megabytes of memory to the most powerful servers. “No matter how you choose to use it, it’s the same software stack end-to-end.”

Gallegos noted that nearly a third of Redpanda users were already Benthos users, and he said he had known Benthos founder Ashley Jeffs for about five years. The fact that Benthos, like much of the Redpanda platform, is written in Go also helped seal the deal because it makes integrating the service much easier. He also stressed that trying to build a product like Benthos from scratch would be a daunting task for any company; Redpanda decided to acquire Benthos thanks to a recent funding round.

In fact, Redpanda has integrated Benthos into its own services and uses it as the core technology for the new Redpanda Connect service. Redpanda Connect will come with 220 pre-built connectors to help engineers quickly build streaming in data transformation pipelines. Redpanda Connect — like Benthos — is open source and available from the Redpanda GitHub repo (except for the two connectors mentioned above).

One of the reference customers for Redpanda’s new service is Zafin, which helps banks modernize their data platforms. “The core of Zafin IO is based on Redpanda’s streaming ETL capabilities,” said Shahir Daya, CTO of Zafin. “With Redpanda’s acquisition of Benthos, Redpanda Connect will enable Zafin IO to efficiently extract data from various systems without any unnecessary hops, process the data in real time, and deliver it to the target system, whether it’s the Zafin platform or other modern systems.”

It’s also worth noting that now more than in recent years, businesses are trying to consolidate where they spend money, so being able to offer an end-to-end platform is an advantage in today’s market, as point solutions often struggle to gain traction.

Existing Benthos users and customers won’t see any immediate changes to their existing workflows, but Gallegos did highlight that Redpanda is turning its previously open-source Snowflake and Splunk API integrations into paid services (existing open-source integrations will continue to work but won’t get updates from Redpanda going forward). “All of the users who use those services are used to paying for integrations with those services,” Gallegos told me. “So these are the only two services we’re launching that are enterprise-only.”

All of this is about AI. Gallegos explained that many Redpanda customers struggled because AI APIs were expensive. But going forward, Redpanda will offer a service that buffers events to measure usage of external APIs. “We’re going to build a portfolio of connections for the most popular AI API platforms, but not get you above average. That logic tends to be very cumbersome and very specific to each API,” he said.

#Redpanda #acquires #Benthos #expand #endtoend #streaming #data #platform

Leave a Reply

Your email address will not be published. Required fields are marked *