Now provides bi-directional integration with Iceberg, sooner vector search, enhanced full-text search, autoscaling and a “carry your personal cloud” deployment
SingleStore, the real-time knowledge platform so that you can transact, analyze and contextualize, introduced a bi-directional integration with Apache Iceberg that opens up a world of alternatives for constructing clever purposes on knowledge lakehouses. This integration addresses the important problem confronted by enterprises the place an estimated 90% of information stays “frozen” in lakehouses and is unusable for powering interactive purposes, analytics or AI.
Apache Iceberg is the de facto normal for knowledge lakes for storing large datasets, providing value effectivity for querying large-scale datasets. Nevertheless, enterprises battle to leverage this knowledge as a consequence of advanced, pricey processes required to ‘thaw’ it, together with in depth ETL workflows and compute-intensive Spark jobs.
SingleStore’s new integration is meant to unravel exactly that, offering low-latency ingestion, bi-directional knowledge circulation and real-time software efficiency at decrease prices for contemporary clever purposes and analytics. This providing is offered in public preview at this time and prospects will quickly be capable of create exterior tables in SingleStore based mostly on Iceberg knowledge, construct projections on these tables and make the most of the velocity and efficiency of SingleStore on frozen knowledge.
SingleStore’s prospects, lots of whom use Apache Iceberg for his or her knowledge lakes and business lakehouses, have expressed a robust curiosity in an answer that allows quick interactive purposes and low-latency analytics utilizing their huge, untapped Iceberg knowledge.
“Our imaginative and prescient has all the time been to offer one single knowledge retailer for all firms to have the ability to make the most of velocity, scale and ease,” stated Raj Verma, CEO, SingleStore. “Our knowledge platform is designed to unlock all sorts of enterprise knowledge — together with knowledge that’s frozen in knowledge lakes — to allow our prospects to construct trendy clever apps. With this launch, we imagine we’re enabling a good portion of the market that at this time can’t construct real-time trendy purposes on knowledge saved in knowledge lakes.”
Other than the Iceberg integration, SingleStore additionally introduced a slew of different new options and product enhancements that allow constructing enterprise-grade clever purposes, together with:
● Quicker vector search. Vector search with HNSW is 40% sooner in comparison with the sooner launch. SingleStore’s IVF Flat index is demonstrated to be between 47 to 100x sooner than pgvector, and vector index construct occasions are actually 2-3x sooner than Milvus and pgvector. Further vector search options embody vary searches and filters (in public preview) to assist enterprises simply construct and scale generative AI purposes.
● Enhanced full-text search. SingleStore has supported full-text seek for plenty of years. With its June 2024 launch, the corporate is asserting the overall availability of sturdy new capabilities in full-text search together with improved relevance scoring, phonetic similarity, fuzzy matching and keyword-proximity-based rating. All this implies organizations can now simplify their knowledge architectures by eliminating the necessity for added specialty databases to construct generative AI and real-time purposes.
● Autoscaling. With compute workspaces and a distributed structure, SingleStore is a extremely scalable knowledge platform. With Autoscaling in its newest launch (in public preview) prospects guarantee software efficiency by scaling compute sources up or down routinely in seconds to regulate to unpredictable workloads — whereas avoiding billing surprises.
● Helios® — Deliver Your Personal Cloud (BYOC) deployment. For a lot of prospects, their knowledge has to stay in their very own digital personal cloud (VPC), below their very own safety and governance insurance policies due to regulatory necessities or contractual obligations. In these instances prospects needed to deploy SingleStore in a self-managed mannequin, managing operations themselves. With this announcement, SingleStore is introducing a fully-managed cloud providing (Helios — BYOC), that lets prospects benefit from the ease of administration and elastic scalability of the platform, however inside their very own digital personal cloud. This providing is now obtainable in personal preview in AWS, and prospects can run SingleStore in their very own tenants whereas complying with knowledge residency and governance insurance policies.
“SingleStore’s knowledge platform is indispensable for analyzing our knowledge and delivering real-time insights to our prospects,” stated Mauricio Aristizabal, Principal Knowledge Architect, influence.com, and Founder, Giist Social. “This newest replace continues to push the boundaries of what we will accomplish by harnessing all of our enterprise knowledge in actual time. We’re wanting ahead to leveraging the newest cutting-edge options to proceed rising our and our purchasers’ enterprise.”
“Our new options and capabilities advance SingleStore’s mission of providing a real-time knowledge platform for the subsequent wave of generative AI and knowledge purposes,” stated Nadeem Asghar, Head of Engineering at SingleStore. “The combination with Iceberg, plus enhancing our platform’s scaling and processing capabilities will enable customers to entry and harness their knowledge in actual time, and construct clever apps.”
SingleStore stays on the forefront of generative AI innovation. The corporate’s product innovation has led to high-momentum progress in prospects, pushing it to surpass $100M in ARR on the finish of 2023. SingleStore was acknowledged with 5 2024 TrustRadius Prime Rated Awards, essentially the most the corporate has ever gained in a single yr. 4 awards had been gained for the third consecutive yr, whereas the popularity within the Vector Database class was a primary.
Join the free insideAI Information newsletter.
Be a part of us on Twitter: https://twitter.com/InsideBigData1
Be a part of us on LinkedIn: https://www.linkedin.com/company/insidebigdata/
Be a part of us on Fb: https://www.facebook.com/insideBIGDATANOW