Sep 22, 2024

Real-time Analytics News for the Week Ending September 21 In this week’s real-time analytics news: The New Jersey Institute of Technology (NJIT) will establish the Grace Hopper AI Research Institute to advance the university’s expertise in AI. Keeping pace with news and developments in the real-time analytics and AI market can be a daunting task. Fortunately, we have you covered with a summary of the items our staff comes across each week. And if you prefer it in your inbox,  sign up here ! The New Jersey Institute of Technology  (NJIT) announced that it is launching a new $10+ million initiative that will significantly advance the university’s strength in the field of artificial intelligence (AI) and position NJIT to become a leader in both AI research and application in higher education. This augments already significant existing academic and research activity in AI and related programs. As part of the new investment, NJIT will establish the Grace Hopper AI Research Institute with support from an anonymous donor and matching funds that total $6 million. The new institute will include existing initiatives, such as the  Center for AI Research  and the  Institute for Data Science . Through collaboration with the New Jersey Innovation Institute, an NJIT corporation, the Grace Hopper AI Research Institute will also form partnerships with healthcare, defense, finance, and manufacturing industries, creating AI solutions for real-world challenges. The  Linux Foundation  announced the release of Valkey 8.0, the newest version of the open-source, in-memory, NoSQL data store. Valkey 8.0 offers significant updates designed to boost performance, reliability, and observability for all installations. Key highlights of the release include: Intelligent multi-core utilization and asynchronous I/O threading improves throughput up to 1.2 million requests per second on AWS r7g instances, over 3x higher than the previous version. Improved cluster scaling with automatic failover for new shards and replicated migration states. Faster replication with dual-channel RDB and replica backlog streaming. Comprehensive per-slot and per-client metrics. Up to 10% reduced memory overhead through optimized key storage. In other news, the Linux Foundation announced the launch of the OpenSearch Software Foundation, a community-driven initiative that will support OpenSearch and its search software, which is used by developers around the world to build search, analytics, observability, and vector database applications. Hosted by the Linux Foundation, the OpenSearch Software Foundation will work with community maintainers and developers, as well as founding member organizations, to support the continued growth of OpenSearch. Other real-time analytics news in brief Confluent  introduced new capabilities to Confluent Cloud to make stream processing and data streaming more accessible and secure. Confluent’s new support of Table API makes Apache Flink available to Java and Python developers; Confluent’s private networking for Flink provides enterprise-level protection for use cases with sensitive data; Confluent Extension for Visual Studio Code accelerates the development of real-time use cases; and Client-Side Field Level Encryption encrypts sensitive data for stronger security and privacy. In other Confluent news, the company announced the Confluent OEM Program. The new program for managed service providers (MSPs), cloud service providers (CSPs), and independent software vendors (ISVs) makes it easy to launch and enhance customer offerings with a complete data streaming platform for Apache Kafka and Apache Flink. The Confluent OEM Program alleviates the burdens of self-managing open-source technologies while going beyond just Kafka and Flink. MSPs and CSPs can easily deliver a complete data streaming platform through Confluent, providing a hassle-free solution for unlocking more customer projects across AI, real-time analytics, application modernization, and more. Anaconda announced the general availability of Python in Excel. This integration with Microsoft Excel allows users to run Python code securely and directly within Excel’s grid, requiring no separate Python installation. With the solution, Excel users can use Python’s advanced capabilities for data manipulation, statistical analysis, and data visualization without leaving their familiar spreadsheet environment. Camunda announced that it is delivering an integration with SAP to tame complexity and increase flexibility for SAP environments. The integration will help SAP users seamlessly orchestrate SAP workflows across all of their people, systems, and devices. Using Camunda’s SAP integration, teams will be able to boost business and IT alignment to increase agility, accelerate development, and reduce risk in SAP S/4HANA migrations. Copado announced the Copado AI platform encompassing a suite of AI-powered DevOps agents. Trained on over a decade of Salesforce expertise, these “super agents” amplify human potential, enabling every contributor to operate at their highest level by automating routine tasks and elevating strategic work. Covering every stage of the DevOps process, Copado AI empowers organizations to streamline, automate, and accelerate the DevOps process for business applications, driving productivity, efficiency, and quality. Cube announced that its universal semantic layer, Cube Cloud, now more deeply integrates with Google Cloud Platform (GCP) and Google Workspace, bringing a single source of truth to BI and analytics programs built on the Google ecosystem. With this new integration, companies can deploy on their platform of choice and extend the benefits of the universal semantic layer by allowing anyone to connect to and reuse trusted data assets and perform live queries on governed data with Google Sheets—no exports needed. DataOps.live announced the immediate availability of its new range of AIOps capabilities, a set of features that provides end-to-end lifecycle management of AI workloads from development to production. Centered around Snowflake Cortex and AWS Bedrock, these latest AIOps capabilities enable data engineers, data product owners, and data scientists to easily and quickly build and operationalize AI-driven data products with unparalleled consistency, scalability, and governance. Datorios launched the Datorios Lineage Analyzer for Apache Flink. Lineage Analyzer provides streaming data infrastructure operators with deeper, more complete insights into the performance of data processing pipelines that drive real-time business operations and real-time AI. Lineage Analyzer also offers a comprehensive suite of features aimed at helping developers trace data across their pipelines, monitor transformations, and identify where data changes occur. Firebolt  announced a next-generation Cloud Data Warehouse (CDW) that delivers low latency analytics with drastic efficiency gains. Firebolt is designed to meet the high demands of modern data workloads. With the solution, data engineers can now deliver customer-facing analytics and data-intensive applications (data apps) more cost-effectively and with greater simplicity. Fivetran announced Hybrid Deployment, a new solution that allows customers to securely run data pipelines within their own environment from the Fivetran-managed platform. The solution provides a single control plane to manage all data sources, whether cloud-based SaaS apps or legacy databases, with data that needs to be tightly controlled and managed for regulatory or compliance purposes. IBM announced the acquisition of Kubecost , a Kubernetes cost monitoring and optimization software company. Kubecost delivers real-time cost visibility and insights needed to not only understand infrastructure spend but intelligently reduce spend and avoid over-provisioning within Kubernetes environments. With direct integrations into the Kubernetes and cloud billing APIs, FinOps teams can get a comprehensive view of their workloads to optimize cloud spend and prevent resource-based outages. Opendatasoft announced a partnership with  Databricks to help organizations maximize value from their data programs. As a validated Databricks Technical Partner, Opendatasoft has developed an integration connector to enable its customers to seamlessly access and reuse data assets on the Databricks Data Intelligence Platform through their data portals. This increases efficiency, offers new experiences for end users, and helps drive data democratization by ensuring self-service access to data for all through an intuitive, eCommerce-style interface. Percona announced that its new database platform, Percona Everest, is now generally available to the public. Percona Everest simplifies database management and enables database deployment standardization across multiple clouds and environments. It is an open-source, cloud-native database platform designed to deliver similar core capabilities and conveniences provided by database-as-a-service (DBaaS) offerings but without the burden of vendor lock-in and associated challenges. Salesforce  and  Google Cloud announced an expanded partnership to create Salesforce Agentforce Agents that help people collaborate securely across Salesforce Customer 360 and Google Workspace apps. Salesforce’s launch of Agentforce extends the existing bidirectional integrations between Salesforce and Google Workspace, allowing mutual customers to easily deploy autonomous agents that can take action and work seamlessly in the apps they use every day, all backed by robust privacy and user data protections already in place across Salesforce and Google Workspace. Sigma announced several new features aimed at providing data engineers, data curators, and business leaders with greater flexibility to run their analysis—within guardrails for consistency in results. The new features provide a structured, high-level representation of business data and its relationships, which helps bridge the gap between complex data sources and data science work with business end users. SingleStore announced its availability as a Snowflake Native App on  Snowflake Marketplace . To make this possible, SingleStore has also developed a bi-directional Iceberg integration to share data with Snowflake, allowing Snowflake users to safely deploy a SingleStore cluster within their Snowflake accounts without having to move or copy data outside of the Snowflake governance boundary. Additionally, customers will be able to use Snowflake credits to pay for the compute to run their SingleStore workloads on the Snowflake platform. StarTree showcased new observability capabilities with a public technology demonstration highlighting how StarTree Cloud, powered by Apache Pinot, can now be used as a Prometheus-compatible time series database to drive real-time Grafana observability dashboards. Specifically, the demonstration StarTree showed how open telemetry (OTEL) metrics generated by Datadog Vector agents were ingested into Apache Kafka to be consumed by StarTree Cloud. The company also provided a demonstration of its new Performance Manager (currently in Private Preview). Striim announced the private preview launch of Striim 5.0, which will become generally available in the near future. This latest release brings enhancements in real-time data processing, real-time AI, and data security, empowering businesses to drive efficiency, innovate faster, and safeguard their data. Additionally, Striim 5.0 offers premier Change Data Capture (CDC) technology, seamless enterprise connectivity, and enhanced AI/ML capabilities. Teradata  announced new features and productivity enhancements to ClearScape Analytics. The new features are designed to enable organizations to maximize the ROI of their AI/ML investments and boost data science productivity to achieve business outcomes faster and more efficiently. New features and functionality include Spark to ClearScape analytics, reducing complexity and costs, operationalizing AI at scale, enabling multi-cloud machine learning, AutoML, KNIME integration, and more. Tecton announced a platform expansion to unlock the full potential of Generative AI in enterprise applications. This release empowers AI teams to build reliable, high-performing systems by infusing LLMs with comprehensive, real-time contextual data. Specifically, Tecton enhances retrieval-augmented generation (RAG) applications by integrating comprehensive, real-time data from across the enterprise. This approach augments the retrieved candidates with up-to-date, contextual information, enabling the LLM to make more informed decisions. Uniphore unveiled X-Stream, a platform capability that industrializes the conversion of structured and unstructured multimodal data into domain-specific knowledge across the enterprise. Housed as an essential layer in Uniphore’s X-Platform, X-Stream will help enterprises get one step closer to AI sovereignty. It is the latest in a series of product announcements from the company focused on helping enterprises leverage their own data from various sources to fuel their digital transformation. Yellow.ai announced the launch of VoiceX, bringing voice conversations a step closer to human-like interactions. With LLM-powered intuitive voice technology and reduced latency, VoiceX-enabled AI agents can handle high volumes of customer queries while maintaining quality and delivering natural, context-aware responses. Yugabyte  unveiled architectural enhancements to its flagship database, YugabyteDB, with new features that fully evolve PostgreSQL to a distributed database for modern applications. These new capabilities — collectively called enhanced Postgres compatibility — enable a broader range of Postgres apps to run on YugabyteDB, making it the perfect database for companies building cloud-native applications and modernizing existing applications to a cloud-native RDBMS. If your company has real-time analytics news, send your announcements to [email protected] . In case you missed it, here are our most recent previous weekly real-time analytics news roundups: