Galileo, a leader in developing generative AI for the enterprise, has officially announced the launch of a new real-time GenAI firewall solution called Galileo Protect, which is designed to intercept malicious inputs and stop harmful responses, such as hallucinations, in Large Language Model (LLM) applications. According to certain reports, the stated solution leverages Galileo’s suite of research-backed metrics to protect LLM applications in real time, from one easy-to-use, centralized user interface for AI and compliance teams. In practice, this translates to how Galileo Protect’s suite of high-accuracy, low-latency metrics, as well as its real-time request and response interception capabilities, can go a long distance to help you conceive predictability and control over your GenAI applications. Talk about the whole value proposition on a slightly deeper level, we begin with the promise of proactive protection from bad inputs. Here, the core idea is rooted in hardening your GenAI system against malicious activities like prompt attacks, offensive inputs, and more. Next up, we have Galileo Protect’s ability to actively block harmful model response. You see, by bestowing greater control for users over their application outputs, the solution makes up a viable pathway to protect them from hallucinations, data leakage, and off-brand responses.
“The rapid adoption of AI has introduced a new set of safety and compliance risks that need to be managed by enterprises. Organizations are struggling to safeguard AI without impacting user experience; nobody wants to talk to a chatbot that takes two seconds to respond,” said Atin Sanyal, CTO and Co-Founder of Galileo. “Galileo has created guardrails that can identify and block malicious activities in real-time, allowing enterprises to enhance AI safety without impacting performance or user experience, and without incurring significant cost. This is built on the back of innovative breakthroughs by Galileo Research.”
We referred to the product’s low-latency nature, but what we still haven’t acknowledged is how it ensures rapid interception without slowing the end-user experience, and even without mandating frequent and costly API calls. Rounding up the highlights would be a dedicated facility to configure rules and handle wider management through a single and centralized UI. Such a facility, on its part, sets the stage for effective collaboration across non-technical and technical teams in the context of configuring, monitoring, managing, and editing Protect® Rules.
Although quite new on the security scene, Galileo Protect has already helped multiple enterprises accelerate AI development, reduce response times, and improve AI security, safety, and governance, all done through its powerful suite of guardrail metrics, baked-in controls, and customization capabilities.
“GenAI has been a major strategic initiative for Clearwater Analytics, and we’ve leveraged it extensively in our ongoing pursuit for efficiencies and enhanced end-user experience,” said Darrel Cherry, Distinguished Engineer at Clearwater Analytics. “Using Galileo Observe®, we’ve significantly enhanced our visibility and reduced response times to any potential issues with LLMs from days to minutes. Galileo Protect® takes this a step further by allowing us to automatically monitor and intercept AI responses in real-time, enabling us to provide guardrails around our AI products and bring them to customers faster.”
Founded in 2021 Galileo’s rise comes on the back of its end-to-end platform for GenAI evaluation, experimentation, and observability. To better understand the company’s excellence in what it does, though, we can just look at its clientele, which already has several Fortune 100 companies, including Headspace, MasterControl, Uniphore, MusixMatch, Ushur, and many more.