Kong is internet hosting its API Summit 2024 occasion, and has made bulletins about a number of enhancements to its platforms. Key highlights are updates to Kong Konnect, its API administration platform, which additionally embrace new variations of Kong Insomnia, Kong Gateway, and Kong AI Gateway.
The most recent updates to Kong Konnect assist corporations additional put together their API infrastructure to deal with AI use instances.
“There isn’t any AI with out APIs, and the most recent model of Kong Konnect delivers the important infrastructure for each. We purpose to provide companies the instruments to handle and scale their API site visitors securely, serving to drive innovation sooner than ever earlier than,” mentioned Augusto Marietti, CEO and co-founder of Kong Inc. “Kong Konnect offers a unified API platform for constructing, operating and governing GenAI functions.”
This replace contains Konnect Service Catalog, which offers a single supply of reality for APIs and companies, which helps corporations handle shadow APIs by permitting them to eliminate undiscovered or unused APIs. The Service Catalog additionally incorporates a Scorecard that assesses how compliance a service is with outlined standards.
Konnect Devoted Cloud Gateways are additionally now accessible on Azure and new AWS areas. In accordance with the corporate, this added availability allows organizations to deploy and handle their APIs throughout a number of clouds and preserve enterprise-grade SLAs.
Kong Insomnia 10, which is an API design and testing software, provides limitless assortment runs, AI Runner for growing GenAI apps, and Invite Management, which ensures that API belongings can solely be accessed by licensed customers.
Different options on this launch of Kong Konnect embrace Serverless Gateways, a centralized and cloud-based repository for managing API configurations, and superior API and AI analytics.
The replace additionally introduces variations 3.8 of each Kong Gateway and Kong AI Gateway. Kong Gateway 3.8 provides Incremental Configuration Updates, which considerably reduces reminiscence and CPU utilization, and enhanced OpenTelemetry assist.
Kong AI Gateway 3.8 provides a number of semantic reasoning capabilities, together with Semantic Caching, which acknowledges when completely different prompts signify the identical query, leading to sooner response instances. As an illustration, “how lengthy does it take to prepare dinner pasta?” and “how lengthy does it take to prepare dinner spaghetti?” could be responded to with the identical cached response.
In accordance with the corporate, the power to answer with cached responses cuts down on processing instances and reduces computational overhead.
One other new function on this replace is Semantic Immediate Guard, which allows AI Gateway to know the “essence” of a request and block inappropriate prompts. Usually, these prompts are sorted out by figuring out particular key phrases, and this function eliminates the necessity for that.
The three.8 launch additionally introduces Semantic Routing, which selects probably the most related LLM primarily based on a developer’s necessities.
“Kong AI Gateway 3.8 is a major step ahead in enabling organizations to completely harness the ability of AI,” mentioned Marco Palladino, co-founder and CTO of Kong. “By introducing Semantic Intelligence into our AI Gateway, we’re addressing probably the most urgent challenges confronted by enterprises leveraging GenAI in the present day — velocity, price and safety — whereas dramatically bettering the developer expertise.”