AI Blueprints from NVIDIA
AI agents are being developed by governments and businesses throughout the world to enhance the abilities of workers who rely on visual data from a growing variety of devices, including cameras, Internet of Things sensors, and cars.The new NVIDIA AI Blueprints for video search and summarization will enable developers across nearly every industry to design visual AI agents that analyze picture and video data. These agents can answer questions from customers, provide summaries, and set off warnings for specific circumstances.
As part of NVIDIA Metropolis, a package of developer tools for building vision AI applications, the blueprint is a customizable approach that combines NVIDIA computer vision and generative AI technology.
Global systems integrators and technology solution providers including as Accenture, Dell Technologies, and Lenovo are bringing the NVIDIA AI Blueprints for visual search and summarization to cities and enterprises worldwide. This marks the beginning of the next generation of AI applications that may be used to improve safety and productivity in a variety of settings, including factories, warehouses, retail stores, airports, and traffic crossings.
Visual computing developers can create and deploy generative AI-powered agents that can consume and understand massive amounts of data archives or live video feeds with the help of the NVIDIA AI Blueprint, which was released before the Smart City Expo World Congress.
The fact that users can alter these visual AI agents using natural language instructions instead of rigid software code facilitates the deployment of virtual assistants across industries and smart city applications.
NVIDIA AI Blueprint Uses Language Models for Vision
By combining language understanding and computer vision, vision language models (VLMs), a subtype of generative AI models, allow visual AI agents to observe the physical world and perform reasoning tasks.NVIDIA NIM microservices for GPU AI models, VLMs like NVIDIA VILA, and LLMs like Meta's Llama 3.1 405BThe NVIDIA AI Blueprint can be configured for video search and summarization using context-aware retrieval-augmented generation and accelerated question answering. Developers can easily adapt various VLMs, LLMs, and graph databases to fit their unique use cases and environments with the help of the NVIDIA NeMo platform.
Developers may be able to save months of time by adopting the NVIDIA AI Blueprints instead of spending months studying and perfecting generative AI models for use in smart city applications. When implemented on NVIDIA GPUs at the edge, on-site, or in the cloud, it may dramatically speed up the process of searching through video archives to locate critical events.
This approach might be used to create an AI agent that alerts workers in a warehouse environment when safety protocols are violated. At a busy intersection, an AI bot may identify traffic incidents and generate data to aid emergency response efforts. Additionally, maintenance staff could ask AI agents to examine above imagery and identify decaying roads, train tracks, or bridges in order to encourage proactive repair in the field of public infrastructure.
In addition to smart spaces, visual AI agents might be used to automatically summarize videos for those with visual impairments, categorize big visual datasets for use in training other AI models, and more.
The video search and summarization workflow is a component of a suite of NVIDIA AI blueprints that enable the development of AI-powered digital avatars, virtual assistants for personalized customer service, and enterprise insights from PDF data.
Developers can test and download NVIDIA AI Blueprints for free with NVIDIA AI Enterprise, an end-to-end software platform that streamlines the development and deployment of generative AI and accelerates data science pipelines. After that, these designs can be put into practice in cloud and accelerated data center environments.
AI Agents Will Provide World Capitals With Insights From Warehouses
The full library of NVIDIA AI Blueprints is also available to enterprise and public sector clients with the support of NVIDIA's partner network.The international professional services company Accenture has integrated NVIDIA AI Blueprints into its Accenture AI Refinery, which is built on NVIDIA AI Foundry and enables clients to construct custom AI models trained on enterprise data.
Global systems integrators in Southeast Asia, including ITMAX in Malaysia and FPT in Vietnam, are creating AI agents based on the NVIDIA AI Blueprint for video search and summarization for use in smart city and intelligent transportation applications.
NVIDIA AI Blueprints can also be developed and deployed on NVIDIA AI systems by developers using compute, networking, and software from global server manufacturers.
Dell will integrate VLM and agent approaches with its NativeEdge platform to enhance existing edge AI applications and create new edge AI-enabled capabilities. The NVIDIA AI Blueprint for video search and summarization and the Dell Reference Designs for the Dell AI Factory with NVIDIA will offer VLM capabilities in specialized AI workflows for data center, edge, and on-premises multimodal corporate use cases.
NVIDIA AI blueprints are also used in Lenovo Hybrid AI solutions.
Companies like K2K, a provider of smart city applications in the NVIDIA Metropolis ecosystem, will use the new NVIDIA AI Blueprint to develop AI agents that are capable of analyzing real-time traffic camera data. With this, city officials will be able to ask about street activities and receive recommendations on how to improve the situation. The company is also working with city traffic management in Palermo, Italy, to deploy visual AI agents using NIM microservices and NVIDIA AI blueprints.
To find out more about the NVIDIA AI Blueprints for video search and summarization, visit the NVIDIA booth at the Smart Cities Expo World Congress, which is taking place in Barcelona until November 7.
0 Comments