The edge refers to computational processes occurring close to the data sources at these locations – be they sensors, devices, or end-users – rather than relying on centralized systems that are common in traditional AI processing. This unlocks hyper-personalized experiences such as dynamic menu recommendations in quick-service restaurants, while also contributing to significant savings in data transfer bandwidth.
Supermicro and NVIDIA deliver Edge AI solutions that streamline deployment through pre-integrated components with optimized hardware and software for real-time processing.
Real-Time
From data analysis, monitoring, predictive maintenance, or personalization, AI at the edge will empower you to meet your business needs as they happen
Uninterrupted
Offline processing and inference enables uninterrupted operations in remote or disconnected environments
Personalized
Understanding and responding to customer preferences in a more natural and engaging manner to create innovative experience, powered by generative AI
![YouTube: [Supermicro] Delivering AI to the Edge](https://img.youtube.com/vi/IQuT2PC2nJ0/maxresdefault.jpg)
The Two Halves of Edge AI
The deployment of AI at the Edge can be for two distinct yet complementary purposes: predictive and generative AI. Predictive AI is the analytical powerhouse, leveraging historical data to forecast future events.
Generative AI, conversely, is a creative catalyst that uses underlying data patterns to synthesize new information, driving innovation and personalized experience.
Retail
Leveraging predictive AI to revolutionize retail spaces
- Asset Protection
- Autonomous Shopping
- Demand Forecasting
- Recommenders & Hyper-Personalization
In the retail sector, predictive AI is revolutionizing asset protection. By analyzing patterns and identifying potential threats, AI systems provide retailers with preemptive solutions to reduce losses and enhance store security.
These calculations must happen at the edge to facilitate the real-time responses that are required to respond effectively.
Product Use Case
SYS-E403-14B-FRN2T
This box-sized system is ideal for front and back-of-store AI applications leveraging the power of an Intel® Xeon® 6 series processor and support for multiple GPU cards.
SYS-112B-FWT
This 1U ultra-short depth system, deployable in space-constrained environments, delivers an Intel® Xeon® 6 CPU and GPU support for AI applications for both front and back-of-store.
AS -1115S-FWTRT
This 1U ultra-short depth system, deployable in space-constrained environments, delivers an AMD EPYC™ 8004 CPU and GPU support for AI applications for both front and back-of-store.
SYS-212B-FN4TP
A 2U short-depth rackmount system designed for edge AI inferencing capable of processing multiple input formats, leveraging a choice of Intel® Xeon® 6 series processors and scalable PCIe configurations.
SYS-322GA-NR
A GPU-optimized server, this 3U platform can support multiple inferencing workloads simultaneously, such as analyzing video feeds or rendering virtual avatars in display kiosks.
Quick-Service Restaurants
Enabling restaurants to stay in front of the competition
- Speech-enabled food kiosks
- Food quality and operational efficiency
- Forecasting & inventory
Quick service restaurants are embracing generative AI to transform their customer experience. Speech-enabled food kiosks, powered by generative AI, offer personalized interactions, understanding and responding to customer preferences in a natural and engaging manner.
Generative AI can offer upsell and complimentary suggestions on the fly or offer human-like customer service right within the kiosk. When combined with predictive AI that learns from a customer’s loyalty card history, each subsequent visit can provide deeper customizations and more delightful interactions.
Product Use Case
SYS-E302-12D-4C
A powerful, lightweight fanless server that is ideal for applications deployed in uncontrolled spaces, such as kitchens, leveraging an Intel® Xeon® D processor.
SYS-E302-12A-4C
A lightweight, power-efficient fanless server that is ideal for applications deployed in uncontrolled spaces, such as kitchens, featuring a low-power Intel® Atom® processor.
SYS-E302-13AD
A lightweight fanless server that is ideal for applications deployed in uncontrolled spaces, such as kitchens, leveraging an Intel® Core™ processor for edge workloads.
SYS-E100-13AD-E
A compact fanless server featuring a powerful Intel® Core™ processor that is easily installed into drive-thru modules, menu boards, as well as run routine store management operations.
SYS-112B-FWT
The 1U ultra-short depth system delivers a high-performance Intel® Xeon® 6 series processor and GPU support in space-constrained, controlled environments.
AS -1115S-FWTRT
The 1U ultra-short depth system delivers a high-performance AMD EPYC™ 8004 series processor and GPU support in space-constrained, controlled environments.
Manufacturing
Streamlining end-to-end manufacturing challenges
- Workforce Health and Safety
- Automated Quality Inspection
- Mitigation of Skilled Employee Attrition
The manufacturing industry is leveraging predictive AI to address one of its most important and expensive challenges: workplace safety. Companies are using Edge AI hardware to connect data feeds from CCTV, machinery, and operational software to provide real-time predictive analysis of potential hazards.
Another significant application is automated quality inspection. For example, by continuously monitoring an automotive parts production line and feeding data into a predictive AI system, it is possible to provide real-time insights for quality control and significantly reduce the risk of defects.
Product Use Case
SYS-112B-FWT
AI-enabled automated quality inspection on the manufacturing floor is easily delivered using this system which supports a choice of Intel® Xeon® 6 series processors and GPU support.
AS -1115S-FWTRT
AI-enabled automated quality inspection on the manufacturing floor is easily delivered using this system which utilizes an AMD EPYC™ 8004 series processor and GPU support.
SYS-212B-FN4TP
Leverage computer vision and predictive AI to ensure workplace safety using this system which supports a choice of Intel® Xeon® 6 series processors and GPU support.
Healthcare & Medical Devices
Helping those who help others provide the highest quality care
- Patient safety and monitoring
- Diagnostic imaging
- Wayfinding
In healthcare, predictive AI is increasingly being trialed with diagnostic imaging, attempting to enhance the accuracy and efficiency of medical diagnoses by augmenting trained experts.
Another example, particularly in hospital settings, is to use generative AI for wayfinding - an application that enhances the patient and visitor experience. Digital kiosks and concierge services, powered by AI, guide individuals through complex hospital layouts, offering directions and information either on wall-mounted screens that follow the visitor’s progress or on updates delivered right to a mobile device.
Product Use Case
SYS-112B-FWT
The 1U ultra-short depth system has the high performance and GPU support to deliver AI applications such as wayfinding on digital kiosks to enhance a hospital visitor's experience.
SYS-212B-FN4TP
The 2U short-depth rackmount system enables edge AI inferencing applications such as patient safety and monitoring by processing multiple input formats, using a choice of Intel® Xeon® 6 series processors and PCIe configurations.
SYS-222HE-FTN
Meet the requirements of demanding applications such as predictive analytics, diagnostics, and personalized medicine by combining the compute performance of a dual Intel® Xeon® 6 series processor with multiple expansion or GPU cards
SYS-322GA-NR
A GPU-optimized server for the healthcare and medical applications, this 3U platform supports multiple inferencing workloads simultaneously, including diagnostics, image interpretation, and risk assessment.
Smart Spaces
Elevating how people interact with other people and their environment
- Crowd and parking management
- Safety enhancement
- Access control
- Traffic management
Smart spaces, such as venues and stadiums, are adopting predictive AI for crowd and parking management. By analyzing real-time data, these systems effectively manage foot traffic and parking logistics, enhancing the overall customer experience while improving safety at the same time.
Product Use Case
SYS-E403-14B-FRN2T
Leverage a wide range of deployment options, including in a pole-mounted, ruggedized outdoor enclosure, for any application that requires the power of an Intel® Xeon® 6 series and support for multiple GPUs
SYS-222HE-FTN
Utilize the compute performance of dual Intel® Xeon® 6 series processors with support for multiple GPU cards to deliver computer vision AI applications for security, traffic control, and parking management.
SYS-322GA-NR
A GPU-optimized server for the enterprise edge, this 3U platform is capable of supporting multiple inferencing workloads simultaneously, such as needed for large events and highly populated areas.
Small
SYS-E300-13AD
| Dimensions (mm) H × W × D | 43.0 × 264.8 × 225.8 |
|---|---|
| Key Features for Predictive | AI computer vision for up to 8 streams1 |
| Up to ~2,000 automatic speech recognition (ASR) samples per second2 | |
| Key Features for Generative | LLM up to 8 billion parameters |
| Image and video generation with Stable Diffusion at ~1 image every 4-5 seconds | |
| GPU Support |
|
Medium
SYS-110D-20C-FRAN8TP3
| Dimensions (mm) H × W × D | 43.0 × 437.0 × 399.0 |
|---|---|
| Key Features for Predictive | AI computer vision for up to 16 streams1 |
| Up to ~6,000 automatic speech recognition (ASR) samples per second2 | |
| Key Features for Generative | LLM up to 24 billion parameters |
| Image and video generation with Stable Diffusion at ~1 image every 2 seconds | |
| GPU Support |
|
Large
SYS-E403-14B-FRN2T
| Dimensions (mm) H × W × D | 117.3 × 266.7 × 406.4 |
|---|---|
| Key Features for Predictive | AI computer vision for up to 32 streams1 |
| Up to ~22,000 automatic speech recognition (ASR) samples per second2 | |
| Key Features for Generative | LLM up to 48 billion parameters |
| Image and video generation with Stable Diffusion at ~1-2 images per second | |
| GPU Support |
|
Extra large
SYS-222HE-(F)TN
| Dimensions (mm) H × W × D | 88.9 × 436.9 × 574.0 |
|---|---|
| Key Features for Predictive | AI computer vision for up to 48 streams per GPU1 |
| Up to ~32,000 automatic speech recognition (ASR) samples per second per GPU2 | |
| Key Features for Generative | LLM up to 80 billion parameters |
| Image and video generation with Stable Diffusion at ~3 images per second | |
| GPU Support |
|
- Based on using an image classification model similar to EfficientNet-B4, dependent on video stream compression and other workloads on the system
- Based on using an ASR model like QuartzNet
- Additional models include SYS-110D-4C-FRAN8TP, SYS-110D-8C-FRAN8TP, SYS-110D-14C-FRAN8TP, and SYS-110D-16C-FRAN8TP
Supermicro + NVIDIA: A Range of Solutions
At the heart of any Edge AI implementation is a robust and cohesive architecture that underpins the solution. Supermicro and NVIDIA’s collaborative approach provides just that – a comprehensive framework that integrates CPUs, GPUs, and optimized memory, all orchestrated within the resilient infrastructure of Supermicro’s systems.
The stack is engineered to ensure maximum efficiency and performance for deploying AI models at scale. Middleware solutions ensure that the systems are not only powerful but also intelligently coordinated and easily integrated into existing workflows.
Security, storage, and networking are foundational elements of this architecture, guaranteeing that data integrity and transmission are never compromised. The result is a scalable solution architecture that empowers end-users to unlock the full potential of Edge AI and edge computing.
White Paper
Accelerating Adoption of Edge AI
Solution Brief
Supermicro And IronYun Collaborate To Advance Edge Vision AI Solutions
Success Story
