An advanced inference performance AI system with a compact chassis equipped with two NVIDIA T4s, serving as an edge AI computing platform.
A box-type computer equipped with two NVIDIA T4 GPUs, featuring a compact chassis measuring 225mm in width, 292mm in depth, and 140mm in height, and implementing 16GB of GPU memory (GDDR6). Each GPU board consumes 70W, providing excellent performance per watt, enabling high-speed processing with nanosecond-level precision required for edge computing.
This system serves as an edge AI computing platform, processing data exchanged between cloud and industrial control system networks, reducing communication costs by transmitting only the necessary data, and allowing installation in environments such as factories due to its robust chassis. It achieves real-time processing through improved latency.
The inference engine is equipped with the "NVIDIA T4 Tensor Core GPU," capable of supporting performance from FP32 to FP16, INT8, and even INT4 precision, delivering up to 40 times the performance of a CPU. This makes it suitable for AI systems that require advanced inference capabilities, such as security monitoring, digital transformation, and appearance inspection devices/systems.