GPU product lineup supporting generative AI and HPC.

As the practical application of LLMs (large language models) like ChatGPT rapidly advances, the requirements for AI infrastructure are also undergoing significant changes. In the past, during the AI development phase, particularly in the "training" phase, the mainstream approach was to gather the highest-performing GPUs and invest heavily in data centers to pursue the speed and capacity of GPU memory. However, as models are completed and we transition to the "inference" phase, where they are utilized in actual business operations and services, new challenges are emerging. One such challenge is the issue that "using the top-tier systems for training (like DGX or HGX) for inference is often over-specification, leading to excessive initial investments and running costs." What is now required from inference infrastructure is not just "maximum performance," but rather "flexibility" and "power efficiency" tailored to specific applications. This time, we will explain the "NVIDIA MGX" architecture, which optimizes the TCO (total cost of ownership) of data centers and enables a streamlined inference foundation, along with the best-fit server configurations proposed by Applied.

In automotive development, CAE (Computer Aided Engineering) is widely used to enhance safety and performance. Among these, "crash analysis," which predicts the deformation, stress, and strain of the vehicle body during a collision, is crucial in the field of crash safety. The representative CAE software LS-DYNA allows for the setting of conditions such as body shape, materials, thickness, and collision speed to analyze the behavior during a crash. On the other hand, automotive development requires not just a single design proposal but also the comparison of numerous candidates, including materials, thickness, component shapes, and reinforcement positions. This is where the focus shifts to utilizing the analysis data accumulated in LS-DYNA to train AI, which can be used for predicting analysis results and screening design candidates. Rather than replacing CAE, combining CAE with AI has the potential to make the design review process more efficient. Furthermore, HPC (High Performance Computing) becomes essential as a foundation supporting CAE analysis, AI learning, and large-scale data processing.

With the spread of generative AI, including ChatGPT, AI has begun to be utilized in various scenarios such as text generation, summarization, translation, and programming assistance. On the other hand, in corporate and research and development settings, there is an increasing expectation for more advanced AI applications, not just to answer questions, but to: - Automatically search for necessary information from internal technical documents - Compare multiple pieces of information to determine the next course of action - Operate external tools and business systems - Progress through a series of tasks including research, analysis, code generation, and report creation This system, which infers based on objectives and utilizes necessary information and tools to advance tasks, is referred to as "Agentic AI." Supporting this Agentic AI is NVIDIA's open model family, known as NVIDIA Nemotron. In this article, we will introduce what NVIDIA Nemotron is, how it differs from traditional generative AI, and what applications can be considered in manufacturing and research and development.

In recent years, have you noticed the changes in data centers? The needs for data centers are currently fluctuating significantly due to the explosive spread of AI. This time, we will introduce the changes in data centers in the IT industry, which can be seen as a reflection of the trends of the times.