Even the Raspberry Pi 3 from 10 years ago can run generative AI - ANGEWORK demonstrates AI implementation and optimization technology for low-spec environments.
ANGEWORK Co., Ltd. used the Raspberry Pi 3 Model B (RAM 1GB) from about 10 years ago to implement and optimize generative AI and verify the operation of small LLMs, publishing two technical articles. In the porting of small AI for ESP32, the generation speed was accelerated approximately 6.3 times from 31.22 tok/s to 195.81 tok/s through software optimization. Furthermore, multiple small LLMs were compared, and a model capable of Japanese conversation was confirmed. The approach to design, model selection, and optimization to establish AI in limited CPU and memory environments is introduced, rather than relying solely on expensive GPUs and the latest equipment. This content is aimed at corporate representatives and engineers considering AI utilization in existing devices, IoT, manufacturing equipment, and closed environments. For more details, please refer to the note article.

Inquiry about this news
Contact Us OnlineMore Details & Registration
Details & Registration
Related Links
Technical verification and acceleration
Comparison of Small LLMs and Japanese Conversation
Offline conversation AI on iPhone "LocaPhone"





