ASUS UGen300 USB AI accelerator features a 40 TOPS Hailo-10H AI processor and 8GB of LPDDR4 memory to support large language models (LLMs), vision language models (VLMs), and AI vision workloads while consuming less than 2.5 Watts.In some ways, the hardware is similar to the Raspberry Pi AI HAT+ 2, but in a slim dongle form factor (105 x 50 x 18mm) and a 10 Gbps USB 3.2 Gen1 USB-C Type-C port instead of a 5 or 8 GT/s PCIe interface.ASUS UGen300 USB AI accelerator (UGen300-USB-8G) specifications:
AI accelerator – Hailo Hailo-10H delivering up to 40 TOPS (INT4) or 20 TOPS (INT8) inferencing performance
Memory – 8GB LPDDR4 @ 4266 MT/s
Host interface – USB 3.1 Gen2 (10 Gbps) Type-C port
Power Supply – 5V via USB-C port
