SANTA CLARA, Calif.–( ORGANIZATION CABLE)– Kinara ™, Inc., today has actually confirmed that its low-power, low-priced AI cpu, the Kinara Ara-2, has actually understood the hefty needs of properly and successfully running Generative AI applications such as Huge Language Versions (LLMs) at the side. Especially, the firm is showing the perfect procedure of the Qwen1.5-7B version operating on a solitary Ara-2 cpu at 12 outcome symbols per secondly. This ability, shown in the brand-new on-line video clip qualified ‘Kina.
发布者:Dr.Durant,转转请注明出处:https://robotalks.cn/kinara-ara-2-processor-hits-12-tokens-per-second-running-7-billion-parameter-llms/