Kinara Ara-2 Processor Hits 12 Tokens Per Second Running 7 Billion Parameter LLMs

SANTA CLARA, Calif.–( ORGANIZATION CABLE)– Kinara ™, Inc., today has actually confirmed that its low-power, low-priced AI cpu, the Kinara Ara-2, has actually understood the hefty needs of properly and successfully running Generative AI applications such as Huge Language Versions (LLMs) at the side. Especially, the firm is showing the perfect procedure of the Qwen1.5-7B version operating on a solitary Ara-2 cpu at 12 outcome symbols per secondly. This ability, shown in the brand-new on-line video clip qualified ‘Kina.

发布者:Dr.Durant,转转请注明出处:https://robotalks.cn/kinara-ara-2-processor-hits-12-tokens-per-second-running-7-billion-parameter-llms/

(0)
上一篇 8 8 月, 2024
下一篇 8 8 月, 2024

相关推荐

发表回复

您的电子邮箱地址不会被公开。 必填项已用 * 标注

联系我们

400-800-8888

在线咨询: QQ交谈

邮件:admin@example.com

工作时间:周一至周五,9:30-18:30,节假日休息

关注微信
社群的价值在于通过分享与互动,让想法产生更多想法,创新激发更多创新。