[论文翻译]SHAKTI:专为边缘AI和低资源环境优化的25亿参数小语言模型


原文地址:https://arxiv.org/pdf/2410.11331v1


SHAKTI: A 2.5 BILLION PARAMETER SMALL LANGUAGE MODEL OPTIMIZED FOR EDGE AI AND LOW-RESOURCE ENVIRONMENTS

SHAKTI:专为边缘AI和低资源环境优化的25亿参数小语言模型

Syed Abdul Gaffar Shakhadri Lead AI Developer SandLogic Technologies Pvt Ltd. syed.abdul@sandlogic.com

Syed Abdul Gaffar Shakhadri 首席AI开发工程师 SandLogic科技有限公司 syed.abdul@sandlogic.com

Rakshit Aralimatti AI Developer SandLogic Technologies Pvt Ltd rakshit.aralimatti@sandlogic.com

Rakshit Aralimatti AI开发工程师 SandLogic科技有限公司 rakshit.aralimatti@sandlogic.com

ABSTRACT

摘要

We introduce Shakti, a 2.5 billion parameter language model specifically optimized for resourceconstrained environments such as edge devices, including smartphones, wearables, and IoT systems. Shakti combines high-performance NLP with optimized efficiency and precision, making it ideal for real-time AI applications where computational resources and memory are limited. With support for vernacular languages and domain-specific tasks, Shakti excels in industries such as healthcare

阅读全文(20积分)