Document Details
Clip:
The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits Shuming Ma ∗ Hongyu Wang ∗ Lingxiao Ma Lei Wang Wenhui Wang Shaohan Huang Li Dong Ruiping Wang Jilong Xue Furu Wei ⋄ https://aka.ms/GeneralAI Abstract Recent research, such as BitNet [WMD + 23 ], is paving the way for a new era of 1- bit Large Language Models (LLMs). In this work, we introduce a 1-bit LLM variant,
Filename:
2402.17764.pdf
Filetype:
application/pdf
Size:
463748 bytes
Uploaded On:
2024-02-28
Abstract:
Summary:
Tags:
Notes:
Visible:
1
Status:
Parsed
Author:
CreationDate:
2024-02-28T02:54:41+00:00
Creator:
LaTeX with hyperref
Keywords:
ModDate:
2024-02-28T02:54:41+00:00
PTEX.Fullbanner:
This is pdfTeX, Version 3.141592653-2.6-1.40.25 (TeX Live 2023) kpathsea version 6.3.5
Producer:
pdfTeX-1.40.25
Subject:
Title:
Trapped:
False
Pages:
8
Return to Document Library