LLMs

Google Research details TurboQuant, a quantization algorithm to enable massive compression of LLMs and vector search engines without sacrificing accuracy (Google Research)

Google has unveiled TurboQuant, a new algorithm designed to compress large language models and vector search engines. This technology aims to reduce memory usage and improve efficiency for AI systems.