Tag: text compression

by Synced 2024-09-28 10

Practical Lossless Text Compression: FineZip Delivers 54x Speed Boost via Large Language Models

In a new paper FineZip : Pushing the Limits of Large Language Models for Practical Lossless Text Compression, a research team from UC Berkeley and NYU introduces FineZip, a novel LLM-based compression system designed to significantly reduce compression time.

by Synced 2024-08-09 4

AI Machine Learning & Data Science Research

From 500 Tokens to One: The Breakthrough Power of Cambridge U’s 500xCompressor

In a new paper 500xCompressor: Generalized Prompt Compression for Large Language Models, a Cambridge U team proposes the 500xCompressor, a method designed to condense extensive natural language contexts into a minimum of just one special token, achieving compression ratios ranging from 6x to 480x.