LLM-Enhanced Text Compression: This project explores using Large Language Models (LLMs) to improve text compression efficiency. It evaluates various LLM architectures (GPT-2, Llama 2, Mistral-7B, Yi-34B) across different context sizes and datasets, implementing a rank-based compression method integrated with conventional algorithms.
compression information-theory llama imperial-college language-models arithmetic-coding mistral text-compression msc-thesis bookcorpus gpt-2 lossless-compression llm yi-34b mixtral text8
-
Updated
May 9, 2026 - Python