MeanAudio: Fast and Faithful Text-to-Audio Generation with Mean Flows

Overview

MeanAudio is a novel MeanFlow-based model tailored for fast and faithful text-to-audio generation. It can synthesize realistic sound in a single step, achieving a real-time factor (RTF) of 0.013 on a single NVIDIA 3090 GPU. Moreover, it also demonstrates strong performance in multi-step generation.

Environmental Setup

1. Create a new conda environment:

conda create -n meanaudio python=3.11 -y
conda activate meanaudio
pip install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cu118 --upgrade

2. Install with pip:

git clone https://github.com/xiquan-li/MeanAudio.git

cd MeanAudio
pip install -e .

Quick Start

To generate audio with our pre-trained model, simply run:

python demo.py --prompt 'your prompt' --num_steps 1

This will automatically download the pre-trained checkpoints from huggingface, and generate audio according to your prompt. The output audio will be at MeanAudio/output/, and the checkpoints will be at MeanAudio/weights/.

Have fun with MeanAudio 😊 !!!