Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
7 changes: 7 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -13,6 +13,13 @@ Paper: [TurboDiffusion: Accelerating Video Diffusion Models by 100-200 Times](ht

The checkpoints and paper are not finalized, and will be updated later to improve quality.

**TurboT2AV**: [`TurboT2AV/`](TurboT2AV/) provides fast text-to-audio-video
generation with a distilled LTX-2 audio-video model. It applies an RCM-style
distillation strategy to joint audio-video generation, combining the diversity
benefits of consistency models with the perceptual quality of score-model
distillation. The released inference pipeline uses a 4-step student distilled
from a 40-step teacher at the 14B-video + 5B-audio scale.

<div align="center">
<img src="assets/TurboDiffusion_speedup.png" width="99%"/>
</div>
Expand Down
252 changes: 252 additions & 0 deletions TurboT2AV/.gitignore
Original file line number Diff line number Diff line change
@@ -0,0 +1,252 @@
# =============================================================================
# turbo-t2av Project .gitignore
# =============================================================================

# =============================================================================
# Python
# =============================================================================
__pycache__/
*.py[cod]
*$py.class
*.so
.Python
build/
develop-eggs/
dist/
downloads/
eggs/
.eggs/
lib/
lib64/
parts/
sdist/
var/
wheels/
*.egg-info/
.installed.cfg
*.egg
MANIFEST

# =============================================================================
# Virtual Environments
# =============================================================================
.env
.venv
env/
venv/
ENV/
env.bak/
venv.bak/

# =============================================================================
# IDE & Editor
# =============================================================================
.idea/
.vscode/
*.swp
*.swo
*~
.project
.pydevproject
.settings/
*.sublime-project
*.sublime-workspace
.spyderproject
.spyproject

# =============================================================================
# Model Checkpoints & Weights (Large Files)
# =============================================================================
*.safetensors
*.pt
*.pth
*.ckpt
*.bin
*.onnx
*.model
*.pk
*.pkl
checkpoints/
weights/
pretrained/
models/*.safetensors
models/*.pt
models/*.pth

# =============================================================================
# Data Files (Large Files)
# =============================================================================
*.mdb

# HDF5 and numpy
*.h5
*.hdf5
*.npy
*.npz

# Parquet and other data formats
*.parquet
*.arrow
*.feather

# Large text datasets (uncomment if needed)
# *.txt

# Specific large data files in this project
LTX-2/packages/*.txt
LTX-2/packages/audiocap_*.txt
LTX-2/packages/vidprom_*.txt
LTX-2/packages/prompts.txt

# General data directories
data/
datasets/
dataset/

# =============================================================================
# Output & Results
# =============================================================================
outputs/
output/
results/
save_results/
generated/
samples/

# =============================================================================
# Logs & Monitoring
# =============================================================================
logs/
*.log
runs/
tensorboard/
mlruns/
lightning_logs/

# =============================================================================
# Media Files (Generated)
# =============================================================================
*.mp4
*.avi
*.mov
*.mkv
*.webm
*.gif
*.png
*.jpg
*.jpeg
*.wav

# Keep README demo assets self-contained in packaged copies of the repository.
!assets/*.mp4
*.mp3
*.flac
*.ogg

# =============================================================================
# Archives (Large Files)
# =============================================================================
*.tar
*.tar.gz
*.tar.bz2
*.tar.xz
*.zip
*.7z
*.rar
*.gz
*.bz2

# =============================================================================
# OS Generated Files
# =============================================================================
.DS_Store
.DS_Store?
._*
.Spotlight-V100
.Trashes
ehthumbs.db
Thumbs.db
Desktop.ini

# =============================================================================
# Cache & Temporary
# =============================================================================
.cache/
*.cache
.pytest_cache/
.mypy_cache/
.ruff_cache/
.hypothesis/
server_cache/
tmp/
temp/
*.tmp
*.bak
*.swp
*~

# =============================================================================
# Jupyter Notebooks
# =============================================================================
.ipynb_checkpoints/
*.ipynb_checkpoints
profile_default/
ipython_config.py

# =============================================================================
# Testing & Coverage
# =============================================================================
htmlcov/
.tox/
.nox/
.coverage
.coverage.*
coverage.xml
*.cover
*.py,cover
.hypothesis/
nosetests.xml
coverage/

# =============================================================================
# Build & Distribution
# =============================================================================
*.manifest
*.spec
pip-log.txt
pip-delete-this-directory.txt

# =============================================================================
# Secrets & Credentials
# =============================================================================
*.env.local
.env.*.local
secrets.yaml
secrets.json
credentials.json
*.pem
*.key

# =============================================================================
# Gradio & Web App
# =============================================================================
.gradio/
app/.gradio/
flagged/

# =============================================================================
# CUDA & Compiled Extensions
# =============================================================================
*.o
*.a
*.exe
*.out
*.pid

# =============================================================================
# Keep These (override ignores)
# =============================================================================
!.gitkeep
!requirements*.txt
!README*.md
!LICENSE
2 changes: 2 additions & 0 deletions TurboT2AV/LTX-2/.gitattributes
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
# SCM syntax highlighting & preventing 3-way merges
pixi.lock merge=binary linguist-language=YAML linguist-generated=true
44 changes: 44 additions & 0 deletions TurboT2AV/LTX-2/.gitignore
Original file line number Diff line number Diff line change
@@ -0,0 +1,44 @@
# Python-generated files
__pycache__/
*.py[oc]
build/
dist/
wheels/
checkpoints/
*.egg-info

# Virtual environments
.venv
.python-version

# IDE settings
.idea/
.vscode/

# Other files
.DS_Store
tmp

# Model checkpoints
*.ckpt
*.pt
*.safetensors
*.sft

# Media files
*.gif
*.heic
*.heif
*.jpg
*.jpeg
*.json
*.m4a
*.mov
*.mp4
*.png
*.wav
*.webp

LTX-2/eval/outputs/*# pixi environments
.pixi/*
!.pixi/config.toml
Loading