Skip to content

Commit 0d3ec31

Browse files
Sohailm25Sohailm25
committed
Add continuous batching runtime with paged KV + benches
1 parent 0dad423 commit 0d3ec31

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

54 files changed

+255062
-374
lines changed

‎.gitignore‎

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -107,6 +107,7 @@ celerybeat.pid
107107
# Environments
108108
.env
109109
.venv
110+
.venv-mlx-lm
110111
env/
111112
venv/
112113
ENV/

‎bench/__init__.py‎

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,2 @@
1+
# ABOUTME: Makes bench directory importable for test helpers.
2+
# ABOUTME: Exposes benchmarking utilities at package level.

0 commit comments

Comments
 (0)