Skip to content

Commit 9c5125d

Browse files
update readme
1 parent a10173c commit 9c5125d

File tree

1 file changed

+20
-1
lines changed

1 file changed

+20
-1
lines changed

README.md

Lines changed: 20 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,4 +1,23 @@
11
# InferAdmin
22

3+
InferAdmin is a lightweight management web interface for local LLM infrastructure. It provides a simple API for deploying and managing docker-based inference engines.
4+
5+
## Features
6+
37
- Deploy and monitor docker based inference engines
4-
- Deploy and monitor docker based web interfaces
8+
- Deploy and monitor docker based web interfaces
9+
- Manage GPU and storage resources
10+
11+
## Installation
12+
13+
First git clone the repo, then use any of the following methods to install and run InferAdmin. Docker is the suggested way to run InferAdmin.
14+
15+
### Docker
16+
17+
1. Install Docker
18+
2. Install Nvidia Container Toolkit
19+
3. Run `docker compose up -d`
20+
21+
### Manual
22+
23+
1. Run `uv run inferadmin`

0 commit comments

Comments
 (0)