v8.2 - Gemma Embedding

Release Notes

Dependencies

• Updated dependencies
• Upgraded PyTorch → 2.8.0
• Upgraded CUDA → 12.8

Chat Models

Added / Updated	Removed
LiquidAI - 0.35b	MiniCPM4 - 0.5b
LiquidAI - 0.7b	Exaone - 2.4b
LiquidAI - 1.2b	Exaone - 7.8b
Qwen 3 - 4b (updated)	MiniCPM4 - 8b
	Exaone - 32b

Embedding Models

Added / Updated	Removed
embeddinggemma-300m	—

Vision Models

Added / Updated	Removed
InternVL3 - 1b (updated)	Ovis2 - 1b
Liquid-VL - 480M	Ovis2 - 2b
Liquid-VL - 1.6B	THUDM glm4v - 9b
GLM-4.1V-9B-Thinking	Molmo-D-0924 - 8b

Improvements

• Improved database creation process
• Added HuggingFace key handling for gated embeddings (e.g., embeddinggemma-300m)
• Revamped vision model settings

v8.1.0 - fixin to leave

This may be the last release for awhile. It attempts to fix some basic things that were preventing Qwen3 embedding models and a few others from working correctly.

v8.0.0 - Qwen3 Embeddings!

Version 8.0.0 changes (from 7.10.0):

Chat Models

• Added Deepseek R1 - excellent new thinking model

Embedding Models

• Added the current top-ranking embedding models Qwen3-Embedding-0.6B, Qwen3-Embedding-4B, and Qwen3-Embedding-8B
• Removed gte-Qwen2-1.5B-instruct - superseded by Qwen3 models

Text to Speech

• Added the exciting new chatterbox backend

Tools Tab

• Added a chart showing embedding model memory usage.

• Fixed scraping of libraries significantly and commented out TO DO to fix.
• Added Radeon RX 9060 series to GPU chart.

Ask Jeeves

• Updated Jeeves' knowledge to include any/all instructions to run the Kobold chat backend.
• Updated Jeeves' knowledge in general.

General Improvements

• Updated dependencies.
• Refactored database operations.
• Eliminated padding/truncation errors.

Installation

• Just follow the installation instructions on the github readme.

Upgrading from a Prior Version

INSTRUCTIONS FOR UPGRADING FROM A PRIOR VERSION

To upgrade from a prior version while still keeping your databases and models that were downloaded, perform the following steps:

• In your directory that contains all of the files currently...delete the Include, Lib, Scripts folders. (pertain to your virtual environment)
• Delete the pyvenv.cfg file. (pertains to your virtual environment)
• At this point, any and all files pertaining to your virtual environment are gone.
• Delete the Assets and CSS folders. (new ones will be provided in their entirety further below)
• Extract all the files from the .zip file for this release and go into the src folder.
• Copy all files and folders EXCEPT THE CONFIG.YAML FILE into the aforementioned folder where you virtual environment USED TO BE. If there are any prompts indicating that files will be overwritten, CLICK YES since we're only updating necessary files now.
• EXCEPT THE CONFIG.YAML FILE!
• EXCEPT THE CONFIG.YAML FILE!
• last time...EXCEPT THE CONFIG.YAML FILE!

Afterwards, open a command prompt and run the installation instructions on this repository's page; specifically:

python -m venv .

.\Scripts\activate

python setup_windows.py

7.10.0 - Ask Jeeves Again

Version 7.10.0 changes (from 7.9.0):

• Fixed Ask Jeeves and updated his knowledge.
• Stop text to speech within Jeeves midstream.
• Updated libraries to scrape.
• Misc.

Installation

• Just follow the installation instructions on the github readme.

Upgrading from a Prior Version

INSTRUCTIONS FOR UPGRADING FROM A PRIOR VERSION

To upgrade from a prior version while still keeping your databases and models that were downloaded, perform the following steps:

• In your directory that contains all of the files currently...delete the Include, Lib, Scripts folders. (pertain to your virtual environment)
• Delete the pyvenv.cfg file. (pertains to your virtual environment)
• At this point, any and all files pertaining to your virtual environment are gone.
• Delete the Assets and CSS folders. (new ones will be provided in their entirety further below)
• Extract all the files from the .zip file for this release and go into the src folder.
• Copy all files and folders EXCEPT THE CONFIG.YAML FILE into the aforementioned folder where you virtual environment USED TO BE. If there are any prompts indicating that files will be overwritten, CLICK YES since we're only updating necessary files now.
• EXCEPT THE CONFIG.YAML FILE!
• EXCEPT THE CONFIG.YAML FILE!
• Last time...EXCEPT THE CONFIG.YAML FILE!

Afterwards, open a command prompt and run the installation instructions on this repository's page; specifically:

python -m venv .

.\Scripts\activate

python setup_windows.py

v7.9.0 - bug fixes

Version 7.9.0 changes (from 7.8.2):

• Fixed vision models (but florence2 still not working)
• Fixed bug whereby HF token was required even for non-gated repositories

Installation

• Just follow the installation instructions on the github readme.

Upgrading from a Prior Version

INSTRUCTIONS FOR UPGRADING FROM A PRIOR VERSION

To upgrade from a prior version while still keeping your databases and models that were downloaded, perform the following steps:

• In your directory that contains all of the files currently...delete the Include, Lib, Scripts folders. (pertain to your virtual environment)
• Delete the pyvenv.cfg file. (pertains to your virtual environment)
• At this point, any and all files pertaining to your virtual environment are gone.
• Delete the Assets and CSS folders. (new ones will be provided in their entirety further below)
• Extract all the files from the .zip file for this release and go into the src folder.
• Copy all files and folders EXCEPT THE CONFIG.YAML FILE into the aforementioned folder where you virtual environment USED TO BE. If there are any prompts indicating that files will be overwritten, CLICK YES since we're only updating necessary files now.
• EXCEPT THE CONFIG.YAML FILE!
• EXCEPT THE CONFIG.YAML FILE!
• Last time...EXCEPT THE CONFIG.YAML FILE!

Afterwards, open a command prompt and run the installation instructions on this repository's page; specifically:

python -m venv .

.\Scripts\activate

python setup_windows.py

v7.8.2 - BLITZKRIEG

Version 7.8.2 changes (from 7.8.0):

• Updated dependencies, including numpy now version 2+.
• Fixes model info for infly embedding models.
• Fixes batch size for embedding models.
• Fixed a major bug that allowed non-string extracted "text" to slipt through, causing tokenizer errors.
• Fixed file hash being computed twice unnecessarily.
• Fixed the .txt file that TTS relies on from containing thinking.
• Made OCR check optional due to massive processing time with a lot of pdf files.
• Improved OCR check functionality.
• Fixed a bug that required HF authentication for non-gated repos, and threw an error if one wasn't provided.

Installation

• Just follow the installation instructions on the github readme.

Upgrading from a Prior Version

INSTRUCTIONS FOR UPGRADING FROM A PRIOR VERSION

To upgrade from a prior version while still keeping your databases and models that were downloaded, perform the following steps:

• In your directory that contains all of the files currently...delete the Include, Lib, Scripts folders. (pertain to your virtual environment)
• Delete the pyvenv.cfg file. (pertains to your virtual environment)
• At this point, any and all files pertaining to your virtual environment are gone.
• Delete the Assets and CSS folders. (new ones will be provided in their entirety further below)
• Extract all the files from the .zip file for this release and go into the src folder.
• Copy all files and folders EXCEPT THE CONFIG.YAML FILE into the aforementioned folder where you virtual environment USED TO BE. If there are any prompts indicating that files will be overwritten, CLICK YES since we're only updating necessary files now.
• EXCEPT THE CONFIG.YAML FILE!
• EXCEPT THE CONFIG.YAML FILE!
• Last time...EXCEPT THE CONFIG.YAML FILE!

Afterwards, open a command prompt and run the installation instructions on this repository's page; specifically:

python -m venv .

.\Scripts\activate

python setup_windows.py

v7.8.1 - blitzkrieg

Version 7.8.1 changes (from 7.8.0):

• Updated dependencies, including numpy now version 2+.
• Fixes model info for infly embedding models.
• Fixes batch size for embedding models.
• Fixed a major bug that allowed non-string extracted "text" to slipt through, causing tokenizer errors.
• Fixed file hash being computed twice unnecessarily.
• Fixed the .txt file that TTS relies on from containing thinking.
• Made OCR check optional due to massive processing time with a lot of pdf files.
• Improved OCR check functionality.

Installation

• Just follow the installation instructions on the github readme.

Upgrading from a Prior Version

INSTRUCTIONS FOR UPGRADING FROM A PRIOR VERSION

To upgrade from a prior version while still keeping your databases and models that were downloaded, perform the following steps:

• In your directory that contains all of the files currently...delete the Include, Lib, Scripts folders. (pertain to your virtual environment)
• Delete the pyvenv.cfg file. (pertains to your virtual environment)
• At this point, any and all files pertaining to your virtual environment are gone.
• Delete the Assets and CSS folders. (new ones will be provided in their entirety further below)
• Extract all the files from the .zip file for this release v7.8.1 and go into the src folder.
• Copy all files and folders EXCEPT THE CONFIG.YAML FILE into the aforementioned folder where you virtual environment USED TO BE. If there are any prompts indicating that files will be overwritten, CLICK YES since we're only updating necessary files now.
• EXCEPT THE CONFIG.YAML FILE!
• EXCEPT THE CONFIG.YAML FILE!
• Last time...EXCEPT THE CONFIG.YAML FILE!

Afterwards, open a command prompt and run the installation instructions on this repository's page; specifically:

python -m venv .

.\Scripts\activate

python setup_windows.py

v7.8.0 - NUMBER ONE

Version 7.8.0 changes (from 7.7.0):

• infly-retriever-v1-1.5b is currently the number one MTEB ranked embedding model

Chat Models

Added GLM4Z - 9b - excellent thinking model
Added Phi 4 Mini - 4b
Added Seed Coder - 8b - excellent coding-focused model

Embedding Models

Added gte-Qwen2-1.5B-instruct
Added infly-retriever-v1-1.5b
Added infly-retriever-v1-7b

Removed Alibaba-gte-base - superseded
Removed Alibaba-gte-modernbert-base - superseded
Removed Alibaba-gte-large - superseded
Removed stella_en_1.5B_v5 - superseded
Removed stella_en_400M_v5 - superseded

General Improvements

• Improved the speed and accuracy of adding files that will be put into the database (symlink creation).
• Fine-tuned embedding model key word arguments
• Improve text extraction.
• Correct PDF page citations
• Refactor gui_tabs_database_query.py
• Improve thinking indicators and displays
• Improve scraper
• Refactor metrics_bar.py
• Refactor module_chat.py

Installation

• Just follow the installation instructions on the github readme.

Upgrading from a Prior Version

INSTRUCTIONS FOR UPGRADING FROM A PRIOR VERSION

To upgrade from a prior version while still keeping your databases and models that were downloaded, perform the following steps:

• In your directory that contains all of the files currently...delete the Include, Lib, Scripts folders. (pertain to your virtual environment)
• Delete the pyvenv.cfg file. (pertains to your virtual environment)
• At this point, any and all files pertaining to your virtual environment are gone.
• Delete the Assets and CSS folders. (new ones will be provided in their entirety further below)
• Extract all the files from the .zip file for this release v7.8.0 and go into the src folder.
• Copy all files and folders EXCEPT THE CONFIG.YAML FILE into the aforementioned folder where you virtual environment USED TO BE. If there are any prompts indicating that files will be overwritten, CLICK YES since we're only updating necessary files now.
• EXCEPT THE CONFIG.YAML FILE!
• EXCEPT THE CONFIG.YAML FILE!
• last time...EXCEPT THE CONFIG.YAML FILE!

Afterwards, open a command prompt and run the installation instructions on this repository's page; specifically:

python -m venv .

.\Scripts\activate

python setup_windows.py

v7.7.4 - BUG fix

• Bug fix. to Kobold backend. Thanks to @berreka

v7.7.3 - BUG fix

• Fix a bug with LM Studio backend.
• Thanks @berreka