GitHub - microsoft/olive-recipes

Olive Recipes For AI Model Optimization Toolkit

This repository compliments Olive, the AI model optimization toolkit, and includes recipes demonstrating its extensive features and use cases. Users of Olive can use these recipes as a reference to either optimize publicly available AI models or to optimize their own proprietary models.

Supported models, architectures, devices and execution providers

Below are list of available recipes grouped by different criteria. Click the link to expand.

Models grouped by model architecture

bert	clip	deepseek	hiera	llama	llama3	mistral	mobilenet	phi3	phi4	qwen2	resnet	sd	vit	whisper
google-bert-bert-base-multilingual-cased	OFA-Sys-chinese-clip-vit-base-patch16	deepseek-ai-DeepSeek-R1-Distill-Llama-8B	sam2.1-hiera-small	deepseek-ai-DeepSeek-R1-Distill-Llama-8B	meta-llama-Llama-3.1-8B-Instruct	mistralai-Mistral-7B-Instruct-v0.2	timm-mobilenetv3_small_100.lamb_in1k	microsoft-Phi-3-mini-128k-instruct	microsoft-Phi-4-mini-instruct	Qwen-Qwen2.5-0.5B-Instruct	microsoft-resnet-50	sd-legacy-stable-diffusion-v1-5	google-vit-base-patch16-224	openai-whisper-large-v3-turbo
google-bert-bert-base-multilingual-cased	laion-CLIP-ViT-B-32-laion2B-s34B-b79K	deepseek-ai-DeepSeek-R1-Distill-Qwen-1.5B		meta-llama-Llama-3.1-8B-Instruct	meta-llama-Llama-3.2-1B-Instruct	mistralai-Mistral-7B-Instruct-v0.2		microsoft-Phi-3-mini-128k-instruct	microsoft-Phi-4-mini-instruct	Qwen-Qwen2.5-0.5B-Instruct			google-vit-base-patch16-224
intel-bert-base-uncased-mrpc	laion-CLIP-ViT-B-32-laion2B-s34B-b79K	deepseek-ai-DeepSeek-R1-Distill-Qwen-1.5B		meta-llama-Llama-3.2-1B-Instruct	meta-llama-Llama-3.2-1B-Instruct	mistralai-Mistral-7B-Instruct-v0.3		microsoft-Phi-3-mini-128k-instruct	microsoft-Phi-4-mini-instruct	Qwen-Qwen2.5-0.5B			google-vit-base-patch16-224
intel-bert-base-uncased-mrpc	openai-clip-vit-base-patch16	deepseek-ai-DeepSeek-R1-Distill-Qwen-1.5B			meta-llama-Llama-3.2-1B-Instruct			microsoft-Phi-3-mini-4k-instruct	microsoft-Phi-4-mini-reasoning	Qwen-Qwen2.5-1.5B-Instruct			sam-vit-base
	openai-clip-vit-base-patch16	deepseek-ai-DeepSeek-R1-Distill-Qwen-14B			meta-llama-Meta-Llama-3-8B			microsoft-Phi-3-mini-4k-instruct	microsoft-Phi-4-reasoning-plus	Qwen-Qwen2.5-1.5B-Instruct
	openai-clip-vit-base-patch32	deepseek-ai-DeepSeek-R1-Distill-Qwen-7B						microsoft-Phi-3-mini-4k-instruct	microsoft-Phi-4-reasoning	Qwen-Qwen2.5-1.5B-Instruct
	openai-clip-vit-base-patch32							microsoft-Phi-3.5-mini-instruct	microsoft-Phi-4	Qwen-Qwen2.5-1.5B-Instruct
	openai-clip-vit-large-patch14							microsoft-Phi-3.5-mini-instruct	microsoft-Phi-4	Qwen-Qwen2.5-14B-Instruct
								microsoft-Phi-3.5-mini-instruct		Qwen-Qwen2.5-14B-Instruct
								microsoft-Phi-3.5-mini-instruct		Qwen-Qwen2.5-3B-Instruct
								microsoft-Phi-4		Qwen-Qwen2.5-7B-Instruct
										Qwen-Qwen2.5-7B-Instruct
										Qwen-Qwen2.5-Coder-0.5B-Instruct
										Qwen-Qwen2.5-Coder-0.5B-Instruct
										Qwen-Qwen2.5-Coder-1.5B-Instruct
										Qwen-Qwen2.5-Coder-1.5B-Instruct
										Qwen-Qwen2.5-Coder-14B-Instruct
										Qwen-Qwen2.5-Coder-14B-Instruct
										Qwen-Qwen2.5-Coder-3B-Instruct
										Qwen-Qwen2.5-Coder-7B-Instruct
										Qwen-Qwen2.5-Coder-7B-Instruct
										deepseek-ai-DeepSeek-R1-Distill-Qwen-1.5B
										deepseek-ai-DeepSeek-R1-Distill-Qwen-14B
										deepseek-ai-DeepSeek-R1-Distill-Qwen-7B

Models grouped by device

cpu	gpu	npu
OFA-Sys-chinese-clip-vit-base-patch16	DeepSeek-R1-Distill-Llama-8B_Model_Builder_INT4	OFA-Sys-chinese-clip-vit-base-patch16
Qwen-Qwen2.5-0.5B-Instruct	DeepSeek-R1-Distill-Qwen-1.5B_Model_Builder_FP16	Qwen-Qwen2.5-0.5B-Instruct
Qwen-Qwen2.5-0.5B	DeepSeek-R1-Distill-Qwen-14B_NVMO_INT4_AWQ	Qwen-Qwen2.5-0.5B-Instruct
Qwen-Qwen2.5-1.5B-Instruct	DeepSeek-R1-Distill-Qwen-7B_NVMO_INT4_RTN	Qwen-Qwen2.5-1.5B-Instruct
Qwen-Qwen2.5-14B-Instruct	Llama-3.2-1B-Instruct_Model_Builder_FP16	Qwen-Qwen2.5-1.5B-Instruct
Qwen-Qwen2.5-3B-Instruct	Llama3.1-8B-Instruct_Model_Builder_INT4	Qwen-Qwen2.5-1.5B-Instruct
Qwen-Qwen2.5-7B-Instruct	Mistral-7B-Instruct-v0.2_Model_Builder_INT4	Qwen-Qwen2.5-1.5B-Instruct
Qwen-Qwen2.5-Coder-0.5B-Instruct	OFA-Sys-chinese-clip-vit-base-patch16	Qwen-Qwen2.5-14B-Instruct
Qwen-Qwen2.5-Coder-1.5B-Instruct	Phi-3-mini-128k-instruct_NVMO_INT4_RTN	Qwen-Qwen2.5-3B-Instruct
Qwen-Qwen2.5-Coder-14B-Instruct	Phi-3-mini-4k-instruct_Model_Builder_INT4	Qwen-Qwen2.5-7B-Instruct
Qwen-Qwen2.5-Coder-3B-Instruct	Phi3.5_Mini_Instruct_Model_Builder_INT4	Qwen-Qwen2.5-7B-Instruct
Qwen-Qwen2.5-Coder-7B-Instruct	Qwen-Qwen2.5-0.5B-Instruct	Qwen-Qwen2.5-7B-Instruct
deepseek-ai-DeepSeek-R1-Distill-Llama-8B	Qwen-Qwen2.5-0.5B-Instruct	Qwen-Qwen2.5-Coder-0.5B-Instruct
deepseek-ai-DeepSeek-R1-Distill-Qwen-1.5B	Qwen-Qwen2.5-0.5B	Qwen-Qwen2.5-Coder-0.5B-Instruct
deepseek-ai-DeepSeek-R1-Distill-Qwen-14B	Qwen-Qwen2.5-1.5B-Instruct	Qwen-Qwen2.5-Coder-1.5B-Instruct
deepseek-ai-DeepSeek-R1-Distill-Qwen-7B	Qwen-Qwen2.5-1.5B-Instruct	Qwen-Qwen2.5-Coder-1.5B-Instruct
gemma-3-1b-it_model_builder_cpu_FP32	Qwen-Qwen2.5-1.5B-Instruct	Qwen-Qwen2.5-Coder-14B-Instruct
google-bert-bert-base-multilingual-cased	Qwen-Qwen2.5-1.5B-Instruct	Qwen-Qwen2.5-Coder-3B-Instruct
google-gemma	Qwen-Qwen2.5-1.5B-Instruct	Qwen-Qwen2.5-Coder-7B-Instruct
google-vit-base-patch16-224	Qwen-Qwen2.5-1.5B-Instruct	Qwen-Qwen2.5-Coder-7B-Instruct
intel-bert-base-uncased-mrpc (ov)	Qwen-Qwen2.5-14B-Instruct	deepseek-ai-DeepSeek-R1-Distill-Llama-8B
laion-CLIP-ViT-B-32-laion2B-s34B-b79K	Qwen-Qwen2.5-14B-Instruct	deepseek-ai-DeepSeek-R1-Distill-Qwen-1.5B
meta-llama-Llama-3.1-8B-Instruct	Qwen-Qwen2.5-3B-Instruct	deepseek-ai-DeepSeek-R1-Distill-Qwen-1.5B
meta-llama-Llama-3.2-1B-Instruct	Qwen-Qwen2.5-7B-Instruct	deepseek-ai-DeepSeek-R1-Distill-Qwen-1.5B
microsoft-Phi-3-mini-128k-instruct	Qwen-Qwen2.5-7B-Instruct	deepseek-ai-DeepSeek-R1-Distill-Qwen-14B
microsoft-Phi-3-mini-4k-instruct	Qwen-Qwen2.5-Coder-0.5B-Instruct	deepseek-ai-DeepSeek-R1-Distill-Qwen-7B
microsoft-Phi-3.5-mini-instruct	Qwen-Qwen2.5-Coder-0.5B-Instruct	deepseek-ai-DeepSeek-R1-Distill-Qwen-7B
microsoft-Phi-4-mini-instruct	Qwen-Qwen2.5-Coder-1.5B-Instruct	google-bert-bert-base-multilingual-cased
microsoft-Phi-4-mini-reasoning	Qwen-Qwen2.5-Coder-1.5B-Instruct	google-bert-bert-base-multilingual-cased
microsoft-Phi-4	Qwen-Qwen2.5-Coder-14B-Instruct	google-bert-bert-base-multilingual-cased
microsoft-resnet-50	Qwen-Qwen2.5-Coder-14B-Instruct	google-vit-base-patch16-224
mistralai-Mistral-7B-Instruct-v0.2	Qwen-Qwen2.5-Coder-3B-Instruct	google-vit-base-patch16-224
mistralai-Mistral-7B-Instruct-v0.3	Qwen-Qwen2.5-Coder-7B-Instruct	google-vit-base-patch16-224
openai-clip-vit-base-patch16	Qwen-Qwen2.5-Coder-7B-Instruct	google-vit-base-patch16-224
openai-clip-vit-base-patch32	Qwen2.5-0.5B-Instruct_Model_Builder_FP16	google-vit-base-patch16-224
openai-clip-vit-large-patch14	Qwen2.5-14B-Instruct_Model_Builder_INT4	intel-bert-base-uncased-mrpc (AMD)
timm-mobilenetv3_small_100.lamb_in1k	Qwen2.5-7B-Instruct_Model_Builder_INT4	intel-bert-base-uncased-mrpc (ov)
	Qwen2.5-Coder-0.5B-Instruct_Model_Builder_FP16	intel-bert-base-uncased-mrpc
	Qwen2.5-Coder-1.5B-Instruct_Model_Builder_FP16	laion-CLIP-ViT-B-32-laion2B-s34B-b79K
	Qwen2.5-Coder-14B-Instruct_Model_Builder_INT4	laion-CLIP-ViT-B-32-laion2B-s34B-b79K
	Qwen2.5-Coder-7B-Instruct_Model_Builder_INT4	laion-CLIP-ViT-B-32-laion2B-s34B-b79K
	Qwen2.5_1.5B_Instruct_Model_Builder_FP16	meta-llama-Llama-3.1-8B-Instruct
	deepseek-ai-DeepSeek-R1-Distill-Llama-8B	meta-llama-Llama-3.1-8B-Instruct
	deepseek-ai-DeepSeek-R1-Distill-Qwen-1.5B	meta-llama-Llama-3.1-8B-Instruct
	deepseek-ai-DeepSeek-R1-Distill-Qwen-1.5B	meta-llama-Llama-3.2-1B-Instruct
	deepseek-ai-DeepSeek-R1-Distill-Qwen-1.5B	meta-llama-Llama-3.2-1B-Instruct
	deepseek-ai-DeepSeek-R1-Distill-Qwen-1.5B	meta-llama-Llama-3.2-1B-Instruct
	deepseek-ai-DeepSeek-R1-Distill-Qwen-1.5B	microsoft-Phi-3-mini-128k-instruct
	deepseek-ai-DeepSeek-R1-Distill-Qwen-1.5B	microsoft-Phi-3-mini-128k-instruct
	deepseek-ai-DeepSeek-R1-Distill-Qwen-14B	microsoft-Phi-3-mini-128k-instruct
	deepseek-ai-DeepSeek-R1-Distill-Qwen-14B	microsoft-Phi-3-mini-128k-instruct
	deepseek-ai-DeepSeek-R1-Distill-Qwen-7B	microsoft-Phi-3-mini-4k-instruct
	deepseek-ai-DeepSeek-R1-Distill-Qwen-7B	microsoft-Phi-3-mini-4k-instruct
	google-bert-bert-base-multilingual-cased	microsoft-Phi-3-mini-4k-instruct
	google-bert-bert-base-multilingual-cased	microsoft-Phi-3-mini-4k-instruct
	google-bert-bert-base-multilingual-cased	microsoft-Phi-3.5-mini-instruct
	google-bert-bert-base-multilingual-cased	microsoft-Phi-3.5-mini-instruct
	google-bert-bert-base-multilingual-cased	microsoft-Phi-3.5-mini-instruct
	google-bert-bert-base-multilingual-cased	microsoft-Phi-3.5-mini-instruct
	google-gemma	microsoft-Phi-3.5-mini-instruct
	google-vit-base-patch16-224	microsoft-Phi-4-mini-instruct
	google-vit-base-patch16-224	microsoft-Phi-4-mini-instruct
	google-vit-base-patch16-224	microsoft-Phi-4-mini-instruct
	google-vit-base-patch16-224	microsoft-Phi-4-mini-instruct
	google-vit-base-patch16-224	microsoft-Phi-4-mini-reasoning
	google-vit-base-patch16-224	microsoft-Phi-4-mini-reasoning
	intel-bert-base-uncased-mrpc (ov)	microsoft-Phi-4-reasoning-plus
	intel-bert-base-uncased-mrpc	microsoft-Phi-4-reasoning
	intel-bert-base-uncased-mrpc	microsoft-Phi-4-reasoning
	intel-bert-base-uncased-mrpc	microsoft-resnet-50
	intel-bert-base-uncased-mrpc	microsoft-resnet-50
	intel-bert-base-uncased-mrpc	microsoft-resnet-50
	laion-CLIP-ViT-B-32-laion2B-s34B-b79K	microsoft-table-transformer-detection
	laion-CLIP-ViT-B-32-laion2B-s34B-b79K	mistralai-Mistral-7B-Instruct-v0.2
	laion-CLIP-ViT-B-32-laion2B-s34B-b79K	mistralai-Mistral-7B-Instruct-v0.2
	laion-CLIP-ViT-B-32-laion2B-s34B-b79K	openai-clip-vit-base-patch16
	laion-CLIP-ViT-B-32-laion2B-s34B-b79K	openai-clip-vit-base-patch16
	laion-CLIP-ViT-B-32-laion2B-s34B-b79K	openai-clip-vit-base-patch16
	meta-llama-Llama-3.1-8B-Instruct	openai-clip-vit-base-patch32
	meta-llama-Llama-3.1-8B-Instruct	openai-clip-vit-base-patch32
	meta-llama-Llama-3.1-8B-Instruct	openai-clip-vit-base-patch32
	meta-llama-Llama-3.2-1B-Instruct	openai-clip-vit-large-patch14
	meta-llama-Llama-3.2-1B-Instruct	openai-clip-vit-large-patch14
	meta-llama-Llama-3.2-1B-Instruct	openai-clip-vit-large-patch14
	meta-llama-Llama-3.2-1B-Instruct	openai-whisper-large-v3-turbo
	meta-llama-Llama-3.2-1B-Instruct	sam-vit-base
	meta-llama-Llama-3.2-1B-Instruct	sam-vit-base
	microsoft-Phi-3-mini-128k-instruct	sam-vit-base
	microsoft-Phi-3-mini-128k-instruct	sam-vit-base
	microsoft-Phi-3-mini-4k-instruct	sam2.1-hiera-small
	microsoft-Phi-3-mini-4k-instruct	sam2.1-hiera-small
	microsoft-Phi-3.5-mini-instruct	sd-legacy-stable-diffusion-v1-5
	microsoft-Phi-3.5-mini-instruct	timm-mobilenetv3_small_100.lamb_in1k
	microsoft-Phi-3.5-mini-instruct	timm-mobilenetv3_small_100.lamb_in1k
	microsoft-Phi-3.5-mini-instruct
	microsoft-Phi-3.5-mini-instruct
	microsoft-Phi-3.5-mini-instruct
	microsoft-Phi-4-mini-instruct
	microsoft-Phi-4-mini-instruct
	microsoft-Phi-4-mini-instruct
	microsoft-Phi-4-mini-instruct_nvmo_ptq_mixed_precision_awq_lite
	microsoft-Phi-4-mini-reasoning
	microsoft-Phi-4-mini-reasoning
	microsoft-Phi-4-mini-reasoning
	microsoft-Phi-4-reasoning-plus
	microsoft-Phi-4-reasoning
	microsoft-Phi-4
	microsoft-Phi-4
	microsoft-Phi-4
	microsoft-resnet-50
	microsoft-resnet-50
	microsoft-resnet-50
	microsoft-resnet-50
	microsoft-resnet-50
	mistralai-Mistral-7B-Instruct-v0.2
	mistralai-Mistral-7B-Instruct-v0.2
	mistralai-Mistral-7B-Instruct-v0.3
	openai-clip-vit-base-patch16
	openai-clip-vit-base-patch16
	openai-clip-vit-base-patch16
	openai-clip-vit-base-patch16
	openai-clip-vit-base-patch16
	openai-clip-vit-base-patch16
	openai-clip-vit-base-patch32
	openai-clip-vit-base-patch32
	openai-clip-vit-base-patch32
	openai-clip-vit-base-patch32
	openai-clip-vit-base-patch32
	openai-clip-vit-base-patch32
	openai-clip-vit-large-patch14
	openai-clip-vit-large-patch14
	openai-clip-vit-large-patch14
	openai-clip-vit-large-patch14
	phi-4_Model_Builder_INT4

Models grouped by EP

CPU	CUDA	Dml	MIGraphX	NvTensorRTRTX	OpenVINO	QNN	VitisAI
gemma-3-1b-it_model_builder_cpu_FP32	google-gemma	Qwen-Qwen2.5-1.5B-Instruct	google-bert-bert-base-multilingual-cased	DeepSeek-R1-Distill-Llama-8B_Model_Builder_INT4	OFA-Sys-chinese-clip-vit-base-patch16	Qwen-Qwen2.5-1.5B-Instruct	Qwen-Qwen2.5-0.5B-Instruct
google-gemma		deepseek-ai-DeepSeek-R1-Distill-Qwen-1.5B	google-vit-base-patch16-224	DeepSeek-R1-Distill-Qwen-1.5B_Model_Builder_FP16	Qwen-Qwen2.5-0.5B-Instruct	Qwen-Qwen2.5-1.5B-Instruct	Qwen-Qwen2.5-1.5B-Instruct
timm-mobilenetv3_small_100.lamb_in1k		google-bert-bert-base-multilingual-cased	intel-bert-base-uncased-mrpc	DeepSeek-R1-Distill-Qwen-14B_NVMO_INT4_AWQ	Qwen-Qwen2.5-0.5B-Instruct	Qwen-Qwen2.5-1.5B-Instruct	Qwen-Qwen2.5-7B-Instruct
		google-vit-base-patch16-224	laion-CLIP-ViT-B-32-laion2B-s34B-b79K	DeepSeek-R1-Distill-Qwen-7B_NVMO_INT4_RTN	Qwen-Qwen2.5-0.5B	Qwen-Qwen2.5-1.5B-Instruct	Qwen-Qwen2.5-Coder-0.5B-Instruct
		intel-bert-base-uncased-mrpc	microsoft-resnet-50	Llama-3.2-1B-Instruct_Model_Builder_FP16	Qwen-Qwen2.5-1.5B-Instruct	Qwen-Qwen2.5-1.5B-Instruct	Qwen-Qwen2.5-Coder-1.5B-Instruct
		laion-CLIP-ViT-B-32-laion2B-s34B-b79K	openai-clip-vit-base-patch16	Llama3.1-8B-Instruct_Model_Builder_INT4	Qwen-Qwen2.5-1.5B-Instruct	Qwen-Qwen2.5-7B-Instruct	Qwen-Qwen2.5-Coder-7B-Instruct
		meta-llama-Llama-3.1-8B-Instruct	openai-clip-vit-base-patch32	Mistral-7B-Instruct-v0.2_Model_Builder_INT4	Qwen-Qwen2.5-14B-Instruct	deepseek-ai-DeepSeek-R1-Distill-Qwen-1.5B	deepseek-ai-DeepSeek-R1-Distill-Qwen-1.5B
		meta-llama-Llama-3.2-1B-Instruct	openai-clip-vit-large-patch14	Phi-3-mini-128k-instruct_NVMO_INT4_RTN	Qwen-Qwen2.5-14B-Instruct	deepseek-ai-DeepSeek-R1-Distill-Qwen-1.5B	deepseek-ai-DeepSeek-R1-Distill-Qwen-7B
		microsoft-Phi-3.5-mini-instruct		Phi-3-mini-4k-instruct_Model_Builder_INT4	Qwen-Qwen2.5-3B-Instruct	deepseek-ai-DeepSeek-R1-Distill-Qwen-1.5B	google-bert-bert-base-multilingual-cased
		microsoft-resnet-50		Phi3.5_Mini_Instruct_Model_Builder_INT4	Qwen-Qwen2.5-3B-Instruct	deepseek-ai-DeepSeek-R1-Distill-Qwen-1.5B	google-vit-base-patch16-224
		openai-clip-vit-base-patch16		Qwen-Qwen2.5-0.5B-Instruct	Qwen-Qwen2.5-7B-Instruct	google-bert-bert-base-multilingual-cased	intel-bert-base-uncased-mrpc (AMD)
		openai-clip-vit-base-patch32		Qwen-Qwen2.5-1.5B-Instruct	Qwen-Qwen2.5-7B-Instruct	google-bert-bert-base-multilingual-cased	laion-CLIP-ViT-B-32-laion2B-s34B-b79K
		openai-clip-vit-large-patch14		Qwen-Qwen2.5-14B-Instruct	Qwen-Qwen2.5-Coder-0.5B-Instruct	google-bert-bert-base-multilingual-cased	meta-llama-Llama-3.1-8B-Instruct
				Qwen-Qwen2.5-7B-Instruct	Qwen-Qwen2.5-Coder-0.5B-Instruct	google-vit-base-patch16-224	meta-llama-Llama-3.2-1B-Instruct
				Qwen-Qwen2.5-Coder-0.5B-Instruct	Qwen-Qwen2.5-Coder-1.5B-Instruct	google-vit-base-patch16-224	microsoft-Phi-3-mini-128k-instruct
				Qwen-Qwen2.5-Coder-1.5B-Instruct	Qwen-Qwen2.5-Coder-1.5B-Instruct	google-vit-base-patch16-224	microsoft-Phi-3-mini-4k-instruct
				Qwen-Qwen2.5-Coder-14B-Instruct	Qwen-Qwen2.5-Coder-14B-Instruct	google-vit-base-patch16-224	microsoft-Phi-3.5-mini-instruct
				Qwen-Qwen2.5-Coder-7B-Instruct	Qwen-Qwen2.5-Coder-14B-Instruct	intel-bert-base-uncased-mrpc	microsoft-Phi-4-mini-instruct
				Qwen2.5-0.5B-Instruct_Model_Builder_FP16	Qwen-Qwen2.5-Coder-3B-Instruct	intel-bert-base-uncased-mrpc	microsoft-Phi-4-mini-reasoning
				Qwen2.5-14B-Instruct_Model_Builder_INT4	Qwen-Qwen2.5-Coder-3B-Instruct	intel-bert-base-uncased-mrpc	microsoft-resnet-50
				Qwen2.5-7B-Instruct_Model_Builder_INT4	Qwen-Qwen2.5-Coder-7B-Instruct	laion-CLIP-ViT-B-32-laion2B-s34B-b79K	mistralai-Mistral-7B-Instruct-v0.2
				Qwen2.5-Coder-0.5B-Instruct_Model_Builder_FP16	Qwen-Qwen2.5-Coder-7B-Instruct	laion-CLIP-ViT-B-32-laion2B-s34B-b79K	openai-clip-vit-base-patch16
				Qwen2.5-Coder-1.5B-Instruct_Model_Builder_FP16	deepseek-ai-DeepSeek-R1-Distill-Llama-8B	laion-CLIP-ViT-B-32-laion2B-s34B-b79K	openai-clip-vit-base-patch32
				Qwen2.5-Coder-14B-Instruct_Model_Builder_INT4	deepseek-ai-DeepSeek-R1-Distill-Llama-8B	meta-llama-Llama-3.1-8B-Instruct	openai-clip-vit-large-patch14
				Qwen2.5-Coder-7B-Instruct_Model_Builder_INT4	deepseek-ai-DeepSeek-R1-Distill-Qwen-1.5B	meta-llama-Llama-3.2-1B-Instruct	timm-mobilenetv3_small_100.lamb_in1k
				Qwen2.5_1.5B_Instruct_Model_Builder_FP16	deepseek-ai-DeepSeek-R1-Distill-Qwen-1.5B	meta-llama-Llama-3.2-1B-Instruct
				deepseek-ai-DeepSeek-R1-Distill-Qwen-1.5B	deepseek-ai-DeepSeek-R1-Distill-Qwen-14B	meta-llama-Llama-3.2-1B-Instruct
				deepseek-ai-DeepSeek-R1-Distill-Qwen-14B	deepseek-ai-DeepSeek-R1-Distill-Qwen-14B	meta-llama-Llama-3.2-1B-Instruct
				deepseek-ai-DeepSeek-R1-Distill-Qwen-7B	deepseek-ai-DeepSeek-R1-Distill-Qwen-7B	microsoft-Phi-3-mini-128k-instruct
				google-bert-bert-base-multilingual-cased	deepseek-ai-DeepSeek-R1-Distill-Qwen-7B	microsoft-Phi-3-mini-128k-instruct
				google-vit-base-patch16-224	google-bert-bert-base-multilingual-cased	microsoft-Phi-3-mini-4k-instruct
				intel-bert-base-uncased-mrpc	google-vit-base-patch16-224	microsoft-Phi-3-mini-4k-instruct
				laion-CLIP-ViT-B-32-laion2B-s34B-b79K	google-vit-base-patch16-224	microsoft-Phi-3.5-mini-instruct
				meta-llama-Llama-3.1-8B-Instruct	intel-bert-base-uncased-mrpc (ov)	microsoft-Phi-3.5-mini-instruct
				meta-llama-Llama-3.2-1B-Instruct	laion-CLIP-ViT-B-32-laion2B-s34B-b79K	microsoft-Phi-3.5-mini-instruct
				microsoft-Phi-3-mini-128k-instruct	meta-llama-Llama-3.1-8B-Instruct	microsoft-Phi-3.5-mini-instruct
				microsoft-Phi-3-mini-4k-instruct	meta-llama-Llama-3.1-8B-Instruct	microsoft-Phi-3.5-mini-instruct
				microsoft-Phi-3.5-mini-instruct	meta-llama-Llama-3.2-1B-Instruct	microsoft-Phi-3.5-mini-instruct
				microsoft-Phi-4-mini-instruct_nvmo_ptq_mixed_precision_awq_lite	meta-llama-Llama-3.2-1B-Instruct	microsoft-Phi-4-mini-instruct
				microsoft-Phi-4	microsoft-Phi-3-mini-128k-instruct	microsoft-Phi-4-mini-instruct
				microsoft-resnet-50	microsoft-Phi-3-mini-128k-instruct	microsoft-Phi-4-reasoning
				mistralai-Mistral-7B-Instruct-v0.2	microsoft-Phi-3-mini-4k-instruct	microsoft-resnet-50
				openai-clip-vit-base-patch16	microsoft-Phi-3-mini-4k-instruct	microsoft-resnet-50
				openai-clip-vit-base-patch32	microsoft-Phi-3.5-mini-instruct	microsoft-table-transformer-detection
				openai-clip-vit-large-patch14	microsoft-Phi-3.5-mini-instruct	openai-clip-vit-base-patch16
				phi-4_Model_Builder_INT4	microsoft-Phi-4-mini-instruct	openai-clip-vit-base-patch16
					microsoft-Phi-4-mini-instruct	openai-clip-vit-base-patch16
					microsoft-Phi-4-mini-instruct	openai-clip-vit-base-patch32
					microsoft-Phi-4-mini-instruct	openai-clip-vit-base-patch32
					microsoft-Phi-4-mini-reasoning	openai-clip-vit-base-patch32
					microsoft-Phi-4-mini-reasoning	openai-clip-vit-large-patch14
					microsoft-Phi-4-mini-reasoning	openai-whisper-large-v3-turbo
					microsoft-Phi-4-mini-reasoning	sam-vit-base
					microsoft-Phi-4-reasoning-plus	sam-vit-base
					microsoft-Phi-4-reasoning-plus	sam-vit-base
					microsoft-Phi-4-reasoning	sam-vit-base
					microsoft-Phi-4-reasoning	sam2.1-hiera-small
					microsoft-Phi-4	sam2.1-hiera-small
					microsoft-Phi-4	sd-legacy-stable-diffusion-v1-5
					microsoft-resnet-50	timm-mobilenetv3_small_100.lamb_in1k
					mistralai-Mistral-7B-Instruct-v0.2
					mistralai-Mistral-7B-Instruct-v0.2
					mistralai-Mistral-7B-Instruct-v0.3
					openai-clip-vit-base-patch16
					openai-clip-vit-base-patch32
					openai-clip-vit-large-patch14

Learn more

🤝 Contributions and Feedback

We welcome contributions! Please read the contribution guidelines for more details on how to contribute to the Olive project.
For feature requests or bug reports, file a GitHub Issue.
For general discussion or questions, use GitHub Discussions.

⚖️ License

Licensed under the MIT License.

Name		Name	Last commit message	Last commit date
Latest commit History 270 Commits
.aitk		.aitk
.assets		.assets
.github		.github
OFA-Sys-chinese-clip-vit-base-patch16		OFA-Sys-chinese-clip-vit-base-patch16
Qwen-Qwen1.5-7B-Chat		Qwen-Qwen1.5-7B-Chat
Qwen-Qwen2-7B-Instruct		Qwen-Qwen2-7B-Instruct
Qwen-Qwen2.5-0.5B-Instruct		Qwen-Qwen2.5-0.5B-Instruct
Qwen-Qwen2.5-0.5B		Qwen-Qwen2.5-0.5B
Qwen-Qwen2.5-1.5B-Instruct		Qwen-Qwen2.5-1.5B-Instruct
Qwen-Qwen2.5-14B-Instruct		Qwen-Qwen2.5-14B-Instruct
Qwen-Qwen2.5-3B-Instruct		Qwen-Qwen2.5-3B-Instruct
Qwen-Qwen2.5-7B-Instruct		Qwen-Qwen2.5-7B-Instruct
Qwen-Qwen2.5-Coder-0.5B-Instruct		Qwen-Qwen2.5-Coder-0.5B-Instruct
Qwen-Qwen2.5-Coder-1.5B-Instruct		Qwen-Qwen2.5-Coder-1.5B-Instruct
Qwen-Qwen2.5-Coder-14B-Instruct		Qwen-Qwen2.5-Coder-14B-Instruct
Qwen-Qwen2.5-Coder-3B-Instruct		Qwen-Qwen2.5-Coder-3B-Instruct
Qwen-Qwen2.5-Coder-7B-Instruct		Qwen-Qwen2.5-Coder-7B-Instruct
Qwen-Qwen2.5-VL-3B-Instruct		Qwen-Qwen2.5-VL-3B-Instruct
Qwen-Qwen3-0.6B		Qwen-Qwen3-0.6B
Qwen-Qwen3-1.7B		Qwen-Qwen3-1.7B
Qwen-Qwen3-14B		Qwen-Qwen3-14B
Qwen-Qwen3-4B		Qwen-Qwen3-4B
Qwen-Qwen3-8B		Qwen-Qwen3-8B
Qwen-Qwen3-VL-2B-Instruct		Qwen-Qwen3-VL-2B-Instruct
Qwen-Qwen3-VL-4B-Instruct		Qwen-Qwen3-VL-4B-Instruct
Qwen-Qwen3-VL-8B-Instruct		Qwen-Qwen3-VL-8B-Instruct
Qwen-Qwen3.5-0.8B		Qwen-Qwen3.5-0.8B
Qwen-Qwen3.5-2B		Qwen-Qwen3.5-2B
Qwen-Qwen3.5-4B		Qwen-Qwen3.5-4B
Qwen-Qwen3.5-9B		Qwen-Qwen3.5-9B
adetailer		adetailer
alibaba-nlp-gte-large-en-v1.5		alibaba-nlp-gte-large-en-v1.5
amd-AMD-OLMo-1B-SFT-DPO		amd-AMD-OLMo-1B-SFT-DPO
compvis-stable-diffusion-v1-4		compvis-stable-diffusion-v1-4
deepseek-ai-DeepSeek-R1-Distill-Llama-8B		deepseek-ai-DeepSeek-R1-Distill-Llama-8B
deepseek-ai-DeepSeek-R1-Distill-Qwen-1.5B		deepseek-ai-DeepSeek-R1-Distill-Qwen-1.5B
deepseek-ai-DeepSeek-R1-Distill-Qwen-14B		deepseek-ai-DeepSeek-R1-Distill-Qwen-14B
deepseek-ai-DeepSeek-R1-Distill-Qwen-7B		deepseek-ai-DeepSeek-R1-Distill-Qwen-7B
facebook-opt-125m		facebook-opt-125m
google-bert-bert-base-multilingual-cased		google-bert-bert-base-multilingual-cased
google-gemma/olive		google-gemma/olive
google-vit-base-patch16-224		google-vit-base-patch16-224
gpt-oss-20b		gpt-oss-20b
intel-bert-base-uncased-mrpc		intel-bert-base-uncased-mrpc
laion-CLIP-ViT-B-32-laion2B-s34B-b79K		laion-CLIP-ViT-B-32-laion2B-s34B-b79K
meta-llama-Llama-2-7b-chat-hf		meta-llama-Llama-2-7b-chat-hf
meta-llama-Llama-2-7b-hf		meta-llama-Llama-2-7b-hf
meta-llama-Llama-3.1-8B-Instruct		meta-llama-Llama-3.1-8B-Instruct
meta-llama-Llama-3.1-8B		meta-llama-Llama-3.1-8B
meta-llama-Llama-3.2-1B-Instruct		meta-llama-Llama-3.2-1B-Instruct
meta-llama-Llama-3.2-3B-Instruct		meta-llama-Llama-3.2-3B-Instruct
meta-llama-Meta-Llama-3-8B		meta-llama-Meta-Llama-3-8B
microsoft-Phi-3-mini-128k-instruct		microsoft-Phi-3-mini-128k-instruct
microsoft-Phi-3-mini-4k-instruct		microsoft-Phi-3-mini-4k-instruct
microsoft-Phi-3.5-mini-instruct		microsoft-Phi-3.5-mini-instruct
microsoft-Phi-4-mini-instruct		microsoft-Phi-4-mini-instruct
microsoft-Phi-4-mini-reasoning		microsoft-Phi-4-mini-reasoning
microsoft-Phi-4-reasoning-plus		microsoft-Phi-4-reasoning-plus
microsoft-Phi-4-reasoning		microsoft-Phi-4-reasoning
microsoft-Phi-4		microsoft-Phi-4
microsoft-deberta-base-mnli		microsoft-deberta-base-mnli
microsoft-resnet-50		microsoft-resnet-50
microsoft-table-transformer-detection		microsoft-table-transformer-detection
mistralai-Mistral-7B-Instruct-v0.2		mistralai-Mistral-7B-Instruct-v0.2
mistralai-Mistral-7B-Instruct-v0.3		mistralai-Mistral-7B-Instruct-v0.3
mistralai-Mistral-7B-v0.1		mistralai-Mistral-7B-v0.1
mit-ast-finetuned-speech-commands-v2		mit-ast-finetuned-speech-commands-v2
open-llama-3b		open-llama-3b
openai-clip-vit-base-patch16		openai-clip-vit-base-patch16
openai-clip-vit-base-patch32		openai-clip-vit-base-patch32
openai-clip-vit-large-patch14		openai-clip-vit-large-patch14
openai-whisper-large-v3-turbo		openai-whisper-large-v3-turbo
openai-whisper-large-v3		openai-whisper-large-v3
sam-vit-base		sam-vit-base
sam2.1-hiera-small		sam2.1-hiera-small
sd-legacy-stable-diffusion-v1-5		sd-legacy-stable-diffusion-v1-5
sentence-transformers-all-MiniLM-L6-v2		sentence-transformers-all-MiniLM-L6-v2
sshleifer-tiny-gpt2		sshleifer-tiny-gpt2
stabilityai-stable-diffusion-xl-base-1.0		stabilityai-stable-diffusion-xl-base-1.0
tiiuae-falcon-7b		tiiuae-falcon-7b
timm-mobilenetv3_small_100.lamb_in1k		timm-mobilenetv3_small_100.lamb_in1k
usefulSensors-moonshine-tiny		usefulSensors-moonshine-tiny
.gitignore		.gitignore
.pre-commit-config.yaml		.pre-commit-config.yaml
CONTRIBUTING.md		CONTRIBUTING.md
LICENSE		LICENSE
README.md		README.md
SECURITY.md		SECURITY.md
requirements.txt		requirements.txt

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Repository files navigation

Olive Recipes For AI Model Optimization Toolkit

Supported models, architectures, devices and execution providers

Learn more

🤝 Contributions and Feedback

⚖️ License

About

Uh oh!

Releases

Packages

Uh oh!

Uh oh!

Contributors

Uh oh!

Languages

Folders and files

Latest commit

History

Repository files navigation

Olive Recipes For AI Model Optimization Toolkit

Supported models, architectures, devices and execution providers

Learn more

🤝 Contributions and Feedback

⚖️ License

About

Resources

License

Code of conduct

Contributing

Security policy

Uh oh!

Stars

Watchers

Forks

Releases

Packages 0

Uh oh!

Uh oh!

Contributors

Uh oh!

Languages

Packages