Skip to content
Docs Try Aspire

Local Fields

Class Fields 28 members
Models available on Foundry Local.
DeepseekR114b Section titled DeepseekR114b staticreadonly FoundryModel

This model is an optimized version of DeepSeek-R1-Distill-Qwen-14B to enable local inference on Intel GPUs.

Model Description

  • Developed by: Microsoft

  • Model type: ONNX

  • License: MIT

  • Model Description: This is a conversion of the DeepSeek-R1-Distill-Qwen-14B for local inference on Intel GPUs.

  • Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model.

Base Model Information

See Hugging Face model DeepSeek-R1-Distill-Qwen-14B for details.

public static readonly FoundryModel DeepseekR114b
DeepseekR115b Section titled DeepseekR115b staticreadonly FoundryModel

This model is an optimized version of DeepSeek-R1-Distill-Qwen-1.5B to enable local inference on Intel GPUs.

Model Description

  • Developed by: Microsoft

  • Model type: ONNX

  • License: MIT

  • Model Description: This is a conversion of the DeepSeek-R1-Distill-Qwen-1.5B for local inference on Intel GPUs.

  • Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model.

Base Model Information

See Hugging Face model DeepSeek-R1-Distill-Qwen-1.5B for details.

public static readonly FoundryModel DeepseekR115b
DeepseekR17b Section titled DeepseekR17b staticreadonly FoundryModel

This model is an optimized version of DeepSeek-R1-Distill-Qwen-7B to enable local inference on Intel GPUs.

Model Description

  • Developed by: Microsoft

  • Model type: ONNX

  • License: MIT

  • Model Description: This is a conversion of the DeepSeek-R1-Distill-Qwen-7B for local inference on Intel GPUs.

  • Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model.

Base Model Information

See Hugging Face model DeepSeek-R1-Distill-Qwen-7B for details.

public static readonly FoundryModel DeepseekR17b
GptOss20b Section titled GptOss20b staticreadonly FoundryModel

This model is an optimized version of gpt-oss-20b to enable local inference. This model uses RTN quantization.

Model Description

  • Developed by: Microsoft

  • Model type: ONNX

  • License: Apache-2.0

  • License Description: Use of this model is subject to the terms of the Apache License, Version 2.0, available at http://www.apache.org/licenses/LICENSE-2.0.

  • Model Description: This is a conversion of the gpt-oss-20b model for local inference.

  • Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model.

Base Model Information

See Azure AI Foundry model gpt-oss-20b for details.

public static readonly FoundryModel GptOss20b
Mistral7bV02 Section titled Mistral7bV02 staticreadonly FoundryModel

This model is an optimized version of Mistral-7B-Instruct-v0.2 to enable local inference on Intel GPUs.

Model Description

  • Developed by: Microsoft

  • Model type: ONNX

  • License: apache-2.0

  • Model Description: This is a conversion of the Mistral-7B-Instruct-v0.2 for local inference on Intel GPUs.

  • Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model.

Base Model Information

See Hugging Face model Mistral-7B-Instruct-v0.2 for details.

public static readonly FoundryModel Mistral7bV02
Phi35Mini Section titled Phi35Mini staticreadonly FoundryModel

This model is an optimized version of Phi-3.5-mini-instruct to enable local inference. This model uses RTN quantization.

Model Description

  • Developed by: Microsoft

  • Model type: ONNX

  • License: MIT

  • Model Description: This is a conversion of the Phi-3.5-mini-instruct for local inference.

  • Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model.

Base Model Information

See Hugging Face model Phi-3.5-mini-instruct for details.

public static readonly FoundryModel Phi35Mini
Phi3Mini128k Section titled Phi3Mini128k staticreadonly FoundryModel

This model is an optimized version of Phi-3-Mini-128K-Instruct to enable local inference. This model uses RTN quantization.

Model Description

  • Developed by: Microsoft

  • Model type: ONNX

  • License: MIT

  • Model Description: This is a conversion of the Phi-3-Mini-128K-Instruct for local inference.

  • Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model.

Base Model Information

See Hugging Face model Phi-3-Mini-128K-Instruct for details.

public static readonly FoundryModel Phi3Mini128k
Phi3Mini4k Section titled Phi3Mini4k staticreadonly FoundryModel

This model is an optimized version of Phi-3-Mini-4K-Instruct to enable local inference. This model uses RTN quantization.

Model Description

  • Developed by: Microsoft

  • Model type: ONNX

  • License: MIT

  • Model Description: This is a conversion of the Phi-3-Mini-4K-Instruct for local inference.

  • Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model.

Base Model Information

See Hugging Face model Phi-3-Mini-4K-Instruct for details.

public static readonly FoundryModel Phi3Mini4k

This model is an optimized version of Phi-4 to enable local inference. This model uses RTN quantization.

Model Description

  • Developed by: Microsoft

  • Model type: ONNX

  • License: MIT

  • Model Description: This is a conversion of the Phi-4 for local inference.

  • Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model.

Base Model Information

See Hugging Face model Phi-4 for details.

public static readonly FoundryModel Phi4
Phi4Mini Section titled Phi4Mini staticreadonly FoundryModel

This model is an optimized version of Phi-4-mini-instruct to enable local inference. This model uses RTN quantization.

Model Description

  • Developed by: Microsoft

  • Model type: ONNX

  • License: MIT

  • Model Description: This is a conversion of the Phi-4-mini-instruct for local inference.

  • Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model.

Base Model Information

See Hugging Face model Phi-4-mini-instruct for details.

public static readonly FoundryModel Phi4Mini
Phi4MiniReasoning Section titled Phi4MiniReasoning staticreadonly FoundryModel

This model is an optimized version of Phi-4-mini-reasoning to enable local inference. This model uses RTN quantization.

Model Description

  • Developed by: Microsoft

  • Model type: ONNX

  • License: MIT

  • Model Description: This is a conversion of the Phi-4-mini-reasoning for local inference.

  • Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model.

Base Model Information

See Hugging Face model Phi-4-mini-reasoning for details.

public static readonly FoundryModel Phi4MiniReasoning
Qwen2505b Section titled Qwen2505b staticreadonly FoundryModel

This model is an optimized version of Qwen2.5-0.5B-Instruct to enable local inference. This model uses RTN quantization.

Model Description

  • Developed by: Microsoft

  • Model type: ONNX

  • License: apache-2.0

  • Model Description: This is a conversion of the Qwen2.5-0.5B-Instruct for local inference.

  • Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model.

Base Model Information

See Hugging Face model Qwen2.5-0.5B-Instruct for details.

public static readonly FoundryModel Qwen2505b
Qwen2514b Section titled Qwen2514b staticreadonly FoundryModel

This model is an optimized version of Qwen2.5-14B-Instruct to enable local inference. This model uses RTN quantization.

Model Description

  • Developed by: Microsoft

  • Model type: ONNX

  • License: apache-2.0

  • Model Description: This is a conversion of the Qwen2.5-14B-Instruct for local inference.

  • Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model.

Base Model Information

See Hugging Face model Qwen2.5-14B-Instruct for details.

public static readonly FoundryModel Qwen2514b
Qwen2515b Section titled Qwen2515b staticreadonly FoundryModel

This model is an optimized version of Qwen2.5-1.5B-Instruct to enable local inference. This model uses RTN quantization.

Model Description

  • Developed by: Microsoft

  • Model type: ONNX

  • License: apache-2.0

  • Model Description: This is a conversion of the Qwen2.5-1.5B-Instruct for local inference.

  • Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model.

Base Model Information

See Hugging Face model Qwen2.5-1.5B-Instruct for details.

public static readonly FoundryModel Qwen2515b
Qwen2515bInstructTestVitisNpu Section titled Qwen2515bInstructTestVitisNpu staticreadonly FoundryModel
Qwen 2.5 1.5B Instruct model for AMD NPUs (test variant).
public static readonly FoundryModel Qwen2515bInstructTestVitisNpu
Qwen257b Section titled Qwen257b staticreadonly FoundryModel

This model is an optimized version of Qwen2.5-7B-Instruct to enable local inference. This model uses RTN quantization.

Model Description

  • Developed by: Microsoft

  • Model type: ONNX

  • License: apache-2.0

  • Model Description: This is a conversion of the Qwen2.5-7B-Instruct for local inference.

  • Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model.

Base Model Information

See Hugging Face model Qwen2.5-7B-Instruct for details.

public static readonly FoundryModel Qwen257b
Qwen25Coder05b Section titled Qwen25Coder05b staticreadonly FoundryModel

This model is an optimized version of Qwen2.5-Coder-0.5B-Instruct to enable local inference. This model uses RTN quantization.

Model Description

  • Developed by: Microsoft

  • Model type: ONNX

  • License: apache-2.0

  • Model Description: This is a conversion of the Qwen2.5-Coder-0.5B-Instruct for local inference.

  • Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model.

Base Model Information

See Hugging Face model Qwen2.5-Coder-0.5B-Instruct for details.

public static readonly FoundryModel Qwen25Coder05b
Qwen25Coder14b Section titled Qwen25Coder14b staticreadonly FoundryModel

This model is an optimized version of Qwen2.5-Coder-14B-Instruct to enable local inference. This model uses RTN quantization.

Model Description

  • Developed by: Microsoft

  • Model type: ONNX

  • License: apache-2.0

  • Model Description: This is a conversion of the Qwen2.5-Coder-14B-Instruct for local inference.

  • Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model.

Base Model Information

See Hugging Face model Qwen2.5-Coder-14B-Instruct for details.

public static readonly FoundryModel Qwen25Coder14b
Qwen25Coder15b Section titled Qwen25Coder15b staticreadonly FoundryModel

This model is an optimized version of Qwen2.5-Coder-1.5B-Instruct to enable local inference. This model uses RTN quantization.

Model Description

  • Developed by: Microsoft

  • Model type: ONNX

  • License: apache-2.0

  • Model Description: This is a conversion of the Qwen2.5-Coder-1.5B-Instruct for local inference.

  • Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model.

Base Model Information

See Hugging Face model Qwen2.5-Coder-1.5B-Instruct for details.

public static readonly FoundryModel Qwen25Coder15b
Qwen25Coder7b Section titled Qwen25Coder7b staticreadonly FoundryModel

This model is an optimized version of Qwen2.5-Coder-7B-Instruct to enable local inference. This model uses RTN quantization.

Model Description

  • Developed by: Microsoft

  • Model type: ONNX

  • License: apache-2.0

  • Model Description: This is a conversion of the Qwen2.5-Coder-7B-Instruct for local inference.

  • Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model.

Base Model Information

See Hugging Face model Qwen2.5-Coder-7B-Instruct for details.

public static readonly FoundryModel Qwen25Coder7b
Qwen306b Section titled Qwen306b staticreadonly FoundryModel

This model is an optimized version of Qwen3-0.6B to enable local inference. This model uses KLD Gradient quantization.

Model Description

  • Developed by: Microsoft

  • Model type: ONNX

  • License: apache-2.0

  • Model Description: This is a conversion of the Qwen3-0.6B for local inference.

  • Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model.

Base Model Information

See Hugging Face model Qwen3-0.6B for details.

public static readonly FoundryModel Qwen306b
Qwen314b Section titled Qwen314b staticreadonly FoundryModel

This model is an optimized version of Qwen3-14B to enable local inference. This model uses GPTQ quantization.

Model Description

  • Developed by: Microsoft

  • Model type: ONNX

  • License: apache-2.0

  • Model Description: This is a conversion of the Qwen3-14B for local inference.

  • Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model.

Base Model Information

See Hugging Face model Qwen3-14B for details.

public static readonly FoundryModel Qwen314b
Qwen317b Section titled Qwen317b staticreadonly FoundryModel

This model is an optimized version of Qwen3-1.7B to enable local inference. This model uses KLD Gradient quantization.

Model Description

  • Developed by: Microsoft

  • Model type: ONNX

  • License: apache-2.0

  • Model Description: This is a conversion of the Qwen3-1.7B for local inference.

  • Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model.

Base Model Information

See Hugging Face model Qwen3-1.7B for details.

public static readonly FoundryModel Qwen317b
Qwen34b Section titled Qwen34b staticreadonly FoundryModel

This model is an optimized version of Qwen3-4B to enable local inference. This model uses KLD Gradient quantization.

Model Description

  • Developed by: Microsoft

  • Model type: ONNX

  • License: apache-2.0

  • Model Description: This is a conversion of the Qwen3-4B for local inference.

  • Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model.

Base Model Information

See Hugging Face model Qwen3-4B for details.

public static readonly FoundryModel Qwen34b
Qwen38b Section titled Qwen38b staticreadonly FoundryModel

This model is an optimized version of Qwen3-8B to enable local inference. This model uses KLD Gradient quantization.

Model Description

  • Developed by: Microsoft

  • Model type: ONNX

  • License: apache-2.0

  • Model Description: This is a conversion of the Qwen3-8B for local inference.

  • Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model.

Base Model Information

See Hugging Face model Qwen3-8B for details.

public static readonly FoundryModel Qwen38b
Qwen3Vl2bInstruct Section titled Qwen3Vl2bInstruct staticreadonly FoundryModel

This model is an optimized version of Qwen3-VL-2B-Instruct to enable local inference. This model uses RTN quantization.

Model Description

  • Developed by: Microsoft

  • Model type: ONNX

  • License: apache-2.0

  • Model Description: This is a conversion of the Qwen3-VL-2B-Instruct for local inference.

  • Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model.

Base Model Information

See Hugging Face model Qwen3-VL-2B-Instruct for details.

public static readonly FoundryModel Qwen3Vl2bInstruct
Qwen3Vl4bInstruct Section titled Qwen3Vl4bInstruct staticreadonly FoundryModel

This model is an optimized version of Qwen3-VL-4B-Instruct to enable local inference. This model uses RTN quantization.

Model Description

  • Developed by: Microsoft

  • Model type: ONNX

  • License: apache-2.0

  • Model Description: This is a conversion of the Qwen3-VL-4B-Instruct for local inference.

  • Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model.

Base Model Information

See Hugging Face model Qwen3-VL-4B-Instruct for details.

public static readonly FoundryModel Qwen3Vl4bInstruct
Qwen3Vl8bInstruct Section titled Qwen3Vl8bInstruct staticreadonly FoundryModel

This model is an optimized version of Qwen3-VL-8B-Instruct to enable local inference. This model uses RTN quantization.

Model Description

  • Developed by: Microsoft

  • Model type: ONNX

  • License: apache-2.0

  • Model Description: This is a conversion of the Qwen3-VL-8B-Instruct for local inference.

  • Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model.

Base Model Information

See Hugging Face model Qwen3-VL-8B-Instruct for details.

public static readonly FoundryModel Qwen3Vl8bInstruct