Local LLM inference engine written from scratch in Rust — hand-written AVX-512 assembly kernels, Metal & Vulkan compute shaders. Supports Qwen3, Mistral3, ... Q4/INT8/BF16 quantization.
-
Updated
Mar 18, 2026 - Rust
#
openweight
Here are 3 public repositories matching this topic...
An offline AI chat application built specifically for Ubuntu Touch, allowing users to run lightweight Large Language Models (LLMs) directly on their mobile device.
-
Updated
Jul 10, 2026 - QML
Open Weight Definition (OWD)
open-source machine-learning opensource ai artificial-intelligence machinelearning artificialintelligence open-weight openweight
-
Updated
Jan 21, 2025 - Ruby
Improve this page
Add a description, image, and links to the openweight topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the openweight topic, visit your repo's landing page and select "manage topics."