Skip to content

@neuralmagic Neural Magic

Change the repository type filter

All

    Repositories list

    80 repositories

    • vllm

      Public
      A high-throughput and memory-efficient inference and serving engine for LLMs
      Python
      •
      Apache License 2.0
      •10k•15•0•18•Updated Sep 23, 2025Sep 23, 2025

    • model-validation-configs

      Public
      0•1•0•2•Updated Sep 23, 2025Sep 23, 2025

    • compressed-tensors

      Public
      A safetensors extension to efficiently store sparse quantized tensors on disk
      Python
      •
      Apache License 2.0
      •31•162•3•20•Updated Sep 23, 2025Sep 23, 2025

    • research

      Public
      Repository to enable research flows
      Python
      •0•1•0•1•Updated Sep 22, 2025Sep 22, 2025

    • axolotl

      Public
      Go ahead and axolotl questions
      Python
      •
      Apache License 2.0
      •1.2k•0•0•5•Updated Sep 21, 2025Sep 21, 2025

    • pytorch

      Public
      Tensors and Dynamic neural networks in Python with strong GPU acceleration
      Python
      •
      Other
      •25k•0•0•1•Updated Sep 17, 2025Sep 17, 2025

    • pydantic-regmix

      Public
      Common mixins, registries, and utilities with native support for Pydantic used across popular repos such as GuideLLM and Speculators
      Apache License 2.0
      •0•0•0•0•Updated Sep 17, 2025Sep 17, 2025

    • upstream-transformers

      Public
      🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
      Python
      •
      Apache License 2.0
      •30k•1•0•0•Updated Sep 12, 2025Sep 12, 2025

    • nm-actions

      Public
      Neural Magic GHA
      Python
      •
      Apache License 2.0
      •0•0•0•3•Updated Sep 3, 2025Sep 3, 2025

    • pplx-kernels

      Public
      Perplexity GPU Kernels
      C++
      •
      MIT License
      •59•0•0•0•Updated Aug 29, 2025Aug 29, 2025

    • DeepEP

      Public
      DeepEP: an efficient expert-parallel communication library
      Cuda
      •
      MIT License
      •934•0•0•0•Updated Aug 29, 2025Aug 29, 2025

    • DeepGEMM

      Public
      DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling
      Cuda
      •
      MIT License
      •697•0•0•0•Updated Aug 29, 2025Aug 29, 2025

    • github-jira-sandbox

      Public
      proving grounds for GitHub to JIRA ... yay!
      Apache License 2.0
      •0•0•0•0•Updated Aug 27, 2025Aug 27, 2025

    • lmms-eval

      Public
      Accelerating the development of large multimodal models (LMMs) with one-click evaluation module - lmms-eval.
      Python
      •
      Other
      •378•0•0•9•Updated Aug 6, 2025Aug 6, 2025

    • flashinfer

      Public
      FlashInfer: Kernel Library for LLM Serving
      Cuda
      •
      Apache License 2.0
      •514•0•0•0•Updated Jul 18, 2025Jul 18, 2025

    • arena-hard-auto

      Public
      Arena-Hard-Auto: An automatic LLM benchmark.
      Python
      •
      Apache License 2.0
      •127•0•0•1•Updated Jul 16, 2025Jul 16, 2025

    • collective_op_benchmarks

      Public
      Python
      •0•0•0•0•Updated Jul 11, 2025Jul 11, 2025

    • LMCache

      Public
      Redis for LLMs
      Python
      •
      Apache License 2.0
      •600•1•0•1•Updated Jun 18, 2025Jun 18, 2025

    • vllm-flash-attention

      Public
      Fast and memory-efficient exact attention
      Python
      •
      BSD 3-Clause "New" or "Revised" License
      •2k•5•0•0•Updated Jun 11, 2025Jun 11, 2025

    • pytest-nm-releng

      Public
      Pytest plugin used by the Release Engineering team
      Python
      •
      Apache License 2.0
      •0•0•0•0•Updated Jun 9, 2025Jun 9, 2025

    • lm-evaluation-harness

      Public
      A framework for few-shot evaluation of language models.
      Python
      •
      MIT License
      •2.7k•4•0•1•Updated Jun 9, 2025Jun 9, 2025

    • yolov5

      Public archive
      YOLOv5 in PyTorch > ONNX > CoreML > TFLite
      Python
      •
      GNU General Public License v3.0
      •17k•19•0•0•Updated Jun 4, 2025Jun 4, 2025

    • yolov3

      Public archive
      YOLOv3 in PyTorch > ONNX > CoreML > TFLite
      Python
      •
      GNU General Public License v3.0
      •3.5k•3•0•0•Updated Jun 4, 2025Jun 4, 2025

    • transformers

      Public archive
      🤗Transformers: State-of-the-art Natural Language Processing for Pytorch and TensorFlow 2.0.
      Python
      •
      Apache License 2.0
      •30k•9•0•0•Updated Jun 4, 2025Jun 4, 2025

    • llm-d

      Public
      llm-d is a Kubernetes-native high-performance distributed LLM inference framework
      Makefile
      •
      Apache License 2.0
      •164•0•0•0•Updated Jun 3, 2025Jun 3, 2025

    • deepsparse

      Public archive
      Sparsity-aware deep learning inference runtime for CPUs
      nlpperformancecomputer-visioninferencemachinelearningpruningobject-detectionpretrained-modelsquantizationcpus
      Python
      •
      Other
      •190•3.2k•1•0•Updated Jun 2, 2025Jun 2, 2025

    • sparsify

      Public archive
      ML model optimization product to accelerate inference.
      computer-visiontensorflowkeraspytorchimage-classificationpruningobject-detectionquantizationautomlonnx
      Python
      •
      Apache License 2.0
      •30•326•1•0•Updated Jun 2, 2025Jun 2, 2025

    • sparseml

      Public archive
      Libraries for applying sparsification recipes to neural networks with a few lines of code, enabling faster and smaller models
      sparsitykerasdeep-learning-algorithmsdeep-learning-librarypruningobject-detectioncomputer-vision-algorithmsonnxdeep-learning-modelssparsification
      Python
      •
      Apache License 2.0
      •157•2.1k•1•0•Updated Jun 2, 2025Jun 2, 2025

    • docs

      Public archive
      Top-level directory for documentation and general content
      MDX
      •7•120•0•0•Updated Jun 2, 2025Jun 2, 2025

    • sparsezoo

      Public archive
      Neural network model repository for highly sparse and sparse-quantized models with matching sparsification recipes
      nlpcomputer-visiondeep-learning-algorithmsyoloresnetpruningtransfer-learningpretrained-modelsquantizationmobilenet
      Python
      •
      Apache License 2.0
      •27•392•1•0•Updated Jun 2, 2025Jun 2, 2025