Skip to content

@intellistream IntelliStream

All

    Repositories list

    34 repositories

    • memory-aware-sparse-kv

      Public
      Memory-aware lossless KV offloading and prefetching for native sparse-attention LLM serving
      Python
      •0•0•2•1•Updated Oct 6, 2026Oct 6, 2026

    • vllm-hust-ext-manager

      Public archive
      Research platform for principled plugin architecture, lifecycle safety, compatibility, and conflict management in LLM inference systems
      extensibilityplugin-systemvllm
      extensibilityplugin-systemvllmllm-inferencesystems-research
      Python
      •1•0•13•1•Updated Oct 6, 2026Oct 6, 2026

    • vllm-hust-eplb-control-plane

      Public
      Python
      •0•0•0•1•Updated Oct 2, 2026Oct 2, 2026

    • vllm-hust-cuda-fullgraph-matrix

      Public
      Independent BetterScale-derived CUDA ECPA mod for vLLM-HUST; authored by Jingyuan Tian, advised by Shuhao Zhang
      Python
      •
      Apache License 2.0
      •0•0•0•0•Updated Oct 1, 2026Oct 1, 2026

    • vllm-hust-cuda-async-tp

      Public
      Independent BetterScale-derived CUDA ECPA mod for vLLM-HUST; authored by Jingyuan Tian, advised by Shuhao Zhang
      Python
      •
      Apache License 2.0
      •0•0•0•0•Updated Oct 1, 2026Oct 1, 2026

    • vllm-hust-cuda-hybrid-apc

      Public
      Independent BetterScale-derived CUDA ECPA mod for vLLM-HUST; authored by Jingyuan Tian, advised by Shuhao Zhang
      Python
      •
      Apache License 2.0
      •0•0•0•0•Updated Oct 1, 2026Oct 1, 2026

    • vllm-hust-cuda-qk-rope

      Public
      Independent BetterScale-derived CUDA ECPA mod for vLLM-HUST; authored by Jingyuan Tian, advised by Shuhao Zhang
      Python
      •
      Apache License 2.0
      •0•0•0•0•Updated Oct 1, 2026Oct 1, 2026

    • sage-qwen-opencode

      Public
      一键配置 OpenCode V2 使用课题组 SAGE Qwen3.8-27B Responses 服务（不包含任何 API Key）
      Shell
      •
      MIT License
      •0•0•0•0•Updated Sep 30, 2026Sep 30, 2026

    • vllm-ascend-compact-greedy-hust

      Public
      Research incubation: exact distributed sampling with checked candidate sufficiency and bounded fallback; experimental Ascend source mod.
      inferenceascendsource-mod
      inferenceascendsource-modvllm
      Python
      •
      Apache License 2.0
      •0•0•1•0•Updated Sep 21, 2026Sep 21, 2026

    • pegaflow-tailguard

      Public archive
      PegaFlow plugin for P/D CPU-memory placement, remote-read admission, and RDMA tail-latency control.
      0•0•0•0•Updated Sep 20, 2026Sep 20, 2026

    • sageTSDB

      Public
      C++
      •
      Other
      •1•2•0•0•Updated Sep 12, 2026Sep 12, 2026

    • bidkv-multinpu

      Public
      Multi-NPU extension of BidKV: topology-aware KV pressure, victim selection, and coordination across devices.
      Python
      •0•1•3•0•Updated Sep 3, 2026Sep 3, 2026

    • vllm-hust-legacy-20260831

      Public archive
      Upstream-compatible vLLM fork for domestic hardware enablement and AGI4S serving
      Python
      •
      Apache License 2.0
      •23k•12•4•1•Updated Aug 31, 2026Aug 31, 2026

    • vllm-ascend-hust-legacy-20260831

      Public archive
      vLLM Ascend integration for vLLM-HUST, focused on Ascend runtime convergence and domestic hardware enablement.
      C++
      •
      Apache License 2.0
      •19•3•19•6•Updated Aug 30, 2026Aug 30, 2026

    • forL0-state-backend

      Public
      An new in-memory flink state backend that utilizes L0 cache.
      TeX
      •1•3•4•0•Updated Aug 21, 2026Aug 21, 2026

    • intellistream.github.io

      Public
      Astro
      •
      MIT License
      •0•0•0•0•Updated Aug 18, 2026Aug 18, 2026

    • .github

      Public
      0•0•0•0•Updated Aug 17, 2026Aug 17, 2026

    • sageVDB

      Public
      C++
      •
      MIT License
      •0•1•0•0•Updated Aug 9, 2026Aug 9, 2026

    • sage-anns

      Public
      SAGE ANNS: Approximate Nearest Neighbor Search algorithms with unified Python interface
      C++
      •
      MIT License
      •0•0•1•0•Updated Aug 9, 2026Aug 9, 2026

    • cceval

      Public
      CrossCodeEval: A Diverse and Multilingual Benchmark for Cross-File Code Completion (NeurIPS 2023)
      Python
      •
      Apache License 2.0
      •29•0•0•0•Updated Aug 4, 2026Aug 4, 2026

    • sageData

      Public
      Python
      •
      MIT License
      •0•1•0•0•Updated Jul 29, 2026Jul 29, 2026

    • harbor

      Public
      Python
      •
      MIT License
      •0•0•0•0•Updated Jul 9, 2026Jul 9, 2026

    • multicodex

      Public
      Python
      •
      MIT License
      •0•0•0•0•Updated Jul 9, 2026Jul 9, 2026

    • brisksnapshot-ui

      Public
      brisksnapshot-ui
      TypeScript
      •0•0•0•0•Updated May 28, 2026May 28, 2026

    • OmniBenchmark

      Public archive
      Benchmark Suite - Comprehensive evaluation framework
      Python
      •
      MIT License
      •0•0•9•0•Updated Feb 6, 2026Feb 6, 2026

    • parallel-computing-course-java-demos

      Public template
      parallel-computingjava-concurrencyjava-examples
      parallel-computingjava-concurrencyjava-examplescourse-templatedemo-code
      Java
      •0•0•0•0•Updated Jan 25, 2026Jan 25, 2026

    • hotllm

      Public
      A high-throughput and memory-efficient inference and serving engine for LLMs
      Python
      •
      Apache License 2.0
      •23k•0•0•0•Updated Aug 29, 2025Aug 29, 2025

    • pycuda

      Public
      CUDA integration for Python, plus shiny features
      Python
      •
      Other
      •298•0•0•0•Updated Jun 8, 2025Jun 8, 2025

    • InfiniGen

      Public
      InfiniGen: Efficient Generative Inference of Large Language Models with Dynamic KV Cache Management (OSDI'24)
      Python
      •
      Apache License 2.0
      •40•0•0•0•Updated Jul 10, 2024Jul 10, 2024

    • CRUD_RAG

      Public
      CRUD-RAG: A Comprehensive Chinese Benchmark for Retrieval-Augmented Generation of Large Language Models
      Python
      •
      MIT License
      •33•2•0•0•Updated Apr 6, 2024Apr 6, 2024
    ProTip! When viewing an organization's repositories, you can use the props. filter to filter by custom property.