Search results

[Question] How to integrate MagicPIG with other benchmark frameworks mentioned in the paper?

Status: Open.

#18 In Infini-AI-Lab/MagicPIG;

· 1235357 opened on Jun 8, 2025

do you support deepseek mla?

Status: Open.

#17 In Infini-AI-Lab/MagicPIG;

· artetaout opened on May 20, 2025

A bug of Illegal instruction (core dumped)

Status: Open.

#16 In Infini-AI-Lab/MagicPIG;

· qqtang-code opened on Apr 5, 2025

The memory size occupied by the hash tables.

Status: Open.

#12 In Infini-AI-Lab/MagicPIG;

· Heappp opened on Feb 14, 2025

Questions about dense layers

Status: Open.

#10 In Infini-AI-Lab/MagicPIG;

· renlicheng opened on Jan 15, 2025

AWQ (Llama3.1/3.3-8B/70B)

enhancementNew feature or requestNew feature or request

Status: Open.

#9 In Infini-AI-Lab/MagicPIG;

· dreaming-panda opened on Jan 15, 2025

FP8 (Llama3.1/3.3-8B/70B)

enhancementNew feature or requestNew feature or request

Status: Open.

#8 In Infini-AI-Lab/MagicPIG;

· dreaming-panda opened on Jan 15, 2025

Quantization Support

enhancementNew feature or requestNew feature or request

Status: Open.

#7 In Infini-AI-Lab/MagicPIG;

· dreaming-panda opened on Jan 15, 2025

Test on a real 24GB GPU

Status: Open.

#6 In Infini-AI-Lab/MagicPIG;

· ydyhello opened on Jan 14, 2025

Support for quantized KV Cache

Status: Open.

#5 In Infini-AI-Lab/MagicPIG;

· zjnyly opened on Jan 8, 2025

Question on Quest implemenation in KV cache selection

Status: Open.

#4 In Infini-AI-Lab/MagicPIG;

· Monstertail opened on Dec 21, 2024

Question in testing latency

Status: Open.

#3 In Infini-AI-Lab/MagicPIG;

· alkane7 opened on Dec 14, 2024