Search results

support vllm cpu in backendruntime

featureCategorizes issue or PR as related to a new feature.Categorizes issue or PR as related to a new feature.

needs-priorityIndicates a PR lacks a label and requires one.Indicates a PR lacks a label and requires one.

needs-triageIndicates an issue or PR lacks a label and requires one.Indicates an issue or PR lacks a label and requires one.

Status: Open (in progress).

InftyAI/llmaznumber 472

#472 In InftyAI/llmaz;

· googs1025 opened on Jun 29, 2025

feat: Add priority field to Flavor

featureCategorizes issue or PR as related to a new feature.Categorizes issue or PR as related to a new feature.

needs-priorityIndicates a PR lacks a label and requires one.Indicates a PR lacks a label and requires one.

needs-triageIndicates an issue or PR lacks a label and requires one.Indicates an issue or PR lacks a label and requires one.

Status: Open.

#469 In InftyAI/llmaz;

· googs1025 opened on Jun 23, 2025

feat: support configuring init container image

featureCategorizes issue or PR as related to a new feature.Categorizes issue or PR as related to a new feature.

needs-priorityIndicates a PR lacks a label and requires one.Indicates a PR lacks a label and requires one.

needs-triageIndicates an issue or PR lacks a label and requires one.Indicates an issue or PR lacks a label and requires one.

Status: Open (in progress).

InftyAI/llmaznumber 443

#443 In InftyAI/llmaz;

· rudeigerc opened on Jun 6, 2025

Milestone v0.3.0

featureCategorizes issue or PR as related to a new feature.Categorizes issue or PR as related to a new feature.

needs-priorityIndicates a PR lacks a label and requires one.Indicates a PR lacks a label and requires one.

needs-triageIndicates an issue or PR lacks a label and requires one.Indicates an issue or PR lacks a label and requires one.

Status: Open.

#433 In InftyAI/llmaz;

· kerthcet opened on Jun 2, 2025

Enable envoy token rate limiting by configuration

featureCategorizes issue or PR as related to a new feature.Categorizes issue or PR as related to a new feature.

help wantedExtra attention is neededExtra attention is needed

needs-priorityIndicates a PR lacks a label and requires one.Indicates a PR lacks a label and requires one.

needs-triageIndicates an issue or PR lacks a label and requires one.Indicates an issue or PR lacks a label and requires one.

Status: Open.

#412 In InftyAI/llmaz;

· kerthcet opened on May 14, 2025

Add T/$ as indicator to measure the cost efficiency

featureCategorizes issue or PR as related to a new feature.Categorizes issue or PR as related to a new feature.

needs-priorityIndicates a PR lacks a label and requires one.Indicates a PR lacks a label and requires one.

needs-triageIndicates an issue or PR lacks a label and requires one.Indicates an issue or PR lacks a label and requires one.

Status: Open.

#401 In InftyAI/llmaz;

· kerthcet opened on May 6, 2025

Manage the ai gateway resources automatically

featureCategorizes issue or PR as related to a new feature.Categorizes issue or PR as related to a new feature.

needs-priorityIndicates a PR lacks a label and requires one.Indicates a PR lacks a label and requires one.

needs-triageIndicates an issue or PR lacks a label and requires one.Indicates an issue or PR lacks a label and requires one.

Status: Open.

#387 In InftyAI/llmaz;

· kerthcet opened on Apr 30, 2025

open-webui support namespaces

featureCategorizes issue or PR as related to a new feature.Categorizes issue or PR as related to a new feature.

help wantedExtra attention is neededExtra attention is needed

needs-priorityIndicates a PR lacks a label and requires one.Indicates a PR lacks a label and requires one.

needs-triageIndicates an issue or PR lacks a label and requires one.Indicates an issue or PR lacks a label and requires one.

Status: Open.

#386 In InftyAI/llmaz;

· kerthcet opened on Apr 29, 2025

[Umbrella] advanced traffic load balancing algorithms

featureCategorizes issue or PR as related to a new feature.Categorizes issue or PR as related to a new feature.

needs-priorityIndicates a PR lacks a label and requires one.Indicates a PR lacks a label and requires one.

needs-triageIndicates an issue or PR lacks a label and requires one.Indicates an issue or PR lacks a label and requires one.

Status: Open.

#376 In InftyAI/llmaz;

· kerthcet opened on Apr 24, 2025

Envoy gateway plugin support with random selection

featureCategorizes issue or PR as related to a new feature.Categorizes issue or PR as related to a new feature.

needs-kindIndicates a PR lacks a label and requires one.Indicates a PR lacks a label and requires one.

needs-priorityIndicates a PR lacks a label and requires one.Indicates a PR lacks a label and requires one.

needs-triageIndicates an issue or PR lacks a label and requires one.Indicates an issue or PR lacks a label and requires one.

Status: Open.

#371 In InftyAI/llmaz;

· kerthcet opened on Apr 23, 2025

[OSPP] KEDA-based Serverless Elastic Scaling for llmaz

featureCategorizes issue or PR as related to a new feature.Categorizes issue or PR as related to a new feature.

needs-kindIndicates a PR lacks a label and requires one.Indicates a PR lacks a label and requires one.

needs-priorityIndicates a PR lacks a label and requires one.Indicates a PR lacks a label and requires one.

needs-triageIndicates an issue or PR lacks a label and requires one.Indicates an issue or PR lacks a label and requires one.

Status: Open.

#362 In InftyAI/llmaz;

· pacoxu opened on Apr 22, 2025

Enabling Efficient Model and Container Image Distribution in LLMaz with Dragonfly

featureCategorizes issue or PR as related to a new feature.Categorizes issue or PR as related to a new feature.

help wantedExtra attention is neededExtra attention is needed

needs-kindIndicates a PR lacks a label and requires one.Indicates a PR lacks a label and requires one.

needs-priorityIndicates a PR lacks a label and requires one.Indicates a PR lacks a label and requires one.

needs-triageIndicates an issue or PR lacks a label and requires one.Indicates an issue or PR lacks a label and requires one.

Status: Open.

#361 In InftyAI/llmaz;

· pacoxu opened on Apr 22, 2025