Lack the flexibility to express deploy primitives

[kerthcet]

What would you like to be cleaned:

For example, people want to deploy the model with different scheduling primitives, colocated or exclusive?

Why is this needed:

Expressing deploy primitives.

[kerthcet]

/kind question
/remove-kind cleanup

[kerthcet]

Right now, people can deploy a more advanced inference workload via Service, this is supported. But with playground, this is not workable.

[kerthcet]

However, especially for multi-host scenarios, topology is important, this is a key problem I think.

[kerthcet]

The general ides would be:

• For Service, because user has accesses to the whole yaml, so it's supported
• For Playground, we may support the topologies as another API