Skip to content

[Core] Placement groups, scheduling and priorities #47760

Open
@inf000

Description

@inf000

Description

Greetings,

I have a couple of questions regarding placement groups, scheduling and priorities.

Mainly my interest is if there is an option to have more flexible placement groups, to have the ability to lets say give a min and max size of the placement group, so that the group can fit when you have almost all the resources need or half of the resources and not have to wait for everything to be available, and add more resources as they become available, and in line with this to be able to start running task as soon as parts of the placement group become available (this is more for running on clusters, not needing to wait for all the nodes to scale up, rather start working as soon as some nodes are available). I'm guessing this all falls into the category of having the ability to resize the placement group.

On topic of scheduling and priorities, i have a question if some features were planed to give the ability of job priorities to Ray core, i saw that you could achieve this using lets say Kueue, but this is more oriented to RayJobs i was thinking of something that works with a running RayCluster or Ray Core, for task submission through code.

Use case

Running multiple jobs on same cluster, job flexibility, isolation, resource management and job priority.

Metadata

Metadata

Assignees

No one assigned

    Labels

    P1Issue that should be fixed within a few weekscoreIssues that should be addressed in Ray Corecore-multi-tenancycore-schedulerenhancementRequest for new feature and/or capability

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions