Skip to content

Multi-GPU KNN graph construction in UMAP #6729

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
divyegala opened this issue May 14, 2025 · 1 comment · Fixed by #6654
Closed

Multi-GPU KNN graph construction in UMAP #6729

divyegala opened this issue May 14, 2025 · 1 comment · Fixed by #6654
Assignees
@jinsolp

Comments

@divyegala
Copy link
Member

divyegala commented May 14, 2025 •
edited
Loading

Related cuVS Issue rapidsai/cuvs#727 and PR rapidsai/cuvs#785
@divyegala divyegala mentioned this issue May 14, 2025
Merged
@jinsolp
Copy link
Contributor

jinsolp commented May 14, 2025

related PR in cuML: #6654

rapids-bot bot pushed a commit that referenced this issue May 29, 2025
@jinsolp
Multi-gpu KNN build for UMAP using all-neighbors API (#6654)
c1a572d 
Allows multi-gpu knn graph building in UMAP using the all-neighbors API.

## PRs that need to be merged before this one
- rapidsai/cuvs#785
- rapidsai/raft#2666

## Changes in cuML UMAP usage
```
from pylibraft.common import DeviceResourcesSNMG

# if want to use multi GPU
multigpu_handle = DeviceResourcesSNMG()
umap_nnd = UMAP(handle = multigpu_handle, 
                 build_algo="nn_descent", 
                 build_kwds={"nnd_n_nearest_clusters": 2, 
                               "nnd_n_clusters": 8, 
                               "nnd_graph_degree": 32, 
                               "nnd_max_iterations": 20
                 })
```

Closes #6729

Authors:
  - Jinsol Park (https://github.com/jinsolp)

Approvers:
  - Simon Adorf (https://github.com/csadorf)
  - Divye Gala (https://github.com/divyegala)
  - Victor Lafargue (https://github.com/viclafargue)
  - Jim Crist-Harif (https://github.com/jcrist)

URL: #6654
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@jinsolp jinsolp

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Multi-gpu KNN build for UMAP using all-neighbors API jinsolp/cuml
2 participants
@divyegala @jinsolp