Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

WIP: [DO NOT MERGE] introduce libcugraph wheels #4804

Draft
wants to merge 41 commits into
base: branch-25.02
Choose a base branch
from
Draft
Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
41 commits
Select commit Hold shift + click to select a range
2898e78
distribute libcugraph wheels
jameslamb Dec 3, 2024
0ecd5a5
exclude libcugraph.so from cugraph/pylibcugraph
jameslamb Dec 4, 2024
f1645ac
fix pr-builder
jameslamb Dec 5, 2024
6e1d3d9
remove more cugraph-ops, fix variables
jameslamb Dec 5, 2024
3aa693c
remove Python interpreter stuff
jameslamb Dec 6, 2024
7c55d20
Merge branch 'branch-25.02' into libcugraph-wheel
jameslamb Dec 6, 2024
c5cb53d
temporarily raise size threshold
jameslamb Dec 6, 2024
e73606c
declare librmm dependency, fix CI dependency tree
jameslamb Dec 6, 2024
fc37020
run a subet of wheel-testing CI
jameslamb Dec 6, 2024
e80d566
skip devcontainer jobs
jameslamb Dec 6, 2024
695f627
skip 'checks' job too
jameslamb Dec 6, 2024
486bf96
just run Python 3.12 builds
jameslamb Dec 6, 2024
fce4fcf
move CUDA libs deps to wheels, ignore deprecation warning
jameslamb Dec 6, 2024
796b54e
more dependency fiddling
jameslamb Dec 6, 2024
157f63e
fix CI configs, remove unnecessary stuff from pylibcugraph CMake
jameslamb Dec 9, 2024
4b4c4b2
load libcugraph_c too
jameslamb Dec 9, 2024
e5aa3c2
merge branch-25.02
jameslamb Dec 9, 2024
089109f
fix typo
jameslamb Dec 9, 2024
881dc25
header install sort of working
jameslamb Dec 10, 2024
3484186
Merge branch 'branch-25.02' into libcugraph-wheel
nv-rliu Dec 12, 2024
ead60e4
install working (no libraft.a/libraft.so, just headers) ... export no…
jameslamb Dec 12, 2024
7dd4409
install working, exports still not quite working
jameslamb Dec 12, 2024
1d60712
remove debugging stuff
jameslamb Dec 12, 2024
7913278
merge branch-25.02
jameslamb Dec 12, 2024
96a7b5b
Merge branch 'libcugraph-wheel' of github.com:jameslamb/cugraph into …
jameslamb Dec 12, 2024
a18be8c
remove more debugging stuff
jameslamb Dec 12, 2024
7f4f13b
try adding exports back
jameslamb Dec 12, 2024
dc7dac9
use libraft wheels
jameslamb Dec 17, 2024
a38e5ae
use libraft from PR
jameslamb Dec 17, 2024
3e57917
update RAFT reference
jameslamb Dec 17, 2024
79cebbc
fix libcugraph build script
jameslamb Dec 17, 2024
3a07f41
try to fix installing libraft
jameslamb Dec 17, 2024
c753752
use constraints instead
jameslamb Dec 17, 2024
8e9fc0e
Merge branch 'branch-25.02' into libcugraph-wheel
jameslamb Dec 17, 2024
e72f55c
Merge branch 'branch-25.02' into libcugraph-wheel
jameslamb Dec 18, 2024
f924cef
merge branch-25.02
jameslamb Dec 20, 2024
c6b1d5a
try new libraft wheels
jameslamb Dec 20, 2024
ba612bd
merge
jameslamb Dec 20, 2024
bf8f815
merge branch-25.02
jameslamb Dec 23, 2024
1847314
remove USE_CUDA_MATH_WHEELS
jameslamb Dec 30, 2024
740c3e9
Merge branch 'branch-25.02' into libcugraph-wheel
jameslamb Jan 2, 2025
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
merge branch-25.02
  • Loading branch information
jameslamb committed Dec 23, 2024
commit bf8f8151bebd5e8ea3ffe5f7dfad7f0fcfb1c427
2 changes: 1 addition & 1 deletion conda/environments/all_cuda-118_arch-x86_64.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -27,7 +27,7 @@ dependencies:
- graphviz
- ipython
- libcudf==25.2.*,>=0.0.0a0
- libraft==25.2.*,>=0.0.0a0
- libraft=25.2.*,>=0.0.0a0
- librmm==25.2.*,>=0.0.0a0
- nbsphinx
- nccl>=2.19
Expand Down
2 changes: 1 addition & 1 deletion conda/environments/all_cuda-125_arch-x86_64.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -33,7 +33,7 @@ dependencies:
- libcurand-dev
- libcusolver-dev
- libcusparse-dev
- libraft==25.2.*,>=0.0.0a0
- libraft=25.2.*,>=0.0.0a0
- librmm==25.2.*,>=0.0.0a0
- nbsphinx
- nccl>=2.19
Expand Down
29 changes: 7 additions & 22 deletions dependencies.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -28,16 +28,6 @@ files:
- python_build_cythonize
- python_build_rapids
- python_build_wheel
- python_build_cythonize
- depends_on_librmm
- depends_on_rmm
- depends_on_cudf
- depends_on_dask_cudf
- depends_on_pylibraft
- depends_on_raft_dask
- depends_on_pylibwholegraph
- depends_on_cupy
- depends_on_pytorch
- python_run_cugraph
- test_notebook
- test_python_common
Expand Down Expand Up @@ -98,8 +88,6 @@ files:
- depends_on_libcugraph
- depends_on_libraft
- depends_on_librmm
- depends_on_rmm
- depends_on_pylibraft
- depends_on_pylibcugraph
- depends_on_pylibraft
- depends_on_rmm
Expand All @@ -110,13 +98,10 @@ files:
table: project
includes:
- depends_on_cudf
- depends_on_dask_cudf
- depends_on_raft_dask
- depends_on_libcugraph
- depends_on_pylibcugraph
- depends_on_cupy
- depends_on_dask_cuda
- depends_on_dask_cudf
- depends_on_libcugraph
- depends_on_pylibcugraph
- depends_on_raft_dask
- depends_on_rmm
Expand All @@ -132,7 +117,6 @@ files:
- depends_on_pylibwholegraph
- test_python_common
- test_python_cugraph
- depends_on_pylibwholegraph
py_build_libcugraph:
output: pyproject
pyproject_dir: python/libcugraph
Expand Down Expand Up @@ -179,7 +163,6 @@ files:
- depends_on_libcugraph
- depends_on_libraft
- depends_on_librmm
- depends_on_rmm
- depends_on_pylibraft
- depends_on_rmm
py_run_pylibcugraph:
Expand All @@ -189,7 +172,6 @@ files:
table: project
includes:
- depends_on_libcugraph
- depends_on_rmm
- depends_on_pylibraft
- depends_on_rmm
py_test_pylibcugraph:
Expand Down Expand Up @@ -354,9 +336,6 @@ dependencies:
packages:
- c-compiler
- cxx-compiler
- libcudf==25.2.*,>=0.0.0a0
- libraft-headers==25.2.*,>=0.0.0a0
- libraft==25.2.*,>=0.0.0a0
- openmpi # Required for building cpp-mgtests (multi-GPU tests)
specific:
- output_types: [conda]
Expand Down Expand Up @@ -619,6 +598,12 @@ dependencies:
- pylibwholegraph-cu11==25.2.*,>=0.0.0a0
- {matrix: null, packages: [*pylibwholegraph_unsuffixed]}

depends_on_libcudf:
common:
- output_types: conda
packages:
- libcudf==25.2.*,>=0.0.0a0

depends_on_libraft:
common:
- output_types: conda
Expand Down
You are viewing a condensed version of this merge commit. You can view the full changes here.