Skip to content

Add 2.8 release notes worksheet for Intel GPU (XPU). #12

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 7 commits into
base: main
Choose a base branch
from

Conversation

etaf
Copy link

@etaf etaf commented Jul 8, 2025

No description provided.

@facebook-github-bot
Copy link

Hi @etaf!

Thank you for your pull request.

We require contributors to sign our Contributor License Agreement, and yours needs attention.

You currently have a record in our system, but the CLA is no longer valid, and will need to be resubmitted.

Process

In order for us to review and merge your suggested changes, please sign at https://code.facebook.com/cla. If you are contributing on behalf of someone else (eg your employer), the individual CLA may not be sufficient and your employer may need to sign the corporate CLA.

Once the CLA is signed, our tooling will perform checks and validations. Afterwards, the pull request will be tagged with CLA signed. The tagging process may take up to 1 hour after signing. Please give it that time before contacting us about it.

If you have received this in error or have any questions, please contact us at [email protected]. Thanks!

- Support int4 WOQ GEMM on Intel GPU ([#137566](https://github.com/pytorch/pytorch/pull/137566))
- Support third_party SYCL kernels with CPP Extension API ([#132945](https://github.com/pytorch/pytorch/pull/132945))
- Support safe softmax for SDPA on Intel GPU ([#151999](https://github.com/pytorch/pytorch/pull/151999))
- SupportGQA and different head_dim of value for SDPA on Intel GPU([#150992](https://github.com/pytorch/pytorch/pull/150992))

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It should be an improvement rather than a new feature.

- Support Intel distributed backend (XCCL) in PyTorch ([#141856](https://github.com/pytorch/pytorch/pull/141856))
- Support int4 WOQ GEMM on Intel GPU ([#137566](https://github.com/pytorch/pytorch/pull/137566))
- Support third_party SYCL kernels with CPP Extension API ([#132945](https://github.com/pytorch/pytorch/pull/132945))
- Support safe softmax for SDPA on Intel GPU ([#151999](https://github.com/pytorch/pytorch/pull/151999))

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It should be an improvement rather than a new feature.

- Improve scalar tensor case handling in addmm, baddmm on Intel GPU ([#153051](https://github.com/pytorch/pytorch/pull/153051))
- Support f32 intermediate dtype, headdim <= 576, and f32 causal mask for SDPA ([#152091](https://github.com/pytorch/pytorch/pull/152091))
- Add Intel GPU device support for nested_layer_norm ([#148593](https://github.com/pytorch/pytorch/pull/148593))
- Refine oneDNN context manager API on Intel GPU ([#147349](https://github.com/pytorch/pytorch/pull/147349))

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Let's remove it.


### bug fixes
- Fix matmul accuracy when offset > 0 ([#154495](https://github.com/pytorch/pytorch/pull/154495))
- Correct torch.xpu.is_bf16_supported to return False if no Intel GPU detected ([#152317](https://github.com/pytorch/pytorch/pull/152317))

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
- Correct torch.xpu.is_bf16_supported to return False if no Intel GPU detected ([#152317](https://github.com/pytorch/pytorch/pull/152317))
- Fix the issue that `torch.xpu.is_bf16_supported` always returns `True` even if Intel GPU is not available ([#152317](https://github.com/pytorch/pytorch/pull/152317))

- Add Intel GPU device support for nested_layer_norm ([#148593](https://github.com/pytorch/pytorch/pull/148593))
- Refine oneDNN context manager API on Intel GPU ([#147349](https://github.com/pytorch/pytorch/pull/147349))
- Improve error handling and reporting in Intel GPU CMake files ([#149353](https://github.com/pytorch/pytorch/pull/149353))
- Support multi_arch_kernel_binary option in AOTInductor for Intel GPU ([#154514](https://github.com/pytorch/pytorch/pull/154514))

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pls. consolidate AOTI-related improvements into a single bullet.

- Support Intel GPU profiler toggle functionality ([#155135](https://github.com/pytorch/pytorch/pull/155135))
- Support distributed memory tracker integration for Intel GPU ([#150703](https://github.com/pytorch/pytorch/pull/150703))
- Improve scalar tensor case handling in addmm, baddmm on Intel GPU ([#153051](https://github.com/pytorch/pytorch/pull/153051))
- Support f32 intermediate dtype, headdim <= 576, and f32 causal mask for SDPA ([#152091](https://github.com/pytorch/pytorch/pull/152091))

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pls. consolidate SDPA-related improvement into a single bullet.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Meta Open Source bot. label Jul 8, 2025
@etaf etaf requested a review from EikanWang July 8, 2025 03:06
- Add memory reporting to Memory Profiler for Intel GPU ([#152842](https://github.com/pytorch/pytorch/pull/152842))
- Support Intel GPU profiler toggle functionality ([#155135](https://github.com/pytorch/pytorch/pull/155135))
- Support distributed memory tracker integration for Intel GPU ([#150703](https://github.com/pytorch/pytorch/pull/150703))
- Improve scalar tensor case handling in addmm, baddmm on Intel GPU ([#153051](https://github.com/pytorch/pytorch/pull/153051))

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Let's move this bullet to performance section. Because it reduces the oneDNN integration overhead.

Copy link

@riverliuintel riverliuintel left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Only one minor comments and looks good.

- Add Intel GPU device support for nested_layer_norm ([#148593](https://github.com/pytorch/pytorch/pull/148593))
- Refine oneDNN context manager API on Intel GPU ([#147349](https://github.com/pytorch/pytorch/pull/147349))
- Improve error handling and reporting in Intel GPU CMake files ([#149353](https://github.com/pytorch/pytorch/pull/149353))
- Support multi_arch_kernel_binary option in AOTInductor for Intel GPU ([#154514](https://github.com/pytorch/pytorch/pull/154514))

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

if code, use single quotes 'multi_arch_kernel_binary'

@etaf etaf marked this pull request as ready for review July 8, 2025 05:26
@riverliuintel
Copy link

@jbschlosser please help to comment and merge it. Thanks.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CLA Signed This label is managed by the Meta Open Source bot.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants