Skip to content

Conversation

ggerganov
Copy link
Member

@ggerganov ggerganov commented Sep 14, 2025

Major refactoring of the Metal backend to make the implementation safer and more manageable:

  • Add ggml-metal-device.h and move device code there
  • Add ggml-metal-context.h and move backend context code there
  • Migrate most kernels to inference-time compilation
  • Split ggml_metal_encode_node into per-op functions and move them to separate sources
  • Apply typedef struct ggml_mem_ranges * ggml_mem_ranges_t;

@github-actions github-actions bot added ggml changes relating to the ggml tensor library for machine learning Apple Metal https://en.wikipedia.org/wiki/Metal_(API) labels Sep 14, 2025
@github-actions github-actions bot added the devops improvements to build systems and github actions label Sep 15, 2025
@ggerganov ggerganov force-pushed the gg/metal-refactor-and-optimize-v2 branch from 6d78c5e to 6905086 Compare September 16, 2025 05:20
@ggerganov ggerganov force-pushed the gg/metal-refactor-and-optimize-v2 branch from 6905086 to cadf515 Compare September 16, 2025 05:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Apple Metal https://en.wikipedia.org/wiki/Metal_(API) devops improvements to build systems and github actions ggml changes relating to the ggml tensor library for machine learning
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant