3 Releases published by 1 person

• v3.0.0

  published Jun 19, 2025

• v3.1.0

  published Jun 26, 2025

• v3.1.1

  published Jun 27, 2025

138 Pull requests merged by 11 people

• chore(model gallery): add mistralai_devstral-small-2507

  #5834 merged Jul 11, 2025

• chore(model gallery): add huihui-ai_huihui-gemma-3n-e4b-it-abliterated

  #5833 merged Jul 11, 2025

• chore(model gallery): add microsoft_nextcoder-32b

  #5832 merged Jul 11, 2025

• chore: ⬆️ Update ggml-org/llama.cpp to 0b8855775c6b873931d40b77a5e42558aacbde52

  #5830 merged Jul 10, 2025

• chore(model gallery): add thedrummer_tiger-gemma-12b-v3

  #5827 merged Jul 10, 2025

• chore(model gallery): add thedrummer_big-tiger-gemma-27b-v3

  #5826 merged Jul 10, 2025

• chore(model gallery): add delta-vector_plesio-70b

  #5825 merged Jul 10, 2025

• chore(model gallery): add huggingfacetb_smollm3-3b

  #5820 merged Jul 9, 2025

• chore(model gallery): add zerofata_l3.3-geneticlemonade-opus-70b

  #5819 merged Jul 9, 2025

• chore(model gallery): add lyranovaheart_starfallen-snow-fantasy-24b-ms3.2-v0.0

  #5818 merged Jul 9, 2025

• feat(cli): allow to install backends from OCI tar files

  #5816 merged Jul 9, 2025

• chore: ⬆️ Update ggml-org/llama.cpp to 6efcd65945a98cf6883cdd9de4c8ccd8c79d219a

  #5817 merged Jul 8, 2025

• chore: ⬆️ Update ggml-org/whisper.cpp to 869335f2d58d04010535be9ae23a69a9da12a169

  #5809 merged Jul 8, 2025

• chore(model gallery): add qwen3-8b-shiningvaliant3

  #5815 merged Jul 8, 2025

• chore(model gallery): add ockerman0_anubislemonade-70b-v1.1

  #5814 merged Jul 8, 2025

• chore(model gallery): add cognitivecomputations_dolphin-mistral-24b-venice-edition

  #5813 merged Jul 8, 2025

• feat(whisper): Enable SYCL

  #5802 merged Jul 8, 2025

• chore: ⬆️ Update ggml-org/llama.cpp to 12f55c302b35cfe900b84c5fe67c262026af9c44

  #5808 merged Jul 7, 2025

• chore(model gallery): add huihui-jan-nano-abliterated

  #5806 merged Jul 7, 2025

• chore(model gallery): add zonui-3b-i1

  #5805 merged Jul 7, 2025

• chore(model gallery): add mini-hydra

  #5804 merged Jul 7, 2025

• chore(model gallery): add compumacy-experimental-32b

  #5803 merged Jul 7, 2025

• chore: ⬆️ Update ggml-org/llama.cpp to 6491d6e4f1caf0ad2221865b4249ae6938a6308c

  #5801 merged Jul 6, 2025

• chore(model gallery): add nano_imp_1b-q8_0

  #5800 merged Jul 6, 2025

• chore(model gallery): add sicariussicariistuff_impish_llama_4b

  #5799 merged Jul 6, 2025

• chore: ⬆️ Update ggml-org/llama.cpp to a0374a67e2924f2e845cdc59dd67d9a44065a89c

  #5798 merged Jul 5, 2025

• chore: ⬆️ Update ggml-org/llama.cpp to ef797db357e44ecb7437fa9d22f4e1614104b342

  #5795 merged Jul 4, 2025

• chore(model gallery): add ockerman0_anubislemonade-70b-v1

  #5794 merged Jul 4, 2025

• chore(model gallery): add zerofata_ms3.2-paintedfantasy-visage-33b

  #5793 merged Jul 4, 2025

• chore(model gallery): add agentica-org_deepswe-preview

  #5792 merged Jul 4, 2025

• chore(model gallery): add helpingai_dhanishtha-2.0-preview

  #5791 merged Jul 4, 2025

• chore: ⬆️ Update ggml-org/llama.cpp to bee28421be25fd447f61cb6db64d556cbfce32ec

  #5788 merged Jul 4, 2025

• chore: ⬆️ Update PABannier/bark.cpp to 5d5be84f089ab9ea53b7a793f088d3fbf7247495

  #4786 merged Jul 3, 2025

• chore(cli): add backends CLI to manipulate and install backends

  #5787 merged Jul 3, 2025

• chore(bark-cpp): generalize and move to bark-cpp

  #5786 merged Jul 3, 2025

• feat(system): detect and allow to override capabilities

  #5785 merged Jul 3, 2025

• feat(backends): add metas in the gallery

  #5784 merged Jul 3, 2025

• chore: ⬆️ Update ggml-org/llama.cpp to e75ba4c0434eb759eb7ff74e034ebe729053e575

  #5783 merged Jul 3, 2025

• chore: ⬆️ Update ggml-org/whisper.cpp to d9999d54c868b8bfcd376aa26067e787d53e679e

  #5782 merged Jul 3, 2025

• docs: ⬆️ update docs version mudler/LocalAI

  #5781 merged Jul 2, 2025

• fix(gallery): correctly show status for downloading OCI images

  #5774 merged Jul 2, 2025

• chore: ⬆️ Update ggml-org/llama.cpp to de569441470332ff922c23fb0413cc957be75b25

  #5777 merged Jul 2, 2025

• chore: ⬆️ Update ggml-org/whisper.cpp to bca021c9740b267c2973fba56555be052006023a

  #5776 merged Jul 2, 2025

• docs: ⬆️ update docs version mudler/LocalAI

  #5775 merged Jul 1, 2025

• chore(model gallery): add pinkpixel_crystal-think-v2

  #5773 merged Jul 1, 2025

• chore(model gallery): add steelskull_l3.3-shakudo-70b

  #5772 merged Jul 1, 2025

• chore(model gallery): add thedrummer_anubis-70b-v1.1

  #5771 merged Jul 1, 2025

• fix: Diffusers and XPU fixes

  #5737 merged Jul 1, 2025

• fix(docs): Improve Header Responsiveness - Hide "Star us on GitHub!" on Mobile

  #5770 merged Jul 1, 2025

• chore: ⬆️ Update ggml-org/llama.cpp to 0a5a3b5cdfd887cf0f8e09d9ff89dee130cfcdde

  #5759 merged Jun 30, 2025

• chore: ⬆️ Update ggml-org/llama.cpp to caf5681fcb47dfe9bafee94ef9aa8f669ac986c7

  #5758 merged Jun 29, 2025

• fix(gallery): automatically install model from name

  #5757 merged Jun 29, 2025

• chore(model gallery): add qwen3-33b-a3b-stranger-thoughts-abliterated-uncensored

  #5755 merged Jun 29, 2025

• chore: ⬆️ Update ggml-org/llama.cpp to 27208bf657cfe7262791df473927225e48efe482

  #5753 merged Jun 29, 2025

• docs: ⬆️ update docs version mudler/LocalAI

  #5752 merged Jun 28, 2025

• feat(llama.cpp): allow to set kv-overrides

  #5745 merged Jun 28, 2025

• chore(model gallery): add gemma-3-4b-it-max-horror-uncensored-dbl-x-imatrix

  #5751 merged Jun 28, 2025

• chore(model gallery): add qwen3-22b-a3b-the-harley-quinn

  #5750 merged Jun 28, 2025

• chore(model gallery): add mistral-small-3.2-46b-the-brilliant-raconteur-ii-instruct-2506

  #5749 merged Jun 28, 2025

• chore(model gallery): add qwen3-42b-a3b-stranger-thoughts-deep20x-abliterated-uncensored-i1

  #5748 merged Jun 28, 2025

• chore(model gallery): add qwen3-55b-a3b-total-recall-deep-40x

  #5747 merged Jun 28, 2025

• chore(model gallery): add qwen3-55b-a3b-total-recall-v1.3-i1

  #5746 merged Jun 28, 2025

• chore: ⬆️ Update ggml-org/llama.cpp to 72babea5dea56c8a8e8420ccf731b12a5cf37854

  #5743 merged Jun 27, 2025

• chore: ⬆️ Update ggml-org/whisper.cpp to c88ffbf9baeaae8c2cc0a4f496618314bb2ee9e0

  #5742 merged Jun 27, 2025

• docs: ⬆️ update docs version mudler/LocalAI

  #5741 merged Jun 27, 2025

• fix(backends gallery): meta packages do not have URIs

  #5740 merged Jun 27, 2025

• fix(backends gallery): correctly identify gpu vendor

  #5739 merged Jun 27, 2025

• feat(gallery): automatically install missing backends along models

  #5736 merged Jun 27, 2025

• fix(ci): enable tag-latest to auto

  #5738 merged Jun 27, 2025

• fix(ci): better handling of latest images for backends

  #5735 merged Jun 27, 2025

• chore: ⬆️ Update ggml-org/whisper.cpp to 32cf4e2aba799aff069011f37ca025401433cf9f

  #5733 merged Jun 26, 2025

• chore: ⬆️ Update ggml-org/llama.cpp to 8846aace4934ad29651ea61b8c7e3f6b0556e3d2

  #5734 merged Jun 26, 2025

• chore(model gallery): add gemma-3n-e4b-it

  #5731 merged Jun 26, 2025

• chore(model gallery): add gemma-3n-e2b-it

  #5730 merged Jun 26, 2025

• feat: ⚠️ reduce images size and stop bundling sources

  #5721 merged Jun 26, 2025

• chore(ci): ⚠️ fix latest tag by using docker meta action

  #5722 merged Jun 26, 2025

• fix(backends gallery): delete dangling dirs if installation failed

  #5729 merged Jun 26, 2025

• Revert "chore: ⬆️ Update leejet/stable-diffusion.cpp to 10c6501bd05a697e014f1bee3a84e5664290c489"

  #5727 merged Jun 26, 2025

• chore: ⬆️ Update ggml-org/whisper.cpp to 4daf7050ca2bf17f5166f45ac6da651c4e33f293

  #5725 merged Jun 26, 2025

• chore: ⬆️ Update ggml-org/llama.cpp to 2bf9d539dd158345e3a3b096e16474af535265b4

  #5724 merged Jun 26, 2025

• chore: ⬆️ Update leejet/stable-diffusion.cpp to 10c6501bd05a697e014f1bee3a84e5664290c489

  #4925 merged Jun 25, 2025

• chore(model gallery): add menlo_jan-nano-128k

  #5723 merged Jun 25, 2025

• chore: ⬆️ Update ggml-org/whisper.cpp to 0083335ba0e9d6becbe0958903b0a27fc2ebaeed

  #5718 merged Jun 25, 2025

• chore: ⬆️ Update ggml-org/llama.cpp to 73e53dc834c0a2336cd104473af6897197b96277

  #5719 merged Jun 24, 2025

• chore(model gallery): add delta-vector_austral-24b-winton

  #5717 merged Jun 24, 2025

• chore(model gallery): add astrosage-70b

  #5716 merged Jun 24, 2025

• chore(model gallery): add skywork_skywork-swe-32b

  #5715 merged Jun 24, 2025

• feat(backend gallery): add meta packages

  #5696 merged Jun 24, 2025

• chore(model gallery): add mistralai_mistral-small-3.2-24b-instruct-2506

  #5714 merged Jun 24, 2025

• chore: ⬆️ Update ggml-org/llama.cpp to ce82bd0117bd3598300b3a089d13d401b90279c7

  #5712 merged Jun 24, 2025

• chore: ⬆️ Update ggml-org/whisper.cpp to a422176937c5bb20eb58d969995765f90d3c1a9b

  #5713 merged Jun 23, 2025

• Docs: Fix typos

  #5709 merged Jun 23, 2025

• chore: ⬆️ Update ggml-org/llama.cpp to 238005c2dc67426cf678baa2d54c881701693288

  #5710 merged Jun 22, 2025

• chore(model gallery): add ds-r1-qwen3-8b-arliai-rpr-v4-small-iq-imatrix

  #5708 merged Jun 22, 2025

• chore(model gallery): add allura-org_q3-8b-kintsugi

  #5707 merged Jun 22, 2025

• chore(model gallery): add qwen3-the-xiaolong-omega-directive-22b-uncensored-abliterated-i1

  #5706 merged Jun 22, 2025

• chore(model gallery): add menlo_jan-nano

  #5705 merged Jun 22, 2025

• chore: ⬆️ Update ggml-org/llama.cpp to aa0ef5c578eef4c2adc7be1282f21bab5f3e8d26

  #5703 merged Jun 21, 2025

• chore: ⬆️ Update ggml-org/whisper.cpp to e6c10cf3d5d60dc647eb6cd5e73d3c347149f746

  #5702 merged Jun 21, 2025

• chore(model gallery): add qwen3-the-josiefied-omega-directive-22b-uncensored-abliterated-i1

  #5704 merged Jun 21, 2025

• chore(ci): add stale bot

  #5700 merged Jun 21, 2025

• chore: ⬆️ Update ggml-org/llama.cpp to 06cbedfca1587473df9b537f1dd4d6bfa2e3de13

  #5697 merged Jun 20, 2025

• chore(ci): try to optimize disk space when tagging latest

  #5695 merged Jun 20, 2025

• chore: ⬆️ Update ggml-org/llama.cpp to 8f71d0f3e86ccbba059350058af8758cafed73e6

  #5692 merged Jun 20, 2025

• chore: ⬆️ Update ggml-org/whisper.cpp to 3e65f518ddf840b13b74794158aa95a2c8aa30cc

  #5691 merged Jun 20, 2025

• docs: ⬆️ update docs version mudler/LocalAI

  #5690 merged Jun 19, 2025

• Fix Typos and Improve Clarity in GPU Acceleration Documentation

  #5688 merged Jun 19, 2025

• chore: ⬆️ Update ggml-org/whisper.cpp to ecb8f3c2b4e282d5ef416516bcbfb92821f06bf6

  #5686 merged Jun 19, 2025

• chore: ⬆️ Update ggml-org/llama.cpp to 8d947136546773f6410756f37fcc5d3e65b8135d

  #5685 merged Jun 19, 2025

• feat(backend gallery): display download progress

  #5687 merged Jun 18, 2025

• Fix Typos in Documentation and Python Comments

  #5658 merged Jun 18, 2025

• fix(backends gallery): propagate p2p settings to correctly draw menu

  #5684 merged Jun 18, 2025

• chore(ci): move also other jobs to public runner

  #5683 merged Jun 18, 2025

• chore(ci): try to use public runners also for release builds

  #5681 merged Jun 18, 2025

• chore(backends): move bark-cpp to the backend gallery

  #5682 merged Jun 18, 2025

• chore: ⬆️ Update ggml-org/llama.cpp to 860a9e4eeff3eb2e7bd1cc38f65787cc6c8177af

  #5678 merged Jun 18, 2025

• chore: ⬆️ Update ggml-org/whisper.cpp to f3ff80ea8da044e5b8833e7ba54ee174504c518d

  #5677 merged Jun 18, 2025

• chore(ci): switch to public runners for base images

  #5680 merged Jun 17, 2025

• chore(backend gallery): add description for remaining backends

  #5679 merged Jun 17, 2025

• chore(backend gallery): re-order and add description for vLLM

  #5676 merged Jun 17, 2025

• chore(deps): bump llama.cpp to 'e434e69183fd9e1031f4445002083178c331a28b

  #5665 merged Jun 17, 2025

• chore: ⬆️ Update ggml-org/whisper.cpp to 2a4d6db7d90899aff3d58d70996916968e4e0d27

  #5661 merged Jun 17, 2025

• chore(deps): bump securego/gosec from 2.22.4 to 2.22.5

  #5663 merged Jun 16, 2025

• fix: add python symlink, use absolute python env path when running backends

  #5664 merged Jun 16, 2025

• chore: Add python3 to images

  #5660 merged Jun 16, 2025

• chore(ci): use public runner for extra backends

  #5657 merged Jun 16, 2025

• chore: ⬆️ Update ggml-org/llama.cpp to 30e5b01de2a0bcddc7c063c8ef0802703a958417

  #5659 merged Jun 15, 2025

• Fix Typos and Improve Documentation Clarity

  #5648 merged Jun 15, 2025

• chore: ⬆️ Update ggml-org/llama.cpp to 3cb203c89f60483e349f841684173446ed23c28f

  #5644 merged Jun 15, 2025

• feat: Add backend gallery

  #5607 merged Jun 15, 2025

• chore: ⬆️ Update ggml-org/whisper.cpp to 705db0f728310c32bc96f4e355e2b18076932f75

  #5643 merged Jun 15, 2025

• chore: improve tests

  #5646 merged Jun 14, 2025

• Minor Documentation Updates: Clarified Comments in Python and Go Files

  #5641 merged Jun 13, 2025

• docs: Update docs metadata headers so when mentioned on slack it doesn't say hugo

  #5642 merged Jun 13, 2025

• chore: ⬆️ Update ggml-org/llama.cpp to ed52f3668e633423054a4eab61bb7efee47025ab

  #5636 merged Jun 12, 2025

• chore(model gallery): add yanfei-v2-qwen3-32b

  #5639 merged Jun 12, 2025

• Fix Typos in Comments and Error Messages

  #5637 merged Jun 12, 2025

• chore: ⬆️ Update ggml-org/whisper.cpp to ebbc874e85b518f963a87612f6d79f5c71a55e84

  #5635 merged Jun 11, 2025

24 Pull requests opened by 5 people

• chore(deps): bump torch from 2.4.1 to 2.7.1 in /backend/python/exllama2 in the pip group

  #5666 opened Jun 17, 2025

• chore(deps): bump torch from 2.3.1+cxx11.abi to 2.7.1 in /backend/python/coqui in the pip group

  #5667 opened Jun 17, 2025

• chore(deps): bump torch from 2.3.1+cxx11.abi to 2.7.1 in /backend/python/common/template in the pip group

  #5668 opened Jun 17, 2025

• chore(deps): bump torch from 2.3.1+cxx11.abi to 2.7.1 in /backend/python/rerankers in the pip group

  #5669 opened Jun 17, 2025

• chore(deps): bump the pip group across 3 directories with 1 update

  #5670 opened Jun 17, 2025

• chore(deps): bump torch from 2.3.1+cxx11.abi to 2.7.1 in /backend/python/bark in the pip group

  #5671 opened Jun 17, 2025

• chore(deps): bump torch from 2.3.1+cxx11.abi to 2.7.1 in /backend/python/diffusers in the pip group

  #5672 opened Jun 17, 2025

• chore(deps): bump the pip group in /backend/python/transformers with 2 updates

  #5673 opened Jun 17, 2025

• chore(deps): bump torch from 2.7.0 to 2.7.1 in /backend/python/vllm in the pip group

  #5674 opened Jun 17, 2025

• chore: :arrow_up: Update leejet/stable-diffusion.cpp to `6d84a30c66cc619fe41a78bc87f83ba41f059cc0`

  #5732 opened Jun 26, 2025

• chore(deps): bump grpcio from 1.71.0 to 1.73.1 in /backend/python/diffusers

  #5760 opened Jun 30, 2025

• chore(deps): bump grpcio from 1.71.0 to 1.73.1 in /backend/python/common/template

  #5761 opened Jun 30, 2025

• chore(deps): bump grpcio from 1.71.0 to 1.73.1 in /backend/python/vllm

  #5762 opened Jun 30, 2025

• chore(deps): bump grpcio from 1.71.0 to 1.73.1 in /backend/python/coqui

  #5763 opened Jun 30, 2025

• chore(deps): bump grpcio from 1.71.0 to 1.73.1 in /backend/python/rerankers

  #5764 opened Jun 30, 2025

• chore(deps): bump grpcio from 1.71.0 to 1.73.1 in /backend/python/exllama2

  #5766 opened Jun 30, 2025

• chore(deps): bump grpcio from 1.71.0 to 1.73.1 in /backend/python/bark

  #5767 opened Jun 30, 2025

• chore(deps): bump grpcio from 1.71.0 to 1.73.1 in /backend/python/transformers

  #5768 opened Jun 30, 2025

• chore(vulkan): enable arm64 image builds

  #5780 opened Jul 2, 2025

• [WIP] feat: build llama cpp externally

  #5790 opened Jul 4, 2025

• Initial commit

  #5807 opened Jul 7, 2025

• chore(deps): bump sentence-transformers from 3.4.1 to 5.0.0 in /backend/python/transformers

  #5811 opened Jul 7, 2025

• chore(deps): bump transformers from 4.48.3 to 4.53.1 in /backend/python/coqui

  #5812 opened Jul 7, 2025

• fix: dockerfile typo

  #5823 opened Jul 10, 2025

33 Issues closed by 11 people

• GRPC error: Unimplemented - CPU support only

  #4308 closed Jul 9, 2025

• On realtime API transcription request, both default whisper-1 model and specified whisper model are loaded

  #5796 closed Jul 6, 2025

• Error: rpc error: code = Unknown desc = unimplemented

  #4170 closed Jul 6, 2025

• Here's a working config for nVidia Nemotron Mini 4B Instruct

  #4234 closed Jul 6, 2025

• [Bug]: Qwen2.5-Omni-7B chat completion returning normal completion "content".

  #5789 closed Jul 3, 2025

• arm64 raspberry pi docker image

  #4205 closed Jul 3, 2025

• Docker build failing on macbook m4

  #4604 closed Jul 3, 2025

• fix(docs): Improve Header Responsiveness - Hide "Star us on GitHub!" on Mobile

  #5769 closed Jul 1, 2025

• [2.25.0] Model gallery is empty + Error 500 since upgrade to 2.25.0

  #4617 closed Jul 1, 2025

• suppor kokoro tts

  #4634 closed Jun 30, 2025

• gpt-4o equivalent model doesn't answer properly to text inputs (using docker aio-cpu images)

  #4644 closed Jun 30, 2025

• when I run project , the console prints "pkg\grpc\backend.go:6:2: no required module provides package github.com/mudler/LocalAI/pkg/grpc/proto; to add it: go get github.com/mudler/LocalAI/pkg/grpc/proto"

  #4670 closed Jun 30, 2025

• Model deepseek-r1-distill-qwen-14b does not work on NVidia RTX A6000 48GB

  #4710 closed Jun 30, 2025

• Paperless NGX

  #4713 closed Jun 29, 2025

• When and only when running a GGUF format Qwen model (e.g., Qwen-Math, Qwen-1M), LocalAI gets confusing output.

  #4734 closed Jun 29, 2025

• Chat: Error: POST /v1/chat/completions 401 - with ssl

  #4782 closed Jun 29, 2025

• Docker: `requirement error: invalid expression`

  #4789 closed Jun 29, 2025

• On GPU, GPT-4o rambles on and on and on... (no stopwords)

  #4816 closed Jun 29, 2025

• Add Local ComfyUI/SD base diffusers step with "json API" PLZ

  #4818 closed Jun 29, 2025

• support for android and enable opencl

  #4831 closed Jun 29, 2025

• rwkv-6-world-7b not using English as much and is adding text from "user"

  #4856 closed Jun 29, 2025

• Local AI Deployment container error on Kubernetes

  #4935 closed Jun 28, 2025

• Implement metal Flash Attention for Apple Metal GPU Framework

  #4947 closed Jun 28, 2025

• Error using rerank twice

  #4967 closed Jun 28, 2025

• No shutdown API buttons

  #5030 closed Jun 28, 2025

• GPU is not used in LocalAI - even though it works in other local AI repos

  #5063 closed Jun 28, 2025

• Local Docker run auto download multiple Models at start.

  #5720 closed Jun 26, 2025

• Show real LocalAI Version

  #5193 closed Jun 26, 2025

• Add support for Ultravox (speech-to-speech translation)

  #4891 closed Jun 23, 2025

• Missing `/v1/rerank` endpoint in swagger docs

  #2338 closed Jun 22, 2025

• [3.0.0] Cannot install on Jetson Orin Nano Super

  #5694 closed Jun 21, 2025

• Can't re-enable SYCL in stablediffusion until GGML is updated upstream

  #5132 closed Jun 17, 2025

• Install backends from WebUI

  #3953 closed Jun 15, 2025

17 Issues opened by 13 people

• AIO entrypoint.sh fail to detect amd GPU/APU

  #5831 opened Jul 11, 2025

• GUI unusable due to CONNECTION_RESET errors

  #5829 opened Jul 10, 2025

• LocalAI ROCm Runtime Issue: HSA_OVERRIDE_GFX_VERSION Required -gfx1151

  #5822 opened Jul 9, 2025

• normalize embeddings

  #5821 opened Jul 9, 2025

• Local ai

  #5810 opened Jul 7, 2025

• failed to load model with internal loader: grpc service not ready

  #5779 opened Jul 2, 2025

• Build vulkan image for arm64

  #5778 opened Jul 2, 2025

• no model found with name while using the model

  #5756 opened Jun 29, 2025

• Error installing backend failed to extract image "unexpected EOF"

  #5754 opened Jun 28, 2025

• `mlock: true` does not lock model in RAM — no mlock() syscall observed

  #5728 opened Jun 26, 2025

• Feature Request: Consume models via API in the GUI

  #5726 opened Jun 25, 2025

• 虧本感

  #5711 opened Jun 22, 2025

• Revamp CI Build Process

  #5701 opened Jun 21, 2025

• Add JSON Schema for Gallery Spec

  #5699 opened Jun 21, 2025

• go mod edit -replace github.com/ggerganov/whisper.cpp=/build/sources/whisper.cpp go: exec go1.23.1: exec format error make: *** [Makefile:330: replace] Error 1 在Hygon C86 7390上docker启动失败有人知道怎么解决吗

  #5698 opened Jun 21, 2025

• [3.0.0] Context local model name not found, setting to default

  #5693 opened Jun 20, 2025

• Downloading Model fails for some models like arch-function-7b

  #5640 opened Jun 13, 2025

56 Unresolved conversations

Sometimes conversations happen on old items that aren’t yet closed. Here is a list of all the Issues and Pull Requests with unresolved conversations.

• Stuck in Function Call Loop

  #3882 commented on Jun 13, 2025 • 0 new comments

• panic: interface conversion: interface {} is []interface {}, not string with OpenAI compatible function defintion

  #5572 commented on Jun 17, 2025 • 0 new comments

• Add support for realtime API

  #3714 commented on Jun 17, 2025 • 0 new comments

• /usr/bin/ld: cannot find -lucd: No such file or directory

  #3770 commented on Jun 18, 2025 • 0 new comments

• LocalAI Rocm/HIP RX9070XT GFX1201

  #5624 commented on Jun 20, 2025 • 0 new comments

• LocalAI Docker Container won't start on Windows 11

  #3588 commented on Jun 21, 2025 • 0 new comments

• Image creation via WebUI does not download the generated image

  #5094 commented on Jun 21, 2025 • 0 new comments

• feat(webui): include all static assets as part of the image

  #5072 commented on Jun 21, 2025 • 0 new comments

• Implement Web Search tool in /chat/completions

  #5018 commented on Jun 22, 2025 • 0 new comments

• Automated reviews with coderabbit.ai

  #5229 commented on Jun 22, 2025 • 0 new comments

• Add TTS model Kokoro

  #5215 commented on Jun 22, 2025 • 0 new comments

• New OpenAI API and Tooling for an Agentic Year

  #5005 commented on Jun 23, 2025 • 0 new comments

• Add Minimum Resource Requirements & Metadata Integration to LocalAI Gallery

  #4823 commented on Jun 24, 2025 • 0 new comments

• make build, fails

  #5383 commented on Jun 24, 2025 • 0 new comments

• Metrics API Endpoint Error: * collected metric "api_call" { [...] } was collected before with the same name and label values

  #1445 commented on Jun 25, 2025 • 0 new comments

• feature: support CTranslate2

  #839 commented on Jun 26, 2025 • 0 new comments

• `libutf8_validity.dylib` missing on darwin

  #5465 commented on Jun 26, 2025 • 0 new comments

• Cannot select models from dropdown

  #3493 commented on Jun 27, 2025 • 0 new comments

• Add Additional model support

  #4951 commented on Jun 28, 2025 • 0 new comments

• Docker support for Apple silicon

  #1659 commented on Jun 28, 2025 • 0 new comments

• vulnerability in LocalAI project

  #5623 commented on Jun 29, 2025 • 0 new comments

• CORS and API key

  #4576 commented on Jun 30, 2025 • 0 new comments

• tts api endpoint just returns the html webpage (Docker)

  #4542 commented on Jun 30, 2025 • 0 new comments

• [vllm backend] Problem loading a model from a local weights cached dir

  #4538 commented on Jul 1, 2025 • 0 new comments

• Cannot use a local model for sentencetransformers

  #4529 commented on Jul 1, 2025 • 0 new comments

• [DOCUMENTATION] ROCm install using Docker

  #4443 commented on Jul 1, 2025 • 0 new comments

• Allow Setting Model Per Task in Settings

  #4450 commented on Jul 2, 2025 • 0 new comments

• make build error on Mac Studio

  #4430 commented on Jul 2, 2025 • 0 new comments

• sudo docker start local-ai Error response from daemon: load library failed: libnvidia-ml.so.1

  #4368 commented on Jul 2, 2025 • 0 new comments

• Feat: Add support for Usage API

  #4346 commented on Jul 2, 2025 • 0 new comments

• REBUILD=true causes a golang "too much data" error

  #4345 commented on Jul 3, 2025 • 0 new comments

• `libprotobuf` version mismatch between the one installed as dependency and the one expected by the runtime

  #4340 commented on Jul 3, 2025 • 0 new comments

• http://localhost:8080/v1/embeddings Error 500

  #4900 commented on Jul 4, 2025 • 0 new comments

• While Deleting: SyntaxError: Failed to execute 'querySelectorAll' on 'Document'

  #5126 commented on Jul 5, 2025 • 0 new comments

• Whisper Notes

  #5425 commented on Jul 5, 2025 • 0 new comments

• F5-TTS Backend

  #4168 commented on Jul 6, 2025 • 0 new comments

• load local model sd3 error with diffuser backend

  #4144 commented on Jul 6, 2025 • 0 new comments

• Feature Request 「plz support InternLM2.5」

  #4142 commented on Jul 6, 2025 • 0 new comments

• TTS audio caches too broadly.

  #4084 commented on Jul 6, 2025 • 0 new comments

• Feature: count tokens before calling '/v1/chat/completions'

  #4027 commented on Jul 6, 2025 • 0 new comments

• Incorrect File Structure according to documentation

  #4018 commented on Jul 7, 2025 • 0 new comments

• Proposal: Migrate gRPC / protobuf definition files to their own repo

  #4012 commented on Jul 7, 2025 • 0 new comments

• patch unexpectedly ends in middle of line

  #3957 commented on Jul 7, 2025 • 0 new comments

• Error on calling an embedding model, error reading from server: EOF

  #3886 commented on Jul 7, 2025 • 0 new comments

• Doesn't run llama-cpp, even though it's in the PATH

  #3858 commented on Jul 8, 2025 • 0 new comments

• Add Deepseek Janus Pro 1B/7B for Vision AND Image Generation

  #4712 commented on Jul 9, 2025 • 0 new comments

• Inferencing not working with P2P in latest version.

  #3968 commented on Jul 9, 2025 • 0 new comments

• Wakeword

  #3840 commented on Jul 10, 2025 • 0 new comments

• output metrics in the chat webui

  #3682 commented on Jul 10, 2025 • 0 new comments

• Missing `libomp.so` in docker container

  #5602 commented on Jul 10, 2025 • 0 new comments

• Add foreign language speech to text models in gallery

  #5226 commented on Jul 10, 2025 • 0 new comments

• error="failed basic startup tasks with error unable to create ModelPath: \"mkdir /usr/share/local-ai/models: permission denied\""

  #3683 commented on Jul 10, 2025 • 0 new comments

• Failure to detect GPU driver

  #4571 commented on Jul 10, 2025 • 0 new comments

• Add support for the parallel_tool_calls parameter for the /chat/completions API

  #3672 commented on Jul 11, 2025 • 0 new comments

• feat: WIP: Adjust GPU Layers

  #3737 commented on Jul 9, 2025 • 0 new comments

• chore(deps): update base images to ubuntu 24.04

  #5553 commented on Jul 4, 2025 • 0 new comments