How to customize an AI API

[1131659949]

Describe the bug
I attempted to implement AI functionality using a custom API. While the API returns data as expected, Blocknote does not render the data within the text content.

This is part of the frontend code.
`
const client = createBlockNoteAIClient({
apiKey: "PLACEHOLDER",
baseURL: BASE_URL + aiChatApi,
});
const model = createGroq({
// call via our proxy client
...client.getProviderSettings("openai"),
})("deepseek-r1-distill-llama-70b");

const editor = useCreateBlockNote({
    dictionary: {
        ...en,
        ai: aiEn, // add default translations for the AI extension
    },
    extensions: [
        createAIExtension({
            model,
        }),
    ],
    // We set some initial content for demo purposes
})

`

We can see that the API is returning data, but BlockNote is still giving me an error message. Could you tell me how to fix this? Many thanks.

• Node version: 10.8.3
• Package manager: @blocknote/xl-ai@0.31.2
• Browser: chrome
• I'm a sponsor and would appreciate if you could look into this sooner than later 💖

[YousefED]

Hi,

• what's the error you're getting?
• you're calling "createGroq", are you using groq as a provider? What are you using as backend LLM?

Also, curious to learn what you're building!

[1131659949]

sorry for that, acctually I got a warning after the request ended.

[YousefED]

Thanks, can you also answer the following:

• you're calling "createGroq", are you using groq as a provider? What are you using as backend LLM?
• can you set stream: false in createAIExtension and see if this resolves the issue? If not, can you share the network response?
• Want to share what kind of product are you building? We're always eager to learn!

[1131659949]

• I'm not using Groq. Instead, I'm providing my own API interface and using it as the backend AI server.
• I’ll spend some time testing whether this solution is feasible. At the moment, I’m struggling with how to properly use
  RESTYjsThreadStore . I hope to persist comments via HTTP, but the documentation doesn’t clearly explain how the API response should be structured. I’d greatly appreciate it if you could provide some documentation or guidance on this.
• I’m currently working on a personal project to build a product similar to Notion. However, since I have very little knowledge about AI, I’m encountering some issues now.

[1131659949]

Additionally, I tried setting up the project (as I wanted to understand the API response through this example), but I encountered some issues when running it. I suspect the problem is related to dependencies.(https://github.com/TypeCellOS/BlockNote-demo-nextjs-hocuspocus)

[YousefED]

Hi!

Would something like this address your needs? #1766