File attachment

[igormedo]

Is it possible to attach an image or pdf to the query?

[kardolus]

It's not possible just yet. I will look into the API and get back to you. Would be a fun feature to add!

[kardolus]

I finally had some time and energy to work on the CLI again. However, unfortunately the current API does not support the uploading of images in the chat completion request:

https://platform.openai.com/docs/api-reference/chat/create

When it becomes available I will certainly add it to the CLI.

[vimagick]

Image URL can be included in message. Maybe it's helpful.

curl https://api.openai.com/v1/chat/completions \
  -H "Content-Type: application/json" \
  -H "Authorization: Bearer $OPENAI_API_KEY" \
  -d '{
    "model": "gpt-4o",
    "messages": [
      {
        "role": "user",
        "content": [
          {
            "type": "text",
            "text": "What'\''s in this image?"
          },
          {
            "type": "image_url",
            "image_url": {
              "url": "https://upload.wikimedia.org/wikipedia/commons/thumb/d/dd/Gfp-wisconsin-madison-the-nature-boardwalk.jpg/2560px-Gfp-wisconsin-madison-the-nature-boardwalk.jpg"
            }
          }
        ]
      }
    ],
    "max_tokens": 300
  }'

[kardolus]

Thanks! I will take a look

[kardolus]

This actually works :)

curl --location --insecure --request POST 'https://api.openai.com/v1/chat/completions'     --header "Authorization: Bearer ${OPENAI_API_KEY}"     --header 'Content-Type: application/json'     --data-raw '{
       "model": "gpt-4o",
       "messages": [
         {"role": "user", "content": "What is this image"},
         { "role": "user", "content": [
             {
               "type": "image_url",
               "image_url": {
                 "url": "data:image/png;base64,'"$(base64 -i ~/Downloads/wifi2.png)"'"
               }
             }
           ]
         }
       ],
       "stream": false
    }' | jq .

But my default arg size (getconf ARG_MAX) is only 1MB... So that won't work for plenty of images. However, you can pass an URL to 4o models instead. I may just stick to that.

[kardolus]

Or I can detect local path vs URL and leave it up to the user to up ARG_MAX? I am not sure just yet.

[kardolus]

Fixed in this commit: 5c6bd63
And released here: https://github.com/kardolus/chatgpt-cli/releases/tag/v1.7.8