dotnet-sdk datasource only retrieves latest-sdk for each major-minor combination, not all available versions

[SjoerdvE]

How are you running Renovate?

Mend Renovate hosted app on github.com

If you're self-hosting Renovate, tell us what version of Renovate you run.

If you're self-hosting Renovate, select which platform you are using.

None

Was this something which used to work for you, and then stopped?

I am trying to get this working for the first time

Describe the problem

Background: Microsoft has three 'tracks' of SDK versions: https://dotnet.microsoft.com/en-us/download/dotnet/6.0
Since our builder image has the 'oldest' track installed, that is the version that we want updated. (So there are 6.0.4xx, 6.0.3yy and 6.0.1zz tracks. We are currently running 6.0.110 and want to update this within the 6.0.1zz track.)

When trying to get Renovate to get me the latest version of a .NET SDK track it only gets the latest-sdk version of a major-minor combination, not all available packages.

I've tried the following situations with allowedVersions (current version is 6.0.110):

• <7 which correctly gets me 6.0.413
• <6.0.200 which does not show any updates, while there is a 6.0.121 available.

For the files and minimal reproduction see the files in this repo: https://github.com/Sjoerde/renovatebot-issue-allowedversions

After some discussion (see below for more details) I found out that:

• Renovate retrieves the dotnet-sdk datasource from:
  "registryUrl": "https://dotnetcli.blob.core.windows.net/dotnet/release-metadata/releases-index.json"
• This releases-index.json only contains the latest-sdk version of each major-minor combination.
• The linked datasources for each specific major-minor combination are referenced, but I assume not loaded in Renovate:
  "releases.json": "https://dotnetcli.blob.core.windows.net/dotnet/release-metadata/6.0/releases.json"
• The 6.0.121 that I want and want to use the <6.0.200 for is available in this linked/nested datasource.

Relevant debug logs

Logs

DEBUG: packageFiles with updates
{
  "baseBranch": "main"
  "config": {
    "nuget": [
      {
        "deps": [
          {
            "depType": "dotnet-sdk",
            "depName": "dotnet-sdk",
            "currentValue": "6.0.110",
            "datasource": "dotnet-version",
            "updates": [],
            "packageName": "dotnet-sdk",
            "versioning": "semver-coerced",
            "warnings": [],
            "sourceUrl": "https://github.com/dotnet/sdk",
            "registryUrl": "https://dotnetcli.blob.core.windows.net/dotnet/release-metadata/releases-index.json",
            "currentVersion": "6.0.110",
            "fixedVersion": "6.0.110"
          }
        ],
        "packageFile": "global.json"
      }
    ]
  }
}

Have you created a minimal reproduction repository?

I have linked to a minimal reproduction in the description above

• https://github.com/Sjoerde/renovatebot-issue-allowedversions

[rarkins]

If the dependency is public then it's possible to make a reproduction

[rarkins]

We should now convert this to a bug report issue however I'm on mobile only this week and it doesn't work through the iPhone app

[SjoerdvE]

I'm not allowed to do the Create issue from discussion so I guess I have to wait until you're back on a computer next week :)

[SjoerdvE]

Hi @rarkins, I see that this discussion dropped from the 1st page of discussions so you might have missed it this week. Can you make it into an issue so that I can follow that? Thank you.

[rarkins]

Thanks, created here: #23888

[viceice]

I've removed the excess config, but the problem remains.
When looking into the logs (see above in the original post) I see that you get the release information from:
"registryUrl": "https://dotnetcli.blob.core.windows.net/dotnet/release-metadata/releases-index.json"
After opening that file I see that that source only shows the latest-sdk for each major-minor combination, so it makes sense that the 6.0.121 cannot be found in that file. However there are dedicated releases.json files referenced in this file (per major-minor combination) in which you can find the actual different options (see the two excerpts below).

I hope this helps you out? Would you be able to pick this up as an issue/bug? Or would it be more of a small story/feature since it's not actually allowedVersions that is broken?

https://dotnetcli.blob.core.windows.net/dotnet/release-metadata/releases-index.json:

...
        {
            "channel-version": "6.0",
            "latest-release": "6.0.21",
            "latest-release-date": "2023-08-08",
            "security": true,
            "latest-runtime": "6.0.21",
            "latest-sdk": "6.0.413",
            "product": ".NET",
            "release-type" : "lts",
            "support-phase": "active",
            "eol-date": "2024-11-12",
            "releases.json": "https://dotnetcli.blob.core.windows.net/dotnet/release-metadata/6.0/releases.json"
        },
...

https://dotnetcli.blob.core.windows.net/dotnet/release-metadata/6.0/releases.json:

...
        {
          "version": "6.0.121",
          "version-display": "6.0.121",
          "runtime-version": "6.0.21",
...

p.s. thank you for your quick responses

the datasource should fetch the channel releases here

renovate/lib/modules/datasource/dotnet-version/index.ts

Line 45 in d45cf97

const channelReleases = await p.map(

[github-actions[bot]]

Hi there,

Get your issue fixed faster by creating a minimal reproduction. This means a repository dedicated to reproducing this issue with the minimal dependencies and config possible.

Before we start working on your issue we need to know exactly what's causing the current behavior. A minimal reproduction helps us with this.

To get started, please read our guide on creating a minimal reproduction.

We may close the issue if you, or someone else, haven't created a minimal reproduction within two weeks. If you need more time, or are stuck, please ask for help or more time in a comment.

Good luck,

The Renovate team

[cleverer]

We also face this issue, anything we can do to help progress this issue?

[rarkins]

Yes, read the message above yours about minimal reproductions

[cleverer]

I think there was one added after first opening it?

Also there seems to be an issue for it already: #23888

[SjoerdvE]

Yes there already is a reproduction, I already added it to the issue description: "For the files and minimal reproduction see the files in this repo: https://github.com/Sjoerde/renovatebot-issue-allowedversions".
Supposedly the code to retrieve the major-minor combinations is already available in Renovate, the question now is still why is it not working.

[rarkins]

Thanks, I had forgotten that an issue was created and that this discussion needs closing in favor of it.