Skip to content

Commit

Permalink
feat(model_providers): Support deepseek-r1 for Nvidia Catalog (langge…
Browse files Browse the repository at this point in the history
…nius#13269)

Signed-off-by: -LAN- <[email protected]>
  • Loading branch information
laipz8200 authored Feb 6, 2025
1 parent 03ec351 commit 6d66d6d
Show file tree
Hide file tree
Showing 3 changed files with 37 additions and 1 deletion.
Original file line number Diff line number Diff line change
@@ -1,3 +1,4 @@
- deepseek-ai/deepseek-r1
- google/gemma-7b
- google/codegemma-7b
- google/recurrentgemma-2b
Expand Down
35 changes: 35 additions & 0 deletions api/core/model_runtime/model_providers/nvidia/llm/deepseek-r1.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,35 @@
model: deepseek-ai/deepseek-r1
label:
en_US: deepseek-ai/deepseek-r1
model_type: llm
features:
- agent-thought
model_properties:
mode: chat
context_size: 128000
parameter_rules:
- name: temperature
use_template: temperature
min: 0
max: 1
default: 0.5
- name: top_p
use_template: top_p
min: 0
max: 1
default: 1
- name: max_tokens
use_template: max_tokens
min: 1
max: 1024
default: 1024
- name: frequency_penalty
use_template: frequency_penalty
min: -2
max: 2
default: 0
- name: presence_penalty
use_template: presence_penalty
min: -2
max: 2
default: 0
2 changes: 1 addition & 1 deletion api/core/model_runtime/model_providers/nvidia/llm/llm.py
Original file line number Diff line number Diff line change
Expand Up @@ -83,7 +83,7 @@ def validate_credentials(self, model: str, credentials: dict) -> None:
def _add_custom_parameters(self, credentials: dict, model: str) -> None:
credentials["mode"] = "chat"

if self.MODEL_SUFFIX_MAP[model]:
if self.MODEL_SUFFIX_MAP.get(model):
credentials["server_url"] = f"https://ai.api.nvidia.com/v1/{self.MODEL_SUFFIX_MAP[model]}"
credentials.pop("endpoint_url")
else:
Expand Down

0 comments on commit 6d66d6d

Please sign in to comment.