Skip to content

Commit

Permalink
docs: add Codestral x Tabby blog (TabbyML#2598)
Browse files Browse the repository at this point in the history
  • Loading branch information
gyxlucy authored Jul 9, 2024
1 parent aabc22e commit 9307e38
Show file tree
Hide file tree
Showing 6 changed files with 57 additions and 23 deletions.
1 change: 1 addition & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -26,6 +26,7 @@ Tabby is a self-hosted AI coding assistant, offering an open-source and on-premi

## 🔥 What's New

* **07/09/2024** 🎉Announce [Codestral integration in Tabby](https://tabby.tabbyml.com/blog/2024/07/09/tabby-codestral/)!
* **07/05/2024** Tabby [v0.13.0](https://github.com/TabbyML/tabby/releases/tag/v0.13.0) introduces ***Answer Engine***, a cetral knowledge engine for internal engineering teams. It seemlessly integrates with dev teams' internal data, delivering reliable and precise answers to empower developers.
* **06/13/2024** [VSCode 1.7](https://marketplace.visualstudio.com/items/TabbyML.vscode-tabby/changelog) marks a significant milestone with a versatile Chat experience throughout your coding exprience. Come and they the latest **chat in side-panel** and **editing via chat command**!
* **06/10/2024** Latest 📃blogpost drop on [an enhanced code context understanding](https://tabby.tabbyml.com/blog/2024/06/11/rank-fusion-in-tabby-code-completion/) in Tabby!
Expand Down
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
48 changes: 48 additions & 0 deletions website/blog/2024-07-09-tabby-codestral/index.mdx
Original file line number Diff line number Diff line change
@@ -0,0 +1,48 @@
---
authors: [gyxlucy]
tags: [partnership, product]
image: ./tabby-mistral.png

---

import CodestralVideoUrl from './tabby_codestral.mp4'


# Introducing the Codestral Integration in Tabby

![Tabby x Mistral](./tabby-mistral.png)

We are excited to share the integration of ***Codestral*** model into Tabby!
Codestral has demonstrated exceptional performance across various coding tasks, and we are delighted to support our users in both self-hosting and accessing Codestral through its cloud API.
This addition aims to enhance your coding experience with precision and efficiency, setting a new standard for AI-enhanced developer experience.

<video autoplay muted controls width="620" height="400" src={CodestralVideoUrl} type="video/mp4"/>


## What's great about Codestral?

Compared to other coding LLMs, Codestral stands out with its single model that supports both instruction-following and fill-in-the-middle compatibility.
This is achieved by fine-tuning the base model on two data sets simultaneously.
This dual fine-tuning strategy allows the same model to perform excellently in both code completion and conversational tasks, greatly simplifying the model deployment stack.
This highlights an important direction we're extremely excited about from an application perspective, especially in on-prem/byoc use cases.

Besides, Codestral is trained on a diverse dataset of **80+ programming languages**, ensuring a high-quality experience for developers working with a wide range of languages.


## Get started with Codestral in Tabby

### Self-hosting Codestral

Codestral-22B is available for both Tabby completion and chat models [link](https://tabby.tabbyml.com/docs/models/).
Please follow [Tabby Installation](https://tabby.tabbyml.com/docs/quick-start/installation/) to host Tabby and set `--model Codestral-22B --chat-model Codestral-22B`.

### Access via Mistal AI API

Tabby also supports connecting to Mistral's API Platform. To use Codestral via Mistral's API, you need to first sign up for an API key from [Mistral AI](https://mistral.ai/).
Then in Tabby, set your model configuration as below in `~/.tabby/config.toml` file ([see more](https://tabby.tabbyml.com/docs/administration/model/#mistral--codestral)).

![Codestral API in Tabby](./codestral_api.jpeg)




3 changes: 3 additions & 0 deletions website/blog/2024-07-09-tabby-codestral/tabby-mistral.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file not shown.
28 changes: 5 additions & 23 deletions website/yarn.lock
Original file line number Diff line number Diff line change
Expand Up @@ -2423,7 +2423,7 @@
"@docusaurus/theme-search-algolia" "3.2.1"
"@docusaurus/types" "3.2.1"

"@docusaurus/[email protected]":
"@docusaurus/[email protected]", "react-loadable@npm:@docusaurus/[email protected]":
version "5.5.2"
resolved "https://registry.yarnpkg.com/@docusaurus/react-loadable/-/react-loadable-5.5.2.tgz#81aae0db81ecafbdaee3651f12804580868fa6ce"
integrity sha512-A3dYjdBGuy0IGT+wyLIGIKLRE+sAk1iNk0f1HjNDysO7u8lhL4N3VEm+FAubmJbAztn94F7MxBTPmnixbiyFdQ==
Expand Down Expand Up @@ -4002,15 +4002,10 @@ caniuse-api@^3.0.0:
lodash.memoize "^4.1.2"
lodash.uniq "^4.5.0"

caniuse-lite@^1.0.0, caniuse-lite@^1.0.30001464, caniuse-lite@^1.0.30001489:
version "1.0.30001495"
resolved "https://registry.yarnpkg.com/caniuse-lite/-/caniuse-lite-1.0.30001495.tgz#64a0ccef1911a9dcff647115b4430f8eff1ef2d9"
integrity sha512-F6x5IEuigtUfU5ZMQK2jsy5JqUUlEFRVZq8bO2a+ysq5K7jD6PPc9YXZj78xDNS3uNchesp1Jw47YXEqr+Viyg==

caniuse-lite@^1.0.30001587:
version "1.0.30001612"
resolved "https://registry.yarnpkg.com/caniuse-lite/-/caniuse-lite-1.0.30001612.tgz#d34248b4ec1f117b70b24ad9ee04c90e0b8a14ae"
integrity sha512-lFgnZ07UhaCcsSZgWW0K5j4e69dK1u/ltrL9lTUiFOwNHs12S3UMIEYgBV0Z6C6hRDev7iRnMzzYmKabYdXF9g==
caniuse-lite@^1.0.0, caniuse-lite@^1.0.30001464, caniuse-lite@^1.0.30001489, caniuse-lite@^1.0.30001587:
version "1.0.30001640"
resolved "https://registry.npmjs.org/caniuse-lite/-/caniuse-lite-1.0.30001640.tgz"
integrity sha512-lA4VMpW0PSUrFnkmVuEKBUovSWKhj7puyCg8StBChgu298N1AtuF1sKWEvfDuimSEDbhlb/KqPKC3fs1HbuQUA==

ccount@^2.0.0:
version "2.0.1"
Expand Down Expand Up @@ -6775,11 +6770,6 @@ marked@^11.0.0:
resolved "https://registry.yarnpkg.com/marked/-/marked-11.2.0.tgz#fc908aeca962b721b0392ee4205e6f90ebffb074"
integrity sha512-HR0m3bvu0jAPYiIvLUUQtdg1g6D247//lvcekpHO1WMvbwDlwSkZAX9Lw4F4YHE1T0HaaNve0tuAWuV1UJ6vtw==

marked@^9.1.5:
version "9.1.5"
resolved "https://registry.yarnpkg.com/marked/-/marked-9.1.5.tgz#fcada4702ea64a5c05a4ff0e0639628aac8a1e5f"
integrity sha512-14QG3shv8Kg/xc0Yh6TNkMj90wXH9mmldi5941I2OevfJ/FQAFLEwtwU2/FfgSAOMlWHrEukWSGQf8MiVYNG2A==

mdast-util-directive@^3.0.0:
version "3.0.0"
resolved "https://registry.yarnpkg.com/mdast-util-directive/-/mdast-util-directive-3.0.0.tgz#3fb1764e705bbdf0afb0d3f889e4404c3e82561f"
Expand Down Expand Up @@ -8834,14 +8824,6 @@ react-loadable-ssr-addon-v5-slorber@^1.0.1:
dependencies:
"@babel/runtime" "^7.10.3"

"react-loadable@npm:@docusaurus/[email protected]":
version "5.5.2"
resolved "https://registry.yarnpkg.com/@docusaurus/react-loadable/-/react-loadable-5.5.2.tgz#81aae0db81ecafbdaee3651f12804580868fa6ce"
integrity sha512-A3dYjdBGuy0IGT+wyLIGIKLRE+sAk1iNk0f1HjNDysO7u8lhL4N3VEm+FAubmJbAztn94F7MxBTPmnixbiyFdQ==
dependencies:
"@types/react" "*"
prop-types "^15.6.2"

react-magic-dropzone@^1.0.1:
version "1.0.1"
resolved "https://registry.yarnpkg.com/react-magic-dropzone/-/react-magic-dropzone-1.0.1.tgz#bfd25b77b57e7a04aaef0a28910563b707ee54df"
Expand Down

0 comments on commit 9307e38

Please sign in to comment.