Skip to content

Commit

Permalink
Create README.md (huggingface#5871)
Browse files Browse the repository at this point in the history
  • Loading branch information
jannesgg authored Jul 21, 2020
1 parent b1ee697 commit e7844d6
Showing 1 changed file with 50 additions and 0 deletions.
50 changes: 50 additions & 0 deletions model_cards/jannesg/takalane_nbl_roberta/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,50 @@
---
language:
- nr
thumbnail: https://pbs.twimg.com/media/EVjR6BsWoAAFaq5.jpg
tags:
- nr
- fill-mask
- pytorch
- roberta
- lm-head
- masked-lm
license: MIT
---

# Takalani Sesame - Ndebele 🇿🇦

<img src="https://pbs.twimg.com/media/EVjR6BsWoAAFaq5.jpg" width="600"/>

## Model description

Takalani Sesame (named after the South African version of Sesame Street) is a project that aims to promote the use of South African languages in NLP, and in particular look at techniques for low-resource languages to equalise performance with larger languages around the world.

## Intended uses & limitations

#### How to use

```python
from transformers import AutoTokenizer, AutoModelWithLMHead

tokenizer = AutoTokenizer.from_pretrained("jannesg/takalane_nbl_roberta")

model = AutoModelWithLMHead.from_pretrained("jannesg/takalane_nbl_roberta")
```

#### Limitations and bias

Updates will be added continously to improve performance. This is a very low resource language, results may be poor at first.

## Training data

Data collected from [https://wortschatz.uni-leipzig.de/en](https://wortschatz.uni-leipzig.de/en) <br/>
**Sentences:** 318M

## Training procedure

No preprocessing. Standard Huggingface hyperparameters.

## Author

Jannes Germishuys [website](http://jannesgg.github.io)

0 comments on commit e7844d6

Please sign in to comment.