Skip to content

Commit

Permalink
Update README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
jinnaiyuu authored Feb 26, 2024
1 parent 5e6e1e0 commit 50ed445
Showing 1 changed file with 13 additions and 7 deletions.
20 changes: 13 additions & 7 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -24,27 +24,33 @@ The code runs in two steps.
./experiments/sample.sh -d [DATASET] -s [NUMBER OF SAMPLES]
```

Sampling sequences on WMT'19 En-De
### Computing Diverse MBR and KMBR

```
./experiments/sample.sh -d wmt19.en-de
./experiments/run_mbr.sh -d [DATASET] -s [NUMBER OF SAMPLES] -a [ALGORITHM]
```

### Computing Diverse MBR and KMBR
### Example on WMT'19 En-De

1. Use [sacrebleu](https://github.com/mjpost/sacrebleu) to prepare the benchmark dataset.
```
./experiments/run_mbr.sh -d [DATASET] -s [NUMBER OF SAMPLES] -a [ALGORITHM]
sacrebleu -t wmt19 -l en-de --echo src > ./dataset/wmt19-text/wmt19.en-de.en
sacrebleu -t wmt19 -l en-de --echo ref > ./dataset/wmt19-text/wmt19.en-de.de
```

### Example
2. Sample candidates on WMT'19 En-De

```
./experiments/sample.sh -d wmt19.en-de
```

Computing the Diverse MBR output on WMT'19 En-De
3. Computing the Diverse MBR output on WMT'19 En-De

```
./experiments/run_mbr.sh -d wmt19.en-de -a diverse
```

Computing the k-Medoid MBR output on WMT'19 En-De
4. Computing the k-Medoid MBR output on WMT'19 En-De

```
./experiments/run_mbr.sh -d wmt19.en-de -a kmmbr
Expand Down

0 comments on commit 50ed445

Please sign in to comment.