Skip to content

Commit

Permalink
update devset example
Browse files Browse the repository at this point in the history
  • Loading branch information
jnwnlee committed Mar 25, 2024
1 parent b83768d commit e29f04a
Showing 1 changed file with 25 additions and 4 deletions.
29 changes: 25 additions & 4 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -67,14 +67,35 @@ fadtk.embeds -m <models...> -d <datasets...>
*--inf* option uses FAD-inf extrapolation, anad *--indiv* calculates FAD for individual songs.

#### (2024) Example 1: Computing FAD scores on Dev Set
1. Download Dev Set and unzip
```sh
# Download Dev Set and unzip
wget todo---
tar -zxvf todo---
```
2. Before computing FAD, make sure the Dev Set directory looks like this:
```
path/to/dev/
├── embeddings/
│ ├── panns-wavegram-logmel
│ ├── vggish
│ ├── clap-2023
│ └── ...
├── stats/
│ └── ...
└── caption.csv
path/to/eval/
├── embeddings/
│ └── ...
├── stats/
│ └── ...
└── caption.csv
```
3. Calculate FAD score
```sh
# Compute FAD between the baseline and evaluation datasets on two different models
fadtk panns-wavegram-logmel /path/to/devset /path/to/evaluation/audio
fadtk clap-2023 /path/to/devset /path/to/evaluation/audio
fadtk panns-wavegram-logmel /path/to/dev /path/to/evaluation/audio
fadtk vggish /path/to/dev /path/to/evaluation/audio
fadtk clap-2023 /path/to/dev /path/to/evaluation/audio
```

#### Example 2: Compute individual FAD scores for each audio
Expand Down

0 comments on commit e29f04a

Please sign in to comment.