Mapper Classifier

Try the model here.

Mapper Classifier is a model that predicts which osu! standard ranked mapper mapped a given beatmap.

This model is built using transfer learning on the Mapperatorinator V22 model. It achieves a top-1 validation accuracy of 12.5% on a random sample of ranked beatmaps and recognizes 3,731 unique mappers. To make its predictions, the model analyzes an 8-second segment of beatmap.

The purpose of this classifier is actually to calculate high-level feature vectors for beatmaps, which can be used to calculate the similarity between generated beatmaps and real beatmaps. This is a technique often used to assess the quality of image generation models with the Fréchet Inception Distance. However, in my testing I found that the computed FID scores for beatmap generation models were not very close to the actual quality of the generated beatmaps. This classifier might not be able to recognize all the necessary features to accurately assess the quality of a beatmap, but it's a start.

Usage

Run classify.py with the path to the beatmap you want to classify and the time in seconds of the segment you want to use to classify the beatmap.

python classify.py beatmap_path="'...\Songs\1790119 THE ORAL CIGARETTES - ReI\THE ORAL CIGARETTES - ReI (Sotarks) [Cataclysm.].osu'" time=60

Mapper: Sotarks (4452992) with confidence: 9.760356903076172
Mapper: Sajinn (13513687) with confidence: 6.975161075592041
Mapper: kowari (5404892) with confidence: 6.800069332122803
Mapper: Haruto (3772301) with confidence: 6.077754020690918
Mapper: Kalibe (3376777) with confidence: 5.894346237182617
Mapper: iljaaz (8501291) with confidence: 5.873990535736084
Mapper: tomadoi (5712451) with confidence: 5.817874431610107
Mapper: Nao Tomori (5364763) with confidence: 5.144880294799805
Mapper: Kujinn (3723568) with confidence: 5.082106590270996
...