murray-z / bert_of_theseus_torch Public

Notifications You must be signed in to change notification settings
Fork 0
Star 1

BERT-of-Theseus 模型壓縮方法的pytorch實現

1 star 0 forks Branches Tags Activity

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 5 Commits
bert_config		bert_config
data		data
model		model
README.md		README.md
bert_model.py		bert_model.py
config.py		config.py
data_helper.py		data_helper.py
data_preprocess.py		data_preprocess.py
train.py		train.py
utils.py		utils.py

Repository files navigation

bert_theuse_torch

實現《BERT-of-Theseus: Compressing BERT by Progressive Module Replacing》，由於沒有GPU，沒有測試。

使用

配置文件config.py
數據預處理
- python data_preprocess.py
訓練模型
- python train.py

About

BERT-of-Theseus 模型壓縮方法的pytorch實現

Report repository

Releases

No releases published

Packages

No packages published

Languages

Python 100.0%