PKU-DAIR
/
Hetu
Not watched
1
0
Fork 0
Code
Releases 0 Wiki evaluate Activity
Issues 0 Pull Requests 0 Datasets Model Cloudbrain HPC
You can not select more than 25 topics Topics must start with a chinese character,a letter or number, can include dashes ('-') and can be up to 35 characters long.
Tree: 311bfde6c1
Branches Tags
${ item.name }
Create branch ${ searchTerm }
from '311bfde6c1'
${ noResults }
Hetu/examples/nlp/README.md

686 B
Raw Blame History

NLP Examples

In this directory we provide simple implementations for Transformer model. We use the IWSLT2016 de-en dataset.

Structure

- nlp
    - hparams.py                    Hyperparameters
    - prepare_data.py               Downloading and preparing data
    - data_load.py                  Dataloader
    - hetu_transformer.py           Transformer model in hetu
    - tf_transformer.py             Transformer model in tensorflow
    - train_hetu_transformer.py     Trainer for hetu
    - train_tf_transformer.py       Trainer for tensorflow

Usage

python train_{framework}_transformer.py

To change the hyperparameters, please modify hparams.py file.