PKU-DAIR
/
Hetu
Not watched
1
0
Fork 0
Code
Releases 0 Wiki evaluate Activity
Issues 0 Pull Requests 0 Datasets Model Cloudbrain HPC
You can not select more than 25 topics Topics must start with a chinese character,a letter or number, can include dashes ('-') and can be up to 35 characters long.
23 Commits
1 Branch
116 MB
0 Download
 
 
 
 
 
 
Tree: 311bfde6c1
Branches Tags
${ item.name }
Create branch ${ searchTerm }
from '311bfde6c1'
${ noResults }
Hetu/examples/nlp
梁宇轩 0cf3d3c07d first commit 4 years ago
..
bert first commit 4 years ago
bookcorpus initial commit 4 years ago
.gitignore initial commit 4 years ago
README.md initial commit 4 years ago
__init__.py initial commit 4 years ago
data_load.py initial commit 4 years ago
hetu_transformer.py initial commit 4 years ago
hparams.py initial commit 4 years ago
prepare_data.py initial commit 4 years ago
processBertData.py initial commit 4 years ago
tf_transformer.py initial commit 4 years ago
train_hetu_transformer.py initial commit 4 years ago
train_tf_transformer.py initial commit 4 years ago
wikipedia.py initial commit 4 years ago

README.md

NLP Examples

In this directory we provide simple implementations for Transformer model. We use the IWSLT2016 de-en dataset.

Structure

- nlp
    - hparams.py                    Hyperparameters
    - prepare_data.py               Downloading and preparing data
    - data_load.py                  Dataloader
    - hetu_transformer.py           Transformer model in hetu
    - tf_transformer.py             Transformer model in tensorflow
    - train_hetu_transformer.py     Trainer for hetu
    - train_tf_transformer.py       Trainer for tensorflow

Usage

python train_{framework}_transformer.py

To change the hyperparameters, please modify hparams.py file.

Delete task

Are you sure you want to delete this task? Once this task is deleted, it cannot be recovered.

cancel
confirm

分布式深度学习系统

Python C++ Cuda C CMake other