hummingbird
/
fastNLP
Not watched
2
0
Fork 0
Code
Releases 13 Wiki Activity
Issues 0 Pull Requests 0 Datasets Model Cloudbrain
You can not select more than 25 topics Topics must start with a chinese character,a letter or number, can include dashes ('-') and can be up to 35 characters long.
1491 Commits
3 Branches
25 MB
1 Download
 
 
 
 
 
Tree: d028d90c41
Branches Tags
${ item.name }
Create branch ${ searchTerm }
from 'd028d90c41'
${ noResults }
fastNLP/reproduction/seqence_labelling/chinese_ner
LeeSureman 08399e9b6e debug 5 years ago
..
LatticeLSTM debug 5 years ago
readme.md 1.增加sequence labeling任务的数据说明; 2.增加对CWSPipe的引用 5 years ago
train_bert.py 1. 增加中文NER相关的loader和pipe; 2. 对应修改sequence_labeling的代码; 3.增加部分测试代码 6 years ago
train_cn_ner.py 增加conll2003Pipe 6 years ago

readme.md

使用以下中文NERPipe自动下载的统计数据

MsraNERPipe # of sents # of tokens
train 41747 1954374
dev 4617 215505
test 4365 172601
total 50729 2342480
这里报道的统计数据，与https://arxiv.org/pdf/1805.02023.pdf报道的一致
WeiboNERPipe # of sents # of tokens
train 1350 73778
dev 270 14509
test 270 14842
total 1890 1890
这里报道的统计数据与https://www.cs.cmu.edu/~ark/EMNLP-2015/proceedings/EMNLP/pdf/EMNLP064.pdf一致
PeopleDailyPipe # of sents # of tokens
train 50658 2169879
dev 4631 172601
test 68 2270
total 55357 2344750
这里使用的数据与https://arxiv.org/pdf/1906.08101.pdf的数据是一致的
Delete task

Are you sure you want to delete this task? Once this task is deleted, it cannot be recovered.

cancel
confirm

一款轻量级的自然语言处理（NLP）工具包，目标是减少用户项目中的工程型代码，例如数据处理循环、训练循环、多卡运行等

Python Jupyter Notebook Text CSV Markdown