ELMo-chinese:中文的深层上下文词表示

上传者: 42134769 | 上传时间: 2022-11-15 21:49:53 | 文件大小: 3.32MB | 文件类型: ZIP
中华英语 中文的深层上下文单词表示。 本仓库只是输出某些无关的单词嵌入。 依赖 python3 张量流> = 1.10 界坝 使用方法 准备数据,参考data和vocab目录,可用pre_data/vocab.py处理出字典(每个data文件不能太大,否则内存不足) 训练模型train_elmo.py 输出模型dump_weights.py 把options.json里的261改成262 输出单词嵌入到hdf5文件usage_token.py 实验结果 用可视化工具看合理, textmatch任务textmatch AUC 1-2。 执照 麻省理工学院

文件下载

资源详情

[{"title":"( 34 个子文件 3.32MB ) ELMo-chinese:中文的深层上下文词表示","children":[{"title":"ELMo-chinese-master","children":[{"title":"setup.py <span style='color:#111;'> 243B </span>","children":null,"spread":false},{"title":"data","children":[{"title":"cn_train_data.txt <span style='color:#111;'> 5.81MB </span>","children":null,"spread":false}],"spread":true},{"title":"usage_token.py <span style='color:#111;'> 3.72KB </span>","children":null,"spread":false},{"title":"bin","children":[{"title":"restart.py <span style='color:#111;'> 1.74KB </span>","children":null,"spread":false},{"title":"train_elmo.py <span style='color:#111;'> 1.87KB </span>","children":null,"spread":false},{"title":"run_test.py <span style='color:#111;'> 1.24KB </span>","children":null,"spread":false},{"title":"dump_weights.py <span style='color:#111;'> 416B </span>","children":null,"spread":false}],"spread":true},{"title":"vocab","children":[{"title":"cn_vocab <span style='color:#111;'> 410.93KB </span>","children":null,"spread":false}],"spread":true},{"title":"usage_cached.py <span style='color:#111;'> 1.27KB </span>","children":null,"spread":false},{"title":"pre_data","children":[{"title":"code","children":[{"title":"pre.py <span style='color:#111;'> 1.47KB </span>","children":null,"spread":false},{"title":"vocab.py <span style='color:#111;'> 1.66KB </span>","children":null,"spread":false}],"spread":true}],"spread":true},{"title":"README.md <span style='color:#111;'> 746B </span>","children":null,"spread":false},{"title":"tests","children":[{"title":"test_training.py <span style='color:#111;'> 5.14KB </span>","children":null,"spread":false},{"title":"test_elmo.py <span style='color:#111;'> 4.67KB </span>","children":null,"spread":false},{"title":"test_data.py <span style='color:#111;'> 14.78KB </span>","children":null,"spread":false},{"title":"fixtures","children":[{"title":"data","children":[{"title":"vocab_test.txt <span style='color:#111;'> 414B </span>","children":null,"spread":false}],"spread":false},{"title":"model","children":[{"title":"lm_weights.hdf5 <span style='color:#111;'> 440.33KB </span>","children":null,"spread":false},{"title":"lm_embeddings_0.hdf5 <span style='color:#111;'> 42.97KB </span>","children":null,"spread":false},{"title":"lm_embeddings_sentences.json <span style='color:#111;'> 4.00KB </span>","children":null,"spread":false},{"title":"options.json <span style='color:#111;'> 308B </span>","children":null,"spread":false},{"title":"lm_embeddings_1.hdf5 <span style='color:#111;'> 33.22KB </span>","children":null,"spread":false},{"title":"vocab_test.txt <span style='color:#111;'> 2.89KB </span>","children":null,"spread":false},{"title":"lm_embeddings_2.hdf5 <span style='color:#111;'> 35.09KB </span>","children":null,"spread":false}],"spread":false},{"title":"train","children":[{"title":"data.txt <span style='color:#111;'> 815B </span>","children":null,"spread":false},{"title":"vocab.txt <span style='color:#111;'> 190B </span>","children":null,"spread":false}],"spread":false}],"spread":true},{"title":"test_model.py <span style='color:#111;'> 7.40KB </span>","children":null,"spread":false}],"spread":true},{"title":"test.py <span style='color:#111;'> 669B </span>","children":null,"spread":false},{"title":"recursive_cut.py <span style='color:#111;'> 1.47KB </span>","children":null,"spread":false},{"title":"usage_character.py <span style='color:#111;'> 2.91KB </span>","children":null,"spread":false},{"title":"bilm","children":[{"title":"training.py <span style='color:#111;'> 42.05KB </span>","children":null,"spread":false},{"title":"__init__.py <span style='color:#111;'> 171B </span>","children":null,"spread":false},{"title":"elmo.py <span style='color:#111;'> 4.09KB </span>","children":null,"spread":false},{"title":"model.py <span style='color:#111;'> 26.08KB </span>","children":null,"spread":false},{"title":"data.py <span style='color:#111;'> 16.53KB </span>","children":null,"spread":false}],"spread":true}],"spread":false}],"spread":true}]

评论信息

免责申明

【只为小站】的资源来自网友分享,仅供学习研究,请务必在下载后24小时内给予删除,不得用于其他任何用途,否则后果自负。基于互联网的特殊性,【只为小站】 无法对用户传输的作品、信息、内容的权属或合法性、合规性、真实性、科学性、完整权、有效性等进行实质审查;无论 【只为小站】 经营者是否已进行审查,用户均应自行承担因其传输的作品、信息、内容而可能或已经产生的侵权或权属纠纷等法律责任。
本站所有资源不代表本站的观点或立场,基于网友分享,根据中国法律《信息网络传播权保护条例》第二十二条之规定,若资源存在侵权或相关问题请联系本站客服人员,zhiweidada#qq.com,请把#换成@,本站将给予最大的支持与配合,做到及时反馈和处理。关于更多版权及免责申明参见 版权及免责申明