Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

whats the difference between albert_tiny_zh and albert_tiny_google_zh #167

Open
zheyuye opened this issue Dec 20, 2021 · 1 comment
Open

whats the difference between albert_tiny_zh and albert_tiny_google_zh #167

zheyuye opened this issue Dec 20, 2021 · 1 comment

Comments

@zheyuye
Copy link

zheyuye commented Dec 20, 2021

我注意到这两个tiny版本略有不同， 从config里看到模型size保持了一致， 但是模型文件参数ckpt.data大小有差异（17.2MB vs 49.7MB）

想请教一下brightmart版本是在预训练的具体什么阶段做了哪些优化
@brightmart
Copy link
Owner

只是模型有一点差异。具体你可以看看model的代码。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@brightmart @zheyuye