BIT2024
/
clip-B
Not watched
1
0
Fork 0
Code
Releases 0 Wiki evaluate Activity
Issues 0 Pull Requests 0 Datasets Model Cloudbrain HPC
You can not select more than 25 topics Topics must start with a chinese character,a letter or number, can include dashes ('-') and can be up to 35 characters long.
39 Commits
1 Branch
2.2 MB
0 Download
 
 
Branch: master
Branches Tags
${ item.name }
Create branch ${ searchTerm }
from 'master'
${ noResults }
clip-B/jclip
BIT2024 76b47b0744 ADD file via upload 1 year ago
..
bpe_simple_vocab_16e6.txt.gz ADD file via upload 1 year ago
clip.py ADD file via upload 1 year ago
mha.py ADD file via upload 1 year ago
model.py ADD file via upload 1 year ago
simple_tokenizer.py ADD file via upload 1 year ago
Delete task

Are you sure you want to delete this task? Once this task is deleted, it cannot be recovered.

cancel
confirm

首先冻结OpenAI官方预训练的ViT-B/32版本的CLIP模型中的全部图像层，再利用AdanBelief优化器训练模型，该优化器是Adan优化器和AdaBelief优化器的融合，在Adan优化器中融入"Belief"增强训练模型的泛化性能。

Python Text

Contributors (1)
All