Hugging Face's logo

Ambarella
/
TinyCLIP

PyTorch
Model card Files
xet
 Community
cooper_robot Cursor commited on
Commit
8cb365e
·
1 Parent(s): b01d62a

Add release note for v1.3.0

Browse files

Co-authored-by: Cursor <cursoragent@cursor.com>

Files changed (13) hide show
  1. LICENSE +33 -0
  2. README.md +32 -0
  3. cv72_tinyclip_vit8m16_image_encoder_act16.bin +3 -0
  4. cv72_tinyclip_vit8m16_text_encoder_act16.bin +3 -0
  5. cv75_tinyclip_vit8m16_image_encoder_act16.bin +3 -0
  6. cv75_tinyclip_vit8m16_text_encoder_act16.bin +3 -0
  7. cv7_tinyclip_vit8m16_image_encoder_act16.bin +3 -0
  8. cv7_tinyclip_vit8m16_text_encoder_act16.bin +3 -0
  9. n1-655_tinyclip_vit8m16_image_encoder_act16.bin +3 -0
  10. n1-655_tinyclip_vit8m16_text_encoder_act16.bin +3 -0
  11. resource/TinyCLIP.png +3 -0
  12. tinyclip_vit8m16_token_embedding_weight.bin +3 -0
  13. tokenizer.json +3 -0
LICENSE ADDED
@@ -0,0 +1,33 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ MIT License
2
+ Copyright (c) Microsoft Corporation.
3
+
4
+ Permission is hereby granted, free of charge, to any person obtaining a copy
5
+ of this software and associated documentation files (the "Software"), to deal
6
+ in the Software without restriction, including without limitation the rights
7
+ to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
8
+ copies of the Software, and to permit persons to whom the Software is
9
+ furnished to do so, subject to the following conditions:
10
+
11
+ The above copyright notice and this permission notice shall be included in all
12
+ copies or substantial portions of the Software.
13
+
14
+
15
+ THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
16
+ IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
17
+ FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
18
+ AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
19
+ LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
20
+ OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
21
+ SOFTWARE
22
+
23
+ =======================================================================================
24
+ MIT license
25
+ =======================================================================================
26
+ - [CLIP](https://github.com/openai/CLIP)
27
+ - [CoFi](https://github.com/princeton-nlp/CoFiPruning)
28
+ - [OpenCLIP](https://github.com/mlfoundations/open_clip)
29
+
30
+ =======================================================================================
31
+ BSD-style license
32
+ =======================================================================================
33
+ - [PyTorch](https://github.com/pytorch/pytorch)
README.md ADDED
@@ -0,0 +1,32 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: pytorch
3
+ ---
4
+
5
+ ![tinyclip_logo](resource/TinyCLIP.png)
6
+
7
+ TinyCLIP is a compact vision–language model that compresses CLIP through knowledge distillation, enabling efficient image–text representation learning with significantly lower compute and memory requirements.
8
+
9
+ Original paper: [TinyCLIP: CLIP Distillation via Affinity Mimicking and Weight Inheritance, Wu et al., 2023](https://arxiv.org/abs/2309.12314)
10
+
11
+ # TinyCLIP-ViT8M16
12
+
13
+ This model uses the TinyCLIP variant, optimized for efficient image–text embedding generation while preserving strong zero-shot classification and retrieval performance. It is well suited for applications such as image retrieval, zero-shot classification, multimodal search, and edge vision-language deployments.
14
+
15
+ Model Configuration:
16
+ - Reference implementation: [Official TinyCLIP source code](https://github.com/microsoft/Cream/tree/main/TinyCLIP)
17
+ - Original Weight: [TinyCLIP-ViT8M16](https://github.com/wkcn/TinyCLIP-model-zoo/releases/download/checkpoints/TinyCLIP-ViT-8M-16-Text-3M-YFCC15M.pt)
18
+ - Resolution: 3x224x224
19
+ - Support Cooper version:
20
+ - Cooper SDK: [2.5.4]
21
+ - Cooper Foundry: [2.3]
22
+
23
+ | Model | Device | Model Link |
24
+ | :-----: | :-----: | :-----: |
25
+ | TinyCLIP-ViT8M16 Image Encoder | N1-655 | [Model_Link](https://huggingface.co/Ambarella/TinyCLIP/blob/main/n1-655_tinyclip_vit8m16_image_encoder_act16.bin) |
26
+ | TinyCLIP-ViT8M16 Text Encoder | N1-655 | [Model_Link](https://huggingface.co/Ambarella/TinyCLIP/blob/main/n1-655_tinyclip_vit8m16_text_encoder_act16.bin) |
27
+ | TinyCLIP-ViT8M16 Image encoder | CV7 | [Model_Link](https://huggingface.co/Ambarella/TinyCLIP/blob/main/cv7_tinyclip_vit8m16_image_encoder_act16.bin) |
28
+ | TinyCLIP-ViT8M16 Text Encoder | CV7 | [Model_Link](https://huggingface.co/Ambarella/TinyCLIP/blob/main/cv7_tinyclip_vit8m16_text_encoder_act16.bin) |
29
+ | TinyCLIP-ViT8M16 Image encoder | CV72 | [Model_Link](https://huggingface.co/Ambarella/TinyCLIP/blob/main/cv72_tinyclip_vit8m16_image_encoder_act16.bin) |
30
+ | TinyCLIP-ViT8M16 Text Encoder | CV72 | [Model_Link](https://huggingface.co/Ambarella/TinyCLIP/blob/main/cv72_tinyclip_vit8m16_text_encoder_act16.bin) |
31
+ | TinyCLIP-ViT8M16 Image encoder | CV75 | [Model_Link](https://huggingface.co/Ambarella/TinyCLIP/blob/main/cv75_tinyclip_vit8m16_image_encoder_act16.bin) |
32
+ | TinyCLIP-ViT8M16 Text Encoder | CV75 | [Model_Link](https://huggingface.co/Ambarella/TinyCLIP/blob/main/cv75_tinyclip_vit8m16_text_encoder_act16.bin) |
cv72_tinyclip_vit8m16_image_encoder_act16.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3ad8656aba7afac8e9a5e43df66775f9dbe02cd976fa3182d8f76d511b9df832
3
+ size 8714032
cv72_tinyclip_vit8m16_text_encoder_act16.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:633791a79e04a90d090cac2b880d64e0b745d876792f25710d1fa59b791d2ce2
3
+ size 5214233
cv75_tinyclip_vit8m16_image_encoder_act16.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e3f4404022e46336354d0ab36da78228b8c9b86d43c137d34e7e3d90437a0c62
3
+ size 8943988
cv75_tinyclip_vit8m16_text_encoder_act16.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:01e9b5d3cbf162fc3ccd719bedfd46ee049cf82b942711f92c8b88a062ad63d3
3
+ size 5322541
cv7_tinyclip_vit8m16_image_encoder_act16.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e093d936539946c35dfc1f78824870fa88881678235b16b062f54ce98452ee21
3
+ size 8675864
cv7_tinyclip_vit8m16_text_encoder_act16.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7f074e6bab91c3ac677357769083d1de709aa11dca3f8a8f6b69f2f628a8a8ba
3
+ size 5207297
n1-655_tinyclip_vit8m16_image_encoder_act16.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:88a4bc6ec6770edc0b286e5aaf16da3e00f60d959e817057b69eab10712651be
3
+ size 8633296
n1-655_tinyclip_vit8m16_text_encoder_act16.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:62ddde59f38d814d355d8e90eba1e9dba6d20e9707f9147df80de4e7af164da1
3
+ size 5183665
resource/TinyCLIP.png ADDED

Git LFS Details

  • SHA256: c6b4cdb7a742126657ed7af471f7b81e09ed1625fb74490692c559df931155aa
  • Pointer size: 132 Bytes
  • Size of remote file: 1.75 MB
tinyclip_vit8m16_token_embedding_weight.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a7808473ae8a33734542079a308a326be392af7aa86dd72895908eb82ec440b1
3
+ size 50593792
tokenizer.json ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b556ac8c99757ffb677208af34bc8c6721572114111a6e0aaf5fa69ff0b8d842
3
+ size 2224041