Patch-CLIP is based on CLIP open source implementation. It introduces additional loss correlating patch token embeddings to text, similar to the global image-text contrastive loss. - View it on GitHub