Inquries about the text encoder's pretrained weight

[hangyulyoon]

I apologize for inquiring about the code released a few years ago, but it appears that the text encoder directly loads the weights from BioClinicalBERT rather than being pretrained through contrastive learning. From my understanding, the text encoder was trained without being frozen. Are there no available pretrained weights for the text encoder of MedCLIP other than those from BioClinicalBERT?

[benSchaper]

I just checked the state dictionary from the pretrained model, and it contains both the vision model and BioClinicalBERT weights. When you call model.from_pretrained(), it should download and load all these weights, not just the original BioClinicalBERT.