With data analysis enabled, I’ve seen it try to use pytesseract to do OCR when you ask it to extract text from an image. (I’ve seen it fail with a timeout trying that on an image that it worked almost instantly on with a similar approach on my laptop.)
CogVLM and Llava can both read text from images I think, although I haven't tried this myself. They certainly describe images very accurately, including giving the pixel location.
Comments
chatpgt can in fact both read words in images and generate images
But ChatGPT is a product, not a model. Might there be an augmenting OCR process feeding it the image's text?
With data analysis enabled, I’ve seen it try to use pytesseract to do OCR when you ask it to extract text from an image. (I’ve seen it fail with a timeout trying that on an image that it worked almost instantly on with a similar approach on my laptop.)
CogVLM and Llava can both read text from images I think, although I haven't tried this myself. They certainly describe images very accurately, including giving the pixel location.