Skip to content

Comment on Ask HN: Why can't image generation models spell?parent

Comments

ChatGPT can eloquently generate words but it is completely unable to generate or understand pictures. Ask ChatGPT to generate some ASCII-art.)

Ok. I did both things.

I took a photo of my feet up on a stool in my living room, and told CharGPT to describe it.

It was reasonably (and rather surprisingly) successful.

I also told it to generate an ASCII image of a car. It did that, too.

GP likely meant GPT-4 (the LLM), not ChatGPT the product as a whole (which has additional models for doing things with images).

Feed original (not copy-pasted from the web) ASCII art of a foot into GPT-4 and I'd be very impressed if it can tell you it's a foot.

I'm actually mildly impressed it could generate ASCII art of a car, because that's a lot better than I've been able to get out of it (albeit on gpt3.5). Try anything more complex and I believe you'll see it's limitations.

AboutSource Built by g1lg1l

Hackerly is an independent reader for Hacker News, built on the public HN API. Not affiliated with Y Combinator.