I wonder if a hacky solution may be to have some kind of intermediate model to serialize the text (whether from an image of it or the raw PDF data) into LaTeX? I imagine the LM has seen enough formulas in TeX to understand it, but in most PDFs formulas are just jumbles of letters.
Comments
Looks neat.
I was hoping it would magically translate some of the math notation into plain English but I think it kind of just ignored it. Would love to see this.
Minor feedback: the UI doesn't really convey that the highlighted text is being processed. I was wondering if anything was happening at first.
We're actively working on math notation! Tough problem but lots of people have asked.
And we'll push an update soon with better loading :)
I wonder if a hacky solution may be to have some kind of intermediate model to serialize the text (whether from an image of it or the raw PDF data) into LaTeX? I imagine the LM has seen enough formulas in TeX to understand it, but in most PDFs formulas are just jumbles of letters.