has been using CLIP models for smart search for a while and anecdotally seems to work really well [..] results are of similar quality to the giant SaaS providers
I'm not super familiar with how the results for the "giant SaaS providers" are, but the demo instance of Immich doesn't seem to do it very well.
Even the fourth result seems to rank higher than photos of actual airplanes, and most of the results aren't actually airplanes at all.
Again, not sure how that compares with other providers, but on Google Photos (as one example I am familiar with), searching for "airplane" shows me photos taken of airplanes, or photos taken from the inside of an airplane. Even lego airplanes seems to show up correctly, and none of the photos are incorrectly shown as far as I can tell.
I’ve just tried that and it’s true although on my instance searching ‘airplane’ gives good results. I wonder if it’s due to an insufficient number of images in the demo? I also took the advice in the forums to tweak the exact model version used.
Comments
I'm not super familiar with how the results for the "giant SaaS providers" are, but the demo instance of Immich doesn't seem to do it very well.
Example query for "airplane": https://demo.immich.app/search?q=airplane&clip=true
Even the fourth result seems to rank higher than photos of actual airplanes, and most of the results aren't actually airplanes at all.
Again, not sure how that compares with other providers, but on Google Photos (as one example I am familiar with), searching for "airplane" shows me photos taken of airplanes, or photos taken from the inside of an airplane. Even lego airplanes seems to show up correctly, and none of the photos are incorrectly shown as far as I can tell.
I’ve just tried that and it’s true although on my instance searching ‘airplane’ gives good results. I wonder if it’s due to an insufficient number of images in the demo? I also took the advice in the forums to tweak the exact model version used.