I agree that it looks confusing, when you combine those two.
What you can do is to show the best matches on top, and add other results, which are not an exact match, but visually separate them ("You might also like these..").
That is how we usually do it. You can use this approach also when recommending visually similar products to the one you searched for.
What you can do is to show the best matches on top, and add other results, which are not an exact match, but visually separate them ("You might also like these..").
That is how we usually do it. You can use this approach also when recommending visually similar products to the one you searched for.