I am a bit confused by the benchmark comparison they are doing. The comparison of a domain specific "LeJEPA" on astronomy images against general models, which are not explicitly fine-tuned on astronomy images seems misleading to me.
Does anybody understand why that benchmark might still be reasonable?
Does anybody understand why that benchmark might still be reasonable?