This is an incredibly naive approach. All asteroids emit light in the infrared, to detect and track asteroids just takes an infrared telescope making apparent motion against any background completely irrelevant. NASA is working on this: https://en.m.wikipedia.org/wiki/NEO_Surveyor