That's nothing: Steven Talley was identified by the FBI as the primary suspect in two bank robberies using a facial recognition algorithm. He had an iron-clad alibi, but the police and FBI weren't convinced. In court one of the bank tellers said Talley definitely wasn't the robber. Nonetheless Talley lost his job, his wife and his family and was held in prison for months:
"LOSING FACE: How a Facial Recognition Mismatch Can Ruin Your Life"
"Talley said he was held for nearly two months in a maximum security pod and was released only after his public defender obtained his employer’s surveillance records. In a time-stamped audio recording from 11:12 a.m. on the day of the May robbery, Talley could be heard at his desk trying to sell mutual funds to a potential client."
Today Talley is still trying to claw his way back to normalcy.
In the outstanding book "Hello World" Hannah Fry examines Talley's story as part of a chapter on crime, AI and facial recognition. Reading Fry's book convinced me that facial recognition software simply does not work well enough to use in police work. As Fry says:
"If you're searching for a particular criminal in digital line-up of millions...the best-case scenario is that you won't find the right person one in six times...". That is not nearly good enough for law enforcement and the courts.
throwaway2245:9 says >"The department probably exists in the first place as a result of an internal political struggle and compromise - with some decision-makers wanting Google to be genuinely more ethical, and others wanting to avoid any genuine oversight."<
I certainly hope you are right. And with some foresight, the ethics department is a "Golgafrinchan Ark Fleet Ship B" now fully loaded and ready for departure. Bon Voyage!