There were more than one system proven to “cheat” through biased training materials.
One model used to tell duck and chicken apart because it was trained with pictures of ducks in the water and chicken on a sandy ground, if I remember correctly.
Since multiple medical image recognition systems are in development, I can’t imagine they’re all this faulty trained with unsuitable materials.
Person of Interest (TV show) as video game