Well, this is getting a little weird! From what I can tell, the flickering only happens on photos that were exported from the Apple Photos desktop app (I haven't tried exporting from the iOS Photos app). If I export a photo to the file system, then open with AP, the flickering happens. If I choose to export it as an unmodified original and then open with AP, there is no flickering.
So far I've only been dealing with JPEG photos. If I then open one of the "bad" photos in AP and export it to TIFF, then open that TIFF in AP, it flickers. This suggests that there's some kind of metadata cause to the instability. Sure enough, if I use exiftool (https://exiftool.org) and strip all the metadata like this
exiftool -all:all= IMG_3025.jpeg -o IMG_3025-noexif.jpeg
and open it, there's no flickering.
Maybe it's related to the color profile. The photos that flicker all have Color Profile: Apple Wide Color Sharing Profile