Like many on this forum, on upgrading to v1.9, I initially had a number of issues. These included various tools giving odd results and incomplete screen updates with blocks missing or strange colours within photos.
I then updated my Windows 10 with recent update KB4598299 (Cumulative Update Preview for .NET) and update KB4598291 (OS Builds 19041.789 and 19042.789). The problems with Affinity Photo disappeared immediately. I cannot see anything in these updates specifically to do with GPU/graphics, so it could just be co-incidence.
For me, Affinity Photo is running quicker than I’ve ever seen and the GPU can be seen to run up to about 10% in task manager.
BTW, I have a Nvidia GeForce GTX 1050 Ti graphics card, Driver version 456.71.