After closing files that were opened in Designer they are still locked by Designer in Windows making it impossible to remove or rename them.
Only after closing Affinity itself the files are unlocked.
I'm pretty sure this wasn't an issue in previous versions of the program.