I don't know if i have the same problem or if i understood you right, but i want help on my issue too (and maybe we have the same problem, so i will post here).
Before starting, you use Affinity publisher (but with affinity Photo brush and mode), whereas i use Affinity Photo, so there is this difference.
i use a Wacom tablet too, to be more Specific:
Wacom Intuos Pen Small Tablet.
I too don't have this problem with other softwares.
My problem seems to be some stamping feature of Affinity Photo (either bug or feature, not a feature if i don't have an option to deactivate it, more like a bug or bad design choice) when using the Paint Brush tool, this can be easily reproduced with with some large brush, if i tap twice with the pen (very lightly, but still detectable) the brush will stamp in large size on screen and when i move the brush (without removing it from the tablet after the second tap (i.e. holding it in place)) the brush will not paint anything (leaving only the stamped stuff onscreen). I really dislike it because it breaks my flux while drawing, i need to use ctrl+z a lot because of it and can't do fine details too, somebody help us to change this configuration or at least make it optional in the next update?
The brush should only stamp with the intensity used by the person and with one tap only, and continue into a stroke if we want too, without any button whatsoever, that way, if we try to draw/write something it doesn't stop us from doing it. This should be in an available configuration at least.
Please, free us from the Death embracing grip of Adobe!