[Affinity Photo - Unwanted Brush switches to Eraser on pen display]

I'm still seeing this behavior on Affinity Photo. My stats:

m1 macbook pro

Tablet: XP-Pen 22"

The pen has a button that can toggle between "pen" and "eraser" modes. Affinity Photo doesn't recognize that state when in the application, but if you move the pen outside of the window, once it comes back it will default to either the "pen" or "eraser" state you've set before. I guess if this problem's been around since 2019 its probably baked-in by this point which is a shame.