I have been experimenting with this and think I have found a solution. There is no need to zoom in but it is absolutely essential that the object you want to move is not selected first! If it is selected, pressing and then trying to move it will transform it 100% of the time (for me, anyway). I managed to get tiny objects to move 95% of the time, but at least it never once transformed anything. The worst that happened was that I missed selecting the object and didn't move it. As you can see below, the text and line were very small compared to the page but I managed to move either object (almost) every time without zooming in and without once transforming either.   Perhaps you could try and let me know?