Just try to select one monkey - it's nearly not possible or there's option that average user can't find it because it's not mention anywhere.
I think shift-selecting should only add, not intersect selections. Or there should be options in context menu for "add", "subtract" etc.
monkeys.mp4
monkeys.svg
An average user works with the tools that are already there.
While a better vector lasso tool would be handy (there's one hidden under the Node tool modifier options, but not necessarily helpful in this case), an average user makes use of the Layers panel and Groups instead. Also make sure to disable Preferences > Tools > Select object when intersects…:
ade_groups_no_lasso_selection.mp4