Currently, a shape that is a group of inner shapes is selected by clicking anywhere inside its bounding box. 
However, when there's a gap between the inner shapes through which you see another shapes, clicking that other shape will not select it due to the bounding box.
If instead the selection was based on the inner shapes, that wouldn't be a problem.