A shutter speed the reciprocal of focal length,is an oft touted "Rule". Meaning the 17-40 "needs" 1/40second shutter speed to handhold as a "Rule" on "average" for most folks. Obviously the 24-105 requires 1/105 second to be equal to the "Rule".
Long way of sayin',I've never been handheld compromised with the 17-40L,if only because every increase of native ISO stop,doubles shutter speed and I know what I need for shutter speed,in a given instance. One of many reasons I set my controls the way I do,because I can have infinite control of same.
There's Method to the Madness...................(grin)