Imagine pushing a door to open it. The force of your push (F) causes the door to rotate about its hinges (the pivot point, O). How hard you need to push depends on the distance you are from the hinges (r) (and several other things, but let's ignore them now). The closer you are to the hinges (i.e. the smaller r is), the harder it is to push. This is what happens when you try to push open a door on the wrong side. The torque you created on the door is smaller than it would have been had you pushed the correct side (away from its hinges).