This is most likely due to the scale of your simulation. Blender does not simulate accurately at real world units. You should scale your objects up by 10/100 to get better results. A good workflow is to set everything up at  the real world scale (including collision distances) and then scale everything up by 10. You can then also set the world scale unit by 10 to ensure all the settings are increased respectively.