It depends on the rain. Rain should be reduced by at least 90% with a cap, but sometimes the wind is blowing and the rain is coming hard. In these instances, rain can get under that cap. Chimney caps are the first thing to fail on a chimney though, and the cheapest to repair, so if you are having issues. It is best to get those looked at.