Flafhing and roofing question in Pittsburgh pa?

We just moved into a house. My neighbor said the roof was put on the house about 5-6 years ago. The problem? There was an icey rain storm a few days ago & I noticed the paint running down the wall in the master bedroom. It is along the wall where the chimney goes up the house. A roofing company I contacted came & looked at it. They said it was the flashing. They came out today & replaced the flashing around the chimney & did some minor sealing around the roof. I still hear a drip noise. It isn't a continuois noise like a leaky facit, but at least every few minutes. The wall is dry now, but how long should I be hearing this noise & is it water that is making the noise? Should it be dried up by now?Am I being peranoid? It is due to start raining tonight here & is due to rain for the next few days. Tonight we are to have another icey rain & then the weather is to warm up, but it is still going to be raining. Anyone who knows about this stuff, please comment. No bull **** comments please.