Most certainly the noise levels obtained from most car stereos can reach levels which are damaging to your hearing, especially with the windows up. Some high end car stereos can reach levels which exceed 130-160 dB. Even short exposures can permanently damage your hearing.

The best advice is to turn the volume down. Once your hearing is damaged or you develop constant tinnitus it cannot be repaired. The best action is prevention.