The glass fogs up every time I use my fireplace. Is this normal?

Yes, water vapor is one the by-products of combustion, and each time you use your fireplace you will see condensation of the glass. It will clear off after a few minutes.