Generally a claim for a windshield replacement should not make your auto insurance premium to go up. The windshield issue does not affect your driving record, thus should not have a bearing on your risk factor with the insurance company.
An auto windshield glass claim would be covered under the comprehensive portion of your insurance policy. With this coverage on your car the only replacement expense might be your deductible. Call your insurance company to get the specifics.
Making Sure Your Car is as Safe as Possible is an article you might find interesting.