A student at IIT Kharagpur can study Physics even without attending classes or going to labs. I think the m experience in any department depends mainly on 3 factors
Your own motivation: You either get inspired or are naturally motivated. The former does not need much external pressure. This means you can function well even without good facilities or professors. However, those who lack such inspiration need constant motivation to depend on good professors to develop an interest in the course and perform well. Physics is a difficult subject and one cannot solely depend upon self-study. So physics at IIT Kharagpur is not for those who lack inherited motivation.
Professors: Sadly, IIT Kharagpur has only a few professors that make it into the category of experienced and learned. Most professors are good at research but lack teaching skills. If the second and third-year subjects are not taught by good professors, you will face quite a bit of a downfall in this path.
Department:
Any particular department can be evaluated on the basis of labs, workload, grading, placements, and scope for higher studies.
Peer group:
Having passionate people in your batch adds to the overall learning experience. The peer group in KGP comprises usually hostel friends or friends from societies or clubs.