No, maths is not a compulsory subject to be a part of the IPM program. You are eligible to apply for the IPM program even if you are from a non-math background.
But the program includes multiple maths and statistics courses in the first 3 years that require a good hold of class 11th and 12th grades’ maths.
In the introductory two terms, Differential and Integral calculus is taught by maths faculty, so it should not be difficult. However, if you are not from a Maths background, then you may have a tough time coping with the multiple subjects. Maths and Statistics courses have a high weightage in the first two years and if not handled well, can pull down your overall grade.
But I know a lot of people from IIM Indore with a non-math background, doing well in academics. If you work hard you can have good academic records too, even if you don’t like Maths.