Were there any Muslim that reject/don't believe the "5 daily" prayer thing and believe you can prayer 2 or 3 time?

If so, what were their reasons?