Headscratchers / Takeshi's Castle

• How is it that in any given round there never seem to be more than ten to fifteen people eliminated? Obviously they primarily show people failing because that's funny but even beyond that most of the challenges look really difficult.