Sure its going to push on a gravel surface, front tires have no traction and will slide. get on a hard track surface and it will steer fine, Remember when steering the car in the pits-only use the steering when the car is in motion, If the car is not moving and need to turn the steering do so by turning the front wheel(s)
How much caster is in the front axle and what front tires are you useing?