Motion in nonlinear systems that is induced merely by noise is controlled using the time-delayed feedback. Two distinct types of noise-induced oscillations are considered: in excitable systems (like neurons) and in systems below Hopf bifurcation. Three aspects of control are addressed: manupulation of timescales and of coherence, and making the noise-induced motion robust against variation in the noise strength. The crucial control parameter is delay time: by varying the value of delay one can change the most probable oscillation period (entrainment) and oscillation coherence. On the other hand, with a properly fixed time delay the oscillation period becomes more robust against variation in the strength of applied noise.