To improve your spoken English the key is to continuously make

improvements in your listening, pronunciation and vocabulary. It is a task that needs to be done a little bit at a time, but regularly, so that you are continually getting better without feeling overwhelmed.