My first suggestion would be to find a local club.... A wealth of knowledge and second hand bargains, but you will be able to see what suits your space and budget...
Alternatively a good store to see what's to be had again budget's and space... Tooling wise tbh I started with 3 chisels, a skew, a gouge and a parting tool, I still only use two... A mandrel to turn on and a pen blank end mill... Over time you'll see other things which may or may not be better but you need to start somewhere.....
Where abouts are you?