Don's advice is in my opinion the best way to go. This way you only buy materials that you will use and can spend more on a decent vise. Avoid the imported from Indian vises, they are poorly made, don't hold hooks well, and don't last very long. You don't have to spend hundreds of dollars on a decent vise, Griffin has some very affordable, well-made vises for $50.00 or less and the venerable Thompson Model A, which has been around for over 100 years (it and the other Thompson vises have been recently put back into production by a new owner after a hiatus of about 8 months after the owner of Thompson Vise decided to retire and close the vise factory), which sells for around $50.00 too.
The two most important tools to buy are the vise and a quality pair of scissors. Therefore, avoid the cheapo scissors too because they are false economy. Instead get a quality pair, afterall, good scissors can be had for between $12.00 and $20.00 and they will last for years, the cheapos won't.
The only tools you need are a vise, scissors, bobbin (which holds your thread), and a bodkin. To this, you can add a whip finisher like the Materelli and your tool needs will be met for many years.