With Windows Blue you'll get a Start button in the bottom left corner -- but when you click it, it's the Metro screen that'll jarringly greet you, not a resurrected Windows 7-style Start menu.

It's just an icon in ... for Windows 8.1 x86 and Windows 8.1 x64. Alternatively, you can install the free app 7+ Taskbar Tweaker which will allow you to hide the start button.