VS Code has always had vertical tabs. It actually launched without horizontal tabs support and only added it due to community pressure. The reason was that VS Code/Monaco was originally designed to run in the browser, and the VS Code team wanted to avoid having a "tabs within tabs" UI.