I used to have fun in Visual Studio 2008 where I could drag my toolbar on the left and it would stick there. WPF does not support this, apparently and Visual Studio 2010 removed this feature. Originally I thought it did not support left hand toolbars either but I found that it did, only you have to click some 20 dialogs to do that, as this post explains..
We dock it on the left side by the following steps,
1. Right click a blank area about the menu or toolbar
2. Then it pops up a context menu. In the context menu, choose the bottom option, "Customize…"
3. In the Customize dialog, in the default Toolbars tab, select the "Debug" item from the listbox
4. Click the Modify Selection button at the right side, and choose "Dock Location: Left"