When the option to open documents in a new tab is on, when closing the second to last tab, the option to click x and close the last remaining tab is removed and you can only click the arrow to go back to the document library. When you then open a new document, the tab from the previous work session is also there. You should be able to close the last remaining tab. So that when you open a new document it is the only open document.