It is not very widely known that Finder has its own browsing history, just like Safari does. When you click and hold Next or Previous button in Safari, you get the list of previously accessed websites. It works the same in Finder, showing you the list of previously accessed folders.

This works only in OS X Lion (10.7)