It is always recommended that you put your site into Maintenance Mode when doing an update or upgrade of Drupal, there might be other times when you choose to do this as well. However, if you turn Maintenance Mode on and yet from another browsing session you can still see the site working it is most likely a caching issue, so from your admin session, clear the cache, refresh the other session and it should then show your maintenance page.