Which is correct: 'Let's go home' or 'It's high time we went home'? And why do we use the past tense of 'go' here?