Have you ever lived in a really crappy apartment or house? Garner and Bryce are talking about the worst living situation you were ever in.
