This is the subject what is being sworn about, and it means that he (man) is ungrateful for the favors of His Lord and he rejects them.
