Man continues to worship the created rather than the creator. This is the ultimate rejection of God, to use the things that God created to create something that takes the place of God.
Paul does not abandon the city because of idols but determines to preach Jesus.