Lovecraft, well, loved writing about secrets of the old world that modern (for his day) gentlemenly types just couldn't stay away from...even if it was for their own good.
A lot of Greek gods and mythology in this story about a mysterious swamp and local beliefs tread on by yet another wannabe aristrocrat in the early 20th century.