They were mostly (if not all) set in Maine I believe, although I think the University that had the Necronomicon might have been in Mass I'm not sure, but the cities he set his works in were varied. Now I am going to have to re-read everything just to so I can cite which works I'm referring to exactly were Portsmouth is named.
