The dollhouse Mabel plays with pretty much spells out why this series is house focused: like someone playing with toys, none of the protagonists are in control. Also the three stories deal with falsehood to some extent (Van Schoonbeek's luring the family, the Developer's shabby job at fixing the house, Rosa's open delusion about the state of the world), as in playing pretend.
The House appears to change positions to a great degree over the years; first it's on a mountainous hill, then in a flat area with other houses in neat lines, and then apparently on a rise high enough to avoid the flood waters. Whilst it doesn't seem to be outright explained, we see how in the first segment the builder's add new parts to the house, such as the room right outside Mable's room, and remove entire parts like the stairs. It's not to hard to imagine that, especially with the Eldritch Location aspects of the House, that it's renovated, by it's original creator and his minions or by other unwitting individuals like the Developer, so much that it's entire position ends up slowly but surely changed. It's just that there's been enough time between the segments that we see the most extreme changes.
Given the segments take place decades apart, you've got to wonder just how many other unlucky folks The House messed up over the years.
This is even referenced by The Odd Couple who said that their family lived in The House before. So that may explain their bug like behavior and the Developer's.
Van Schoonbeek having been a friend of Raymond's dad, plus Thomas' angst over having to be his "Actor" suggests Van Schoonbeek has been screwing people over long before he built The House. Thomas likely saw more than his fair share of tragedy he was forced to be an accomplice to.
It's possible that Van Schoonbeck screwed over Raymond's father as well, or that he was lying about being a friend of his father's just so that he could screw Raymond over.
It' implied that the Odd Couple as well as their relatives are just in the Developer's head.
Rosa's rent schedule shows most of the tenants have fled, but the one at the top of the chart skips directly to "Vacant" without a "Tenant Leaving" sticker, suggesting whomever was in Apartment 1 never got the chance.
