The Disgustoids are, or at least were members of the Black Hat Organization
The Fort itself looks quite evil, this Troper can definitely imagine it being a product from the Black Hat Organization. Secret Mountain Fort Awesome is in the same world as Steven Universe too.
Because Uncle Grandpa crossed over with both. Maybe the reason the Disgustoids have to live with humans is because their original world was taken over or destroyed by the Diamonds.