Okay then we've got computer specs ruled out.
Your next step is look around town for a spot that might be mysteriously calling out to sims to congregate there. People have reported beaches, a parking garage, etc., have lured all of the sims in the town to the spot where they all just gather, starve to death, etc. and never go home. Deleting this area has fixed it for them.
Worth a shot to look.