Guilds grow over time. It wont happen over night, lets say you have someone that plays until 12am he invites someone that plays 1130pm to 230am. And this new person plays 200am to 500am. He invites someone that plays 300am to 600am.
It takes time, but thats how all social interactions work.