Why can some atoms form giant covalent structures, but not all?

Carbon can form molecules or giant structures. Same for silicon. What determines whether molecule or giant structure?