Baby sleeping at night and pacifier?

My baby(5months) goes to sleep with his pacifier at night but always wakes up when it falls out, should i just let him cry it out? I'm afraid he'll never get rid of using is he always needs it to sleep. Thanks