My recommendation is to wean your baby off a pacifier ideally between 9 and 15 months of age. During this time, your child can’t “ask for it” and is also very capable of finding other ways to be soothed. This makes for an easier transition for both parent and child.
Waiting until the child is 3-4 years old can be much more difficult since your child will likely beg and plead for it back. Good luck!!