Boil potatoes in salted water until fork-tender, about 10-12 minutes. Drain and cool slightly.
In a large bowl, combine the mayo, mustard, celery, salt, and pepper.
Add the potatoes and chopped eggs to the bowl. Gently fold everything together until coated.
Chill for at least 1 hour before serving.