In a large bowl, mix together the corn, cracker crumbs and milk. Beat the eggs fairly well and add to the corn mixture. Add salt, pepper and nutmeg; stir well. Pour into a pudding pan or large baking dish and dot with bits of butter. Bake slowly in a warmish (300 degree) oven for about an hour.