I think he’s playing on the saying “act your age, not your shoe size,” hinting that he knows it’s a silly/childish thing to do, but excusing it because his feet are enormous.