He retired at 90, a Supreme Court justice with 35 years of experience. How did he know when to leave?