what colonial men did for fun