Legend has it that Milton was referred to by one of its most irritating features: the brambles and briars that once grew along the banks of the river. There were no roads and the river was the transportation network. Hence, in early days Milton was referred to as "Scratch Ankle." The annual "Scratch Ankle" festival is held in April each year in downtown Milton.