Two things of note happened on July 4 during the Civil War... and both in 1863. The first that is most well known is that it's the day Lee started his army retreating from Gettysburg after those three bloody days. That very same day, the Confederates (Lt Gen Pemberton's forces) surrendered Vicksburg after being trapped in the city since May by Grant's troops.
