The Courthouse was built in 1908 for $63,000. When constructed, the Upson County Commissioners placed a $10 bill in one of the columns so that the county would never be broke. P.W. Alexander, a Confederate War correspondent, was at the bombardment of Fort Sumter and sent the White family (of the Pettigrew-White-Stamps House) a cannonball, said to be the first one fired. It is mounted on the monument at the southeast corner of the courthouse lawn.