The town name of Rutherford or Ruderforde is of great antiquity. The nearby Rutherford moor has the vestiges of a Roman encampment, with a Roman causeway. In its early days Rutherford had a hospital dedicated to Saint Mary Magdalene. Hospitals in those days were as much an inn as a hospital. Therefore, the mission of Saint Mary Magdalene's Hospital was to take in travelers and care for the poor and sick of the area. In those days, there was no church at Rutherford, only a chapel within the hospital.

In 1296 the master of the hospital swore fealty to Edward I "Longshanks" of England - these were the days of Sir William Wallace's fight for Scottish independence from the English and this "fealty" was achieved at the point of a sword. Later when Scotland had won its freedom, King Robert the Bruce granted the newly created hospital to the protection of the Abbey of Jedburgh. In about 1770 the cemetery was ploughed up, the gravestones were broken up and thrown into field drains by the farmer. In 1296 there was no parish attached to Rutherford, however, the present parish of Maxton comprises the ancient parishes of Maccuston/Mackiston and Rutherford. After its destruction by Henry VIIIs English army in July 1544, Rutherford was absorbed into Maxton parish.

During the reigns of Saint/Queen Margaret and Saint/King David [mother and son] abbeys were created at Kelso, Melrose, Dryburgh and Jedburgh. These were a strategically placed defence against English invasion. This line across the Cheviot Hills also included the smaller parishes, such as, Rutherford, Roxburgh, Makerstoun and Maxton. The Cheviot Hills are a region of heathered moorlands and smoothly rounded hills divided by deep glens. The Tweed River itself has always been a barrier against the English and the river made Rutherford very important militarily. If Jedburgh Castle fell, the next line of defence was Rutherford on the Tweed and nearby Roxburgh Castle