And those men like Robert E. Lee weren't traitors
He served in the United States Army, before the war, as a Commissioned Officer, which by definition means he swore an oath to preserve and protect the United States. If you're worried about your State one day needing to leave the Union then you probably shouldn't be swearing oaths to preserve the Union.
The only difference between them is that most in the South say themselves not just as Americans, but ultimately as Virginians, Georgians, Mississippians, etc.
Parse this part of the 14th Amendment:
No person shall be a Senator or Representative in Congress, or elector of President and Vice President, or hold any office, civil or military, under the United States, or under any State, who, having previously taken an oath, as a member of Congress, or as an officer of the United States, or as a member of any State legislature, or as an executive or judicial officer of any State, to support the Constitution of the United States, shall have engaged in insurrection or rebellion against the same, or given aid or comfort to the enemies thereof. But Congress may, by a vote of two-thirds of each House, remove such disability.
You do realize the 14th Amendment was added to the Constitution AFTER the Civil War, in 1868, right? And that ratifying it was one of the conditions imposed on the Southern states during reconstruction. So there was nothing in the Constitution that prohibited what they did. Also, but 1898 Congress generally removed disabilities incurred due to the 14th Amendment by those involved in the Confederacy. Lee's citizenship was also restored retroactively to June 13 1865, but that didn't happen until 1975. Davis got his restored in 1978. So no, they are not traitors.