Only Americans have rights to anything, due process included.
You are not correct in this assertion.
Only rights guaranteed to "the people" are exclusively applicable to American citizens.
Rights guaranteed to "persons" belong to everyone.
To make it clearer, would it be legal to hold a slave if that slave is not an American citizen?