Scalia was outraged that SCOTUS hadn't dismissed Windsor for the pretty much the same reasons that they dismissed Perry. There was no case. The district court said that DOMA(3) was not constitutional. The government agreed. Should have been end of story with DOMA(3) in the trashcan (in that district ... but with more to follow from other cases like Golinski, Pederson, Gil, and a dozen others). The supreme court exists to resolve disputes - and there was no dispute here. Both parties to the case were in full agreement.
The only fly in the ointment was Speaker John Boehner sending in the BLAG (bi-partisan legal advisory group - which is anything *but* bi-partisan since the authorization came from a 3-2 committee vote of Republicans vs. Democrats) to make the appeals to the circuit court and then to SCOTUS.
So Scalia's preferred outcome would probably have been to deny Cert in the first place, or to ditch the case on standing grounds - either of which would have still resulted in DOMA(3) being struck down.
The latter part of his dissent makes it clear that he isn't a big fan of same sex marriage