You just need to obtain confidence that your counterparty is not double spending in some manner
Which is not secure, at least not under the definition of security that is commonly used in digital cash.
For example, your counterparty may have some secure hardware that is capable of remote attestation.
EMV (chip-n-pin) cards have used them for many years
These are usually used in conjunction with an online payment processor, which changes the security model in fundamental ways. The security goal of these cards is to prevent unauthorized use of legitimate credentials; the legitimate user of those credentials is not the adversary. With double-spending, the legitimate user of the card is the adversary.
breaking the hardware? Doesn't happen
Faking the hardware can happen and Bitcoin will only stop it if you are online. What are you going to do to stop someone from producing a card that looks just like the "real thing" but which does not actually stop them from double spending? If you are going to introduce a central authority that issues these cards, why would you even bother with Bitcoin? You can get a more secure digital cash protocol that uses a central authority to issue the currency units, which actually supports secure offline transactions (regardless of the hardware someone uses).