Drone pilots more removed from the action than infantry? Hell yes.
More removed then the rest of the Air Force? Hell no.
The way a drone strike works is a drone loiters on station for weeks on end. During this time the drone's pilots figure out who is in the house when, so they can avoid blowing it up when the local equivalent of the Girl Scouts are in the living room. Which means drone pilots know when their target takes the trash out, whether the teenage daughter has a boyfriend who sneaks in sometimes, etc. This makes for attacks that are much easier on the civilian population then normal bombing, because you can skip the night when the girl and her boyfriend are enjoying themselves, but it makes for very stressed out drone pilots.
It is much worst then that. The houses they are loitering are often the targets relatives. For weeks they get to see their children playing the women tending to the livestock, their joy when the men comes home from work. Then one day Uncle Mullah and some of his friends show up and they have to pull the trigger, sit there and watch as the villagers pull out their bodies from the rubble they just turned the house into. Shift over now they get to go home and kiss their wives and kids.