caseih raises more excellent points, but IMO misses the worst flaw in your reasoning: it's not okay to drive on the wrong side of the road just because if you cause a head-on collision you'll be held responsible.
Even assuming that you identify the drone 'pilot' responsible, and manage to indict them for what they did; holding somebody responsible for damage or injury doesn't undo the fact that through act or neglect they injured somebody who was innocently going about their day, or in this case, doing their job to protect the community.
Why apply no-fly zones where emergency services are engaged in air operations? Because they already have too much important shit to worry about. Updrafts, smoke, terrain, coordinating with other air- and ground-based personnel, flying at or near load capacity, at low speed and altitude, identifying effective deployment locations on a moving fire-front and planning manoeuvres to hit them at the right altitude and angle, ON TOP of all the usual concerns with operating an aircraft.
Don't risk the safety of others, without need or consent. Just don't. This is why we regulate dangerous behaviour; to empower the legal representatives of society to judiciously apply appropriate corrective pressure to the anti-social behaviour of others.
If it's big enough, stable enough, and capable enough that you can't get all your fun out of it on your own property - probably inside - it should be subject to some regulation when operating in public space. If it could be encountered by somebody who has to be aware of in-air obstructions like birds, radio masts, and power lines; it should be subject to emergency services exclusion zones, public nuisance controls, and privacy/surveillance law.