While thousands of dollars on customized luxury pens and journals is not a single large expense it's part of an overall pattern of wasted of government money in the current administration. I don't think it's necessary for hundreds of dollars in gifts to be handed out to foreign environmental policy heads. This is something the Republicans supposedly care about more than Democrats, though Republicans' actions seem to speak differently while in office.
I would expect the government to operate efficiently at all levels up to the top. Leadership is by example, and if people see their leaders being wasteful then they're going to want to start being wasteful with taxpayer money too.
And also important, the current executive policy at the top and at the EPA is deliberately moving us away from a leadership position on the world stage on most matters - military, environment, and democracy to name a few. Our worldwide partners don't care about fancy pens being handed out, they care about what we're doing about the environment, with our alliances, treaties, and with world security and politics. A pen won't magically make them like us.