Imagine a single atom in space. What is its temperature? The answer is we don't know from a single atom. If we had lots of atoms and they were all moving in random directions, then the atoms would have a temperature. If they were all moving in the same direction then they would have zero temperature, but the would have a temperature.
Temperature is a property of things in steady equilibrium with other things. In space, there are lots of atoms which are too spaced out to be interacting very much. There are interactions and that is what makes the heliopause, but there isn't a lot of it. So if you were Voyager 2 you would not be losing or gaining much heat from the surrounding 'atmosphere' because there is so little of it.
Voyager 2 is losing heat by radiation. Space is very transparent to most radiation: we can see almost all the way back to the Big Bang. We haven't got true thermal equilibrium, which would mean we haven't got temperature as we normally measure it on Earth. They can give a 'temperature' figure to the atoms in space because they are exchanging almost no radiation, so the equilibrium is dominated by the other interactions that made the heliopause.
It's a bit of a weird answer, I'm afraid. The answer depends on the definition of temperature, and that can get a bit weird in deep space. But you and Voyager 2 will radiate heat, so it will feel very cold out there.