DU is only a slightly radioactive heavy metal. It is pretty safe and easy to handle. Sort of like lead is.
That is until you shoot it at someone and it burns and fragments and does all sorts of nasty stuff to spread itself around.
(sorry I just had to add to your comment; in that is is mostly safe but as with most materials it depends on what you do with it)