Been done. DAG (German military ammo maker) made/makes plastic training rounds in 762x51 NATO (aka 308 Winchester), they can be lethal under 100 yards.
Or, go muzzle loader (not a gun per federal law then) and use a piezoelectric spark to ignite your powder, use a glass marble or other non-metallic item (ceramic?) as your bullet. Plenty effective at short ranges.