Unless your trying to weight save for a track day its not worth it tbh, the complete rear bench weighs around 10-15kg i think.
Technically your making your car a 2 seater in the eyes of some insurance companies, so they may refuse to insure you. No need to tell them however as there is little gain to be had from doing it, i personally wouldn't bother unless i was going for a track day.
Mike