Could Peter Mandelson be removed from the House of Lords over Epstein ties?

Some MPs have called for him to be stripped of his peerage or have the Labour whip removed.