Ousted Speaker Kevin McCarthy was behind the move to kick Pelosi out of her office, because he wanted it for himself, report says.