Exiled minister Jane Garrett should resign from Parliament if she is not “contributing to the cause”, Victoria’s Treasurer Tim Pallas has declared.