Anthony Albanese's comments prompted outrage from women's rights groups and opposition lawmakers.