This article from The Age reports that Alexandra Hasluck, the wife of Sir Paul Hasluck, insisted her husband not stay on as Govenor-General in 1974.
Hasluck’s departure led to the appointment of Sir John Kerr as Governor-General.
The article refers to an interview Hasluck gave to former Whitlam minister Clyde Cameron in 1985. Hasluck is quoted as saying he believed Kerr erred in consulting with Fraser during the constitutional crisis.