Outgoing Australian Public Service Commissioner Gordon de Brouwer has broken down in tears while thanking his colleagues and senators in a public statement.