So that SSLSocket has it to. Though the SSLListener still needs to set the remote address after accepting a new connection.