The Austrian appeared to wave goodbye to the Hammers fans as he was replaced during the second half of the win over Arsenal