A man wearing a T-shirt with a swastika was initially moved on by police outside the royal commission into antisemitism in Sydney, before later being arrested.