A man has been left with a serious head injury after a fight in the city centre, which police described as a "violent assault".