An Inner-Sydney building continues to smoulder this morning after a spectacular fire which closed down part of the city. The heritage listed building will have to be demolished with fears the remaining walls of the old hat factory in Surry Hills have been so weakened they could collapse in strong winds.