The government today, on Monday, filed an affidavit in the Supreme Court and said that Rohingya refugees pose a big security threat as many of them have links with terror organisations and extremist groups.