Prime Minister Narendra Modi, who is on a two-day visit to Varanasi, had lunch with construction workers who worked on the Kashi Vishwanath Dham project.