"Yes, I had said I would step down if Congress leaders continue to take potshots at me. If they repeatedly make such statements, how many more days can I tolerate such stuff. Power is ephemeral. What is permanent is you (party workers) and six-and-a-half crore people of this state," he said addressing the National JDS Convention here.