Strong tremors from a 4.4 magnitude earthquake were felt in Delhi and nearby regions on Thursday morning.