Local police said they were collecting hospital records for the mum and newborn babies, reports Asian News International.
The police are trying to recreate the chain of events when the twins were declared dead and handed over to the family in a yellow plastic bag. "I was shocked. I couldn't believe my eyes", Malik said in a previous CNN report.
"While the inquiry by the expert group which includes external experts from Indian Medical Association is still in process, we have chose to terminate the services of the two treating doctors", the statement said.
Speaking with CNN after the baby's death on Wednesday, Malik said the family was devastated.
The family rushed the baby to a nearby nursing home in Pitampura, while the mother remained at Max Hospital as she was very weak. "They betrayed us", Mr Malik said.
Max Healthcare said the firings represent a "strict action" but should not be viewed as a finding of fault against the physicians, AP Mehta and Vishal Gupta.
Deepak Bidawat, the child's uncle, told the India Times: 'We will keep protesting until we get justice. "Had the baby not been exposed for so many hours after his birth, maybe we could have probably prolonged his life longer".
Max Healthcare had earlier said it had chose to terminate the services of two doctors allegedly involved in the case.
Dr KK Aggarwal, the national president of the Indian Medical Association, ruled out criminal negligence, instead describing the incident as a "mistak".
State Health Minister Satyendar Jain tweeted last week that he has ordered an inquiry "into this unacceptable act".
A preliminary report by the Delhi government's panel found the hospital to be guilty of not following the norms while dealing with newborns. "These two cases have been clubbed and we will take action accordingly", he added.
According to reports, police sources said that if the allegations were found to be true, the hospital might be charged for extortion.