Demonstrators both for and against the removal of Confederate era statues had gathered at the site.
Supporters of Confederate-era monuments slated for removal in New Orleans have launched a new court fight to save one of them.
"We would have preferred it to be in the daytime", monument opponent Malcolm Suber told Kaplan-Levenson, "so everybody could see it in the light of day".
Landrieu's office has not revealed when these two remaining statues will come down, citing safety concerns.
Before the monument could be removed, police had to clear the immediate area of demonstrators - both supporters of the monuments and those who want them taken away.
Opposing protesters were separated by metal barriers set up by police and heckled each other from opposite sides of the barricades.
"Hey white supremacy ain't tryna talk to ya, I'm gonna knock that statue down with my Altima", says a Take Em' Down NOLA protester.
Richard Marksbury had filed suit earlier this week as a private citizen, contending that the City Park board and not the city of New Orleans owned the statue and the land upon which it sits.More news: Restraining order granted against mother of Elizabeth Thomas
More news: Jon Stewart supports Stephen Colbert amid backlash with 'Daily Show' reunion
More news: Video purportedly shows destruction of Pak bunkers in shelling
The statues in New Orleans are part of a controversy surrounding Confederate symbols over whether they represent slavery and racial injustice, or heritage.
Another monument, the Battle of Liberty Place, was removed during the early morning hours.
However, Landrieu said the monument of Davis and the statues of Confederate generals Robert E. Lee and P.G.T. Beauregard could come down "anytime, sooner rather than later".
The statuette has stood in its location for 106 years. Beauregard was a prominent general during the Civil War and the last survivor of the top Confederate leaders.
The inscription on the Davis statue reads, "His name is enshrined in the hearts of the people for whom he suffered, and his deeds are forever wedded to immortality".
Mayor Mitch Landrieu's office said the statues will go to storage while the city looks for a suitable venue to display them, such as a museum. "We should not be afraid to confront and reconcile our past".
"This morning we continue our march to reconciliation by removing the Jefferson Davis Confederate statue from its pedestal of reverence", Tweeted Mayor Mitch Landrieu. When the Confederate flag was not lowered to half-mast on the SC statehouse house grounds following the shooting - as had been done with the USA flag and the state flag in mourning for the victims - those pictures sparked a contentious debate that led then-Governor Nikki Haley to make a strong appeal to legislators that resulted in the flag being removed from the statehouse grounds altogether.