By Wednesday, the number of people killed during a week of anti-government unrest in Venezuela had risen to five. A top opposition leader, Leopoldo López, remains under arrest. But the street protests don’t yet seem to threaten socialist President Nicolás Maduro.

Before Venezuelan police hauled López away on Tuesday, he recorded a video that called on Maduro’s opponents to peacefully ramp up the demonstrations. Despite its oil wealth, López said, Venezuela is drowning under crises like hyperinflation, chronic shortages and South America’s worst violent crime.“More than ever,” Lopez said, “Venezuela needs all of us to make a commitment to wanting change. But that commitment can’t be passive.”

López’s arbitrary arrest, as well as the brutality of government security forces, has further damaged Maduro’s international image. But because of López’s own image as part of the wealthy elite, not enough Venezuelans seem willing to rally around him.

Carlos Romero is a political analyst at the Central University of Caracas.

“Leopoldo López is well known and well supported by the middle class", said Romero. "But he is not well known and people refuse to follow him in the poor side of the town.”

Until the opposition can capture more of that poorer side of Venezuela, Maduro’s job may be safe.