"It's not necessarily a bad thing, but we cannot say that it is good," Herbst said in an interview with the Ukrainian TV channel Inter.
At the same time, he added that similar arrests take place in the United States as well.
"When prosecutors learn that a rich businessman did something bad, they have the photograph of his detention taken, including the process of his being handcuffed. In fact, this is unnecessary," Herbst said.
He stressed the importance of halting corruption in Ukraine. "We have not seen any real steps against corruption; you need real action, not a show," he said, referring to the Ukrainian authorities.
Both men were handcuffed during a Cabinet meeting while a group of journalists eagerly watched and took pictures of the process.
Shortly after, Ukraine's Interior Minister Arsen Avakov called for the dismissal of Bochkovsky and Stoetsky, as well as all senior regional officials of Ukraine’s State Emergency Service who were suspected of compliance in the embezzlement scheme.
Earlier this month, Bochkovsky and Stoetsky were released on bail.