Rogozin arrived in Baku, the capital of Azerbaijan, earlier in the day, as a part of a delegation led by Prime Minister Dmitry Medvedev.
"[Deliveries go] in accordance with contracts. Both [Armenia and Azerbaijan] are our strategic partners," Rogozin told reporters.
The latest violence in the self-proclaimed republic of Nagorno-Karabakh, mostly inhabited by Armenians, intensified on April 2, leading to multiple casualties before Armenia and Azerbaijan reached a shaky ceasefire deal three days later. Both sides have since blamed each other for multiple ceasefire violations.
On Wednesday, Armenian President Serzh Sargsyan said that Russia would remain Armenia's strategic partner despite Moscow's deliveries of arms to Azerbaijan.