According to the police, the incident took place late on Wednesday near the South Korean port of Mokpo. The fishing boat was carrying six people, three of whom died.
Searches for the remaining people are reportedly underway.
No one on the cargo ship was injured, the police added.
The incident took place 10 kilometers (6.2 miles) from an island in the South Jeolla Province. An investigation into the case has been launched.