While Smith officially remains at the helm of Team Australia, the public has been calling for his suspension and to forfeit the test with the country's Prime Minister Malcolm Turnbull leading the charge.
Mr. Turnbull has already contacted the former member of his Indigenous Advisory Council and chairman of Cricket Australia, David Peever, AAP reports.
"I've expressed to him very clearly and unequivocally my disappointment and my concern about the events in South Africa."
READ MORE: Russian Figure Skater Zagitova's Coach Explains Failure at World Competition
Saturday's events might just cap off a fractious four-match series, with several players already having been disciplined by the International Cricket Council (ICC).
