Reform has initiated two separate Holyrood debates in recent weeks pushing for a prohibition on face coverings, though its most recent motion singled out the burka and niqab by name.
Roughly one in every hundred Scottish Muslim women is estimated to wear one of the garments.
Mr Kerr explained: “When you are covering your entire face, it becomes a security risk because you never know who is behind that.”
He continued: “I think that we are in a Christian nation which is built on Christian values.
“I think that if you’re going to integrate in our society properly, then you should live by the rules that we have, and that means learning the language, that means speaking how we speak, that means integrating properly with our society.”
The Reform deputy leader dismissed accusations of racism, noting that 24 nations – among them EU member states France and Denmark – have already enacted burka bans.