No AI can be represented as a human person without explict disclosure. ("The person in this image is AI generated" "This phonecall is from an computer" "This chat is not a person")
Personally I think it is unethical and immoral to develop any AI product or feature that emulates a real person without explicit disclosure. Whether its "AI UGC" (what!?), AI influcencers, or an AI SDR.
Reason one: No reasonable person would accept justification of being tricked by a person who claimed they should have known, "I wasn't actually being your spouse, I was pretending to be your spouse and you should have been able to recognize that".
That doesn't mean AI can't "act human" or represent that. It just needs to disclose it.
Reason two: There are moral and legal frameworks governing a person's behavior. If a person commits fraud in a business context, the company and the person can be held accountable.
That doesn't exist for AI.