Malaysia and Indonesia have suspended access to Grok, the artificial intelligence chatbot developed by Elon Musk’s company xAI, citing concerns that the tool can be misused to create sexually explicit deepfake images.
Regulators in both countries said the decision followed reports that the chatbot’s image-generation feature had been used to alter photos of real people, presenting them in revealing or sexualised ways without consent. Authorities warned that such misuse poses risks to personal dignity, online safety and the protection of minors.
The move makes Malaysia and Indonesia the first countries to impose a nationwide block on Grok. Officials described the action as temporary, pending stronger safeguards from the platform.
Concerns Raised by Regulators
Malaysia’s communications regulator said it had contacted X earlier this year after identifying repeated instances where Grok-generated content violated local standards. The regulator said the platform’s response focused mainly on user reporting tools and did not adequately address risks linked to the system’s design.
As a result, access to Grok has been restricted until what authorities described as “effective and enforceable” protections are put in place. The public has also been encouraged to report harmful online material.
In Indonesia, the communications and digital affairs ministry said the production of explicit and non-consensual images using AI technology undermines basic rights and online ethics. The ministry has requested clarification from X on how Grok is being monitored and controlled.
Indonesia has previously taken firm action against online platforms hosting adult content, with long-standing bans on sites such as Pornhub and OnlyFans.
User Experiences Highlight Impact
Several Indonesian users said they discovered manipulated images of themselves circulating on X after prompts were submitted to Grok. One content creator, who shares posts about living with a disability, said strangers had used her photos to request altered images portraying her in swimwear.
She said attempts to adjust privacy settings and request removals were largely ineffective, adding that asking others to report the images risked spreading them further. The experience, she said, was distressing and humiliating.
Global Scrutiny Intensifies
The decision in South East Asia comes as pressure grows elsewhere. In the UK, senior politicians have signalled support for tougher action if online safety rules are breached. Prime Minister Keir Starmer has publicly criticised the creation of sexualised AI images, while Technology Secretary Liz Kendall has said she would support the regulator if it moved to restrict access to services that fail to comply with the law.
The UK’s Online Safety Act gives watchdog Ofcom powers to block platforms that refuse to meet legal standards. Elon Musk, the owner of X, has rejected such criticism, arguing that restrictions threaten free expression.
Awaiting Response
The BBC has contacted representatives for Grok and X for comment on the bans in Malaysia and Indonesia. Regulators in both countries say access could be restored if the platform demonstrates stronger controls to prevent the generation and spread of harmful deepfake content.