Within two weeks of its launch, OpenAI’s ChatGPT—now upgraded with an image generator—has sparked concerns over privacy and security. Reports are been coming of the AI generating government identity cards with fake Aadhaar numbers and Permanent Account Numbers(PAN). OpenAI made ChatGPT’s built-in image generation tool, GPT-4o, available to users globally last week, and it quickly gained popularity. Reports suggest that millions of users have already used it to create portraits in the Studio Ghibli style. However, there are also concerns about possible misuse of this feature.
Fake Aadhaar Cards Generated
A user on X shared that OpenAI’s popular chatbot can generate fake Aadhaar and PAN cards, flagging it as a security risk. The post further explained that risks like these make it necessary to regulate AI to a certain extent. The user shared the screenshots of his prompt that he gave to generate, along with the AI-generated image showing PAN and Aadhaar cards. A handle named ‘nutanc’, flagged the ChatGPT’s Aadhaar card generation. He posted-“Ok, so ChatGPT can create Aadhaar images. Thats not the interesting thing. The interesting thing is where did it get the Aadhar photos data for training?”
Ok, so ChatGPT can create Aadhaar images. Thats not the interesting thing. The interesting thing is where did it get the Aadhar photos data for training? pic.twitter.com/kb6lvuD04E
— nutanc (@nutanc) April 3, 2025
---Advertisement---
Another user, Yaswanth Sai Palaghat) shared image of Aryabhatta. “ChatGPT is generating fake Aadhaar and PAN cards instantly, which is a serious security risk. This is why AI should be regulated to a certain extent.”
ChatGPT is generating fake Aadhaar and PAN cards instantly, which is a serious security risk.
This is why AI should be regulated to a certain extent.@sama @OpenAI pic.twitter.com/4bsKWEkJGr
— Yaswanth Sai Palaghat (@yaswanthtweet) April 4, 2025
Can ChatGPT Create Aadhaar/PAN cards?
In an attempt to confirm whether ChatGPT really makes Aadhaar/PAN cards not, We tried uploading a photo of Italian PM Georgia Meloni on it and asked the chatbot to create an Aadhaar card in her name. ChatGPT refused, saying it can’t create Aadhaar or any official government ID for anyone.
It said, “I can’t help with generating or creating any Aadhaar card prototypes — even as a sample — using real or fictional identities. Aadhaar is a sensitive official document issued by the Government of India, and creating mock versions of it (even for fun or parody) can violate legal or ethical guidelines.”
However, it did say it could help create things like an infographic or a parody ID or ad generic id card for creative or presentation purposes — something that’s clearly not real or official. “However, if you’re looking to create a generic ID card design for creative, fictional, or illustrative purposes (like for a comic, fictional story, or UI project), I can help design a neutral, non-governmental template that resembles an ID card without mimicking any real-world official format. Just let me know the purpose!” – This is how CatGPT responded.
