AI writes Quran verses and hadith with textual errors
Category: Bugs Priority: P1 Severity: major Area: ai-answers Reports: 2 Status: Open
Summary
The same detail-oriented user, Sino Mukhamedov, filed two reports two months apart of the AI producing incorrect sacred text in the chat itself. In June the AI quoted a hadith with Arabic spelling mistakes and wrong vowel markings (i'rab) on "the blessed word"; in August it miswrote ayah 36:57 in the chat answer, even though tapping the verse opened the correct text — proving the underlying verse database is correct and the error is in the model-generated inline quotation. For an Islamic research app whose selling point is faithful sourcing, model-generated misquotes of Quran and hadith are a trust-critical defect. Both times the user could only document the issue via screen recording because the chat share flow is broken (share → email pastes nothing), a secondary bug worth fixing so reports arrive with reproducible chat links. Abdellatif confirmed the June case was a genuine mistake and escalated it to engineering (forwarded to Ahmed Riad); for the August case he asked for the chat ID via share.
What users say
Sino Mukhamedov mukhamedovsino@gmail.com
- Date: 2026-08-23 | Language: English (with Arabic) | Thread:
1a03082966f2f1c5| Replied: yes
Reports the AI cited ayah 36:57 incorrectly in the chat text; tapping the ayah showed the correct text and meaning. He made a screen recording and reminds the team he previously reported an Arabic grammar mistake, stressing that correct citation is essential. Abdellatif asked him to share the chat ID.
I made a screen recording of the mistake he wrote the آية incorrect but when I clicked on the آية and he showed me the meaning then it was correct, the آية correctly is (36:57)
لَهُمْ فِيهَا فَـٰكِهَةٌۭ وَلَهُم مَّا يَدَّعُونَ ٥٧
The AI showed it correctly but only after I clicked on it, before on the chat itself it's not
Sino Mukhamedov mukhamedovsino@gmail.com
- Date: 2026-06-12 | Language: English (with Arabic) | Thread:
19ebd3ff674492eb| Replied: yes
Earlier report (subject: "الإعراب" — i'rab/vowel inflection): the AI quoted a hadith with Arabic spelling/grammar mistakes, including wrong vowel markings on "the blessed word". Abdellatif investigated, confirmed "This is a mistake indeed", and forwarded the case to engineering (Ahmed Riad).
The Ai once quoted the hadith with some spelling mistakes in Arabic grammar so please make sure that he cites correctly and puts the correct vowel markings
In the same thread he also hit a share-flow bug while trying to send the problematic chat (see Details):
I couldn't share the chat I don't know why I clicked on the share button and then email but he didn't paste anything, could you open the recording?
Details / repro
- August case (
1a03082966f2f1c5): ayah 36:57 (لَهُمْ فِيهَا فَـٰكِهَةٌۭ وَلَهُم مَّا يَدَّعُونَ) written incorrectly in the chat answer body; the tap-through verse view (Saheeh International translation shown) is correct. So the canonical verse data/renderer is fine — the LLM's inline transcription of the verse is what's wrong. Evidence: user's screen recording; Abdellatif requested the chat ID for repro. - June case (
19ebd3ff674492eb): hadith quoted with Arabic spelling mistakes and incorrect vowel markings (i'rab) on a blessed word. Evidence: screen recording (user couldn't share a chat link). Confirmed as a real mistake and escalated to engineering on 2026-06-14. - Possible direction: render Quran/hadith quotations from the verified source database (as the tap-through view already does) instead of trusting model-generated text, or diff/validate model quotations against the canonical text before display.
- Secondary bug (minor, iOS app, same June thread): chat share button → email produced an empty message, so the user could not send a chat link and both reports rely on screen recordings. This also blocked Abdellatif from getting a URL for engineering.
Threads
1a03082966f2f1c5— AI miswrites ayah 36:57 in chat; correct on tap-through (Sino Mukhamedov)19ebd3ff674492eb— AI cites hadith with wrong vowel markings (i'rab); share-via-email pastes nothing (Sino Mukhamedov)