AI drafts contain frequent errors in religious narratives

Researchers released SadaqahStories, a parallel English-Arabic corpus of 41 illustrated stories about Islamic charitable giving for children aged 7 to 18.

The project includes three versions of each story: an initial draft created with a large language model, an audited version, and a final version approved by an Islamic scholar. The corpus includes stories about Sadaqah, Zakat, and Waqf, which are forms of Islamic charity. The audit of the AI-generated drafts revealed substantive errors in 39 of the 41 stories.

These inaccuracies primarily included invented names, dates, prices, and quotations, as well as the blending of different historical events. Some drafts also contained incorrect wording or rulings regarding religious texts. To make the content accessible for children, the researchers rewrote the English text to lower the reading level. The project also provides an 81-entry charity lexicon covering Modern Standard Arabic and Qatari Arabic.

The researchers made these materials available on a free website to help others study how artificial intelligence mishandles religious and historical content.