Patheos

BuddhistCatholicContemplativeEvangelicalGeneral ChristianHinduJewishLatter-day SaintMuslimNew VisionsProgressive Christian

Beliefs

Topics

Columnists

Resource Library

Research Tools

Video

Podcasts

Thought Readers

Faith In Media Tracker

Newsletters

Ad-Free & Subscriber Log-In Subscription Support

Patheos

Ad-Free & Subscriber Log-In Subscription Support

Follow Patheos Patheos on Facebook Patheos on YouTube

religionprof

Algorithmythicism at #AARSBL19

Last updated on: February 18, 2020 at 5:14 am   by James F. McGrath

Algorithmythicism at #AARSBL19 2020-02-16T19:31:26-05:00 James F. McGrath

LOGO Patheos Explore the world's faith through different perspectives on religion and spirituality! Patheos has the views of the prevalent religions and spiritualities of the world.

Continuing my recap of the Digital Humanities session I chaired in November. Let me begin with links to three updates on Claire Clivaz’s Mark 16 project (highlighted in my first post from this session). The most pressing is probably the one with news and upcoming events.

Daniel Stökl Ben Ezra of the Ecole Pratique des Hautes Etudes and Hayim Lapin of the University of Maryland – College Park presented on “Automatic Transcriptions of Medieval Hebrew Manuscripts and Crowdsourcing Their Corrections.” They mentioned that it is unfortunate SBL does not allow submissions that include authors that are not present. In the natural sciences it is different. Astronomers have been living in this world for half a century. When it comes to digital rendering of Hebrew texts, we need to have data points at the level of the stroke, letter, etc.

(See Patrick Sahle’s text wheel.) This project is at the intersection of several other projects: eRabbinica, Sofer Mahir (automatic transcription of Tannaitic treatises), Tikkoun Sofrim (automatic transcription of Tanhuma), BiblIA, Scripta numerique. Their approach allows fast transcription of huge amounts of data. They were originally at 3 errors per 100 characters, and are now at 1.8. Computers and humans can both include extra space, other things not needed, because of not knowing the language and thus not knowing what is significant. Computer can learn to recognize letters extended to fill the line! Some alphabets have curved, straight, and oblique lines. The initial OCR had 20,000 mistakes. It turns out that the general public can be helpful in eliminating them. Questions I had included: Can the correctors help the software learn to do better? Risk of “correctors” who do not know language making software worse at recognition? Do large numbers of participants in such a project offset negative impact of any individual who is incompetent or malicious?

The presenters doubted this could be done with Latin scripts in Israel. The number of users grew to 373, and the number of lines checked by the most active users was 11,552. The hyperengaged are 10-20% of the total, and they do 80-90% of the work. Almost 90,000 transcribed lines resulted from this project. They noted there were fewer users on the sabbath. News coverage caused peaks. System malfunction also led to low points in activity. The quality of crowd corrections was pretty good for those who were experienced. The character error ratio was .5, typically special characters. Users improved over time. They mentioned collatEx. A text service must provide instructions about how it should be cited, machine and human readable. The project is aiming to be open source. Another question I had was whether users transcribe accurately even if a text is grammatically wrong?

A. Marshall King V of the University of Notre Dame presented a test case on Deuteronomy exploring big data, intertextuality, and the Bible. This represents a personal project with no funding, working on tools to investigate shared citation. Looking at existing sources such as Biblia Patristica and Biblindex, what they do they do well, but some questions were not answered by the configurations of the data provided there. For instance there was no help with weighing, i.e. evaluation of which verses have been cited most in a time period. Other interesting questions that digitized texts ought to help answer but do not currently are: Which groups cite particular verses most? Which verses are cited by the largest number of authors? Which verse is most cited? Which of the ten commandments is most cited? It takes “years of analysis for a day of synthesis.” King wondered why has it taken so long for network theory to be applied to this, specifically Willem Vorster’s work on network of traces.

This was where the question occurred to me: Could an AI calculate a probability that something is an allusion to an earlier text?

The raw frequency with which commandments are cited by later authors is fascinating. Coveting is the most mentioned. Honoring parents is cited by the most authors. The parting of the ways and the different ways of delineating the commandments affect things. Searching for citation of Deut. 32 yields very different results among Jewish and Christian authors. This project relied on existing lists of citations. But in theory one might automatically detect citation.

Benjamin White from Clemson University presented on the idea of “dirty texts” and how it relates to stylometric analysis. Stylometry, for those not familiar with it, is the attempt to quantify the writing style of an author such as Paul, with a view to determining the authenticity or actual authorship of letters. The previous year White tackled whether named coauthors might have impacted the stylome. It turned out that there is no reason to hang multiple authorship over stylometric analysis. Inclusion of Timothy doesn’t change the stylome. He talked about the work Paul Duwalla of Duquesne University has done on canonization and the idea of a pure text, and what Maciej Eder has done on the “dirty corpus.” The work of the Computational Stylistics Group was mentioned. In this year’s presentation White focused on clustering of tests and signal interference through scribal transmission process. This represents a form of metacriticism of the use of stylometric analysis to determine authenticity. We don’t always consider the way using different manuscripts, or an eclectic critical edition, could potentially produce different results in a study like this. On the other hand, when classical speeches are analyzed, even random replacement of 40% of letters did not prevent 70% accuracy being achieved, suggesting that this computer-assisted method should still work in principle, and work better than human judgment.

In the case of Paul’s letters, however, one has to also account for the very different results that have emerged from past stylometric analysis by computer scientists, mathematicians, and NT scholars of Pauline epistles. Ironically, the consensus of scholars, that there is a corpus of seven letters that is the most likely to be authentic, has the least stylistic support! Some of those who undertook studies in the past have used the Textus Receptus, some used Nestle Aland, and White wondered whether this could be the cause of the divergences. (P46 could not be included because it is incomplete.) The Stylo package lets you run a variety of tests at once. It then provides a depiction of the average result. One can choose the increments used. Most frequent word vectors ranged  from 10-50, avoiding the accusation of cherry-picking results you like from among different outcomes. White showed us his Codex Sinaiticus cluster analysis, talking about a “Bootstrap Consensus Tree.” Comparing the results from Sinaiticus vs. Family 35 we could clearly see the cluster differences represented visually. 1 Timothy and Titus align differently in the two results! Word frequency changes between the manuscripts, but sometimes they merely flip places. As words become more infrequent, they skip around in the ranking a lot more. White focused a lot on function words, as it necessary to try to get the content and subject of a particular text not to determine the result, since the same author often wrote about many different subjects, by definition using different vocabulary when doing so.

Looking at weighting tables and network analysis of connections, similarities, and degrees of difference, a key question is which texts are most centrally related to the group. Interestingly, 2 Timothy emerged as the middle of the network, then Philippians, then 2 Corinthians. If one adds other early Christian literature, similar patterns emerge as the network expands.

The key takeaway result is that the Pauline epistles are not especially dirty. They fall within the margin of error for the industry standard for stylometric analysis, regardless of which manuscripts are used. The study has nonetheless helped make clear what has led to past discrepancies. Hugh Houghton said he would have preferred that a modern critical edition be used because of the scribal tendency towards harmonization. Another key point to take away is that to get 80% correct attribution, you need a minimum number of words (2000), and that cuts out half the Pauline epistles. And so, on the one hand, excuses sometimes offered for ignoring stylometric analysis are invalid. On the other hand, the method applied to much of the Pauline corpus is by definition invalid.

The connections of this part of the session with mythicism include not only the connection with evaluating authenticity, something that mythicists handle in sweeping generalizations and other ham-fisted ways, but also the use of technology to spot intertextual connections. My evaluation of Thomas Brodie’s work, in which he argues that the Gospels were created by taking earlier texts and transforming them in ways that can and are supposed to be detected, is that it is intertextuality and parallelomania run amok. A machine could find even more parallels than I did in my article on this topic. And so on the one hand a machine might be able to quantify the differences and similarities with respect not only to vocabulary but also structure in ways that might be useful. But it would also find parallels where it will make more sense to interpret them as due to the fact that human vocabulary involves a limited number of words, and they are used in predictable ways by us all, and sometimes converge on the same word choice even in ways that are unpredictable and even striking but in no reasonable scenario can be due to direct borrowing. The use of computer technology in this area has great promise, as long as we remember what we need to remember about machine learning and algorithmic processes in general, namely that they offer us information which it is still up to us to use wisely. At least at the present, our machines have intelligence but do not possess wisdom. Thankfully some humans do.

In an exciting coincidence, after I wrote this post but before it was scheduled to appear, an article appeared on precisely the topic I have been discussing: “On the Feasibility of Automated Detection of Allusive Text Reuse.”

Also related to this see the parallels provided by Luigi Walt from his book Paolo e le parole di Gesù: Frammenti di un insegnamento orale (Brescia: Morcelliana, 2013), a recent article, Maruf A. Dhali et al., “Feature-Extraction Methods for Historical Manuscript Dating Based on Writing Style Development,” Pattern Recognition Letters 131 (2020): 413–20, and the issue of Open Theology focused on Digital Humanities.

And of course, don’t miss my earlier post about this session at SBL 2019 if you haven’t already read it:

#DH @ #AARSBL19

mythicism

Society of Biblical Literature

algorithms

Dennis R. MacDonald

Digital Humanities

imitation

intertextuality

mythicism

mythicists

Thomas Brodie

Previous Post



February 17, 2020

Doctor Who: The Haunting of Villa Diodati

Next Post



February 19, 2020 ReligionProf Podcast with Ruth Hayhoe about Suzanne McCarthy, Transcripted


Browse Our Archives

Select a Category 1 Corinthians 1 John 1 Peter 1 Samuel 1 Thessalonians 1 Timothy 2 Corinthians 2 Kings 2 Peter 2 Samuel 2 Thessalonians 2 Timothy academia Acts of the Apostles afterlife Akhaten Alcatraz American Academy of Religion Amos Anglican Arabic Aramaic archaeology art artificial intelligence astronomy atheism atonement Babylon 5 Baptists Battlestar Galactica Bible Biblical Studies Carnival biblioblogging Black Mirror Blade Runner Book of Job book review Buddhism Call for Papers China Christianity Christmas Christology Chronicles Coptic creation Daniel Deuteronomy Doctor Who Dune Easter Ecclesiastes economics education Eldad Keynan Enoch Seminar Ephesians eschatology Esther Evangelicals evolution Exodus Expanse Ezekiel Ezra fantasy Fringe fundamentalism Galatians games Ge'ez genealogy Genesis Gnosticism Gospel of Jesus' Wife Gospel of John Gospel of Judas Gospel of Luke Gospel of Mark Gospel of Matthew Gospel of Peter Gospel of Thomas Greek Harry Potter Hebrew Hebrews Hinduism historical Jesus history Hitchhiker's Guide to the Galaxy Holidays horror Hosea humor incarnation India inerrancy information literacy inspirational Intelligent Design Ireland Isaiah Islam Israel Italy James Jeremiah John the Baptist Jonah Joshua Judaism Jude Judges Judith Lamentations languages Latin Leviticus libraries literature Lord of the Rings LOST Mandaeans Mandaic memes Methodism Micah monotheism morality Mormons movies music mythicism NASSCAL Nehemiah new perspective New Testament news Numbers Orthodox paganism panentheism pantheism Patheos Paul and his letters Pentecostals Philippians Philippians 2:6-11 philosophy physics Planet of the Apes podcast politics Progressive Christianity Protestantism Proverbs Psalms pseudoscience racism religion Revelation Roman Catholicism Romania Romans Ruth scams science science fiction Secret Gospel of Mark Society of Biblical Literature Song of Songs Star Trek Star Wars Stargate Swahili Syriac Taoism technology Terminator The Handmaid's Tale The Hobbit The Matrix theodicy theology theory Timeless Titus tomb Torchwood travel TRON Uncategorized United Kingdom Westworld X-Files young-earth creationism Zechariah

Select a Month November 2026 October 2026 September 2026 August 2026 July 2026 June 2026 May 2026 April 2026 March 2026 February 2026 January 2026 December 2025 November 2025 October 2025 September 2025 July 2025 June 2025 May 2025 April 2025 March 2025 February 2025 January 2025 December 2024 November 2024 October 2024 September 2024 August 2024 July 2024 June 2024 May 2024 April 2024 March 2024 February 2024 January 2024 December 2023 November 2023 October 2023 September 2023 August 2023 July 2023 May 2023 April 2023 March 2023 February 2023 January 2023 December 2022 November 2022 October 2022 September 2022 August 2022 July 2022 June 2022 May 2022 April 2022 March 2022 February 2022 January 2022 December 2021 November 2021 October 2021 September 2021 August 2021 July 2021 June 2021 May 2021 April 2021 March 2021 February 2021 January 2021 December 2020 November 2020 October 2020 September 2020 August 2020 July 2020 June 2020 May 2020 April 2020 March 2020 February 2020 January 2020 December 2019 November 2019 October 2019 September 2019 August 2019 July 2019 June 2019 May 2019 April 2019 March 2019 February 2019 January 2019 December 2018 November 2018 October 2018 September 2018 August 2018 July 2018 June 2018 May 2018 April 2018 March 2018 February 2018 January 2018 December 2017 November 2017 October 2017 September 2017 August 2017 July 2017 June 2017 May 2017 April 2017 March 2017 February 2017 January 2017 December 2016 November 2016 October 2016 September 2016 August 2016 July 2016 June 2016 May 2016 April 2016 March 2016 February 2016 January 2016 December 2015 November 2015 October 2015 September 2015 August 2015 July 2015 June 2015 May 2015 April 2015 March 2015 February 2015 January 2015 December 2014 November 2014 October 2014 September 2014 August 2014 July 2014 June 2014 May 2014 April 2014 March 2014 February 2014 January 2014 December 2013 November 2013 October 2013 September 2013 August 2013 July 2013 June 2013 May 2013 April 2013 March 2013 February 2013 January 2013 December 2012 November 2012 October 2012 September 2012 August 2012 July 2012 June 2012 May 2012 April 2012 March 2012 February 2012 January 2012 December 2011 November 2011 October 2011 September 2011 August 2011 July 2011 June 2011 May 2011 April 2011 March 2011 February 2011 January 2011 December 2010 November 2010 October 2010 September 2010 August 2010 July 2010 June 2010 May 2010 April 2010 March 2010 February 2010 January 2010 December 2009 November 2009 October 2009 September 2009 August 2009 July 2009 June 2009 May 2009 April 2009 March 2009 February 2009 January 2009 December 2008 November 2008 October 2008 September 2008 August 2008 July 2008 June 2008 May 2008 April 2008 March 2008 February 2008 January 2008 December 2007 November 2007 October 2007 September 2007 August 2007 July 2007 June 2007 February 2007 January 2001


Follow Us!

Follow Us on Facebook Follow Us on Twitter



TAKE THE

Religious Wisdom Quiz

Which Psalm is often read at funerals: "Even though I walk through the valley..."?

Select your answer to see how you score.

Psalm 23 Psalm 137 Psalm 90 Psalm 51

Books by This Author Books by James F. McGrath

See All Titles »

Related posts from Religion Prof: The Blog of James F. McGrath

Family

Where To Find Me at #SBLAAR26

Religion Prof: The Blog of James F. McGrath

Family

The Obsolete Paradigm of a Purely Mythical Jesus

Religion Prof: The Blog of James F. McGrath

Family

Where I'll Be (November 2025 Edition)

Religion Prof: The Blog of James F. McGrath

Family

Scholarship is Not Merely Skepticism

Religion Prof: The Blog of James F. McGrath

TRENDING AT PATHEOS Progressive Christian

Finding Gratitude in the Growth You Didn't Choose

I Wouldn't Have Chosen This My life has had many twists and...

  I'm lately seeing a remarkable amount of online fear-mongering and sensationalized...

Salisbury Cathedral (outside)-- Part Four

There is a relatively new statue outside the cathedral of the 'walking...

I Was in Prison ... On Matthew 25:35-36

I Was in Prison...and You Came to Me "for I was hungry...

'Ebenezer': Johnny Depp in a Dickens That Gets...

November, the Catholic month of memento mori, is a perfect time for...

On Grief, Anger, and Fiona the Hippo

  The most terrible lesson we have to learn, is that sometimes...

view all Progressive Christian blogs

Patheos on Facebook Patheos on YouTube

Ad-Free & Subscriber Log-In Subscription Support

Copyright 2008-2026, Patheos. All rights reserved.

Subscription Support Ad-Free & Subscriber Log-In

Follow Patheos Patheos on Facebook Patheos on YouTube