We asked artificial intelligence to analyze a graphic novel – and found both limits and new insights

scifigeneration:

by Leonie Hintze and Arend Hintze

File 20181127 76761 1hb2k33.jpg?ixlib=rb 1.1
What can an algorithm find when it reads a book? Vasilyev Alexandr/Shutterstock.com

With one spouse studying the evolution of artificial and natural intelligence and the other researching the language, culture and history of Germany, imagine the discussions at our dinner table. We often experience the stereotypical clash in views between the quantifiable, measurement-based approach of natural science and the more qualitative approach of the humanities, where what matters most is how people feel something, or how they experience or interpret it.

We decided to take a break from that pattern, to see how much each approach could help the other. Specifically, we wanted to see if aspects of artificial intelligence could turn up new ways to interpret a nonfiction graphic novel about the Holocaust. We ended up finding that some AI technologies are not yet advanced and robust enough to deliver useful insights – but simpler methods resulted in quantifiable measurements that showed a new opportunity for interpretation.

Keep reading