t-SNE projection of image vectors of data collected for Huffer and Graham 2017, where the red points indicate the location of cluster 35, the blue points indicate the location of cluster 80, and the green points indicate the location of cluster 82.

Fleshing Out the Bones: Studying the Human Remains Trade with Tensorflow and Inception

Abstract

There is an active trade in human remains facilitated by social media sites. In this paper we ask: can machine learning detect visual signals in photographs indicating that the human remains depicted are for sale? Do such signals even exist? This paper describes an experiment in using Tensorflow and the Google Inception-v3 model against a corpus of publicly available photographs collected from Instagram. Previous examination of the associated metadata for these photos detected patterns in the connectivity and rhetoric surrounding this ‘bone trade’, including several instances where ‘for sale’ seemed to be implied, though not explicitly stated. The present study looks for signals in the visual rhetoric of the images as detected by the computer and how these signals may intersect with the other data present.

Publication
Journal of Computer Applications in Archaeology