OpenTag Demo Presentation has been accepted and presented at the 8th AAAI Conference on Human Computation and Crowdsourcing (HCOMP 2020), held online from Hilversum, The Netherlands, from October 25th–29th of 2020.
Update: This work has received the HCOMP 2020 Best Demo Award.
The paper
Abstract
Image Tagging Algorithms (ITAs) are extensively used in our information ecosystem, from facilitating the retrieval of images in social platforms to learning about users and their preferences. However, audits performed on ITAs have demonstrated that their behaviors often exhibit social biases, especially when analyzing images depicting people. We present OpenTag, a platform that fuses the auditing process with a crowdsourcing approach. Users can upload an image, which is then analyzed by various ITAs, resulting in multiple sets of descriptive tags. With OpenTag, the user can observe and compare the output of multiple ITAs simultaneously, while researchers can study the manner in which users perceive this output. Finally, using the collected data, further audits can be performed on ITAs.
Read the paper: https://www.humancomputation.com/2020/assets/2020/wip_demos/HCOMP_2020_paper_76.pdf
Presentation
You can watch the pre-recorded backup presentation sent to the conference below:
