Workshop on Human-In-the-Loop Data Analytics
Co-located with SIGMOD 2020 (19 June 2020, Portland, OR, USA)

Past workshops: HILDA 2019 | HILDA 2018 | HILDA 2017

Slack Channel: #19junehildaworkshop

HILDA brings together researchers and practitioners to exchange ideas and results on human-data interaction. It explores how data management and analysis can be made more effective when taking into account the people who design and build these processes as well as those who are impacted by their results.

Keynote Speakers

Our exciting program will feature the following invited keynote speakers from different communities (HCI/VIS/DB) to talk about the challenges of human-data interaction.


The times in the following schedule are all in PST. Keynotes are 30 minutes with 15 minutes of Q&A. Regular talks are 12 minutes with a few minutes of Q&A. You can find the links to the Zoom webinar for each session in the program below:

Zoom Link:
8:30 Opening Remarks
8:45 Keynote by Arvind Satyanarayan: Towards Effective Interaction with Data Visualization
9:30 In Memoriam: Sherif Sakr, By Angela Bonifati
iSmartML: An Interactive and User-Guided Framework for Automated Machine Learning [pdf]
Shota Amashukeli, Radwa Elshawi and Sherif Sakr
10:00 Break
10:15 Session 1: Natural Language Interfaces (Chair: Azza Abouzied)
Towards Robust and Transparent Natural Language Interfaces for Databases [pdf]
Christoph Brandt, Benjamin Hättasch, Nadja Geisler and Carsten Binnig
NLonSpark: NL to SQL translation on top of Apache Spark [pdf]
Apostolos Glenis and Georgia Koutrika
10:45 Break
Zoom Link:
11:00 Keynote by Jessica Hullman: Beyond Visualization, Theories of Inference for Better Data Interfaces
11:45 Break
12:00 Session 2: Integration & Recommendation (Chair: Sihem Amer-Yahia)
Interactive View Recommendation with a Utility Function of a General Form [pdf]
Xiaozhong Zhang, Xiaoyu Ge and Panos Chrysanthis
Loki: Streamlining Integration and Enrichment [pdf]
William Spoth, Poonam Kumari, Oliver Kennedy and Fatemeh Nargesian
Surveillance Video Querying With A Human-in-the-Loop [pdf]
Michael Cafarella, Michael Stonebraker, Bharat Bhargava, Zachary Collins, Aaron Sipser, Tao Sun, Jenna McClellan, Alina Nesen, Kma Solaiman, Ganapathy Mani, Kevin Kochpatcharin and Pelin Angin
13:00 Break
Zoom Link:
13:15 Keynote by Peter Bailis: Human-in-the-Loop Proactive Analytics: Lessons (2015-2020)
14:00 Break
14:15 Session 3: Machine Learning & Spreadsheets (Chair: Zachary Ives)
Demystifying a Dark Art: Understanding Real-World Machine Learning Model Development [pdf]
Angela Lee, Doris Xin, Doris Jung-Lin Lee and Aditya Parameswaran
Understanding Data Analysis Workflows on Spreadsheets: Roadblocks and Opportunities [pdf]
Pingjing Yang, Ti-Chung Cheng, Sajjadur Rahman, Mangesh Bendre, Karrie Karahalios and Aditya Parameswaran
Fairness-Aware Instrumentation of Preprocessing Pipelines for Machine Learning [pdf]
Ke Yang, Biao Huang, Julia Stoyanovich and Sebastian Schelter
15:00 Closing Remarks

Call for Papers

We welcome work that proposes innovations in design to improve the way people can work with data management systems, as well as work that studies empirically how humans interact with existing systems. We welcome research that comes from the traditions of the database systems community, and also reports on industry activities, and research on data topics from communities that study people and organizations. A sample of topics that are in the spirit of this workshop include, but are not limited to:

  • novel query interfaces,
  • interactive query refinement,
  • data exploration and analysis,
  • data visualization,
  • human-assisted data integration and cleaning,
  • perception-aware data processing,
  • database systems designed for highly interactive use cases,
  • empirical studies of database use,
  • evaluating and ensuring fairness in data-driven decision making processes, New
  • understanding the outcomes of processes through provenance and explanations, New
  • interactive debugging of complex data systems, New
  • crowd-powered data infrastructure, etc.

HILDA is a forum where people from multiple communities engage with one another’s ideas. We are keen to have submissions that present initial ideas and visions, just as much as reports on early results, or reflections on completed projects. The workshop will focus on discussion and interaction, rather than static presentations of what is in the paper.


Authors are invited to submit either of the following:

(1) Original, unpublished research papers that are not being considered for publication in any other forum. These will be published in the HILDA proceedings. Authors need to present these papers. Research papers are between four and six pages in length, excluding references.

(2) Abstracts of previous work presented in other venues ideally outside the database community. Abstracts will be considered for discussion at the workshop. Abstracts are one page only. They are not included in the HILDA proceedings. The title must include (Abstract).

All submissions must follow the latest ACM paper format with 10pt font size.

You can submit your papers through EasyChair.


    We will provide links to accepted papers in the program here as well as publish them for a year through the ACM DL.

Important Dates

  • Workshop Date: June 19, 2020
  • Submissions (Research Papers): March 23 April 6, 2020, 11:59PM US PDT
  • Notification of outcome: April 23 April 27, 2020 11:59PM US PDT (or before SIGMOD early registration deadline)
  • Camera-ready due: April 27 May 4, 2020 11:59PM US PDT

Related Workshops

Program Chairs

Program Committee

  • Adriane Chapman, University of Southampton
  • Behrooz Omidvar-Tehrani, NAVER LABS Europe
  • Carsten Binnig, TU Darmstadt
  • Cong Yu, Google
  • Danyel Fisher, Microsoft Research
  • Dominik Moritz, University of Washington
  • Eugene Wu, Columbia University
  • Georgia Koutrika, ATHENA Research Center
  • H. V. Jagadish, University of Michigan
  • Jean-Daniel Fekete, Equipe Aviz, INRIA Saclay - Île-de-France
  • Joao Comba, Federal University of Rio Grande do Sul
  • Karl Aberer, Ecole Polytechnique Fédérale de Lausanne
  • Oliver Kennedy, University at Buffalo
  • Remco Chang, Tufts University
  • Reynold Cheng, The University of Hong Kong
  • Rick Cole, Tableau Software, Inc.
  • Saravanan Thirumuruganathan, Qatar Computing Research Institute
  • Sourav S Bhowmick, Nanyang Technological University
  • Stratos Idreos, Harvard University
  • Yael Amsterdamer, Bar-Ilan University
  • Yanlei Diao, UMass Amherst

Steering Committee

  • Carsten Binnig (TU Darmstadt)
  • Juliana Freire (New York University)
  • Joseph M. Hellerstein (University of California, Berkeley)
  • Aditya Parameswaran (University of Illinois)


For questions, please email the workshop chairs directly.

Follow us

Join us on Twitter.