Workshop on Human-In-the-Loop Data Analytics
Co-located with SIGMOD 2022 (12 June 2022, Philadelphia, PA, USA), Pennsylvania Convention Center, Room 201b


Past workshops: HILDA 2020 | HILDA 2019 | HILDA 2018 | HILDA 2017 | HILDA 2016

HILDA brings together researchers and practitioners to exchange ideas and results on human-data interaction. It explores how data management and analysis can be made more effective when taking into account the people who design and build these processes as well as those who are impacted by their results.

We are trying to change things up a bit for HILDA 2022 (inspired by workshops such as PLATEAU). There are now several good venues for the kind of work that HILDA has traditionally attracted. We plan to focus the workshop on early-stage research that is promising and exciting. A core part of this plan is that every paper gets a mentor. More details on the process are below.

Keynote Speakers

Our exciting program will feature the following invited keynote speakers to talk about the challenges of human-data interaction.

Program

The times in the following schedule are all in EST. Keynotes are 30 minutes with 15 minutes of Q&A. Regular talks are 10 minutes and QA will be in a panel after a block of talks.

The scheule is not finalized and may change. Please check it again closer to the event.

9:30 Opening Remarks
9:45 Keynote by Sudeepa Roy: πŸŽ₯ Causality and Explanations for Interpretable Data Analysis
10:30 Break
11:00 Context Sight: Model Understanding and Debugging via Interpretable Context πŸŽ₯
Jun Yuan and Enrico Bertini
Quest: A Query-Driven Framework to Explain Classification Models on Tabular Data πŸŽ₯
Nadja Geisler and Carsten Binnig
Exploratory Training: When Trainers Learn πŸŽ₯
Omeed Habibelahian, Rajesh Shrestha, Arash Termehchy and Paolo Papotti
Panel discussion
12:00 Lunch Break
13:30 Keynote by Kanit (Ham) Wongsuphasawat: πŸŽ₯ The Evolution of Visualization Tools
14:15 Designing the Evaluation of Operator-Enabled Interactive Data Exploration in VALIDE πŸŽ₯
Yogendra Patil, Sihem Amer-Yahia and Srividya Subramanian
Enabling Useful Provenance in Scripting Languages with a Human-in-the-Loop πŸŽ₯
Yuze Lou and Michael Cafarella
Another Way to Implement Complex Computations: Functional-Style SQL UDF πŸŽ₯
Christian Duta
Panel discussion
15:15 Break
15:45 Keynote by Duen Horng (Polo) Chau: πŸŽ₯ Visualization for Deep Learning: An Odyssey
16:30 HumanAL: Calibrating Human Matching Beyond a Single Task πŸŽ₯
Roee Shraga
Opportunities and risks for engaging research participants with self-logged menstrual health data at scale πŸŽ₯
Samantha Robertson, Kim Harley and Niloufar Salehi
Flexible and Scalable Annotation Tool to Develop Scene Understanding Datasets πŸŽ₯
Md Fazle Elahi, Renran Tian and Xiao Luo
Towards Causal Query Answering for Debugging Video Analytics Systems πŸŽ₯
Jin Jin Zhao, Ted Shaowang, Stavros Sintos and Sanjay Krishnan
Panel discussion
17:45 Closing Remarks

What to submit

We encourage both standard research papers and more unusual worksβ€”for instance papers that describe in-progress work, reports on experiences, question accepted wisdom, raise open problems, or propose speculative new approaches. A HILDA submission should describe work or perspectives that will lead to interesting discussions at the workshop or that the authors want feedback on.

We welcome work that proposes innovations in design to improve the way people can work with data management systems, as well as work that studies empirically how humans interact with existing systems. We welcome research that comes from the traditions of the database systems community, and also reports on industry activities, and research on data topics from communities that study people and organizations. A sample of topics that are in the spirit of this workshop include, but are not limited to:

  • novel query interfaces,
  • interactive query refinement,
  • data exploration and analysis,
  • data visualization,
  • human-assisted data integration and cleaning,
  • perception-aware data processing,
  • database systems designed for highly interactive use cases,
  • empirical studies of database use,
  • evaluating and ensuring fairness in data-driven decision making processes
  • understanding the outcomes of processes through provenance and explanations
  • interactive debugging of complex data systems
  • crowd-powered data infrastructure, etc.

Submissions can also examine any of the above topics from an application or domain perspective.

HILDA is a forum where people from multiple communities engage with one another's ideas. We are keen to have submissions that present initial ideas and visions, just as much as reports on early results, or reflections on completed projects.

The workshop will focus on discussion and interaction, rather than static presentations of what is in the paper.

Review and Mentorship Process

HILDA reviews are single blind. All submitted papers will be reviewed by at least three reviewers who will determine the fit of the work for HILDA's unique mentorship process this year, the quality of the work, and its potential for future research.

Every accepted paper will be assigned a mentor who will engage with the authors providing constructive feedback through one-on-one, virtual, discussions. We hope that the authors will work closely with their mentors to improve the substance and direction of their work.

Authors and mentors can withdraw without repercussions due to unforeseen conflicts. In such situations, the program chairs will try to find another suitable mentor.

All accepted papers will have the chance to demonstrate the work during the workshop's demonstration session. For papers selected for presentation at the conference, the mentors will also introduce and contextualize the work and enable feedback from the attendees.

Final camera-ready submissions will be solicited for a selection of the accepted papers after the workshop allowing authors to integrate feedback from discussions with the mentor and workshop participants.

Submission

Authors are invited to submit papers between four and six pages in length excluding references and using the standard SIGMOD paper formatting template Submissions should reflect the current state of the research work but also include a section on limitations and challenges that they wish to receive feedback from their mentors and the HILDA community on.

All submissions must follow the latest ACM paper format with 10pt font size.

You can submit your papers through EasyChair.

Proceedings

    We will provide links to accepted papers in the program here as well as publish them for a year through the ACM DL.


Important Dates

  • Workshop Date: June 12, 2022
  • Submissions: April 1, 2022 AOE April 11, 2022 AOE
  • Notification of outcome: April 22, 2022
  • Camera-ready due: July 1, 2022 (after the workshop)

Workshop Chairs

Mentors

  • Arnab Nandi
  • Arun Kumar
  • Arvind Satyanarayan
  • Behrooz Omidvar-Tehrani
  • Brit Youngmann
  • Cagatay Demiralp
  • El Kindi Rezig
  • Eugene Wu
  • Giuseppe Santucci
  • Jean-Daniel Fekete
  • Jeffrey Heer
  • Kanit Wongsuphasawat
  • Leilani Battle
  • Leo Liu
  • Melanie Tory
  • Minsuk Kahng
  • Oliver Kennedy
  • Roee Shraga
  • Tiziana Catarci
  • Zoi Kaoudi

Steering Committee

  • Carsten Binnig (TU Darmstadt)
  • Juliana Freire (New York University)
  • Joseph M. Hellerstein (University of California, Berkeley)
  • Aditya Parameswaran (University of California, Berkeley)

Contact

For questions, please email the workshop chairs directly.

Follow us

Join us on Twitter.