Call for Applied Data Science Track Papers
Call for Applied Data Science Track Papers
Important Dates (Time: Anywhere on Earth)
We solicit submissions of papers describing designs and implementations of solutions and systems for practical tasks in data mining, data analytics, data science, and applied machine learning. The primary emphasis is on papers that either solve or advance the understanding of issues related to deploying data science technologies in the real world. Papers demonstrating significant, verifiable business- or real-world impact as a result of such deployments are encouraged. For details, please go over the Requirement section below.
The topics of submissions include data-science applications in all mature and emerging domains, as well as contributions to enabling algorithmic, infrastructure, and optimization methodologies to improve learning efficiency, scaling, and adoption/deployment. Submission topics broadly include data-science application in all mature and emerging domains, as well as contributions to enabling algorithmic, infrastructure, and optimization methodologies to improve learning efficiency, scaling, and adoption/deployment.
- Data protection
- Design of experiments
- Interpretable models
- Addressing bias in deployed systems
- Addressing vulnerabilities in on-field deployment
- Improving the reliability of deployed systems
- Privacy-sensitive applications of learning systems
- Ethical consideration in applications
- Applications involving explainable aspects of algorithms
- Validation and verification approaches for learning systems
- Applications that support broader goals on sustainability, equitability, bias-reduction, social justice, and social good
The Applied Data Science Track is distinct from the Research Track in that submissions focus on applied work addressing real-world problems and systems demonstrating tangible impact/value in their respective domains (e.g., industries, government initiatives, social programs). Please note that papers that do not satisfy the requirements (e.g., a research track paper) might be rejected without a formal review.
A paper in the Applied Data Science Track may fall into two major categories, Deployed and Evidential.
Category DEPLOYED: Must describe the implementation of a system that solves a significant real-world problem and is (or was) in production use for an extended period of time. The paper should present the problem, its significance to the application domain, the decisions and tradeoffs made when making design choices for the solution, the deployment challenges, and the lessons learned from successes and failures. Evidence must be provided that the solution has been deployed by quantifying post-launch performance. Papers that describe enabling infrastructure for large-scale deployment of applied machine learning also fall in this category. An example might be a deployed system that collects heartbeat audio from mobile phones during a marathon race and uses machine learning to identify potentially irregular heartbeat signals and alert support personnel. The work may particularly focus on how to overcome challenges in data collection, low-resource processing, and usability, and it is perfectly fine that the underlying machine learning algorithms are not fundamentally groundbreaking.
Category EVIDENTIAL: Must describe fundamental insights derived from addressing a significant real-world problem, even though a system has not been deployed. This might include papers providing significant gains in the understanding of an applied area/domain (for example, involving data or system deployment needs) or even papers where a conclusion has been reached that the problem is unsolvable. In addition to insights, the paper must explain what milestones were reached, what the practical impact is, and (if applicable) what the obstacles to deployment are. Straightforward improvements over trivial baseline solutions are unlikely to qualify. Continuing the example above, a paper in this category might present a system that achieves reasonable error rates in an experiment with many volunteers but suffers from interferences among mobiles that are located very close to each other.
Besides common requirements such as impact, clarity of presentation, reproducibility, we require that a submission clearly specifies an audience or a group of users that have evidently benefited or will benefit from the solution presented in the submission. In particular, the focus of novelty for an ADS submission is different from that of a Research Track submission in the sense that we focus more on business novelty, engineering novelty, usability, and user experience novelty, and whether the work provides significant gains in the understanding in an applied domain, etc.
KDD is a dual track conference hosting both a Research track and an Applied Data Science track. Due to a large number of submissions, papers submitted to the Research track will not be considered for publication in the Applied Data Science track and vice versa. Authors are encouraged to read the track descriptions carefully and to choose an appropriate track for their submissions. Following KDD conference tradition, reviews are not double-blind, and author names and affiliations should be listed.
Submissions are limited to a total of nine (9) pages, including all content and references, and must be in PDF format and formatted according to the new Standard ACM Conference Proceedings Template. For LaTeX users: unzip acmart.zip, make, and use sample-sigconf.tex as a template.
Additional information about formatting and style files is available online at: https://www.acm.org/publications/proceedings-template.
Papers that do not meet the formatting requirements will be rejected without review.
In addition, authors can provide an optional two (2) page supplement at the end of their submitted paper (it needs to be in the same PDF file and start at page 10) focused on reproducibility (see reproducibility section for more details.
After the submission deadline, authors are not allowed to add additional authors to the submitted papers.
Website for submissions: https://cmt3.research.microsoft.com/KDD2021
Haixun Wang, Instacart
Iryna Skrypnyk, EVERSANA