SER&IP 2020: International Workshop on Software Engineering Research and Industrial Practice – Seoul, South Korea

Please submit to the 7th International Workshop on Software Engineering Research and Industrial Practice (SER&IP 2020). The deadline for paper and talk proposal submissions is January 22, 2020 — as always, please check the webpage. I’m one of the organizers.

The aim of the workshop is to bring together researchers and practitioners to discuss the current state of Software Engineering (SE) research and Industrial Practice (IP), and advance collaboration to reduce the gap between research and practice. Researchers can be unaware of real problems and constraints in practice, whereas practitioners may find themselves unable to adopt existing useful research. Practitioners are often reluctant or even prevented from sharing industry information due to confidentiality and legal constraints. Practitioners often feel that researchers work on dated or futuristic theoretical challenges which are divorced from today’s industrial practice. Researchers believe that practitioners are looking for quick fixes instead of using systematic methods. Practitioners have a view that case studies in research do not adequately represent the complexities of real projects and often dismiss results outright when students are used as test subjects in research. Researchers expect good work to take a few years to generate good publications which may affect a specific domain in an incremental manner. Practitioners expect a quick solution which must pay off in the short term. Researchers are more interested in proposing new techniques and tools. Practitioners would appreciate systematic evaluation and comparison of existing techniques and tools in real-world settings. Researchers and practitioners need to overlap research and practice to build trust in their partnership. This workshop is a platform to discuss and address such challenges.

ICSR 2019: International Conference on Software and Systems Reuse (ICSR) – Cincinnati, USA

Please submit to the 18th International Conference on Software and Systems Reuse (ICSR 2019). The submission deadline has been extended to February 15 — as always, please check the webpage. I’m a member of the Program Committee.

The International Conference on Software and Systems Reuse (ICSR) is the premiere event in the field of software and systems reuse research, technology, and practice. The main goal of ICSR is to present the most recent advances and breakthroughs in the area of software and systems reuse and to promote an intensive and continuous exchange of ideas among researchers and practitioners.

We solicit novel and well-founded work in the wider area of software and systems reuse, with a strong theoretical or empirical foundation and practical relevance. Theoretical work should introduce innovative ideas and should be based on a solid theoretical basis. Empirical work such as case studies and experiments is also welcome. Moreover, work linking academic research to software and systems reuse in industrial practice, including reports on practical experience and technology transfer to industry, is highly encouraged.

EAQSE 18: International Workshop on Empirical Answers to Questions of Software Engineering – Villebrumier, France

Please submit to the First International Workshop on Empirical Answers to Questions of Software Engineering (EAQSE 18). The submission deadline is September 15, 2018 — as always, please check the webpage for any extensions. I’m a member of the Programm Committee. The workshop will be held in the Villebrumier LASER center, 19-21 November 2018.

Empirical methods have transformed software engineering. Over the past two decades, it has become essential to back assertions on methodology, languages and tools by objective analysis of their effect. Sometimes, however, the temptation has been to perform empirical studies on problems that can be studied, because they make it easy to set up an empirical study, rather than problems that should be studied, because they are important for the practice of software development.

For more background see two blog posts starting at

The EAQSE workshop focuses precisely on this goal: empirical studies whose results teach us lessons about what helps, or hinders, the quality of both software processes and software products.

A page listing sample software engineering questions which empirical studies could help address is available at Please contribute to it by adding your own questions and concerns. (It suffices to use “Reply.”)

Papers should identify clearly the software engineering questions being addressed, their practical relevance, the empirical study or studies that have been performed, and their contribution to answering the questions.

The three-day workshop will include invited talks and presentations of the accepted papers, and will reserve ample time for discussions. The papers will be published as post-proceedings, as a volume of the Springer Lecture Notes in Computer Science.

Submissions will be reviewed by the international program committee. They should be in LNCS format. To kinds of submission are possible: full paper and can take the form of either a full paper (up to 15 LNCS pages) or an extended abstract (2 to 5 pages).

Submission page:

Important dates
Deadline for submissions (full paper or extended abstract): 15 September 2018 (firm).
Acceptance notice: 5 October 2018.
EAQSE workshop: 19-21 November 2018.

Program chairs
Jean-Michel Bruel (University of Toulouse)
Bertrand Meyer (Politecnico di Milano and Innopolis University)

ACM SIGSOFT Elections 2018

I running for Chair of ACM SIGSOFT. Find out more about my goals.

APSA 2018: International Workshop on Anti-Patterns for Software Analytics – Gothenburg, Sweden

Please submit to the 1st International Workshop on Anti-Patterns for Software Analytics (APSA 2018), in conjunction with ICSE 2018, Gothenburg, Sweden. The submission deadline is February 5 — as always, please check the webpage for any extensions. I’m a member of the Program Committee.

In this data-driven economy, as society makes increasing use of data mining technology, it is now more important to that our community has a shared understanding on how to assess the results coming out of those data miners. Recent results experience shows that, in the arena of software analytics, we do not share that understanding.

We now have more than a decade of research on data mining in software repositories, reported at all major software engineering venues (ICSE, TSE, EMSE, MSR, ASE, ICSME, ESEM, …). Based on the organizers’ experience on their last dozen journal papers, we assert that conference and journal reviewers in SE have very little shared criteria on how to assess data miners. Simple low-level issues, such as what performance indicator to use, are still controversial. Some reviewers eschew accuracy or precision; some demand SE (standardized error). Similarly, many higher issues are also unclear such as what statistical test to use on how many data sets (and where should that data come from). More generally, recently several papers reported on failed replications or problems with the data we use.
All the above hints at general and systemic problems with the way we evaluate and compare our research. This is a pressing, open and urgent problem not just for researchers since we know many software developers who routinely ship some kind of analytics functionality as part of their delivery tools. If we, as academics, cannot agree on how to assess those tools, then how can industrial practitioners ever certify that the analytic tools they are shipping to clients are useful (or, at the very least, not misleading).

Accordingly, this workshop’s goal is the development of guidelines for assessing software analytics. We want to bring together the community to discuss anti-patterns as a first step towards guidelines for repeatable, comparable, and replicable software analytics research, e.g., on defect prediction and effort prediction. As such, we do not want to discuss new techniques, data sets, or ways to mine data, but instead focus solely on the discussion of how we should actually evaluate our research. This shall give researchers a forum to share anti-patterns they frequently observe and how to avoid them.

ISSTA 2018: ACM SIGSOFT International Symposium on Software Testing and Analysis – Amsterdam, Netherlands

Please submit to the ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA 2018). The submission deadline is January 29 for the technical track — as always, please check the webpage for any extensions. I’m a member of the Programm Committee.

The ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA) is the leading research symposium on software testing and analysis, bringing together academics, industrial researchers, and practitioners to exchange new ideas, problems, and experience on how to analyze and test software systems. ISSTA’18 will be co-located with the European Conference on Object-Oriented Programming (ECOOP ’18), and with Curry On, a conference focused on programming languages & emerging challenges in industry.

Research Papers

Authors are invited to submit research papers describing original contributions in testing or analysis of computer software. Papers describing original theoretical or empirical research, new techniques, in-depth case studies, infrastructures of testing and analysis methods or tools are welcome.

Experience Papers

Authors are invited to submit experience papers describing a significant experience in applying software testing and analysis methods or tools and should carefully identify and discuss important lessons learned so that other researchers and/or practitioners can benefit from the experience. Of special interest are experience papers that report on industrial applications of software testing and analysis methods or tools.

Reproducibility Studies (New!)

ISSTA would like to encourage researchers to reproduce results from previous papers, which is why ISSTA 2018 will introduce a new paper category called Reproducibility Studies. A reproducibility study must go beyond simply re-implementing an algorithm and/or re-running the artifacts provided by the original paper. It should at the very least apply the approach to new, significantly broadened inputs. Particularly, reproducibility studies are encouraged to target techniques that previously were evaluated only on proprietary subject programs or inputs. A reproducibility study should clearly report on results that the authors were able to reproduce as well as on aspects of the work that were irreproducible. In the latter case, authors are encouraged to make an effort to communicate or collaborate with the original paper’s authors to determine the cause for any observed discrepancies and, if possible, address them (e.g., through minor implementation changes). We explicitly encourage authors to not focus on a single paper/artifact only, but instead to perform a comparative experiment of multiple related approaches.

ICSME 2017: International Conference on Software Maintenance and Evolution – Shanghai, China

Please submit to the 33rd International Conference on Software Maintenance and Evolution (ICSME 2017). The submission deadline is Thursday, April 6 (abstracts March 30) for the technical track— as always, please check the webpage for any extensions. Together with Lu Zhang I’m Co-Chair of the program committee for the research track. ICSME will be the first IEEE-sponsored conference to award the IEEE TCSE Distinguished Paper Awards.

The International Conference on Software Maintenance and Evolution (ICSME) is the premier international forum for researchers and practitioners from academia, industry, and government to present, discuss, and debate the most recent ideas, experiences, and challenges in software maintenance and evolution.

ICSME 2017, the 33rd in the conference series, will be held in Shanghai, China. Shanghai is the largest and most prosperous city in China. World Expo 2010 was held in Shanghai. Shanghai is situated in the Yangtze River delta next to the East China Sea.

As one of the largest cities in Asia, Shanghai has rich cultural relics. You can not only experience a modern trip including the Bund, Xintiandi, the Oriental Pearl TV Tower and World Financial Center, but also explore an old and ancient journey by visiting the Yuyuan Garden, Jade Buddha Temple and Zhujiajiao Ancient Town. Nearby Suzhou and Hangzhou, you can easily visit some ancient water towns in Jiangsu and Zhejiang Provinces from Shanghai.

This is Shanghai from Rob Whitworth on Vimeo.