Highlights from 30 years of ISSRE

 

On 2019, the 30th edition of the International Symposium on Software Reliability Engineering (ISSRE 2019) took place in Berlin, Germany, October 28-31. The first edition took place in Washington, DC, USA, in 1990.

To celebrate this very important anniversary, we promoted an initiative to identify the ISSRE most influential papers, called "Highlights from 30 years of ISSRE". We looked for ISSRE papers that had a great influence and impact in the community. The goal of the initiative is to remember those papers and their authors, which, in practice, tell a good part of the story of our conference.

To identify the papers, we first published an open call for proposal from the community, where people could suggest one or more papers and their motivations for why they consider them to have been influent for the community. Then, we performed a bibliometric analysis of all ISSRE papers, by dividing the 30 years in 5-years epochs, and by adding more papers uniformly across the epochs. Finally, we interviewed most of the former PC-Chairs of all ISSRE editions to further extend the pool of papers. At the end of this process, we ended up with 26 influential papers.

Software Reliability Analysis

  • Musa, John D. "The operational profile in software reliability engineering: an overview." [1992] ISSRE 1992 (link)

  • Musa, John D. "Adjusting measured field failure intensity for operational profile variation." ISSRE 1994 (link)

  • Bastani, Farokh, and Alberto Pasquini. "Assessment of a sampling method for measuring safety-critical software reliability." ISSRE 1994 (link)

  • Yacoub, Sherif M., Bojan Cukic, and Hany H. Ammar. "Scenario-based reliability analysis of component-based software." ISSRE 1999 (link)

  • Neufelder, Ann Marie. "How to measure the impact of specific development practices on fielded defect density." ISSRE 2000 (link)

  • Williams, Laurie, E. Michael Maximilien, and Mladen Vouk. "Test-driven development as a defect-reduction practice." ISSRE 2003 (link)

  • Xing, Fei, Ping Guo, and Michael R. Lyu. "A novel method for early software quality prediction based on support vector machine." ISSRE 2005 (link)

  • Bird, C., Nagappan, N., Gall, H., Murphy, B., and Devanbu, P. "Putting it all together: Using socio-technical networks to predict failures." ISSRE 2009 (link)

 

Failure Analysis and Monitoring

  • Kanoun, Karama, Mohamed Kaâniche, and J-C. Laprie. "Experience in software reliability: From data collection to quantitative evaluation." ISSRE 1993 (link)

  • Thakur, A., Iyer, R. K., Young, L., and Lee, I. "Analysis of failures in the Tandem NonStop-UX operating system." ISSRE 1995 (link)

  • Chen, Xin, Charng-Da Lu, and Karthik Pattabiraman. "Failure analysis of jobs in compute clouds: A Google cluster case study." ISSRE 2014 (link)

  • He, S., Zhu, J., He, P., and Lyu, M. R. "Experience report: System log analysis for anomaly detection." ISSRE 2016 (link)

  • Sauvanaud, C., Lazri, K., Kaâniche, M., and Kanoun, K. "Anomaly detection and root cause localization in virtual network functions." ISSRE 2016 (link)

 

Software Testing

  • Lyu, Michael R., Joseph R. Horgan, and Saul London. "A coverage analysis tool for the effectiveness of software testing." ISSRE 1993 (link)

  • Wong, W. E., Horgan, J. R., London, S., and Mathur, A. P. "Effect of test set size and block coverage on the fault detection effectiveness." ISSRE 1994 (link)

  • Antoniol, G., Briand, L. C., Di Penta, M., and Labiche, Y. "A case study using the round-trip strategy for state-based class testing." ISSRE 2002 (link)

  • Ma, Yu-Seung, Yong-Rae Kwon, and Jeff Offutt. "Inter-class mutation operators for Java." ISSRE 2002 (link)

  • Moreira, Rodrigo MLM, Ana CR Paiva, and Atif Memon. "A pattern-based approach for GUI modeling and testing." ISSRE 2013 (link)

 

Fault Injection and Robustness Testing

  • Voas, Jeffrey M., and Keith W. Miller. "Improving the software development process using testability research." ISSRE 1992 (link)

  • Suh, B. H., Hudak, J., Siewiorek, D., & Segall, Z. "Development of a benchmark to measure system robustness: experiences and lessons learned." ISSRE 1992 (link)

  • Malaiya, Yashwant K. "Antirandom testing: Getting the most out of black-box testing." ISSRE 1995 (link)

  • Christmansson, Jörgen, and Peter Santhanam. "Error injection aimed at fault removal in fault tolerance mechanisms-criteria for error selection using field data on software faults." ISSRE 1996 (link)

  • Duraes, Joao, and Henrique Madeira. "Emulation of software faults by educated mutations at machine-code level." ISSRE 2002 (link)

 

Software Aging and Rejuvenation

  • Garg, S., Puliafito, A., Telek, M., and Trivedi, K. S. "Analysis of software rejuvenation using Markov Regenerative Stochastic Petri Net." ISSRE 1995 (link)

  • Garg, S., Van Moorsel, A., Vaidyanathan, K., and Trivedi, K. S. "A methodology for detection and estimation of software aging." ISSRE 1998 (link)

  • Cotroneo, D., Natella, R., Pietrantuono, R., and Russo, S. "Software aging analysis of the Linux operating system." ISSRE 2010 (link)