Replication Package for: "What Would Users Change in My App? Summarizing App Reviews for Recommending Software Changes"


Mobile app developers constantly monitor feedback in user reviews with the goal of improving their mobile apps and better meeting user expectations. Thus, automated approaches have been proposed in literature with the aim of reducing the effort required for analyzing feedback contained in user reviews via automatic classification (or prioritization) according to specific topics (e.g., bugs, features etc.). In this paper, we introduce SURF (Summarizer of User Reviews Feedback), a novel approach to condense the enormous amount of information that developers of popular apps have to manage due to user feedback received on a daily basis. SURF relies on a conceptual model for capturing users' needs useful for developers performing maintenance and evolution tasks. Then it uses sophisticated summarisation techniques for summarizing thousands of reviews and generating an interactive, structured and condensed agenda of recommended software changes. We performed an end-to-end evaluation of SURF on user reviews of 17 mobile apps (5 of them developed by Sony Mobile), involving in total 23 developers and researchers. Results demonstrate high accuracy of SURF in summarizing reviews and the meaningfulness of the recommended changes. In evaluating our approach we found that SURF helps developers in better understanding user needs, substantially reducing the time required by developers for manual analyzing users (change) requests and planning future software changes.




This page provides the replication package with (i) material and working data sets of our study, (ii) complete results of the survey, (iii) raw data (for replication purposes and to support future studies), and (iv) the prototypical implementation of SURF used in this research. A detailed description of the contents is included in README.txt.

Download Replication Package



Andrea Di Sorbo University of Sannio, Italy


Sebastiano Panichella University of Zurich, Switzerland


Carol V. Alexandru University of Zurich, Switzerland


Junji Shimagaki Sony Mobile Communications, Japan
Corrado A. Visaggio University of Sannio, Italy

Gerardo Canfora

University of Sannio, Italy


Harald C. Gall University of Zurich, Switzerland