Skip to main content

Table 2 OSS evaluation indicator proposed in the prior studies. “Evaluation Indicator” denotes the used evaluation indicators for investigation, “Static” indicates whether the authors used data at a single point to represent the whole time

From: Evaluation indicators for open-source software: a review

Study Year Evaluation Indicator Static
   Project activity  
Crowston et al.(2004) 2004 Developer number Yes
   Bug fixing time  
   Download number  
   Developer type  
   Developer satisfaction  
   User satisfaction  
Crowston et al. (2003) 2003 Users’ participation Yes
   Quality  
   Project process  
   Project recognition codes  
   Developer number  
Garousi (2009) 2009 Download number No
   Bug-fixing performance  
   License type  
   Project age  
Sen (2006) 2006 Project status Yes
   Potential users  
   Project system compatibility  
   Concurrent Versioning Systems (CVS) code commit  
   Download number  
Grewal (2006) 2006 Bugs closed per month Yes
   Support requests per month  
   Number of page views  
   Add new features  
Raymond (1999) 1999 Fix bugs Yes
   Release new versions  
   Output of each contributor  
   License type  
Fershtman et al. (2004) 2004 Program language Yes
   Operating system  
   Target users  
   Ranking of activity percentile  
Lerner (2005) 2005 Developers number Yes
   Bugs or errors number  
Midha et al. (2012) 2012 Download number No
   Concurrent Versioning Systems (CVS) code commit  
Colazo (2005) 2005 Developer number Yes
   Developer contribution  
Tsay et al. (2012) 2012 Developer interest No
   Developer contribution  
   Project activity  
Subramaniam (2009) 2009 Developer interest Yes
   User interest  
   Project size  
Beecher (2008) 2008 Developer Yes
   Project activity  
   Hit number  
Comino et al. (2007) 2007 Project status Yes
Giuri et al. (2004)   Developer capability Yes
   Project age  
Schweik (2009) 2009 Project activity Yes
   Downloads number  
   Developer interest  
   Project activity  
Ghapanchi (2015) 2015 User interest Yes
   Developer pernancement  
   Developer pernancement  
Chang (2018) 2018 Developer satisfaction Yes
   Project status  
Feitelson et al. (2006) 2006 Download number Yes
Israeli and Feitelson (2007) 2007 Download number Yes
   Release new version  
Emanuel et al. (2010) 2010 Download number Yes
   Developer contribution  
Ke et al. (2011) 2011 Developer capability Yes
   User satisfaction  
Margan and Čandrlić (2015) 2015 Developer capability Yes
   Developer interest  
   Developer number  
Joy et al. (2018) 2018 Project size Yes
   Project age  
Peng (2019 2019 Connected projects Yes
   Watching number  
Crowston and Shamshurin (2017) 2017 Volume of communication Yes