International Journal of Web Applications

DLINE Journals portal

Home

New Journals

Browse Journals

Journal Prices

For Authors

Print ISSN: 0974-7710
Online ISSN: 0974-7729

About IJWA
	Aims & Scope Editorial Board Contact us Current Issue Next Issue Previous Issue Sample Issue Be a Reviewer Publisher Subscription

How To Order
	Order Online Price Information Request for Complimentary Print Copy

For Authors
	Guidelines for Contributors Online Submission Call for Papers Author Rights

RELATED JOURNALS

Journal of Digital Information Management (JDIM)

Journal of E-Technology(JET)

International Journal of Web Applications

An Analytical Study of Geoscience Conference Research for Understanding the Reproducible Research

Frank O. Ostermann., Daniel NÃ¼st., Carlos Granell., Barbara Hofer., Markus Konkol
Faculty of Geo-Information Science and Earth Observation (ITC) University of Twente, Enschede The Netherlands., Institute for Geoinformatics University of MÃ¼nster Germany., Institute of New Imaging Technologies, Universitat Jaume I de CastellÃ³n Spain.,

Abstract: GeoInformation System Science research is investigated in many papers. We in this work have analysed the computational reproducibility challenges in the GIScience conference papers. We have used a rubric for monitoring the reproducibility of 75 conference papers published in the GIScience conferences. We have also compared the results of the GIScience papers with the earlier similar studies. We found that the reproducibility is restricted the same set of authors and the used data cannot be reused by others. We suggest to use the earlier studies relating to reusability, quality, and openness of its research. Besides, we analysed the reflect on the process of assessing paper reproducibility, and offered solutions for improving future evaluation. We have given the code and data for this research https://doi.org/10.5281/zenodo.4032875.

Keywords: Reproducible Research, Geoinformation Science, GIS Conference Papers An Analytical Study of Geoscience Conference Research for Understanding the Reproducible Research

DOI:https://doi.org/10.6025/ijwa/2021/13/4/105-118

Full_Text PDF 1.69 MB Download: 74 times

References:

[1] Archmiller, Althea A., Johnson, Andrew D., Nolan, Jane., Edwards, Margaret., Elliott, Lisa H. Ferguson, Jake M., Juliana Vélez, Fabiola Iannarilli., Vitense, Kelsey., Johnson, Douglas H., Fieberg, John. (2020). Computational Reproducibility in The Wildlife Society’s Flagship Journals. The Journal of Wildlife Management, 84 (5) 1012–1017. doi:10.1002/jwmg.21855.
[2] Barba, Lorena A. (2018). Terminologies for Reproducible Research. arXiv:1802.03311 [cs], 2018. arXiv: 1802.03311. URL: https:/ /arxiv.org/abs/1802.03311.
[3] Brunsdon, Chris. (2016). Quantitative methods I: Reproducible research and quantitative geography. Progress in Human Geography, 40 (5) 687–696. doi:10.1177/0309132515599625.
[4] Brunsdon, Chris., Comber, Alexis. (2020). Opening practice: supporting reproducibility and critical spatial data science. Journal of Geographical Systems, August. doi:10.1007/s10109-020-00334-2.
[5] Colavizza, Giovanni., Hrynaszkiewicz, Iain., Staden, Isla., Whitaker, Kirstie., Mc-Gillivray, Barbara. (2020). The citation advantage of linking publications to research data. PLOS ONE, 15 (4), e0230416, 2020. doi:10.1371/journal.pone.0230416.
[6] Donoho, David L. (2014). An invitation to reproducible computational research. Biostatistics,11(3) 385–388, July 2010. doi:10.1093/ biostatistics/kxq028. Ostermann, F. O., Nüst, D., Granell, C., Hofer, B., Konkol, M. (2014). 2:15
[7] Duckham, Matt., Pebesma, Edzer., Stewart, Kathleen., Frank, Andrew U. (2014). editors. Geographic Information Science. Springer International Publishing, 2014. doi:10.1007/978-3-319-11593-1.
[8] Egenhofer, M., Clarke, K., Gao, S. (2016). Teriitutea Quesnot, W. Franklin, M. Yuan, and David Coleman. Contributions of GIScience over the past twenty years. In Harlan Onsrud and Werner Kuhn, editors, Advancing Geographic InformationScience: The Past and Next Twenty Years. GSDI Association Press, Needham, MA, 2016. URL: http://www.gsdiassociation.org/images/ publications/AdvancingGIScience.pdf.
[9] Eglen, Stephen., Nüst, Daniel. (2019). CODECHECK: An open-science initiative to facilitate sharing of computer programs and results presented in scientific publications. Septentrio Conference Series, (1). doi:10.7557/5.4910.
[10] Freire, Juliana., Fuhr, Norbert., Rauber, Andreas. (2016). Reproducibility of Data-Oriented Experiments in e-Science (Dagstuhl Seminar 16041). Dagstuhl Reports, 6 (1) 108–159. doi:10.4230/DagRep.6.1.108.
[11] Goodchild, Michael F. (1992). Geographical information science. International journal of geographical information systems, 6 (1) 31–45. doi:10.1080/02693799208901893.
[12] Katz, Daniel S., Chue Hong, Neil P., Clark, Tim., Muench, August., Stall, Shelley., Bouquin, Daina., Cannon, Matthew., Edmunds, Scott., Faez, Telli., Feeney, Patricia., Fenner, Martin., Riedman, Michael., Grenier, Gerry., Harrison, Melissa., Heber, Joerg., Leary, Adam., MacCallum, Catriona., Murray, Hollydawn., Pastrana, Erika., Perry, Katherine., Schuster, Douglas., Stockhause, Martina., Yeston, Jake. (2021). Recognizing the value of software: a software citation guide. F1000Research, 9:1257, January 2021. doi:10.12688/f1000research.26932.2.
[13] Kedron, Peter., Li, Wenwen., Fotheringham, Stewart., Goodchild, Michael. (2020). Reproducibility and replicability: opportunities and challenges for geospatial research. International Journal of Geographical Information Science, 0 (0): 1–19, 2020. Publisher: Taylor & Francis _eprint: https://doi.org/10.1080/13658816.2020.1802032. doi:10.1080/13658816.2020.1802032.
[14] Kemp, Karen., Kuhn, Waren., Brox, Christoph. (2013). Results of a survey to rate GIScience publication outlets. Technical report, AGILE Initiative - GIScience Publication Rating. URL: https://agile-online.org/conference_paper/images/initiatives/ results_of_a_ survey_to_rate_giscience_publications.pdf.
[15] Keßler, Carsten., Janowicz, Krzysztof., Kauppinen, Tomi. (2012). spatial@linkedscience – Exploring the Research Field of GIScience with Linked Data. In Ningchuan Xiao, Mei-Po Kwan, Michael F. Goodchild, and Shashi Shekhar, editors, Geographic Information Science, Lecture Notes in Computer Science, pages 102–115, Berlin, Heidelberg. Springer. doi:10.1007/ 978-3-642- 33024-7_8.
[16] Konkol, Markus., Kray, Christian., Pfeiffer, Max. (2019). Computational reproducibility in geoscientific papers: Insights from a series of studies with geoscientists and a reproduction study. International Journal of Geographical Information Science, 33 (2), 408–429, February 2019. doi:10.1080/13658816.2018.1508687.
[17] Kray, Christian., Pebesma, Edzer., Konkol, Markus., Nüst, Daniel. (2019). Reproducible Research in Geoinformatics: Concepts, Challenges and Benefits (Vision Paper). In Sabine Timpf, Christoph Schlieder, Markus Kattenbeck, Bernd Ludwig, and Kathleen Stewart, editors, COSIT 2019, volume 142 of LIPIcs, pages 8:1–8:13. Schloss Dagstuhl Leibniz-Zentrum für Informatik. doi:10.4230/ LIPIcs.COSIT.8.
[18] Lawrence., Bryan., Jones, Catherine., Matthews., Brian., Pepler., Sam., and Callaghan., Sarah. (2011). Citation and Peer Review of Data: Moving Towards Formal Data Publication. International Journal of Digital Curation, 6 (2).
[19] Markowetz, Florian. (2015). Five selfish reasons to work reproducibly. Genome Biology, 16: 274. doi:10.1186/s13059-015-0850- 7.
[20] Miller, Jennifer A . (2016). 'Sullivan, David O., Wiegand, Nancy. (2016). editors. Geographic Information Science. Springer International Publishing, 2016. doi:10.1007/978-3-319-45738-3.
[21] Muenchow, Jannes., Schäfer, Susann., Krüger. (2019). Reviewing qualitative GIS research—Toward a wider usage of opensource GIS and reproducible research practices. Geography Compass, 13 (6), e12441, 2019. doi:10.1111/gec3.12441.
[22] Munafò, Marcus R., Nosek, Brian A., Bishop, Dorothy V. M., Button, Katherine S., Chambers, Christopher D., Sert, Nathalie Percie du., Simonsohn, Uri., Wagenmakers, Eric-Jan., Ware, Jennifer J., Ioannidis, John P. A. (2017). A manifesto for reproducible science. Nature Human Behaviour, 1:0021, January 2017. doi:10.1038/s41562-016-0021.
[23] Nosek, Brian A., Errington, Timothy M. (2020). What is replication? PLOS Biology, 18 (3): e3000691, March. doi:10.1371/ journal.pbio.3000691.
[24] Nüst, Daniel., Ostermann, Frank., Sileryte, Rusne., Hofer, Barbara., Granell, Carlos., Teperek, Marta., Graser, Anita., Broman, Karl., Hettne, Kristina. (2019). AGILE Reproducible Paper Guidelines, 2019. doi:10.17605/OSF.IO/CB7Z8.
[25] Nüst, Daniel., Ostermann, Frank., Sileryte, Rusne., Hofer, Barbara., Granell, Carlos., Teperek, Marta., Graser, Anita., Broman, Karl., Hettne, Kristina. (2019). Reproducible Publications at AGILE Conferences, 2019. doi:10.17605/OSF.IO/PHMCE.
[26] Nüst, Daniel., Granell, Carlos., Hofer, Barbara., Konkol, Markus., Ostermann, Frank O., Sileryte, Rusne., Cerutti, Valentina., (2018). Reproducible research and GIScience: an evaluation using AGILE conference papers. PeerJ, 6:e5072, 2018. doi:10.7717/ peerj.5072.
[27] Nüst, Daniel., Ostermann, Frank., Granell, Carlos., Hofer, Barbara. (2020). Reproducibility package for Reproducible Research and GIScience: an evaluation using GIScience conference papers, September. doi:10.5281/zenodo.4032875.0
[28] Nüst, Daniel., Ostermann, Frank., Granell, Carlos., Kmoch, Alexander. (2020). Improving reproducibility of geospatial conference papers – lessons learned from a first implementation of reproducibility reviews. Septentrio Conference Series, (4), September 2020. doi:10.7557/5.5601.
[29] Ostermann, Frank O. (2021). Linking Geosocial Sensing with the Socio-Demographic Fabric of Smart Cities. ISPRS International Journal of Geo-Information, 10 (2) 52, January 2021. doi:10.3390/ijgi10020052.
[30] Peng, Roger D. (2011). Reproducible Research in Computational Science. Science, 334 (6060) 1226– 1227, December. doi:10.1126/ science.1213847.
[31] Peng, Roger D., Hicks, Stephanie C. (2020). Reproducible Research: A Retrospective. arXiv:2007.12210 [stat], July 2020. arXiv: 2007.12210. URL: http://arxiv.org/abs/2007.12210.
[32] Stagge, James H., Rosenberg, David E., Abdallah, Adel M, Akbar, Hadia., Attallah, Nour A., James, Ryan. (2019). Assessing data availability and research reproducibility in hydrology and water resources. Scientific Data, 6 (1), 190030, February 2019. Number: 1 Publisher: Nature Publishing Group. doi:10.1038/sdata.2019.30.
[33] Stodden, Victoria., Seiler, Jennifer., Ma, Zhaokun. (2018). An empirical analysis of journal policy effectiveness for computa tional reproducibility. In: Proceedings of the National Academy of Sciences, 115 (11) 2584–2589. doi:10.1073/pnas.1708290115.
[34] Winter, S., Griffin, A., Sester, M. (2018). Editors. Proceedings 10th International Conference on Geographic Information Science (GIScience 2018), volume 114. LIPIcs, 2018. URL: http://www.dagstuhl.de/dagpub/978-3-95977-083-5.
[35] Ningchuan, Xiao., Mei-Po, Kwan., Goodchild, Michael F., Shekhar, Shashi. (2012). Editors. Geographic Information Science. Springer Berlin Heidelberg. doi:10.1007/978-3-642-33024-7.

DLINE Journals portal