de Rigo, D., 2013. Software Uncertainty in Integrated Environmental Modelling: the role of Semantics and Open Science.Geophysical Research Abstracts 15, 13292+. ISSN 1607-7962, European Geosciences Union (EGU). arXiv:1311.4762   This is the author's version of the work. The definitive version is published in the Vol. 15 of Geophysical Research Abstracts (ISSN 1607-7962) and presented at the European Geosciences Union (EGU) General Assembly 2013, Vienna, Austria, 07-12 April 2013http://www.egu2013.eu/   Software Uncertainty in Integrated Environmental Modelling: the role of Semantics and Open Science Daniele de Rigo ¹ ² ¹ European Commission, Joint Research Centre, Institute for Environment and Sustainability,Via E. Fermi 2749, I-21027 Ispra (VA), Italy ² Politecnico di Milano, Dipartimento di Elettronica e Informazione,Via Ponzio 34/5, I-20133 Milano, Italy   Excerpt: Computational aspects increasingly shape environmental sciences. Actually, transdisciplinary modelling of complex and uncertain environmental systems is challenging computational science (CS) and also the science-policy interface. Large spatial-scale problems falling within this category - i.e. wide-scale transdisciplinary modelling for environment (WSTMe) - often deal with factors (a) for which deep-uncertainty may prevent usual statistical analysis of modelled quantities and need different ways for providing policy-making with science-based support. Here, practical recommendations are proposed for tempering a peculiar - not infrequently underestimated - source of uncertainty. Software errors in complex WSTMe may subtly affect the outcomes with possible consequences even on collective environmental decision-making. Semantic transparency in CS and free software are discussed as possible mitigations. [...]     References [1] Casagrandi, R., Guariso, G., 2009. Impact of ICT in environmental sciences: A citation analysis 1990-2007. Environmental Modelling & Software 24 (7), 865-871. DOI:10.1016/j.envsoft.2008.11.013 [2] de Rigo, D., (exp.) 2013. Behind the horizon of reproducible integrated environmental modelling at European scale: ethics and practice of scientific knowledge freedom. F1000 Research. Submitted[3] Gomes, C. P 2009. Computational sustainability: Computational methods for a sustainable environment, economy, and society. The Bridge 39 (4), 5-13. http://www.nae.edu/File.aspx?id=17673[4] Easterbrook, S. M., Johns, T. C., 2009. Engineering the software for understanding climate change. Computing in Science & Engineering 11 (6), 65-74. DOI:10.1109/MCSE.2009.193[5] Hamarat, C., Kwakkel, J. H., Pruyt, E., 2012. Adaptive robust design under deep uncertainty. Technological Forecasting and Social Change. DOI:10.1016/j.techfore.2012.10.004[6] Bankes, S. C., 2002. Tools and techniques for developing policies for complex and uncertain systems. Proceedings of the National Academy of Sciences of the United States of America 99 (Suppl 3), 7263-7266. DOI:10.1073/pnas.092081399[7] Kandlikar, M., Risbey, J., Dessai, S., 2005. Representing and communicating deep uncertainty in climate-change assessments. Comptes Rendus Geoscience 337 (4), 443-455. DOI:10.1016/j.crte.2004.10.010 [8] de Rigo, D., Corti, P Caudullo, G., McInerney, D., Di Leo, M., San-Miguel-Ayanz, J., 2013. Toward Open Science at the European scale: Geospatial Semantic Array Programming for Integrated Environmental Modelling. Geophysical Research Abstracts 15, 13245+ DOI:10.6084/m9.figshare.155703[9] Rodriguez Aseretto, D., Di Leo, M., de Rigo, D., Corti, P., McInerney, D., Camia, A., San Miguel-Ayanz, J., 2013. Free and Open Source Software underpinning the European Forest Data Centre. Geophysical Research Abstracts 15, 12101+ DOI:10.6084/m9.figshare.155700[10] de Rigo, D., Corti, P Caudullo, G., McInerney, D., Di Leo, M., San-Miguel-Ayanz, J., (exp.) 2013. Supporting Environmental Modelling and Science-Policy Interface at European Scale with Geospatial Semantic Array Programming. In prep.[11] Lempert, R. J., 2002. A new decision sciences for complex systems. Proceedings of the National Academy of Sciences of the United States of America 99 (Suppl 3), 7309-7313. DOI:10.1073/pnas.082081699[12] Gober, P Kirkwood, C. W., 2010. Vulnerability assessment of climate-induced water shortage in Phoenix. Proceedings of the National Academy of Sciences 107 (50), 21295-21299. DOI:10.1073/pnas.0911113107[13] de Rigo, D., 2012. Semantic Array Programming for Environmental Modelling: Application of the Mastrave library. In: Seppelt, R., Voinov, A. A., Lange, S., Bankamp, D. (Eds.), International Environmental Modelling and Software Society (iEMSs) 2012 International Congress on Environmental Modelling and Software. Managing Resources of a Limited Planet: Pathways and Visions under Uncertainty, Sixth Biennial Meeting. pp. 1167-1176. http://www.iemss.org/iemss2012/proceedings/D3_1_0715_deRigo.pdf[14] de Rigo, D., 2012. Semantic Array Programming with Mastrave - Introduction to Semantic Computational Modelling. http://mastrave.org/doc/MTV-1.012-1 [15] Free Software Foundation, 2012. What is free software? http://www.gnu.org/philosophy/free-sw.html (revision 1.118 archived at http://www.webcitation.org/6DXqCFAN3 )[16] Stallman, R. M., 2009. Viewpoint: Why "open source" misses the point of free software. Communications of the ACM 52 (6), 31-33. DOI:10.1145/1516046.1516058 (free access version: http://www.gnu.org/philosophy/open-source-misses-the-point.html )[17] de Rigo, D., 2012. Integrated Natural Resources Modelling and Management: minimal redefinition of a known challenge for environmental modelling. Excerpt from the Call for a shared research agenda toward scientific knowledge freedom, Maieutike Research Initiative. http://www.citeulike.org/groupfunc/15400/home[18] Morin, A., Urban, J., Adams, P D., Foster, I., Sali, A., Baker, D., Sliz, P., 2012. Shining light into black boxes. Science 336 (6078), 159-160. DOI:10.1126/science.1218263[19] Lempert, R., Schlesinger, M. E., 2001. Climate-change strategy needs to be robust. Nature 412 (6845), 375. DOI:10.1038/35086617[20] Shell, K. M., 2012. Constraining cloud feedbacks. Science 338 (6108), 755-756. DOI:10.1126/science.1231083[21] van der Sluijs, J. P 2012. Uncertainty and dissent in climate risk assessment: A Post-Normal perspective. Nature and Culture 7 (2), 174-195. DOI:10.3167/nc.2012.070204[22] Lenton, T. M., Held, H., Kriegler, E., Hall, J. W., Lucht, W., Rahmstorf, S., Schellnhuber, H. J., 2008. Tipping elements in the earth’s climate system. Proceedings of the National Academy of Sciences 105 (6), 1786-1793. DOI:10.1073/pnas.0705414105[23] Hastings, A., Wysham, D. B., 2010. Regime shifts in ecological systems can occur with no warning. Ecology Letters 13 (4), 464-472. DOI:10.1111/j.1461-0248.2010.01439.x[24] Barnosky, A. D., Hadly, E. A., Bascompte, J., Berlow, E. L., Brown, J. H., Fortelius, M., Getz, W. M., Harte, J., Hastings, A., Marquet, P A., Martinez, N. D., Mooers, A., Roopnarine, P., Vermeij, G., Williams, J. W., Gillespie, R., Kitzes, J., Marshall, C., Matzke, N., Mindell, D. P., Revilla, E., Smith, A. B., 2012. Approaching a state shift in earth’s biosphere. Nature 486 (7401), 52-58. DOI:10.1038/nature11018[25] Milly, P C. D., Betancourt, J., Falkenmark, M., Hirsch, R. M., Kundzewicz, Z. W., Lettenmaier, D. P., Stouffer, R. J., 2008. Stationarity is dead: Whither water management? Science 319 (5863), 573-574. DOI:10.1126/science.1151915[26] Sloan, S., Pelletier, J., 2012. How accurately may we project tropical forest-cover change? A validation of a forward-looking baseline for REDD. Global Environmental Change 22 (2), 440-453. DOI:10.1016/j.gloenvcha.2012.02.001[27] Nabuurs, G. J., van Putten, B., Knippers, T. S., Mohren, G. M. J., 2008. Comparison of uncertainties in carbon sequestration estimates for a tropical and a temperate forest. Forest Ecology and Management 256 (3), 237-245. DOI:10.1016/j.foreco.2008.04.010[28] Green, D. G., Sadedin, S., 2005. Interactions matter – complexity in landscapes and ecosystems. Ecological Complexity 2 (2), 117-130. DOI:10.1016/j.ecocom.2004.11.006[29] Baker, R., Koch, F., Kriticos, D., Rafoss, T., Venette, R., van der Werf, W. (Eds.), 2012. Advancing risk assessment models for invasive alien species in the food chain: contending with climate change, economics and uncertainty. Bioforsk FOKUS 7. Bioforsk, Frederik A. Dahls vei 20, 1432 Ås, Norway. http://www.pestrisk.org/2012/BioforskFOKUS7-10_IPRMW-VI.pdf[30] de Rigo, D., Caudullo, G., San-Miguel-Ayanz, J., Stancanelli, G., 2012. Mapping European forest tree species distribution to support pest risk assessment. In: Baker, R., Koch, F., Kriticos, D., Rafoss, T., Venette, R., van der Werf, W. (Eds.), Advancing risk assessment models for invasive alien species in the food chain: contending with climate change, economics and uncertainty. Bioforsk FOKUS 7. Bioforsk, Frederik A. Dahls vei 20, 1432 ås, Norway. http://www.pestrisk.org/2012/BioforskFOKUS7-10_IPRMW-VI.pdf[31] Thompson, I., Mackey, B., McNulty, S., Mosseler, A., 2009. Forest resilience, biodiversity, and climate change: a synthesis of the biodiversity/resilience/stability relationship in forest ecosystems. Vol. 43 of Technical Series. Secretariat of the Convention on Biological Diversity. ISBN: 9292251376[32] Center for International Forestry Research., FAO Regional Office for Asia and the Pacific, 2005. Forests and floods: drowning in fiction or thriving on facts? Center for International Forestry Research; Food and Agriculture Organization of the United Nations, Regional Office for Asia and the Pacific. http://www.worldcat.org/isbn/9793361646[33] Bonan, G. B., 2008. Forests and climate change: Forcings, feedbacks, and the climate benefits of forests. Science 320 (5882), 1444-1449. DOI:10.1126/science.1155121[34] Ferreira, L., Constantino, M. F., Borges, J. G., Garcia-Gonzalo, J., 2012. A stochastic dynamic programming approach to optimize Short-Rotation coppice systems management scheduling: An application to eucalypt plantations under wildfire risk in portugal. Forest Science, 353-365. DOI:10.5849/forsci.10-084[35] de Rigo, D., Rizzoli, A. E., Soncini-Sessa, R., Weber, E., Zenesi, P., 2001. Neuro-dynamic programming for the efficient management of reservoir networks. In: Proceedings of MODSIM 2001, International Congress on Modelling and Simulation. Vol. 4. Modelling and Simulation Society of Australia and New Zealand, pp. 1949-1954. DOI:10.5281/zenodo.7481[36] Bond, C. A., Champ, P Meldrum, J., Schoettle, A., 2011. Investigating the optimality of proactive management of an invasive forest pest. In: Keane, R. E., Tomback, D. F., Murray, M. P., Smith, C. M. (Eds.), The future of high-elevation, five-needle white pines in Western North America: Proceedings of the High Five Symposium. U.S. Department of Agriculture, Forest Service, Rocky Mountain Research Station, pp. 295-302. http://www.treesearch.fs.fed.us/pubs/38241[37] de Rigo, D., Castelletti, A., Rizzoli, A. E., Soncini-Sessa, R., Weber, E., 2005. A selective improvement technique for fastening neuro-dynamic programming in water resources network management. In: Zítek, P (Ed.), Proceedings of the 16th IFAC World Congress. Vol. 16. International Federation of Automatic Control (IFAC), pp. 7-12. DOI:10.3182/20050703-6-CZ-1902.02172[38] Phillis, Y. A., Kouikoglou, V. S., 2012. System-of-Systems hierarchy of biodiversity conservation problems. Ecological Modelling 235-236, 36-48. DOI:10.1016/j.ecolmodel.2012.03.032[39] Cavallo, A., Nardo, A., 2008. Optimal fuzzy management of reservoir based on genetic algorithm. In: Lowen, R., Verschoren, A. (Eds.), Foundations of Generic Optimization. Vol. 24 of Mathematical Modelling: Theory and Applications. Springer Netherlands, pp. 139-159. DOI:10.1007/978-1-4020-6668-9_2[40] Castelletti, A., de Rigo, D., Tepsich, L., Soncini-Sessa, R., Weber, E., 2008. On-Line design of water reservoir policies based on inflow prediction. In: Myung, C., Misra, P. (Eds.), Proceedings of the 17th IFAC World Congress. Vol. 17. International Federation of Automatic Control (IFAC), pp. 14540-14545. DOI:10.3182/20080706-5-KR-1001.02463[41] Kempeneers, P Sedano, F., Seebach, L. M., Strobl, P., San-Miguel-Ayanz, J., 2011. Data fusion of different spatial resolution remote sensing images applied to Forest-Type mapping. IEEE Transactions on Geoscience and Remote Sensing 49 (12), 4977-4986. DOI:10.1109/TGRS.2011.2158548[42] Sedano, F., Kempeneers, P Strobl, P McInerney, D., San-Miguel-Ayanz, J., 2012. Increasing Spatial Detail of Burned Scar Maps Using IRSâASAWiFS Data for Mediterranean Europe. Remote Sensing 4 (3), 726-744. DOI:10.3390/rs4030726[43] de Rigo, D., Bosco, C., 2011. Architecture of a Pan-European Framework for Integrated Soil Water Erosion Assessment. IFIP Advances in Information and Communication Technology 359, 310-318. DOI:10.1007/978-3-642-22285-6_34[44] Voinov, A., Shugart, H. H., 2013. ’Integronsters’, integral and integrated modeling. Environmental Modelling & Software 39, 149-158. DOI:10.1016/j.envsoft.2012.05.014[45] Mendoza, G. A., Martins, H., 2006. Multi-criteria decision analysis in natural resource management: A critical review of methods and new modelling paradigms. Forest Ecology and Management 230 (1-3), 1-22. DOI:10.1016/j.foreco.2006.03.023[46] O’Farrell, P J., Anderson, P M. L., 2010. Sustainable multifunctional landscapes: a review to implementation. Current Opinion in Environmental Sustainability 2 (1-2), 59-65. DOI:10.1016/j.cosust.2010.02.005[47] Dale, V. H., Beyeler, S. C., 2001. Challenges in the development and use of ecological indicators. Ecological Indicators 1 (1), 3-10. DOI:10.1016/S1470-160X(01)00003-6[48] Gilbert, N., 2010. Balancing water supply and wildlife. Nature. DOI:10.1038/news.2010.505[49] Barnes, N., Jones, D., 2011. Clear climate code: Rewriting legacy science software for clarity. Software, IEEE 28 (6), 36-42. DOI:10.1109/MS.2011.113[50] Sanders, R., Kelly, D., 2008. Dealing with risk in scientific software development. Software, IEEE 25 (4), 21-28. DOI:10.1109/MS.2008.84[51] Cerf, V. G., 2012. Where is the science in computer science? Commun. ACM 55 (10), 5. DOI:10.1145/2347736.2347737 [52] Pincas, U., 2011. Program verification and functioning of operative computing revisited: How about mathematics engineering? Minds and Machines 21 (2), 337-359. DOI:10.1007/s11023-011-9237-z[53] Sanders, P 2009. Algorithm engineering – an attempt at a definition. In: Albers, S., Alt, H., Näher, S., (Eds.), Efficient Algorithms. Vol. 5760 of Lecture Notes in Computer Science. Springer Berlin Heidelberg, pp. 321-340. DOI:10.1007/978-3-642-03456-5_22[54] Kleiner, K., 2011. Data on demand. Nature Climate Change 1 (1), 10-12. DOI:10.1038/nclimate1057[55] Nature, 2011. Devil in the details. Nature 470 (7334), 305-306. DOI:10.1038/470305b[56] Peng, R. D., 2011. Reproducible research in computational science. Science 334 (6060), 1226-1227.DOI:10.1126/science.1213847[57] Cai, Y., Judd, K. L., Lontzek, T. S., 2012. Open science is necessary. Nature Climate Change 2 (5), 299.DOI:10.1038/nclimate1509[58] Ghisla, A., Rocchini, D., Neteler, M., Förster, M., Kleinschmit, B., 2012. Species distribution modelling and open source GIS: why are they still so loosely connected? In: Seppelt, R., Voinov, A. A., Lange, S., Bankamp, D. (Eds.), International Environmental Modelling and Software Society (iEMSs) 2012 International Congress on Environmental Modelling and Software. Managing Resources of a Limited Planet: Pathways and Visions under Uncertainty, Sixth Biennial Meeting. pp. 1481-1488.[59] Iverson, K. E., 1980. Notation as a tool of thought. Communications of the ACM 23 (8), 444-465.http://awards.acm.org/images/awards/140/articles/9147499.pdf[60] Lehman, M. M., 1989. Uncertainty in computer application and its control through the engineering of software. J. Softw. Maint: Res. Pract. 1 (1), 3-27. DOI:10.1002/smr.4360010103[61] Lehman, M. M., Ramil, J. F., 2002. Software uncertainty. In: Bustard, D., Liu, W., Sterritt, R. (Eds.), Soft-Ware 2002: Computing in an Imperfect World. Vol. 2311 of Lecture Notes in Computer Science. Springer Berlin / Heidelberg, Ch. 14, pp. 477-514. DOI:10.1007/3-540-46019-5_14[62] Hook, D., Kelly, D., 2009. Testing for trustworthiness in scientific software. In: Software Engineering for Computational Science and Engineering, 2009. SECSE ’09. ICSE Workshop on. IEEE, Washington, DC, USA, pp. 59-64. DOI:10.1109/SECSE.2009.5069163[63] Hatton, L., 2007. The chimera of software quality. Computer 40 (8), 104-103. DOI:10.1109/MC.2007.292 [64] Hatton, L., 1997. The t experiments: errors in scientific software. Computational Science & Engineering, IEEE 4 (2), 27-38. DOI:10.1109/99.609829[65] Hatton, L., 2012. Defects, scientific computation and the scientific method uncertainty quantification in scientific computing. IFIP Advances in Information and Communication Technology 377, 123-138. DOI:10.1007/978-3-642-32677-6_8[66] Lehman, M. M., 1996. Laws of software evolution revisited software process technology. In: Montangero, C. (Ed.), Software Process Technology. Vol. 1149 of Lecture Notes in Computer Science. Springer Berlin/Heidelberg, Ch. 12, pp. 108-124. DOI:10.1007/BFb0017737[67] Oberkampf, W. L., DeLand, S. M., Rutherford, B. M., Diegert, K. V., Alvin, K. F., 2002. Error and uncertainty in modeling and simulation. Reliability Engineering & System Safety 75 (3), 333-357. DOI:10.1016/S0951-8320(01)00120-X[68] Wilson, G., 2006. Where’s the real bottleneck in scientific computing? American Scientist 94 (1), 5+. DOI:10.1511/2006.1.5[69] Rebaudengo, M., Reorda, M., Violante, M., 2011. Software-Level Soft-Error mitigation techniques. In: Nicolaidis, M. (Ed.), Soft Errors in Modern Electronic Systems. Vol. 41 of Frontiers in Electronic Testing. Springer US, pp. 253-285. DOI:10.1007/978-1-4419-6993-4_9[70] Beaudette, D., 2008. Simple comparison of two Least-Cost path approaches. In: Open Source Software Tools for Soil Scientists. http://casoilresource.lawr.ucdavis.edu/drupal/node/544 (archived at: http://www.webcitation.org/6D0LHBRXW )