Post-Hoc Pattern-Oriented Testing and Tuning of an Existing Large Model

Lessons from the Field Vole

Christopher John Topping, Trine Dalkvist, Volker Grimm

    Research output: Contribution to journalJournal articleResearchpeer-review

    Abstract

    Pattern-oriented modeling (POM) is a general strategy for modeling complex systems. In POM, multiple patterns observed at different scales and hierarchical levels are used to optimize model structure, to test and select sub-models of key processes, and for calibration. So far, POM has been used for developing new models and for models of low to moderate complexity. It remains unclear, though, whether the basic idea of POM to utilize multiple patterns, could also be used to test and possibly develop existing and established models of high complexity. Here, we use POM to test, calibrate, and further develop an existing agent-based model of the field vole (Microtus agrestis), which was developed and tested within the ALMaSS framework. This framework is complex because it includes a high-resolution representation of the landscape and its dynamics, of the individual’s behavior, and of the interaction between landscape and individual behavior. Results of fitting to the range of patterns chosen were generally very good, but the procedure required to achieve this was long and complicated. To obtain good correspondence between model and the real world it was often necessary to model the real world environment closely. We therefore conclude that post-hoc POM is a useful and viable way to test a highly complex simulation model, but also warn against the dangers of over-fitting to real world patterns that lack details in their explanatory driving factors. To overcome some of these obstacles we suggest the adoption of open-science and open-source approaches to ecological simulation modeling.
    Original languageEnglish
    JournalP L o S One
    Volume7
    Issue number9
    ISSN1932-6203
    DOIs
    Publication statusPublished - 2012

    Cite this

    Topping, Christopher John ; Dalkvist, Trine ; Grimm, Volker . / Post-Hoc Pattern-Oriented Testing and Tuning of an Existing Large Model : Lessons from the Field Vole. In: P L o S One. 2012 ; Vol. 7, No. 9.
    @article{65a5627b41394fab85a255548b1753a7,
    title = "Post-Hoc Pattern-Oriented Testing and Tuning of an Existing Large Model: Lessons from the Field Vole",
    abstract = "Pattern-oriented modeling (POM) is a general strategy for modeling complex systems. In POM, multiple patterns observed at different scales and hierarchical levels are used to optimize model structure, to test and select sub-models of key processes, and for calibration. So far, POM has been used for developing new models and for models of low to moderate complexity. It remains unclear, though, whether the basic idea of POM to utilize multiple patterns, could also be used to test and possibly develop existing and established models of high complexity. Here, we use POM to test, calibrate, and further develop an existing agent-based model of the field vole (Microtus agrestis), which was developed and tested within the ALMaSS framework. This framework is complex because it includes a high-resolution representation of the landscape and its dynamics, of the individual’s behavior, and of the interaction between landscape and individual behavior. Results of fitting to the range of patterns chosen were generally very good, but the procedure required to achieve this was long and complicated. To obtain good correspondence between model and the real world it was often necessary to model the real world environment closely. We therefore conclude that post-hoc POM is a useful and viable way to test a highly complex simulation model, but also warn against the dangers of over-fitting to real world patterns that lack details in their explanatory driving factors. To overcome some of these obstacles we suggest the adoption of open-science and open-source approaches to ecological simulation modeling.",
    author = "Topping, {Christopher John} and Trine Dalkvist and Volker Grimm",
    note = "Artikel nr. e45872",
    year = "2012",
    doi = "10.1371/journal.pone.0045872",
    language = "English",
    volume = "7",
    journal = "P L o S One",
    issn = "1932-6203",
    publisher = "Public Library of Science",
    number = "9",

    }

    Post-Hoc Pattern-Oriented Testing and Tuning of an Existing Large Model : Lessons from the Field Vole. / Topping, Christopher John; Dalkvist, Trine; Grimm, Volker .

    In: P L o S One, Vol. 7, No. 9, 2012.

    Research output: Contribution to journalJournal articleResearchpeer-review

    TY - JOUR

    T1 - Post-Hoc Pattern-Oriented Testing and Tuning of an Existing Large Model

    T2 - Lessons from the Field Vole

    AU - Topping, Christopher John

    AU - Dalkvist, Trine

    AU - Grimm, Volker

    N1 - Artikel nr. e45872

    PY - 2012

    Y1 - 2012

    N2 - Pattern-oriented modeling (POM) is a general strategy for modeling complex systems. In POM, multiple patterns observed at different scales and hierarchical levels are used to optimize model structure, to test and select sub-models of key processes, and for calibration. So far, POM has been used for developing new models and for models of low to moderate complexity. It remains unclear, though, whether the basic idea of POM to utilize multiple patterns, could also be used to test and possibly develop existing and established models of high complexity. Here, we use POM to test, calibrate, and further develop an existing agent-based model of the field vole (Microtus agrestis), which was developed and tested within the ALMaSS framework. This framework is complex because it includes a high-resolution representation of the landscape and its dynamics, of the individual’s behavior, and of the interaction between landscape and individual behavior. Results of fitting to the range of patterns chosen were generally very good, but the procedure required to achieve this was long and complicated. To obtain good correspondence between model and the real world it was often necessary to model the real world environment closely. We therefore conclude that post-hoc POM is a useful and viable way to test a highly complex simulation model, but also warn against the dangers of over-fitting to real world patterns that lack details in their explanatory driving factors. To overcome some of these obstacles we suggest the adoption of open-science and open-source approaches to ecological simulation modeling.

    AB - Pattern-oriented modeling (POM) is a general strategy for modeling complex systems. In POM, multiple patterns observed at different scales and hierarchical levels are used to optimize model structure, to test and select sub-models of key processes, and for calibration. So far, POM has been used for developing new models and for models of low to moderate complexity. It remains unclear, though, whether the basic idea of POM to utilize multiple patterns, could also be used to test and possibly develop existing and established models of high complexity. Here, we use POM to test, calibrate, and further develop an existing agent-based model of the field vole (Microtus agrestis), which was developed and tested within the ALMaSS framework. This framework is complex because it includes a high-resolution representation of the landscape and its dynamics, of the individual’s behavior, and of the interaction between landscape and individual behavior. Results of fitting to the range of patterns chosen were generally very good, but the procedure required to achieve this was long and complicated. To obtain good correspondence between model and the real world it was often necessary to model the real world environment closely. We therefore conclude that post-hoc POM is a useful and viable way to test a highly complex simulation model, but also warn against the dangers of over-fitting to real world patterns that lack details in their explanatory driving factors. To overcome some of these obstacles we suggest the adoption of open-science and open-source approaches to ecological simulation modeling.

    U2 - 10.1371/journal.pone.0045872

    DO - 10.1371/journal.pone.0045872

    M3 - Journal article

    VL - 7

    JO - P L o S One

    JF - P L o S One

    SN - 1932-6203

    IS - 9

    ER -