Jump to content

Talk:Sensitivity analysis: Difference between revisions

Page contents not supported in other languages.
From Wikipedia, the free encyclopedia
Content deleted Content added
m Archiving 1 discussion(s) to Talk:Sensitivity analysis/Archive 1) (bot
 
(29 intermediate revisions by 15 users not shown)
Line 8: Line 8:
|archive = Talk:Sensitivity analysis/Archive %(counter)d
|archive = Talk:Sensitivity analysis/Archive %(counter)d
}}
}}
{{WikiProjectBannerShell|1=
{{WPMeasure|class=B|b1=yes|b2=yes|b3=yes|b4=yes|b5=yes|importance=High}}
{{WPStatistics|class=B|importance=mid}}}}
{{talk header}}
{{talk header}}
{{backwardscopy|title=Fractional Operators with Constant and Variable Order with Application to Geo-Hydrology|year=2018}}
{{backwardscopy|title=Fractional Operators with Constant and Variable Order with Application to Geo-Hydrology|year=2018}}{{connected contributor|User1=Saltean|U1-EH=yes}}
{{WikiProject banner shell|class=B|
{{WikiProject Measurement|b1=yes|b2=yes|b3=yes|b4=yes|b5=yes|importance=High}}
{{WikiProject Statistics|importance=mid}}
}}


== Proposal for restoring some of the changes operated by [[User:MrOllie]] ==


{{edit COI|D|C}}
== Discussing a recent editing of this page by [[User talk:MrOllie]] ==


This is a suggestion for improvement of the page, following an intervention of [[User talk:MrOllie]]. In this page, as well as in the other pages he/she has visited last September, i.e. [[Sensitivity auditing]], [[Sociology of quantification]], [[Ethics of quantification]], [[Post-normal science]], [[Quantitative storytelling]] and others, the intervention could use some form of revision.
As per this page, if one cares to look at [https://scholar.google.com/citations?user=vqhLsGkAAAAJ Google Scholar] one will see that the reference that have been censored are relevant references to the discipline of sensitivity analysis – more precisely they are those with the most citations (see below). Although I did not create this page, I was deeply involved in its development, acting as the Wikipedia editor for a nascent community. The figures on the page were likewise uploaded by myself, as can [https://commons.wikimedia.org/wiki/File:Sensitivity_scheme.jpg be easily verified]. When the page became too large, I fully restructured it in 2020, for which I incurred serious problems with Wikipedia 's editors, as it seemed that I had plagiarized an existing book. Luckily, I could prove that the opposite was the case, and that it was the book that plagiarized Wikipedia. For having resolved this case, I received the encomium below.
{| style="border: 1px solid gray; background-color: #fdffe7;"
|rowspan="2" style="vertical-align:middle;" | [[File:Barnstar_of_Diligence.png|100px]]
|rowspan="2" |
|style="font-size: x-large; padding: 0; vertical-align: middle; height: 1.1em;" | '''The Barnstar of Diligence'''
|-
|style="vertical-align: middle; border-top: 1px solid gray;" | For your investigatory work on [[Sensitivity analysis]]. [[User:Kj cheetham|Kj cheetham]] ([[User talk:Kj cheetham|talk]]) 10:20, 25 August 2020 (UTC)
|}<!--Template:The Barnstar of Diligence-->
I reported the story to document my involvement in the maintenance of this page. Going back to the intervention of [[User talk:MrOllie]] on this page, I note that having removed all my articles (with my co-authors), the editor paradoxically acted as an hypothetical 'rival' academician who wanted to deface the contribution of an author and of his school. This operated a sort of ''damnatio memoriae'', totally outside academia. Removing the most cited handbooks of sensitivity analysis (see below) makes this Wikipedia page less useful for the readers and ultimately biased. Primary sources have been removed, including for the definition of global sensitivity analysis itself.
The elision of the SAMO conference series, that now foresees an 11th installment in Grenoble in 2025, likewise deprives a large community of users of an actionable piece of information – i.e. a new researcher joining the community may plan an abstract for the next conference-<ref>[https://sensitivityanalysis.org/conferences/SAMO SAMO PAGE</ref> Wikipedia being a living encyclopaedia.
Since I am certain that the intention of [[User talk:MrOllie]] was not rewrite the history of the field nor to bias Wikipedia, but only to fix a conflict of interest, I suggest a civilized solution is found to this problem, for which I welcome your suggestions. [[User:Saltean|Saltean]] ([[User talk:Saltean|talk]]) 10:18, 8 January 2024 (UTC)


Based on the above discussion in the present talk page, here is my attempt to re-establish essential references using the '''edit COI''' template. Andrea Saltelli [[User:Saltean|Saltean]] ([[User talk:Saltean|talk]]) 09:47, 19 January 2024 (UTC)
'''Input to this discussion'''


* Specific text to be added or removed: <span style="color:red">several sentences and references were added - ten references with me as co-author. The changes are motivated by the repeated interventions of [[User:MrOllie]] that have been deep and have left the page with errors. If and when the present editing are accepted, and even if they are not, the page will need housekeeping and cleaning. A solution will also need to be found for the sections that were eliminated and for which the community of sensitivity analysis practitioners<ref>SAMO Scientific Committee. 2022. “SAMO | Sensitivity Analysis of Model Output.” SAMO | Sensitivity Analysis of Model Output. 2022. https://www.sensitivityanalysis.org/.</ref> might be involved. </span>
Hello [[User:MrOllie]] and [[User:Saltean]] - I would like to give some input here as someone who has contributed quite significantly to this page, albeit some years ago.
* Reason for the change: <span style="color:red">Relevance of the proposed insertion to the page, see discussion in the present talk page</span>
* References supporting change: <span style="color:red">See in the present talk page the section entitle ''Top cited articles in sensitivity analysis'' with the number of citations </span>


[[User:MrOllie]] I understand and agree with your efforts to check self-citations. However I think this needs to be done with discretion. In this case, [[User:Saltean]] is one of the most well-known academics in the field of sensitivity analysis, so removing all citations to his work makes very little sense. I would strongly support reinstating at least some of the references mentioned below, many of which are key texts used by students and academics, as well as important papers in the history of sensitivity analysis, and add value to the page. I say this as an academic who has worked in the field for 15+ years. To be transparent, I do know [[User:Saltean]] personally, but I am intervening here on the grounds of fairness and maintaining the quality of the page. I am sure with some discussion we can find a balanced solution.
[[User:WillBecker|WillBecker]] ([[User talk:WillBecker|talk]]) 07:45, 19 January 2024 (UTC)


{{TextDiff|1=Sensitivity analysis is the study of how the uncertainty in the output of a mathematical model or system (numerical or otherwise) can be divided and allocated to different sources of uncertainty in its inputs.|2=Sensitivity analysis is the study of how the uncertainty in the output of a mathematical model or system (numerical or otherwise) can be divided and allocated to different sources of uncertainty in its inputs.<ref>Saltelli, Andrea. 2002. “Sensitivity Analysis for Importance Assessment.” In Risk Analysis, 22:579–90. https://doi.org/10.1111/0272-4332.00040.</ref>}}
:Welcome back after your 7 year absence. The balanced solution is a sample one - just respect the process for COI editors going forward. Key texts used by students and academics will likely be recognized as such even by folks who are not Saltean themself or personally acquiainted with them, and those folks should be the ones adding the citations. [[User:MrOllie|MrOllie]] ([[User talk:MrOllie|talk]]) 13:28, 19 January 2024 (UTC)


{{TextDiff|1=The process of recalculating outcomes under alternative assumptions to determine the impact of a variable under sensitivity analysis can be useful for a range of purposes,<ref name="Examples">{{cite journal |last=Pannell |first=D. J. |year=1997 |title=Sensitivity Analysis of Normative Economic Models: Theoretical Framework and Practical Strategies |journal=Agricultural Economics |volume=16 |issue= 2|pages=139–152 |doi =10.1016/S0169-5150(96)01217-0 |url=http://ageconsearch.umn.edu/record/174060/files/agec1997v016i002a005.pdf }}</ref> including:|2=The process of recalculating outcomes under alternative assumptions to determine the impact of a variable under sensitivity analysis can be useful for a range of purposes,<ref name="Examples">{{cite journal |last=Pannell |first=D. J. |year=1997 |title=Sensitivity Analysis of Normative Economic Models: Theoretical Framework and Practical Strategies |journal=Agricultural Economics |volume=16 |issue= 2|pages=139–152 |doi =10.1016/S0169-5150(96)01217-0 |url=http://ageconsearch.umn.edu/record/174060/files/agec1997v016i002a005.pdf }}</ref><ref>Saltelli, Andrea, S. Tarantola, and F. Campolongo. 2000. “Sensitivity Anaysis as an Ingredient of Modeling.” Statistical Science 15 (4): 377–95.</ref> including:}}
{{reflist-talk}}


{{TextDiff|1=In models involving many input variables, sensitivity analysis is an essential ingredient of model building and quality assurance. National and international agencies involved in [[impact assessment]] studies have included sections devoted to sensitivity analysis in their guidelines. Examples are the [[European Commission]] (see e.g. the guidelines for [[impact assessment]]),<ref name="EC_GUIDE">[https://ec.europa.eu/info/law/law-making-process/planning-and-proposing-law/better-regulation-why-and-how/better-regulation-guidelines-and-toolbox_en European Commission. 2021. “Better Regulation Toolbox.” November 25.]</ref> the White House [[Office of Management and Budget]], the [[Intergovernmental Panel on Climate Change]] and [[US Environmental Protection Agency]]'s modeling guidelines.<ref>{{Cite web |url=http://www.epa.gov/CREM/library/cred_guidance_0309.pdf |title=Archived copy |access-date=2009-10-16 |archive-date=2011-04-26 |archive-url=https://web.archive.org/web/20110426180258/http://www.epa.gov/CREM/library/cred_guidance_0309.pdf |url-status=dead }}</ref>|2=In models involving many input variables, sensitivity analysis is an essential ingredient of model building and quality assurance. National and international agencies involved in [[impact assessment]] studies have included sections devoted to sensitivity analysis in their guidelines. Examples are the [[European Commission]] (see e.g. the guidelines for [[impact assessment]]),<ref name="EC_GUIDE">[https://ec.europa.eu/info/law/law-making-process/planning-and-proposing-law/better-regulation-why-and-how/better-regulation-guidelines-and-toolbox_en European Commission. 2021. “Better Regulation Toolbox.” November 25.]</ref> the White House [[Office of Management and Budget]], the [[Intergovernmental Panel on Climate Change]] and [[US Environmental Protection Agency]]'s modeling guidelines.<ref>{{Cite web |url=http://www.epa.gov/CREM/library/cred_guidance_0309.pdf |title=Archived copy |access-date=2009-10-16 |archive-date=2011-04-26 |archive-url=https://web.archive.org/web/20110426180258/http://www.epa.gov/CREM/library/cred_guidance_0309.pdf |url-status=dead }}</ref> The practice of sensitivity analysis is described in several handbooks<ref>Saltelli, Andrea, Stefano Tarantola, Francesca Campolongo, and Marco Ratto. 2004. Sensitivity Analysis in Practice. Chichester, UK: John Wiley & Sons, Ltd. https://doi.org/10.1002/0470870958.</ref><ref name="Primer"/><ref>Da Veiga, Sébastien, Fabrice Gamboa, Bertrand Iooss, and Clémentine Prieur. 2021. Basics and Trends in Sensitivity Analysis. SIAM. https://blackwells.co.uk/bookshop/product/Basics-and-Trends-in-Sensitivity-Analysis-by-Sbastien-da-Veiga-Fabrice-Gamboa-Bertrand-Iooss-Clmentine-Prieur/9781611976687.</ref>}}
== Top cited articles in sensitivity analysis (<b>bold=number of citations</b>; only articles with more than 1,000 citations reported) ==

* Sensitivity analysis in practice: a guide to assessing scientific models, A Saltelli, S Tarantola, F Campolongo, M Ratto, Wiley, <b>9000</b>, 2004
{{TextDiff|1=There are a large number of approaches to performing a sensitivity analysis, many of which have been developed to address one or more of the constraints discussed above. They are also distinguished by the type of sensitivity measure, be it based on (for example) variance decompositions, partial derivatives or elementary effects. In general, however, most procedures adhere to the following outline:|2=There are a large number of approaches to performing a sensitivity analysis, many of which have been developed to address one or more of the constraints discussed above. They are also distinguished by the type of sensitivity measure, be it based on (for example) variance decompositions, partial derivatives or elementary effects. In general, however, most procedures adhere to the following outline:<ref name="Primer">Saltelli, Andrea, M. Ratto, T. H. Andres, F. Campolongo, J. Cariboni, D. Gatelli, M. Saisana, and S. Tarantola. 2008. Global Sensitivity Analysis : The Primer. John Wiley. https://doi.org/10.1002/9780470725184.</ref>}}
*Global sensitivity analysis: the primer, A Saltelli, M Ratto, T Andres, F Campolongo, J Cariboni, D Gatelli, ..., John Wiley & Sons, <b>7834</b>, 2008

* Variance based sensitivity analysis of model output. Design and estimator for the total sensitivity index, A Saltelli, P Annoni, I Azzini, F Campolongo, M Ratto, S Tarantola, Computer physics communications 181 (2), 259-270, <b>3051</b> 2010
{{TextDiff|1=Despite its simplicity however, this approach does not fully explore the input space, since it does not take into account the simultaneous variation of input variables. This means that the OAT approach|2=Despite its simplicity however, this approach does not fully explore the input space, since it does not take into account the simultaneous variation of input variables. For this reason OAT is not advised when the degree of linearity of a model is unknown: an OAT analysis of a possibly nonlinear and non additive model can be ''perfunctory'',<ref>Saltelli, Andrea, and Paola Annoni. 2010. ‘How to Avoid a Perfunctory Sensitivity Analysis’. Environmental Modelling & Software 25 (12): 1508–17. https://doi.org/10.1016/j.envsoft.2010.04.012.</ref> although many sensitivity analyses seen in the literature are OAT<ref>Ferretti, Federico, Andrea Saltelli, and Stefano Tarantola. 2016. ‘Trends in Sensitivity Analysis Practice in the Last Decade’. Science of The Total Environment 568 (October): 666–70. https://doi.org/10.1016/j.scitotenv.2016.02.133.</ref>. The OAT approach}}
* A quantitative model-independent method for global sensitivity analysis of model output, A Saltelli, S Tarantola, KPS Chan, Technometrics, 39-56, <b>2532</b> 1999

*Importance measures in global sensitivity analysis of nonlinear models, T Homma, A Saltelli, Reliability Engineering & System Safety 52 (1), 1-17, <b>2237</b> 1996
{{TextDiff|1=A further measure, known as the ''total effect index'',<ref>Homma, Toshimitsu, and Andrea Saltelli. 1996. ‘Importance Measures in Global Sensitivity Analysis of Nonlinear Models’. Reliability Engineering & System Safety 52 (1): 1–17. https://doi.org/10.1016/0951-8320(96)00002-6.</ref> gives the total variance in ''Y'' caused by ''X''<sub>''i''</sub> ''and'' its interactions with any of the other input variables.|2=A further measure, known as the ''total effect index'', gives the total variance in ''Y'' caused by ''X''<sub>''i''</sub> ''and'' its interactions with any of the other input variables.}}
* Making best use of model evaluations to compute sensitivity indices, A Saltelli, Computer physics communications 145 (2), 280-297, <b>2196</b> 2002
*An effective screening design for sensitivity analysis of large models, F Campolongo, J Cariboni, A Saltelli, Environmental modelling & software 22 (10), 1509-1518, <b>2052</b> 2007
{{TextDiff|1=The Fourier amplitude sensitivity test (FAST) uses the [[Fourier series]] to represent a multivariate function (the model) in the frequency domain, using a single frequency variable. Therefore, the integrals required to calculate sensitivity indices become univariate, resulting in computational savings.
* Sensitivity analysis for importance assessment, A Saltelli, Risk analysis 22 (3), 579-590, <b>1478</b> 2002
|2=The Fourier amplitude sensitivity test (FAST) uses the [[Fourier series]] to represent a multivariate function (the model) in the frequency domain, using a single frequency variable. Therefore, the integrals required to calculate sensitivity indices become univariate, resulting in computational savings. FAST can be used to compute both the first order and the total effect sensitivity index.<ref>Saltelli, Andrea, S. Tarantola, and K. P.-S. Chan. 1999. “A Quantitative Model-Independent Method for Global Sensitivity Analysis of Model Output.” Technometrics 41 (1): 39–56. https://doi.org/10.1080/00401706.1999.10485594.</ref>}}
*Sensitivity analysis as an ingredient of modeling, A Saltelli, S Tarantola, F Campolongo, Statistical science, 377-395, <b>1127</b> 2000

* How to avoid a perfunctory sensitivity analysis, A Saltelli, P Annoni, Environmental Modelling & Software 25 (12), 1508-1517, <b>1124</b> 2010
{{TextDiff|1=In order to take these concerns into due consideration the instruments of SA have been extended to provide an assessment of the entire knowledge and model generating process. This approach has been called 'sensitivity auditing'.
Andrea Saltelli [[User:Saltean|Saltean]] ([[User talk:Saltean|talk]]) 10:18, 8 January 2024 (UTC)
|2=In order to take these concerns into due consideration the instruments of SA have been extended to provide an assessment of the entire knowledge and model generating process. This approach has been called 'sensitivity auditing'.<ref>Saltelli, Andrea, Ângela; Guimaraes Pereira, Jeroen P. van der Sluijs, and Silvio Funtowicz. 2013. “What Do I Make of Your Latinorumc Sensitivity Auditing of Mathematical Modelling.” International Journal of Foresight and Innovation Policy 9 (2/3/4): 213–34. https://doi.org/10.1504/IJFIP.2013.058610.</ref>
}}

{{TextDiff|1=Sensitivity analysis is closely related with uncertainty analysis; while the latter studies the overall [[uncertainty]] in the conclusions of the study, sensitivity analysis tries to identify what source of uncertainty weighs more on the study's conclusions.|2=Sensitivity analysis is closely related with uncertainty analysis; while the latter studies the overall [[uncertainty]] in the conclusions of the study, sensitivity analysis tries to identify what source of uncertainty weighs more on the study's conclusions.<ref name="Primer"/> Sensitivity and analysis can be combined together when using approached such as [[Simulation decomposition|SimDec]].}}

{{TextDiff|1=Variance-based methods allow full exploration of the input space, accounting for interactions, and nonlinear responses. For these reasons they are widely used when it is feasible to calculate them. Typically this calculation involves the use of [[Monte Carlo integration|Monte Carlo]] methods, but since this can involve many thousands of model runs, other methods (such as emulators) can be used to reduce computational expense when necessary.|2=Variance-based methods allow full exploration of the input space, accounting for interactions, and nonlinear responses. For these reasons they are widely used when it is feasible to calculate them. Typically this calculation involves the use of [[Monte Carlo integration|Monte Carlo]] methods, but since this can involve many thousands of model runs, other methods (such as emulators) can be used to reduce computational expense when necessary. y. The full variance decompositions are only meaningful when the input factors are independent from one another.<ref>{{cite journal | last1 = Saltelli | first1 = A. | last2 = Tarantola | first2 = S. | year = 2002 | title = On the relative importance of input factors in mathematical models: safety assessment for nuclear waste disposal | journal = Journal of the American Statistical Association | volume = 97 | issue = 459| pages = 702–709 | doi=10.1198/016214502388618447| s2cid = 59463173 }}</ref>}}

{{TextDiff|1=S|2=C}}

Among the several section suppressed by [[User:MrOllie]] the following section (indicated in in red) includes the method of Morris that is one of the most widely used in sensitivity analysis. I propose to reinstate it as it was ''verbatim'' inserting it as a new section (as before) with a modified title: ''Morris Method''.

<span style="color:red">Screening is a particular instance of a sampling-based method. The objective here is rather to identify which input variables are contributing significantly to the output uncertainty in high-dimensionality models, rather than exactly quantifying sensitivity (i.e. in terms of variance). Screening tends to have a relatively low computational cost when compared to other approaches, and can be used in a preliminary analysis to weed out uninfluential variables before applying a more informative analysis to the remaining set. One of the most commonly used screening method is the [[Elementary effects method|elementary effect method]].<ref>{{cite journal | last1 = Morris | first1 = M. D. | year = 1991 | title = Factorial sampling plans for preliminary computational experiments | journal = Technometrics | volume = 33 | issue = 2| pages = 161–174 | doi=10.2307/1269043| jstor = 1269043 | citeseerx = 10.1.1.584.521 }}</ref><ref>{{cite journal | last1 = Campolongo | first1 = F. | last2 = Cariboni | first2 = J. | last3 = Saltelli | first3 = A. | year = 2007 | title = An effective screening design for sensitivity analysis of large models | journal = Environmental Modelling and Software | volume = 22 | issue = 10| pages = 1509–1518 | doi=10.1016/j.envsoft.2006.10.004| s2cid = 15357037 }}</ref>
</span>

In these proposed changes I have not suppressed text from other authors. Andrea Saltelli [[User:Saltean|Saltean]] ([[User talk:Saltean|talk]]) 09:57, 19 January 2024 (UTC)

<b>References for the entire page</b> Andrea Saltelli [[User:Saltean|Saltean]] ([[User talk:Saltean|talk]]) 15:13, 19 January 2024 (UTC)

:I can try evaluate them, though i only have deep knowledge in explainable AI. [[User:BikingFish|BikingFish]] ([[User talk:BikingFish|talk]]) 19:51, 27 January 2024 (UTC)
::Thanks [[User:BikingFish]] but this is a request done under 'Conflict of Interest' template, I understand this is for Wikipedia Editors, not for Authors like us. Here a interesting paper that might interest you in case you want to discuss it on Wikipedia, in this page or elsewhere.<ref>{{cite book | vauthors=((Iooss, B.)), ((Kenett, R. S.)), ((Secchi, P.)) | date=16 October 2022 | chapter=Interpretability for Industry 4.0 : Statistical and Machine Learning Approaches | title=Different views of interpretability | publisher=Springer International Publishing | edition=Antonio Lepore, Boagio Palumbo, Jean-Michel Poggi | isbn=978-3-031-12401-3}}</ref> Andrea Saltelli [[User:Saltean|Saltean]] ([[User talk:Saltean|talk]]) 11:18, 31 January 2024 (UTC)

*'''Comment''' - the section below is related to this request. [[User:STEMinfo|<span style="color: red;">STEM</span><span style="color: green;">info</span>]] ([[User talk:STEMinfo|talk]]) 23:53, 27 March 2024 (UTC)
*I am marking this request as declined. {{u|Saltean}}, you have been told before that repeatedly asking for the removals to be reverted and appealing to your position as the leading academic on the subject will not convince people here. Either work on a rewrite as a draft as you were advised to at the administrators' noticeboard, or propose smaller changes that can be digested and evaluated. [[User:Snowmanonahoe|Snowmanonahoe]] ([[User talk:Snowmanonahoe|talk]] '''·''' [[Special:Contributions/Snowmanonahoe|contribs]] '''·''' [[User:Snowmanonahoe/Typos|typos]]) 19:16, 28 March 2024 (UTC)

{{reflist-talk}}

Latest revision as of 15:21, 25 May 2024

Proposal for restoring some of the changes operated by User:MrOllie

[edit]


Based on the above discussion in the present talk page, here is my attempt to re-establish essential references using the edit COI template. Andrea Saltelli Saltean (talk) 09:47, 19 January 2024 (UTC)[reply]

  • Specific text to be added or removed: several sentences and references were added - ten references with me as co-author. The changes are motivated by the repeated interventions of User:MrOllie that have been deep and have left the page with errors. If and when the present editing are accepted, and even if they are not, the page will need housekeeping and cleaning. A solution will also need to be found for the sections that were eliminated and for which the community of sensitivity analysis practitioners[1] might be involved.
  • Reason for the change: Relevance of the proposed insertion to the page, see discussion in the present talk page
  • References supporting change: See in the present talk page the section entitle Top cited articles in sensitivity analysis with the number of citations


Sensitivity analysis is the study of how the uncertainty in the output of a mathematical model or system (numerical or otherwise) can be divided and allocated to different sources of uncertainty in its inputs.
+
Sensitivity analysis is the study of how the uncertainty in the output of a mathematical model or system (numerical or otherwise) can be divided and allocated to different sources of uncertainty in its inputs.
The process of recalculating outcomes under alternative assumptions to determine the impact of a variable under sensitivity analysis can be useful for a range of purposes, including:
+
The process of recalculating outcomes under alternative assumptions to determine the impact of a variable under sensitivity analysis can be useful for a range of purposes, including:
In models involving many input variables, sensitivity analysis is an essential ingredient of model building and quality assurance. National and international agencies involved in [[impact assessment]] studies have included sections devoted to sensitivity analysis in their guidelines. Examples are the [[European Commission]] (see e.g. the guidelines for [[impact assessment]]), the White House [[Office of Management and Budget]], the [[Intergovernmental Panel on Climate Change]] and [[US Environmental Protection Agency]]'s modeling guidelines.
+
In models involving many input variables, sensitivity analysis is an essential ingredient of model building and quality assurance. National and international agencies involved in [[impact assessment]] studies have included sections devoted to sensitivity analysis in their guidelines. Examples are the [[European Commission]] (see e.g. the guidelines for [[impact assessment]]), the White House [[Office of Management and Budget]], the [[Intergovernmental Panel on Climate Change]] and [[US Environmental Protection Agency]]'s modeling guidelines. The practice of sensitivity analysis is described in several handbooks
There are a large number of approaches to performing a sensitivity analysis, many of which have been developed to address one or more of the constraints discussed above. They are also distinguished by the type of sensitivity measure, be it based on (for example) variance decompositions, partial derivatives or elementary effects. In general, however, most procedures adhere to the following outline:
+
There are a large number of approaches to performing a sensitivity analysis, many of which have been developed to address one or more of the constraints discussed above. They are also distinguished by the type of sensitivity measure, be it based on (for example) variance decompositions, partial derivatives or elementary effects. In general, however, most procedures adhere to the following outline:
Despite its simplicity however, this approach does not fully explore the input space, since it does not take into account the simultaneous variation of input variables. This means that the OAT approach
+
Despite its simplicity however, this approach does not fully explore the input space, since it does not take into account the simultaneous variation of input variables. For this reason OAT is not advised when the degree of linearity of a model is unknown: an OAT analysis of a possibly nonlinear and non additive model can be ''perfunctory'', although many sensitivity analyses seen in the literature are OAT. The OAT approach
A further measure, known as the ''total effect index'', gives the total variance in ''Y'' caused by ''X''<sub>''i''</sub> ''and'' its interactions with any of the other input variables.
+
A further measure, known as the ''total effect index'', gives the total variance in ''Y'' caused by ''X''<sub>''i''</sub> ''and'' its interactions with any of the other input variables.
The Fourier amplitude sensitivity test (FAST) uses the [[Fourier series]] to represent a multivariate function (the model) in the frequency domain, using a single frequency variable. Therefore, the integrals required to calculate sensitivity indices become univariate, resulting in computational savings.
+
The Fourier amplitude sensitivity test (FAST) uses the [[Fourier series]] to represent a multivariate function (the model) in the frequency domain, using a single frequency variable. Therefore, the integrals required to calculate sensitivity indices become univariate, resulting in computational savings. FAST can be used to compute both the first order and the total effect sensitivity index.
In order to take these concerns into due consideration the instruments of SA have been extended to provide an assessment of the entire knowledge and model generating process. This approach has been called 'sensitivity auditing'.
+
In order to take these concerns into due consideration the instruments of SA have been extended to provide an assessment of the entire knowledge and model generating process. This approach has been called 'sensitivity auditing'.
Sensitivity analysis is closely related with uncertainty analysis; while the latter studies the overall [[uncertainty]] in the conclusions of the study, sensitivity analysis tries to identify what source of uncertainty weighs more on the study's conclusions.
+
Sensitivity analysis is closely related with uncertainty analysis; while the latter studies the overall [[uncertainty]] in the conclusions of the study, sensitivity analysis tries to identify what source of uncertainty weighs more on the study's conclusions. Sensitivity and analysis can be combined together when using approached such as [[Simulation decomposition|SimDec]].
Variance-based methods allow full exploration of the input space, accounting for interactions, and nonlinear responses. For these reasons they are widely used when it is feasible to calculate them. Typically this calculation involves the use of [[Monte Carlo integration|Monte Carlo]] methods, but since this can involve many thousands of model runs, other methods (such as emulators) can be used to reduce computational expense when necessary.
+
Variance-based methods allow full exploration of the input space, accounting for interactions, and nonlinear responses. For these reasons they are widely used when it is feasible to calculate them. Typically this calculation involves the use of [[Monte Carlo integration|Monte Carlo]] methods, but since this can involve many thousands of model runs, other methods (such as emulators) can be used to reduce computational expense when necessary. y. The full variance decompositions are only meaningful when the input factors are independent from one another.
S
+
C

Among the several section suppressed by User:MrOllie the following section (indicated in in red) includes the method of Morris that is one of the most widely used in sensitivity analysis. I propose to reinstate it as it was verbatim inserting it as a new section (as before) with a modified title: Morris Method.

Screening is a particular instance of a sampling-based method. The objective here is rather to identify which input variables are contributing significantly to the output uncertainty in high-dimensionality models, rather than exactly quantifying sensitivity (i.e. in terms of variance). Screening tends to have a relatively low computational cost when compared to other approaches, and can be used in a preliminary analysis to weed out uninfluential variables before applying a more informative analysis to the remaining set. One of the most commonly used screening method is the elementary effect method.[17][18]

In these proposed changes I have not suppressed text from other authors. Andrea Saltelli Saltean (talk) 09:57, 19 January 2024 (UTC)[reply]

References for the entire page Andrea Saltelli Saltean (talk) 15:13, 19 January 2024 (UTC)[reply]

I can try evaluate them, though i only have deep knowledge in explainable AI. BikingFish (talk) 19:51, 27 January 2024 (UTC)[reply]
Thanks User:BikingFish but this is a request done under 'Conflict of Interest' template, I understand this is for Wikipedia Editors, not for Authors like us. Here a interesting paper that might interest you in case you want to discuss it on Wikipedia, in this page or elsewhere.[19] Andrea Saltelli Saltean (talk) 11:18, 31 January 2024 (UTC)[reply]
  • Comment - the section below is related to this request. STEMinfo (talk) 23:53, 27 March 2024 (UTC)[reply]
  • I am marking this request as declined. Saltean, you have been told before that repeatedly asking for the removals to be reverted and appealing to your position as the leading academic on the subject will not convince people here. Either work on a rewrite as a draft as you were advised to at the administrators' noticeboard, or propose smaller changes that can be digested and evaluated. Snowmanonahoe (talk · contribs · typos) 19:16, 28 March 2024 (UTC)[reply]

References

  1. ^ SAMO Scientific Committee. 2022. “SAMO | Sensitivity Analysis of Model Output.” SAMO | Sensitivity Analysis of Model Output. 2022. https://www.sensitivityanalysis.org/.
  2. ^ Saltelli, Andrea. 2002. “Sensitivity Analysis for Importance Assessment.” In Risk Analysis, 22:579–90. https://doi.org/10.1111/0272-4332.00040.
  3. ^ a b Pannell, D. J. (1997). "Sensitivity Analysis of Normative Economic Models: Theoretical Framework and Practical Strategies" (PDF). Agricultural Economics. 16 (2): 139–152. doi:10.1016/S0169-5150(96)01217-0.
  4. ^ Saltelli, Andrea, S. Tarantola, and F. Campolongo. 2000. “Sensitivity Anaysis as an Ingredient of Modeling.” Statistical Science 15 (4): 377–95.
  5. ^ a b European Commission. 2021. “Better Regulation Toolbox.” November 25.
  6. ^ "Archived copy" (PDF). Archived from the original (PDF) on 2011-04-26. Retrieved 2009-10-16.{{cite web}}: CS1 maint: archived copy as title (link)
  7. ^ "Archived copy" (PDF). Archived from the original (PDF) on 2011-04-26. Retrieved 2009-10-16.{{cite web}}: CS1 maint: archived copy as title (link)
  8. ^ Saltelli, Andrea, Stefano Tarantola, Francesca Campolongo, and Marco Ratto. 2004. Sensitivity Analysis in Practice. Chichester, UK: John Wiley & Sons, Ltd. https://doi.org/10.1002/0470870958.
  9. ^ a b c Saltelli, Andrea, M. Ratto, T. H. Andres, F. Campolongo, J. Cariboni, D. Gatelli, M. Saisana, and S. Tarantola. 2008. Global Sensitivity Analysis : The Primer. John Wiley. https://doi.org/10.1002/9780470725184.
  10. ^ Da Veiga, Sébastien, Fabrice Gamboa, Bertrand Iooss, and Clémentine Prieur. 2021. Basics and Trends in Sensitivity Analysis. SIAM. https://blackwells.co.uk/bookshop/product/Basics-and-Trends-in-Sensitivity-Analysis-by-Sbastien-da-Veiga-Fabrice-Gamboa-Bertrand-Iooss-Clmentine-Prieur/9781611976687.
  11. ^ Saltelli, Andrea, and Paola Annoni. 2010. ‘How to Avoid a Perfunctory Sensitivity Analysis’. Environmental Modelling & Software 25 (12): 1508–17. https://doi.org/10.1016/j.envsoft.2010.04.012.
  12. ^ Ferretti, Federico, Andrea Saltelli, and Stefano Tarantola. 2016. ‘Trends in Sensitivity Analysis Practice in the Last Decade’. Science of The Total Environment 568 (October): 666–70. https://doi.org/10.1016/j.scitotenv.2016.02.133.
  13. ^ Homma, Toshimitsu, and Andrea Saltelli. 1996. ‘Importance Measures in Global Sensitivity Analysis of Nonlinear Models’. Reliability Engineering & System Safety 52 (1): 1–17. https://doi.org/10.1016/0951-8320(96)00002-6.
  14. ^ Saltelli, Andrea, S. Tarantola, and K. P.-S. Chan. 1999. “A Quantitative Model-Independent Method for Global Sensitivity Analysis of Model Output.” Technometrics 41 (1): 39–56. https://doi.org/10.1080/00401706.1999.10485594.
  15. ^ Saltelli, Andrea, Ângela; Guimaraes Pereira, Jeroen P. van der Sluijs, and Silvio Funtowicz. 2013. “What Do I Make of Your Latinorumc Sensitivity Auditing of Mathematical Modelling.” International Journal of Foresight and Innovation Policy 9 (2/3/4): 213–34. https://doi.org/10.1504/IJFIP.2013.058610.
  16. ^ Saltelli, A.; Tarantola, S. (2002). "On the relative importance of input factors in mathematical models: safety assessment for nuclear waste disposal". Journal of the American Statistical Association. 97 (459): 702–709. doi:10.1198/016214502388618447. S2CID 59463173.
  17. ^ Morris, M. D. (1991). "Factorial sampling plans for preliminary computational experiments". Technometrics. 33 (2): 161–174. CiteSeerX 10.1.1.584.521. doi:10.2307/1269043. JSTOR 1269043.
  18. ^ Campolongo, F.; Cariboni, J.; Saltelli, A. (2007). "An effective screening design for sensitivity analysis of large models". Environmental Modelling and Software. 22 (10): 1509–1518. doi:10.1016/j.envsoft.2006.10.004. S2CID 15357037.
  19. ^ Iooss, B., Kenett, R. S., Secchi, P. (16 October 2022). "Interpretability for Industry 4.0 : Statistical and Machine Learning Approaches". Different views of interpretability (Antonio Lepore, Boagio Palumbo, Jean-Michel Poggi ed.). Springer International Publishing. ISBN 978-3-031-12401-3.