Towards Overcoming the Curse of Dimensionality: The Third-Order Adjoint Method for Sensitivity Analysis of Response-Coupled Linear Forward/Adjoint Systems, with Applications to Uncertainty Quantification and Predictive Modeling
This work presents the Third-Order Adjoint Sensitivity Analysis Methodology (3rd-ASAM) for response-coupled forward and adjoint linear systems. The 3rd-ASAM enables the efficient computation of the exact expressions of the 3rd-order functional derivatives ("sensitivities") of a general system response, which depends on both the forward and adjoint state functions, with respect to all of the parameters underlying the respective forward and adjoint systems. Such responses are often encountered when representing mathematically detector responses and reaction rates in reactor physics problems. The 3rd-ASAM extends the 2nd-ASAM in the quest to overcome the "curse of dimensionality" in sensitivity analysis, uncertainty quantification and predictive modeling. This work also presents new formulas that incorporate the contributions of the 3rd-order sensitivities into the expressions of the first four cumulants of the response distribution in the phase-space of model parameters. Using these newly developed formulas, this work also presents a new mathematical formalism, called the 2nd/3rd-BERRU-PM "Second/Third-Order Best-Estimated Results with Reduced Uncertainties Predictive Modeling") formalism, which combines experimental and computational information in the joint phase-space of responses and model parameters, including not only the 1st-order response sensitivities, but also the complete hessian matrix of 2nd-order second-sensitivities and also the 3rd-order sensitivities, all computed using the 3rd-ASAM. The 2nd/3rd-BERRU-PM uses the maximum entropy principle to eliminate the need for introducing and "minimizing" a user-chosen "cost functional quantifying the discrepancies between measurements and computations," thus yielding results that are free of subjective user-interferences while generalizing and significantly extending the 4D-VAR data assimilation procedures. Incorporating correlations, including those between the imprecisely known model parameters and computed model responses, the 2nd/3rd-BERRU-PM also provides a quantitative metric, constructed from sensitivity and covariance matrices, for determining the degree of agreement among the various computational and experimental data while eliminating discrepant information. The mathematical framework of the 2nd/3rd-BERRU-PM formalism requires the inversion of a single matrix of size N-r x N-r, where N-r denotes the number of considered responses. In the overwhelming majority of practical situations, the number of responses is much less than the number of model parameters. Thus, the 2nd-BERRU-PM methodology overcomes the curse of dimensionality which affects the inversion of hessian matrices in the parameter space.
Digital Object Identifier (DOI)
Published in Energies, Volume 12, Issue 21, 2019, pages 4216-.
© 2019 by the author. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).
Cacuci, D. (2019). Towards Overcoming the Curse of Dimensionality: The Third-Order Adjoint Method for Sensitivity Analysis of Response-Coupled Linear Forward/Adjoint Systems, with Applications to Uncertainty Quantification and Predictive Modeling. Energies, 12(21), 4216. doi: 10.3390/en12214216