Posts

Showing posts from July, 2022

Model evaluation

Model evaluation [ edit ] A crucial part of the modeling process is the evaluation of whether or not a given mathematical model describes a system accurately. This question can be difficult to answer as it involves several different types of evaluation. Fit to empirical data [ edit ] Usually, the easiest part of model evaluation is checking whether a model fits experimental measurements or other empirical data. In models with parameters, a common approach to test this fit is to split the data into two disjoint subsets: training data and verification data. The training data are used to estimate the model parameters. An accurate model will closely match the verification data even though these data were not used to set the model's parameters. This practice is referred to as  cross-validation  in statistics. Defining a  metric  to measure distances between observed and predicted data is a useful tool for assessing model fit. In statistics, decision theory, and some ...