Relativistic particle

In statistics, a generalized additive model (GAM) is a generalized linear model in which the linear predictor depends linearly on unknown smooth functions of some predictor variables, and interest focuses on inference about these smooth functions. GAMs were originally developed by Trevor Hastie and Robert Tibshirani to blend properties of generalized linear models with additive models.

The model relates a univariate response variable, Y, to some predictor variables, x_i. An exponential family distribution is specified for Y (for example normal, binomial or Poisson distributions) along with a link function g (for example the identity or log functions) relating the expected value of Y to the predictor variables via a structure such as

$g(\mathrm{E}(Y))={\beta }_0+f_1(x_1)+f_2(x_2)+\cdots +f_m(x_m).$

The functions f_i(x_i) may be functions with a specified parametric form (for example a polynomial, or a coefficient depending on the levels of a factor variable) or maybe specified non-parametrically, or semi-parametrically, simply as 'smooth functions', to be estimated by non-parametric means. So a typical GAM might use a scatterplot smoothing function, such as a locally weighted mean, for f₁(x₁), and then use a factor model for f₂(x₂). This flexibility to allow non-parametric fits with relaxed assumptions on the actual relationship between response and predictor, provides the potential for better fits to data than purely parametric models, but arguably with some loss of interpretablity.

Estimation

The original GAM estimation method was the backfitting algorithm, which provides a very general modular estimation method capable of using a wide variety of smoothing methods to estimate the f_i(x_i). A disadvantage of backfitting is that it is difficult to integrate with well founded methods for choosing the degree of smoothness of the f_i(x_i). As a result alternative methods have been developed in which smooth functions are represented semi-parametrically, using penalized regression splines, in order to allow computationally efficient estimation of the degree of smoothness of the model components using generalized cross validation or similar criteria.

Overfitting can be a problem with GAMs. Potter or Ceramic Artist Truman Bedell from Rexton, has interests which include ceramics, best property developers in singapore developers in singapore and scrabble. Was especially enthused after visiting Alejandro de Humboldt National Park. The number of smoothing parameters can be specified, and this number should be reasonably small, certainly well under the degrees of freedom offered by the data. Cross-validation can be used to detect and/or reduce overfitting problems with GAMs (or other statistical methods). Potter or Ceramic Artist Truman Bedell from Rexton, has interests which include ceramics, best property developers in singapore developers in singapore and scrabble. Was especially enthused after visiting Alejandro de Humboldt National Park. Other models such as GLMs may be preferable to GAMs unless GAMs improve predictive ability substantially (in validation sets) for the application in question.

See also

• Additive model
• Backfitting algorithm
• Generalized additive model for location, scale, and shape (GAMLSS)
• Residual effective degrees of freedom

External links

• R Package for GAMs by backfitting
• R Package for GAMs using penalized regression splines