Latent variable model
A latent variable model is a statistical model that relates a set of observable variables (also called manifest variables or indicators)[1] to a set of latent variables. Latent variable models are applied across a wide range of fields such as biology, computer science, and social science.[2] Common use cases for latent variable models include applications in psychometrics (e.g., summarizing responses to a set of survey questions with a factor analysis model positing a smaller number of psychological attributes, such as the trait extraversion, that are presumed to cause the survey question responses),[3] and natural language processing (e.g., a topic model summarizing a corpus of texts with a number of "topics").[4]
It is assumed that the responses on the indicators or manifest variables are the result of an individual's position on the latent variable(s), and that the manifest variables have nothing in common after controlling for the latent variable (local independence).
Different types of the latent variable models can be grouped according to whether the manifest and latent variables are categorical or continuous:[5]
| Manifest variables | ||
|---|---|---|
| Latent variables | Continuous | Categorical |
| Continuous | Factor analysis | Item response theory |
| Categorical | Latent profile analysis | Latent class analysis |
The Rasch model represents the simplest form of item response theory. Mixture models are central to latent profile analysis.
In factor analysis and latent trait analysis[note 1] the latent variables are treated as continuous normally distributed variables, and in latent profile analysis and latent class analysis as from a multinomial distribution.[7] The manifest variables in factor analysis and latent profile analysis are continuous and in most cases, their conditional distribution given the latent variables is assumed to be normal. In latent trait analysis and latent class analysis, the manifest variables are discrete. These variables could be dichotomous, ordinal or nominal variables. Their conditional distributions are assumed to be binomial or multinomial.
See also
- Confirmatory factor analysis
- Hidden Markov model
- Partial least squares path modeling
- Structural equation modeling
Notes
References
- ^ "Latent Variable Models". Statistics.com: Data Science, Analytics & Statistics Courses. Archived from the original on 2022-11-01. Retrieved 2022-11-01.
- ^ Blei, David M. (2014-01-03). "Build, Compute, Critique, Repeat: Data Analysis with Latent Variable Models". Annual Review of Statistics and Its Application. 1 (1): 203–232. Bibcode:2014AnRSA...1..203B. doi:10.1146/annurev-statistics-022513-115657. ISSN 2326-8298.
- ^ Borsboom, Denny; Mellenbergh, Gideon J.; van Heerden, Jaap (April 2003). "The theoretical status of latent variables". Psychological Review. 110 (2): 203–219. doi:10.1037/0033-295X.110.2.203. ISSN 1939-1471. PMID 12747522.
- ^ Blei, David M.; Ng, Andrew Y.; Jordan, Michael I. (2003). "Latent dirichlet allocation". J. Mach. Learn. Res. 3 (3/1/2003): 993–1022. ISSN 1532-4435.
- ^ Bartholomew, David J.; Steel, Fiona; Moustaki, Irini; Galbraith, Jane I. (2002). The Analysis and Interpretation of Multivariate Data for Social Scientists. Chapman & Hall/CRC. p. 145. ISBN 1-58488-295-6.
- ^ Uebersax, John. "Latent Trait Analysis and Item Response Theory (IRT) Models". John-Uebersax.com. Archived from the original on 2022-11-01. Retrieved 2022-11-01.
- ^ Everitt, BS (1984). An Introduction to Latent Variables Models. Chapman & Hall. ISBN 0-412-25310-0.
Further reading
- Skrondal, Anders; Rabe-Hesketh, Sophia (2004). Generalized Latent Variable Modeling. Chapman & Hall. ISBN 1-58488-000-7.