Joint Distribution

  • Summing over the possible values of = marginalizing out
  • Independence
    • conditional PDF = marginal PDF
    • joint PDF factors into marginal PDFs
  • The example of Chicken-Egg
    • eggs are laid, and hatched with probability of
    • The number of hatched eggs is , and that of the unhatched is .
    • The total number of eggs is random, hence the two r.v.s are counterintuitively independent.
  • The example of comparing exponentials
    • By integrating over and .

  • Covariance measures linear association
  • Multinomial distribution
  • Multivariate Normal Distribution
    • All linear combination of the r.v.s in the vector must be normal.
    • In MVN, independence and zero correlation are equivalent