Thursday, November 12, 2009

Judea Pearl on IPW - a great find!

Judea Pearl's recent post on the intuition behind inverse probability weighting (IPW) is not likely to be one that I send out to non-statistical collaborators, but I did find it very useful for applied statisticians who want to understand current statistical thinking on the theoretical basis for IPW, and how that should guide selection of variables to include in a model for the probabilities in question.

For anyone who is working with observational studies, where selection to treatment is non-random; or with analysis of survey data, where response rates are a concern and non-response bias is possible, the technique of re-weighting the observed data to compensate for the observational design is worth a good look. Guidance on how to think about the models is much needed- and I believe that this post goes a long way towards providing that guidance! I hope to post an application note or two once I've made some headway on at least two projects where this will be useful.

No comments:

Post a Comment