Skip to content

parametric standard error post-matching #200

Closed

Description

@daniellebraun

hi @wxwx1993 and @Naeemkh,
post-matching when running erf parametric i think we need to change code so that we adjust for counter using GEE, otherwise we are underestimating the standard error (this came up with michelle q and falco, for SGI project).

@m-qin
@fbargaglistoffi

Activity

  1. Naeemkh commented on Feb 22, 2023

    @Naeemkh
    Member

    Please add more details to this issue. Thanks.

  2. Naeemkh commented on Apr 10, 2023

    @Naeemkh
    Member

    @daniellebraun, @m-qin, @fbargaglistoffi, please add more details to this issue.

  3. m-qin commented on Apr 10, 2023

    @m-qin

    I think Danielle and Falco understand this statistical issue better than me, but my impression is that it centers around how we understand the counter_weight variable in the data structure. Since counter_weight records how many times an observation should be duplicated, it may need to be accounted for explicitly in a statistical outcome model, such as through a "clustering" structure in a Generalized Estimating Equation (GEE).

    In the SGI project, we expanded out the data (I forget what this is called) using counter_weight to repeat each row a counter_weight number of times. Then, a GEE model was run with row_index as the "cluster ID".

  4. wxwx1993 commented on Apr 10, 2023

    @wxwx1993
    Collaborator

    The variances estimates of the matching estimator are of interest. Importantly, a paper under binary treatment (https://www.tandfonline.com/doi/full/10.1080/01621459.2020.1840383) may illustrate some points raised here.

    But let's start simply. that is 1) if using a GLM in R, and set weight = counter_weight, I thought the GLM wouldn't treat two identical units independently, rather, they will use a weighted LS and corresponding weighted covariance matrix to calculate the variance. I do not think in this case, GEE will make difference. 2) If using a GLM in R on unweighted data (with many duplicated rows. and GLM will wrongly treat them independently), then a GEE is necessary.

  5. wxwx1993 commented on Apr 10, 2023

    @wxwx1993
    Collaborator

    If someone wants to write a theoretical paper on variance estimation of matching estimators, I am up for it.

  6. m-qin commented on Apr 10, 2023

    @m-qin

    The paper that @wxwx1993 linked looks cool; it found that (for binary treatments), "We have shown that sandwich standard errors are not generally valid for the post-matching least squares estimator. In this section, we will demonstrate that, when matching is done without replacement, clustered standard errors (Liang and Zeger 1986; Arellano 1987) can be employed to obtain valid estimates of the standard deviation of post-matching regression coefficients. ... In this [later] section, we show that a clustered version of the nonparametric [block] bootstrap (Efron 1979) is also valid."

  7. m-qin commented on Apr 10, 2023

    @m-qin

    @Naeemkh maybe this thread should be under Discussion rather than Issue, haha. Seems like the methodology is still being developed

  8. Naeemkh commented on Apr 10, 2023

    @Naeemkh
    Member

    Thanks, @wxwx1993 and @m-qin. I will move it under discussions.

  9. m-qin commented on Apr 10, 2023

    @m-qin

    @wxwx1993 For our SGI project, we did get different results using 1) weighted GLM using counter_weight and 2) GEE on the dataset containing duplicate rows. (Falco and Danielle were more involved in this step than I was, so they may be able to expound.)

  10. locked and limited conversation to collaborators on Apr 10, 2023
  11. converted this issue into a discussion #207 on Apr 10, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions