Suppose that one can construct a valid $(1-\delta)$-CI for each of $K$ parameters of potential interest. If a data analyst uses an arbitrary data-dependent criterion to select some subset $S$ of parameters, then the aforementioned confidence intervals for the selected parameters are no longer valid due to selection bias. We design a new method to adjust the intervals in order to control the false coverage rate (FCR). The main established method is the "BY procedure" by Benjamini and Yekutieli (JASA, 2005). Unfortunately, the BY guarantees require certain restrictions on the the selection criterion and on the dependence between the CIs. We propose a natural and much simpler method -- both in implementation, and in proof -- which is valid under any dependence structure between the original CIs, and any (unknown) selection criterion, but which only applies to a special, yet broad, class of CIs. Our procedure reports $(1-\delta|S|/K)$-CIs for the selected parameters, and we prove that it controls the FCR at $\delta$ for confidence intervals that implicitly invert e-values; examples include those constructed via supermartingale methods, or via universal inference, or via Chernoff-style bounds on the moment generating function, among others. The e-BY procedure is proved to be admissible, and it recovers the BY procedure as a special case via calibration. Our work also has implications for multiple testing in sequential settings, since it applies at stopping times, to continuously-monitored confidence sequences with bandit sampling.
翻译:如果数据分析员使用任意的基于数据的标准来选择某些子子子美元参数,那么上述对选定参数的信任间隔由于选择偏差而不再有效。我们设计了一种新的方法来调整间隔,以控制虚假的覆盖率(FCR)。主要既定方法是Benjami和Yekutieeli的“BY程序”(JASA,2005年)。不幸的是,BY保证要求对选择标准和对CIers之间的依赖性作出某些限制。我们建议一种自然的、更简单得多的方法 -- -- 无论是在执行还是证据上 -- -- 在原CIs和任何(未知的)选择标准之间的任何依赖性结构下都是有效的。我们设计了一个新的方法来调整间隔,以控制虚假的覆盖率(FCR),我们的程序报告是Benjani和Yekutieeli(JASA,2005年)的“BYBY 程序 ” 。不幸的是,BY保证要求BYCR以$delta$来控制信任间隔,从而在电子价值和证据中隐性地转换电子价值;在通过Servial Redual rodeal robe 中,通过Seral recal ex recal roduction roduction roduce beless 中, ex belation the the ex ex ex ex ex ex ex ex ex the the the the ex ex ex ex ex ex ex ex ex beal ex ex ex ex ex ex ex ex ex ex ex exprevolviewolviolviewts ex a ex ex ex ex ex ex ex ex ex ex ex ex ex ex ex ex ex ex ex ex ex ex ex ex ex ex ex ex ex ex ex ex ex ex ex ex expeutal expal ex ex ex ex ex ex ex ex ex ex ex ex be ex ex ex ex ex ex ex ex ex ex ex ex ex ex ex ex ex ex ex ex ex