TY - GEN
T1 - Second-level partition for estimating far confidence intervals in biometric systems
AU - Li, Rongfeng
AU - Tang, Darun
AU - Li, Wenxin
AU - Zhang, Dapeng
PY - 2009/9/28
Y1 - 2009/9/28
N2 - Most biometric authentication algorithms make use of a similarity score that defines how similar two templates are according to a threshold and the accuracy of the results are expressed in terms of a False Reject Rate (FRR) or False Accept Rate (FAR) that is estimated using the training data set. A confidence interval is assigned to any claim of accuracy with 90% being commonly assumed for biometric-based authentication systems. However, these confidence intervals may not be as accurate as is presumed. In this paper, we report the results of experiments measuring the performance of the widely-used subset bootstrap approach to estimating the confidence interval of FAR. We find that the coverage of the FAR confidence intervals estimated by the subset bootstrap approach is reduced by the dependence between two similarities when they come from two individual pairs shared with a common individual. This is because subset bootstrap requires the independence of different subsets. To deal with this, we present a second-level partition to the similarity score set between different individuals, producing what we call a subset false accept rate (SFAR) bootstrap estimation. The experimental results show that the proposed procedures greatly increase the coverage of the FAR confidence intervals.
AB - Most biometric authentication algorithms make use of a similarity score that defines how similar two templates are according to a threshold and the accuracy of the results are expressed in terms of a False Reject Rate (FRR) or False Accept Rate (FAR) that is estimated using the training data set. A confidence interval is assigned to any claim of accuracy with 90% being commonly assumed for biometric-based authentication systems. However, these confidence intervals may not be as accurate as is presumed. In this paper, we report the results of experiments measuring the performance of the widely-used subset bootstrap approach to estimating the confidence interval of FAR. We find that the coverage of the FAR confidence intervals estimated by the subset bootstrap approach is reduced by the dependence between two similarities when they come from two individual pairs shared with a common individual. This is because subset bootstrap requires the independence of different subsets. To deal with this, we present a second-level partition to the similarity score set between different individuals, producing what we call a subset false accept rate (SFAR) bootstrap estimation. The experimental results show that the proposed procedures greatly increase the coverage of the FAR confidence intervals.
KW - Biometric
KW - Bootstrap
KW - Confidence interval
KW - Performance evaluation
UR - http://www.scopus.com/inward/record.url?scp=70349325949&partnerID=8YFLogxK
U2 - 10.1007/978-3-642-03767-2_7
DO - 10.1007/978-3-642-03767-2_7
M3 - Conference article published in proceeding or book
SN - 3642037666
SN - 9783642037665
T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
SP - 58
EP - 65
BT - Computer Analysis of Images and Patterns - 13th International Conference, CAIP 2009, Proceedings
T2 - 13th International Conference on Computer Analysis of Images and Patterns, CAIP 2009
Y2 - 2 September 2009 through 4 September 2009
ER -