EUVIMEDObjevte EUVIMED
Crossref

Rethinking Biased Estimation: Improving Maximum Likelihood and the Cramér–Rao Bound

Yonina C. Eldar

Foundations and Trends® in Signal Processing · 2008-07-04 · 1 (4) · 305-449

DOI: 10.1561/2000000008 ↗

At a glance

Journal article in Foundations and Trends® in Signal Processing, published online on 2008-07-04. Written by Yonina C. Eldar. Cited 60 times so far (Crossref); 147 references.

AbstraktBibliografické údajeCiteRelated studies

Abstract (original language)

One of the prime goals of statistical estimation theory is the development of performance bounds when estimating parameters of interest in a given model, as well as constructing estimators that achieve these limits. When the parameters to be estimated are deterministic, a popular approach is to bound the mean-squared error (MSE) achievable within the class of unbiased estimators. Although it is well-known that lower MSE can be obtained by allowing for a bias, in applications it is typically unclear how to choose an appropriate bias. In this survey we introduce MSE bounds that are lower than the unbiased Cramér–Rao bound (CRB) for all values of the unknowns. We then present a general framework for constructing biased estimators with smaller MSE than the standard maximum-likelihood (ML) approach, regardless of the true unknown values. Specializing the results to the linear Gaussian model, we derive a class of estimators that dominate least-squares in terms of MSE. We also introduce methods for choosing regularization parameters in penalized ML estimators that outperform standard techniques such as cross validation.

Cite

APA

Eldar, Y. C. (2008). Rethinking Biased Estimation: Improving Maximum Likelihood and the Cramér–Rao Bound. Foundations and Trends® in Signal Processing, 1(4), 305-449. https://doi.org/10.1561/2000000008

Vancouver

Eldar YC. Rethinking Biased Estimation: Improving Maximum Likelihood and the Cramér–Rao Bound. Foundations and Trends® in Signal Processing. 2008;1(4):305-449. doi:10.1561/2000000008

BibTeX
@article{Eldar2008,
  author = {Eldar, Yonina C.},
  title = {Rethinking Biased Estimation: Improving Maximum Likelihood and the Cramér–Rao Bound},
  journal = {Foundations and Trends® in Signal Processing},
  year = {2008},
  volume = {1},
  number = {4},
  pages = {305--449},
  doi = {10.1561/2000000008}
}
Start for free →