Presents a unified approach to parametric estimation, confidence intervals, hypothesis testing, and statistical modeling, which are uniquely based on the likelihood function
This book addresses mathematical statistics for upper-undergraduates and first year graduate students, tying chapters on estimation, confidence intervals, hypothesis testing, and statistical models together to present a unifying focus on the likelihood function. It also emphasizes the important ideas in statistical modeling, such as sufficiency, exponential family distributions, and large sample properties. Mathematical Statistics: An Introduction to Likelihood Based Inference makes advanced topics accessible and understandable and covers many topics in more depth than typical mathematical statistics textbooks. It includes numerous examples, case studies, a large number of exercises ranging from drill and skill to extremely difficult problems, and many of the important theorems of mathematical statistics along with their proofs.
In addition to the connected chapters mentioned above, Mathematical Statistics covers likelihood-based estimation, with emphasis on multidimensional parameter spaces and range dependent support. It also includes a chapter on confidence intervals, which contains examples of exact confidence intervals along with the standard large sample confidence intervals based on the MLE's and bootstrap confidence intervals. There’s also a chapter on parametric statistical models featuring sections on non-iid observations, linear regression, logistic regression, Poisson regression, and linear models.
- Prepares students with the tools needed to be successful in their future work in statistics data science
- Includes practical case studies including real-life data collected from Yellowstone National Park, the Donner party, and the Titanic voyage
- Emphasizes the important ideas to statistical modeling, such as sufficiency, exponential family distributions, and large sample properties
- Includes sections on Bayesian estimation and credible intervals
- Features examples, problems, and solutions
Mathematical Statistics: An Introduction to Likelihood Based Inference is an ideal textbook for upper-undergraduate and graduate courses in probability, mathematical statistics, and/or statistical inference.
Table of Contents
Preface xiii
Acknowledgments xvii
1 Probability 1
1.1 Sample Spaces, Events, and ;;-Algebras 1
Problems 7
1.2 Probability Axioms and Rules 9
Problems 14
1.3 Probability with Equally Likely Outcomes 16
Problems 18
1.4 Conditional Probability 19
Problems 25
1.5 Independence 28
Problems 31
1.6 Counting Methods 33
Problems 38
1.7 Case Study -The Birthday Problem 41
Problems 44
2 Random Variables and Random Vectors 45
2.1 Random Variables 45
2.1.1 Properties of Random Variables 46
Problems 50
2.2 Random Vectors 53
2.2.1 Properties of Random Vectors 53
Problems 60
2.3 Independent Random Variables 63
Problems 66
2.4 Transformations of Random Variables 68
2.4.1 Transformations of Discrete Random Variables 68
2.4.2 Transformations of Continuous Random Variables 69
2.4.3 Transformations of Continuous Bivariate Random Vectors 73
Problems 75
2.5 Expected Values for Random Variables 77
2.5.1 Expected Values and Moments of Random Variables 77
2.5.2 The Variance of a Random Variable 81
2.5.3 Moment Generating Functions 86
Problems 89
2.6 Expected Values for Random Vectors 94
2.6.1 Properties of Expectation with Random Vectors 96
2.6.2 Covariance and Correlation 99
2.6.3 Conditional Expectation and Variance 106
Problems 110
2.7 Sums of Random Variables 114
Problems 120
2.8 Case Study - HowMany Times Was the Coin Tossed? 123
2.8.1 The Probability Model 124
Problems 126
3 Probability Models 129
3.1 Discrete Probability Models 129
3.1.1 The Binomial Model 129
3.1.1.1 Binomial Setting 130
3.1.2 The HypergeometricModel 132
3.1.2.1 Hypergeometric Setting 132
3.1.3 The Poisson Model 134
3.1.4 The Negative BinomialModel 135
3.1.4.1 Negative Binomial Setting 135
3.1.5 The MultinomialModel 138
3.1.5.1 Multinomial Setting 139
Problems 140
3.2 Continuous Probability Models 147
3.2.1 The Uniform Model 147
3.2.2 The Gamma Model 149
3.2.3 The Normal Model 152
3.2.4 The Log-normal Model 155
3.2.5 The Beta Model 156
Problems 158
3.3 Important Distributional Relationships 163
3.3.1 Sums of Random Variables 163
3.3.2 The T and F Distributions 166
Problems 170
3.4 Case Study -The Central LimitTheorem 172
3.4.1 Convergence in Distribution 172
3.4.2 The Central LimitTheorem 173
Problems 176
4 Parametric Point Estimation 177
4.1 Statistics 177
4.1.1 Sampling Distributions 178
4.1.2 Unbiased Statistics and Estimators 179
4.1.3 Standard Error and Mean Squared Error 181
4.1.4 The Delta Method 186
Problems 186
4.2 Sufficient Statistics 190
4.2.1 Exponential Family Distributions 195
Problems 200
4.3 Minimum Variance Unbiased Estimators 203
4.3.1 Cramér-Rao Lower Bound 205
Problems 212
4.4 Case Study -The Order Statistics 214
Problems 219
5 Likelihood-based Estimation 223
5.1 Maximum Likelihood Estimation 226
5.1.1 Properties of MLEs 226
5.1.2 One-parameter Probability Models 228
5.1.3 Multiparameter Probability Models 235
Problems 240
5.2 Bayesian Estimation 247
5.2.1 The Bayesian Setting 247
5.2.2 Bayesian Estimators 250
Problems 255
5.3 Interval Estimation 258
5.3.1 Exact Confidence Intervals 259
5.3.2 Large Sample Confidence Intervals 264
5.3.3 Bayesian Credible Intervals 267
Problems 269
5.4 Case Study - Modeling Obsidian Rind Thicknesses 273
5.4.1 Finite Mixture Model 274
Problems 278
6 Hypothesis Testing 281
6.1 Components of a Hypothesis Test 282
Problems 286
6.2 Most Powerful Tests 288
Problems 293
6.3 Uniformly Most Powerful Tests 296
6.3.1 Uniformly Most Powerful Unbiased Tests 299
Problems 301
6.4 Generalized Likelihood Ratio Tests 305
Problems 311
6.5 Large Sample Tests 314
6.5.1 Large Sample Tests Based on the MLE 314
6.5.2 Score Tests 316
Problems 320
6.6 Case Study - Modeling Survival of the Titanic Passengers 323
6.6.1 Exploring the Data 324
6.6.2 Modeling the Probability of Survival 325
6.6.3 Analysis of the Fitted Survival Model 327
Problems 328
7 Generalized Linear Models 331
7.1 Generalized LinearModels 332
Problems 334
7.2 Fitting a Generalized LinearModel 336
7.2.1 Estimating ⃗ ;; 336
7.2.2 Model Deviance 338
Problems 340
7.3 Hypothesis Testing in a Generalized Linear Model 341
7.3.1 Asymptotic Properties 341
7.3.2 Wald Tests and Confidence Intervals 342
7.3.3 Likelihood Ratio Tests 343
Problems 346
7.4 Generalized LinearModels for a Normal Response Variable 348
7.4.1 Estimation 349
7.4.2 Properties of the MLEs 353
7.4.3 Deviance 357
7.4.4 Hypothesis Testing 359
Problems 362
7.5 Generalized LinearModels for a Binomial Response Variable 365
7.5.1 Estimation 366
7.5.2 Properties of the MLEs 368
7.5.3 Deviance 370
7.5.4 Hypothesis Testing 371
Problems 373
7.6 Case Study - IDNAP Experimentwith Poisson Count Data 375
7.6.1 The Model 376
7.6.2 StatisticalMethods 376
7.6.3 Results of the First Experiment 379
Problems 381
References 383
A Probability Models 385
B DataSets 387
Problem Solutions 389
Index 413
