ST2004 - ST2352 Applied Probability I A.Y. 2016/2017 Module Code: ST2004 or ST2352 Module Title: Applied Probability I Cohorts: MSISS, BAI, CSL(JS), Maths, TSM Week range: 05-10, 12-16 Semester: S1 (Michaelmas) Total hours: 33 Timetable: - Monday, h. 9-10, (ICTLAB & ITCLAB2), room LB04 starting on 28/11 - Tuesday, h. 17-18, room LB08 - Wednesday, h. 15-16, room M17 Textbook: Tijms, "Understanding Probability" (pages indicated below refer to 3rd edition). SYLLABUS (lecture by lecture): 27/09/16: Monte Carlo approach, Empirical Law of Large Numbers, Birthday problem. Textbook: Section 2 (pp. 18-25), Section 3 (pp. 75-80, 3.1.4 excluded). ----- 28/09/16: True and pseudo random number generation, Multiplicative congruential method, Random generation from an interval, Random generation from integers. Textbook: Section 2.8 (pp. 52-59). ----- 3/10/16: Lab - Generating random passwords. ----- 4/10/16: Generation of random permutations, 1970 draft lottery problem. Textbook: Section 2.9.4 (pp. 62-63), Section 3.7 (pp. 98-102). ----- 5/10/16: More on 1970 draft lottery, Frequentist probability, Axiomatic foundations of probability. Textbook: Chapter 7, Section 7.1 (pp. 229-232). ----- 10/10/16: Lab - Does skill win the league? ----- 11/10/16: Probabilities on a finite or countable sample space, Equally likely outcomes, Buffon needle problem. Textbook: Section 7.1.1 (pp. 232-235). Assignment: Problems 7.1-7.5 and 7.14. ----- 12/10/16: Derivation of basic rules of probability from axioms, Independent events. Textbook: Section 7.2 (pp. 239-241, 7.2.1 excluded), Section 7.3 (pp. 243-244). Assignment: Probl. 7.27 and 7.28. ----- 17/10/16: Lab - System lifetime. ----- 18/10/16: Monty Hall problem, Conditional probability, Chain rule, Bayes rule, Law of conditional probability (or Law of total probabilities) Textbook: Chapter 6 (pp. 212-127, 6.1.3 excluded, pp. 220-222), Chapter 8 (pp. 256-258, pp. 260-261, pp.264-267). Assignment: Problems 8.1-8.3, 8.15. ----- 19/10/16: Tutorial - Solution of some problems given as assignment. ----- 24/10/16: Lab - Summaries of variation. ----- 25/10/16: Bayes theorem, Monty Hall problem using Bayes theorem, Problems 8.19, 8.30, Random variables. Textbook: Chapter 9 (pp. 283-285). Assignment: Problems 8.17, 8.31, 8.32. ----- 26/10/16: Discrete random variables: Probability mass function, Expected value, E[X+Y]=E[X]+E[Y]. Textbook: Chapter 9 (pp. 286-291). Assignment: Problems 9.1, 9.3. ----- 1/11/16: Expected value of g(X), E[aX+b]=aE[X]+b, Variance and Standard Deviation of a R.V. Textbook: pp. 292-294. Assignment: Problem 9.14. ----- 2/11/16: Independent random variables (general and discrete case), E[XY]=E[X]E[Y] if X and Y are independent, Problem 9.25. Textbook: pp. 299-300. Assignment: Prove that Var(aX+b)=a^2Var(X), Problem 9.19. ----- 14/11/16: Lab - Simple queues. ----- 15/11/16: Distribution of the sum of two independent discrete RVs, Bernoulli distribution, Binomial distribution. Textbook: pp. 300-305, pp. 312-313 (9.6.5). Assignment: Problem 9.32, Prove that Var(X+Y)=Var(X)+Var(Y) if X and Y are independent. ----- 16/11/16: Tutorial: Solution of some problems given as assignment (8.12, 8.31, 9.14). ----- 21/11/16: Lab - Group project. ----- 22/11/16: Geometric distribution, Geometric sum and series, Poisson distribution. Textbook: pp. 112-115, p. 306, pp. 312-313 (9.6.5). Assignment: Verify that the probability mass function of a geometric r.v. sums up to 1, Example 9.8. ----- 23/11/16: Poisson distribution as a limit of Binomial, Cumulative distribution function. Textbook: pp. 306-307. ----- 28/11/16: Continuous distributions, Density function, Density function from cumulative distribution function. Textbook: pp. 318-322. Assignment: Example 10.3, Problem 10.1. ----- 29/11/16: Interpretation of densities, Exponential distribution, Inverse-transform method. Textbook: pp. 322-324, pp. 353-354. ----- 30/11/16: Tutorial by Gernot Roetzer. Problem 10.3 and 10.7, Example 10.5 in the textbook. ----- 5/12/16: Proof of inverse-transform method, Expectation and Variance of continuous r.v., Mean of exp. r.v., Memoryless property of exp. r.v. Textbook:pp. 326-330, pp. 335-337. Assignment: Show that Var(X)=1/lambda^2 if X is Exp(lambda), Problem 10.11. ----- 6/12/16: Connection between Exponential and Poisson, Gamma distribution, Expected value, Connection between Gamma and Poisson. Textbook: pp. 338-342,. Assignment: Show that Var(X)=a/lambda^2 if X is Gamma(a,lambda). ----- 7/12/16: Normal distribution, Markov inequality, Chebyschev inequality. Textbook: pp. 343-345, pp. 448-449. Assignment: Problem 10.36. ----- 12/12/16: Examples on Chebyshev inequality, Joint probability mass function, Marginal distributions. Textbook: pp. 360-362. Assignment: Problems 11.1 and 11.3. ----- 13/12/16: Equivalent definition of independence of discrete r.v.'s, Joint density function for continuous r.v.'s, Interpretation of joint density, Convolution formula for the density of a sum of continuous r.v.'s. Textbook: pp. 362-365. Assignment: Prove the two definitions (in terms of c.d.f. and in terms of p.m.f.) of independence of two discrete R.V.'s are equivalent. ----- 14/12/16: Marginal density functions, Equivalent definition of independence of continuous r.v.s, Expected value of g(X,Y), Variance of X+Y, Covariance of (X,Y). Textbook: pp. 367-374. ----- |