ST2004 - Applied Probability I 


Module Code: ST2004

Module Title: Applied Probability I (module descriptor)

Credit Value: 5

Cohorts: MSISS, CSL(JS)

Week range: 05-10, 12-16 

Semester: S1 (Michaelmas) 

Total hours: 33


- Monday, h. 9am-10am, (ICTLAB1 till 13/11/17) LB107 since 20/11/17

- Tuesday, h. 5pm-6pm, room LB08

- Wednesday, h. 3 pm-4pm, room LB04

Calendar of lab sessions:

Lab sessions are scheduled on Monday morning. As for the first six weeks, labs are scheduled for:

- Monday 2/10/17

- Monday 9/10/17

- Monday 16/10/17 (cancelled)

- Monday 23/10/17

- Monday 13/11/17

Group project

Groups allocation (pdf)

Instructions (pdf) deadline postponed to 6 pm on the 31st of January.

Submission: please submit a printed copy of your project at my office (LB 1.28). To make sure you'll find me at the office, please come along on these times:

- Tue 30th January, 2.30pm-6.30pm

- Wed 31st January, 11am-1pm or 3.30pm-6.00pm

Textbook: Tijms, "Understanding Probability" (pages indicated below refer to 3rd edition).

Additional material will be provided when needed.


26/09/17: slides (pdf)

27/09/17: slides (pdf)

02/10/17: lab (pdf,xlsx)

03/10/17: slides (pdf)

09/10/17: lab (pdf,xlsx)

17/10/17: slides (pdf), spreadsheet (xlsx)

23/10/17: lab (pdf,xlsx)

13/11/17: lab (pdf,xlsx)

30/11/17: mock exam (pdf)

Doc-cam notes (password protected files)

04/10/17, 10/10/17, 12/10/17: doc-cam notes (encrypted pdf)

17/10/17, 18/10/17, 24/10/17: doc-cam notes (encrypted pdf)

25/10/17, 31/10/17, 01/11/17: doc-cam notes (encrypted pdf)

14/11/17, 15/11/17: doc-cam notes (encrypted pdf)

20/11/17, 21/11/17, 22/11/17, 27/11/17, 28/11/17, 29/11/17, 30/11/17: doc-cam notes (encrypted pdf)

Syllabus (lecture by lecture):

26/09/17: Monte Carlo approach, Empirical Law of Large Numbers, Birthday problem (via both simulation and combinatorics).

Textbook: Section 2 (pp. 18-25), Section 3 (pp. 75-80, 3.1.4 excluded).


27/09/17: True and pseudo random number generation, Multiplicative congruential method, Random generation from an interval, Random generation from integers, Generation of random permutations.

Textbook: Section 2.8 (pp. 52-59), Section 2.9.4 (pp. 62-63).


02/10/17: Lab 1 - generating random passwords.


03/10/17: More on generation of random permutations, 1970 draft lottery problem.

Textbook: Section 2.8.1 (pp. 55-56), Section 3.7 (pp. 98-102).


04/10/17: Frequentist probability, Axiomatic foundations of probability.

Textbook: Chapter 7, Section 7.1 (pp. 229-232).


09/10/17: Lab 2 - does skill win the league?


10/10/17: Definition of probability functions on a finite or countably infinite sample space, Equally likely events, Examples.

Textbook: Section 7.1.1 (pp. 232-235). 

Assignment: Problems 7.1-7.5 and 7.14 (if you want them to be checked -not marked- hand your solutions in on Wednesday 18/10/17).


12/10/17: Probability on an uncountable sample space (dartboard example)Derivation of basic rules of probability from axioms, Independent events.

Textbook: Example 7.3 (pag. 234), Section 7.2 (pp. 239-241, 7.2.1 excluded), Section 7.3 (pp. 243-244). 

Assignment: Probl. 7.27 and 7.28 (if you want them to be checked -not marked- hand your solutions in on Wednesday 18/10/17).


17/10/17: Monty Hall problem via simulation, Conditional probability, Chain rule, Bayes rule.

Textbook: Chapter 6 (pp. 212-217, 6.1.3 excluded, pp. 220-222), Chapter 8 (pp. 256-258, pp. 260-261). 

Assignment: Problems 8.1-8.3 (if you want them to be checked -not marked- hand your solutions in on Tuesday 31/10/17).


18/10/17: Tutorial: solution of Exercise 7.3, 7.4, 7.5 and 7.14. Binomial coefficient. 


23/10/17: Lab 3 - system lifetime.


24/10/17: Law of conditional probability (or law of total probabilities), Bayes theorem, Monty hall problem with Bayes theorem, Problems 8.30 and 8.19.

Textbook: pp. 264-267.

Assignment: 8.17, 8.31, 8.32 (if you want them to be checked -not marked- hand your solutions in on Tuesday 31/10/17).


25/10/17: Random variables (RV), Range of a RV, Probability mass function (or distribution) of a discrete RV, Expected value of a discrete RV.

Textbook: Chapter 9, pp. 283-290.

Assignment: 9.1, 9.2, 9.3 (if you want them to be checked -not marked- hand your solutions in on Tuesday 31/10/17)


31/10/17: Linearity of expectation: E[X+Y]=E[X]+E[Y] (proof for discrete R.V.s); Expectation of g(X); Counterexample disproving E[g(X)]=g(E[X]); E[aX+b]=aE[X]+b.

Textbook: pp. 290-294.

Assignment: 9.14.


01/11/17: Measures of dispersion: variance and standard deviation of a R.V.; Equivalent definitions for the variance; Independent R.V.s (general case);

Textbook: pp. 294-295, p. 299.

Assignment: prove that Var(aX+b)=a^2Var(X) (prove it for X discrete).


13/11/17: Lab 4 - Summaries of variation.


14/11/17:  Independent R.V.s (discrete case); X and Y independent => E[XY]=E[X]E[Y] (but not viceversa); Distribution of sum of independent R.V.s (discrete case); Bernoulli distribution.

Textbook: pp. 300-301, convolution formula at p. 302, 303-304.


- Toss of two dice: let X=sum of outcomes, Y=max of outcomes, and prove that X and Y are not independent.

- Prove that if X and Y are independent then Var(X+Y)=Var(X)+Var(Y).


15/11/17: Binomial distribution; Geometric distribution.

Textbook: pp. 304-305; Section 9.6.5. at p. 312.

Assignment: Problem 9.32.


20/11/17: Geometric sum and geometric series; Poisson distribution; Poisson approximation of the binomial distribution (no proof).

Textbook: pp. 111-113;

Assignment: Verify that if X is Geometric(p), the sum for k that goes from 1 to infinity of P(X=k) is equal to 1.


21/11/17: Cumulative distribution function; Uniform distribution; Continuous random variables; Probability density function



22/11/17: Density function is not unique; From cumulative distribution function to density; Interpretation of density functions.



27/11/17: If X is continuous, then P(X=x)=0 for every x; Exponential distribution; Exponential r.v. as transformation of a uniform r.v.; inverse-transform method.



28/11/17: Expectation for a continuous r.v. X; Expectation of g(X); Memoryless property of the exponential distribution; Connection between exponential and Poisson; Normal distribution.



29/11/17: Standard normal distribution; Standardisation; Joint probability mass function of two discrete r.v.'s X and Y; Marginal distributions; Probability table.


Assignment: Problems 10.11, 10.36.


30/11/17: Joint density of two continuous r.v.'s X and Y; Interpretation of the joint density; Marginal densities; Convolution formula (no proof).


Assignment: Problem 11.12.


11/12/17: Independent random variables (continuous case); Expected value of g(X,Y); X and Y continuous independent RVs => E[XY]=E[X]E[Y]; X and Y continuous RVs => E[X+Y]=E[X]+E[Y]; Simple linear regression. 

Textbook: pp. 367-374



12/12/17: Least squares method: derivation of optimal regression coefficients. Geometric interpretation of least squares line.




13/12/17: Properties of residuals: null mean and zero correlation with the predictor; Decomposition of variance; coefficient of determination.




14/12/17: Normal linear regression; 95% prediction intervals for the response variable.