MTH734U-MTHM012, Topics in Probability & Stochastic Processes, 2011-2012


Welcome to MTH734U-MTHM012 Topics in Probability & Stochastic Processes!


Three practice exams have been posted below.

Course Material

  • Course Description
  • Course Information

    In week #1 we reviewed some material from Probability Models and introduced renewal processes.

  • Lecture notes for week #1. These may differ from what I wrote in lecture.
  • Problem Sheet #1.
  • Solutions to Problem Sheet #1.

    In week #2 we continued with renewal processes.

  • Notes for week #2.
  • Problem Sheet #2.
  • Solutions to Problem Sheet #1.

    In week #3 we introduced Poisson processes.

  • Notes for week #3.
  • Problem Sheet #3.
  • Solutions to Problem Sheet #3.

    In week #4 we discussed the Renewal Rewards Theorem and its implications.

  • Notes for week #4.
  • Problem Sheet #4.
  • Solutions to Problem Sheet #4.

    In week #5 we discussed semi-Markov processes.

  • Notes for week #5.
  • Problem Sheet #5.
  • Solutions to Problem Sheet #5.

    In week #6 we proved a result about conditioning a Poisson process on the value of N(t) and introduced continuous time Markov chains.

  • Notes for week #6.

    Week #7 is Reading Week and there are no lectures or exercise classes.
    You should take this time to review your notes and the problem sheets.
    The problems on side 2 of Problem Sheet #5 will be covered in Week #8.

    In week #8 we characterized continuous time Markov chains and defined the generator.

  • Notes for week #8.
  • Problem Sheet #8.
  • Solutions to Problem Sheet #8.

    In week #9 we investigated the limiting distributions of continuous time Markov chains.

  • Notes for week #9.
  • Problem Sheet #9.
  • Solutions to Problem Sheet #9.

    In week #10 we introduced Brownian Motion.

  • Notes for week #10.
  • Problem Sheet #10.
  • Solutions to Problem Sheet #10.

    In week #11 we discussed the invariance and reflection principles.

  • Problem Sheet #11.
  • Notes for week #11.
  • Solutions to Problem Sheet #11.

    In week #12 I made some remarks about the final exam. It will consist of five questions, each worth 20 marks, all of which you should do. Each question will be on one topic. You can expect a question on semi-Markov processes or conditioning the value of a Poisson process on N(t). There won't be a question on discrete time renewal theory, as we did not cover that in detail.

  • Notes for week #12.

    Final exams from previous years

    The exams from these years covered material similar to what we covered, except in these exams there is a question on discrete renewal theory. Our exam will be in the same format as these exams: five questions with one topic per question.

  • 2011 exam
  • 2011 exam solutions

  • 2008 exam
  • 2008 exam solutions

  • Sample exam (from 2008)
  • Sample exam solutions