520.651 Random Signals Analysis
Fall 2007
Thu Fri 9:00-10:30 AM in Latrobe 107
This is an introductory graduate course in stochastic processes, with
an emphasis on second-order properties, signal detection and parameter
estimation.
-
Random Variables and Functions of Random Variables
-
Expectation and Conditional Expectation (Basic Estimation)
-
Random Vectors (Joint Distributions, Covariance, Diagonalization)
-
Random Sequences (Bernoulli Trials, Markov Chains, ARMA Models)
-
Random Processes (Poisson Processes, Brownian Motion, Stationarity and Ergodicity)
-
Estimation of Random Variables (Kalman and Weiner Filtering)
-
Parameter Estimation (HMMs, Maximum Entropy, EM Algorithm)
The widespread use of statistical models in signal and image
processing, speech recognition and language modeling, communication
networks, stochastic control and almost every other subfield in
Electrical and Computer Engineering makes this a foundation course for
further work for many.
Instructor:
E mail:
Telephone:
Fax:
Office Location:
Office Hours:
Course Assistant:
E mail:
Office Location:
Office Hours:
|
Sanjeev Khudanpur
MyLastName at jhu dot edu
410-516-7024
410-516-5050
Barton 223A
10:30-12:00 Thu & Fri (by appointment, please)
S. Krishna Nemala
siris DOT TheBoldFacedName AT gmail DOT com
Barton 223C
2:00-3:00 Mon & Tue (or by appointment)
|
Textbook and Reference Material
The Fall 2007 offering of the course will utilize the third edition of
the book by Stark and Woods as the primary textbook for the first half
of the course, with additional reading material from Poor for the
second half. Notes from previous offerings of this course may also
be provided as needed.
-
H. Stark and J. W. Woods, Probability and Random
Processes with Applications to Signal Processing, 3rd
Edition, Prentice Hall, 2001. (Differs significantly from older
editions.)
-
H. V. Poor, An Introduction to Signal Detection
and Estimation, 2nd Edition, Springer-Verlag, 1994.
Students are expected to be somewhat familiar with probability theory,
and an undergraduate-level textbook for self study is
-
S. Ross, A First Course in
Probability, 6th Edition, Prentice Hall, 2002.
Homeworks and Exams
Evaluation will be based on a combination of
-
weekly homework assignments (20%) due on Fridays (9:00 AM),
-
a midterm examination (40%) on Thursday, October 25, 2007 (9:00 AM to 12:00 noon).
-
a final examination (40%) on Thursday, December 20, 2007 (9:00 AM to 12:00 noon).
Homework assignments and notes will be posted here throughout the
semester. Check this page frequently!
- Fall 2007 Homework #1: Due Sep 14, 2007: pdf.
- Fall 2007 Homework #2: Due Sep 21, 2007: pdf.
- Fall 2007 Homework #3: Due Sep 28, 2007: pdf.
- Fall 2007 Homework #4: Due Oct 05, 2007: pdf.
- Fall 2007 Homework #5: Due Oct 12, 2007: pdf.
- Fall 2007 Homework #6: Due Oct 19, 2007: pdf.
- Fall 2007 Homework #7: Due Oct 26, 2007: pdf.
- Fall 2007 Homework #8: Due Nov 02, 2007: pdf.
- Fall 2007 Homework #9: Due Nov 09, 2007: pdf.
- Fall 2007 Homework #10: Due Nov 16, 2007: pdf.
- Fall 2007 Homework #11: Due Nov 29, 2007: pdf.
- Fall 2007 Homework #12: Due Dec 07, 2007: pdf.
Problem numbers such as 6.13 (and Arabic chapter numbers) refer to the Stark and Woods textbook (3rd Ed.), while problem numbers like IV.F.5 (and Roman chapter numbers) refer to the Poor book.
An Important Note on Academic Ethics:
Cheating is wrong. Cheating hurts our community by undermining academic integrity, creating mistrust, and fostering unfair competition. The university will punish cheaters with failure on an assignment, failure in a course, permanent transcript notation, suspension, and/or expulsion. Offenses may be reported to medical, law or other professional or graduate schools when a cheater applies.
Violations can include cheating on exams, plagiarism, reuse of assignments without permission, improper use of the Internet and electronic devices, unauthorized collaboration, alteration of graded assignments, forgery and falsification, lying, facilitating academic dishonesty, and unfair competition. Ignorance of these rules is not an excuse.
In this course, you will complete all homework and exams without unauthorized assistance from any person, materials or device. If you have questions about this policy, please ask the instructor. For more information, see the guide on "Academic Ethics for Undergraduates" and the Ethics Board web site.
Remark: Most of the students who took this course in the recent past have indicated in their feedback that the workload in this course was much higher (~50%) or higher (~40%) than in other courses they took. Even with a high workload, however, most students said that the overall quality of the course was excellent (~50%), very good (~35%) or good (~15%). Current students should take note, and budget time and effort accordingly to get the most out of this course.
Old Homeworks and Exams
Homeworks and exams from past offerings of this course are listed
below to give students a better idea of the concepts covered in this
course, and a feel for the pace and level of effort expected.
The homeworks and exams assigned this time may vary slightly, but
hopefully not significantly, based on material covered in class.
- Fall 2006 Homework #1: Due Sep 15, 2006: pdf.
- Fall 2006 Homework #2: Due Sep 22, 2006: pdf.
- Fall 2006 Homework #3: Due Sep 29, 2006: pdf.
- Fall 2006 Homework #4: Due Oct 06, 2006: pdf.
- Fall 2006 Homework #5: Due Oct 13, 2006: pdf.
- Fall 2006 Homework #6: Due Oct 20, 2006: pdf.
- Fall 2006 Homework #X: Won't be graded: pdf.
- Fall 2006 Homework #7: Due Nov 03, 2006: pdf.
- Fall 2006 Homework #8: Due Nov 10, 2006: pdf.
- Fall 2006 Homework #9: Due Nov 17, 2006: pdf.
- Fall 2006 Homework #Y: Won't be graded: pdf.
- Fall 2006 Homework #10: Due Dec 01, 2006: pdf.
- Fall 2006 Homework #11: Due Dec 08, 2006: pdf.
-
Fall 2002 Mid-Term Exam (pdf)
-
Fall 2003 Mid-Term Exam: Oct 30, 2003: (pdf, ps)
-
Fall 2003 Mid-Term Re-exam: Dec 10, 2003: (pdf, ps)
-
Fall 2004 Mid-Term Exam: Oct 20, 2004: (pdf)
-
Fall 2005 Mid-Term Exam: Oct 27, 2005: (pdf)
-
Fall 2006 Mid-Term Exam: Oct 26, 2006: (pdf)
-
Fall 2007 Mid-Term Exam: Oct 25, 2007: (pdf)
-
Fall 2003 Final Exam: Dec 19, 2003: (pdf, ps)
-
Fall 2004 Final Exam: Dec 17, 2004: (pdf)
-
Fall 2005 Final Exam: Dec 22, 2005: (pdf)
-
Fall 2006 Final Exam: Dec 22, 2006: (pdf)
-
Fall 2007 Final Exam: Dec 20, 2007: (pdf)
Old Notes
Some excellent notes on Random Processes are available from the person who taught me Probability, Random Variables and Stochastic Processes: Prof Adrian Papamarcou of the University of Maryland, College Park.