MID0019 | Parallel Programming: Techniques and Paradigms |
Teaching Staff in Charge |
Assoc.Prof. NICULESCU Virginia, Ph.D., vniculescucs.ubbcluj.ro |
Aims |
- To understand the fundametal notions of parallel programming.
- To know and use some formal methods for parallel programs development. - To implement parallel algorithms using MPI language and Java threads. |
Content |
This course covers theoretical foundations of parallel algorithms. The emphasis of this course is on the design and analysis of parallel algorithms.
Parallel algorithms are presented with emphasis on linear algebra applications, FFTs, graph, searching and sorting algorithms. 1. Fundamental notions about parallel programming: - Parallel systems classifications - Processors interconnection networks - Parallel programs performance evaluation 2.General principles for parallel programs construction: methodical design, partitioning, communication, agglomeration, mapping. 3.A method based on imperative programming: - Parameterized processes, - Data distributions, - Derivation from specifications. 4. Methods based on functional programming: - Bird-Meertens Formalism, - PowerList, ParList, PList theories. Laboratory Parallel programs development using: - Java Threads, - Message Passing Interface (MPI). |
References |
1. CHIOREAN, IOANA: Calcul Paralel - Fundamente, Ed. Microinformatica, 1995.
1. FOSTER, IAN: Designing and Building Parallel Programs, Addison-Wesley 1995. 2. LOYENS, L.D.: A Design Method for Parallel Programs, PhD. Thesis, University of Eindhoven, 1992. 3. MISRA, J.: PowerList: A structure for parallel recursion. ACM Transactions on Programming Languages and Systems, 16(6):1737-1767, November 1994. 4. NICULESCU, V.: Modele de elaborare a algoritmilor paraleli, PhD. Thesis, Univ. Babes-Bolyai, 2002. 5. PETCU, D.: Procesare paralela, Editura Eubeea, 2001, Colectia Informatica, Timisoara, ISBN 973-9479-48-0, 414 pagini. 6. SKILLICORN, D.: Foundations of Parallel Programming, Cambridge International Series on Parallel Computations, 1994. 7. SKILLICORN,D.B. - TALIA, D.: Models and Languages for Parallel Computation. ACM Computer Surveys, 30(2) pg.123-136, June 1998. 8. The Message Passing Interface (MPI) standard, [http://www-unix.mcs.anl.gov/mpi/], 2000. 9. The Java Tutorial. [http://java.sun.com/docs/books/tutorial/] |
Assessment |
An average between the laboratory grade and a written exam grade.
Lab activity: 40% Written examination: 60% |
Links: | Syllabus for all subjects Romanian version for this subject Rtf format for this subject |