Babes-Bolyai University of Cluj-Napoca
Faculty of Mathematics and Computer Science
Study Cycle: Master

SUBJECT

Code
Subject
MID1023 Validation of Simulation
Section
Semester
Hours: C+S+L
Category
Type
Component-Based Programming
4
2+1+0
speciality
optional
Intelligent Systems
4
2+1+0
speciality
optional
Formal Methods in Programing
4
2+1+0
speciality
optional
Modeling and Simulation - in English
4
2+1+0
speciality
compulsory
Teaching Staff in Charge
Lect. PREJMEREAN Vasile, Ph.D.,  percs.ubbcluj.ro
Aims
To assimilate the Simulation as a method of studying the real phenomenon. To gain skils related to problem solving through simulation. To teach the students the concepts used in the field of modeling and simulation and to acquire the methods for validation of simulation.
After promotion the students should be able to use simulation as a method of solving real problems. They will know to verify their programs and to validate the simulation results.
Content
(C1-C14 lectures, S1-S14 seminars)

C1 (+S1)- The Object of simulation ([4,6,9])
• What is simulation?
• When to use simulation?
• Types of modeling and simulation
• Advantages of simulation
C2 (+S2)- Examples of Simulation ([8] chapter 5)
• Two problems that can be used by simulation
• The components of the simulation programs
• We need the parameters of the models, random numbers and statistical methods!
C3 (+S3) - The steps of a Simulation study ([6] chapters 1&2)
• Statement of the problem
• Data collection
• Model building
• Program implementation
• Program verification
• Output Analysis and validation
• Decision making
• Document the entire simulation activity
C4 (+S4 ) - Verification and validation of a software system ([2], chapters [1,2])
• The components of verification and validation
• Is the program correct?
• Static, dynamic, and formal verification
• Program validation: inspection and testing
• Input and output validation
C5 (+S5 )- Validation of simulation model ([6] chapter 5, [7])
• Is the model correct for what is required?
• Choosing the important variables
• Validate the parameters of the model
C6(+S6)- Program Inspection ([5] chapter 3)
• What is Inspection ?
• Inspection team
• The steps of Inspection
• Advantages of inspection over testing
C7(+S7)- Program Testing ([5] chapter 3)
• What is testing?
• Types of testing
• Unit testing, integration testing
• Regression testing
C8(+S8)- Input analysis ([2,3])
• Parameter estimation methods
• Confidence intervals
• Data validity
• Data availability
• What if no real data is available?
C9(+S9)- Sensitive Analysis ([O2])
• What is sensitive analysis
• Regression analysis
• Statistical design
• Factorial analysis
C10(+S10)- Calibration ([1, 6 chapter 5, O6])
• What is calibration?
• Comparation of results with real data
• Acceptability of simulation results
C11 (+S11) - Statistical analysis of output data ([O1])
• Parameter estimation methods
• Confidence intervals
• Statistical hypothesis verification
• Compare the simulation results to real data
C12 (+S12) - Certification, Acreditation ([6], chapter 6)
• The needs of certification and accreditation
• What are they?
• Elements of certification and accreditation
C13 (+S13) - Software tools for validation ( [6, 11])
• testing tools
• debugging tools
• programs for performing statistical data analysis

C14 (+S14) - Simulation Documentation ( [2,7])
• Why document?
• What must it contain?
• Documentation validation.
There are laboratory classes where the department network is used. Specific bibliographic materials are also used (books, articles, Internet resources)
References
1. ARSHAM H., Systems Simulation: The Shortest Path from Learning to Applications,
http://www.ubmail.ubalt.edu/~harsham/simulation/sim.htm
2. BALCI, O., Validation, Verification, and Testing Techniques throught the Life Cycle of a Simulation Study, Annals of Operations Research, 1994, no.12, pp.1-49
3. BLAGA P., Statistica prin MATLAB, Presa Universitara Clujeana, 2002.
4. DODESCU Gh., Simularea sistemelor, Ed.Militara, Bucuresti.
5. M.Frenţiu, Verificarea corectitudinii programelor, Ed.Univ.”Petru-Maior”, Tg.-Mureş, 2001, 116 pp., ISBN 973-8084-32-6
6. Averill M. Law and W. David Kelton, Simulation Modeling and Analysis, McGraw Hill, Third Edition (2000).
7. Kleijnen J.P.C., Theory and methodology of Verification and validation of simulation models, European Journal of Operational Research, 82(1995), 145-162.
8. STATE, L., J.POPESCU, Modele probabiliste in Inteligenta Artificiala, Litog. Univ. Bucuresti, 1979.
9. VADUVA I., Modele de simulare cu calculatorul, Ed. Tehnica, Bucuresti 1977.
O1. Jack P.C. Kleijnen, Five-stage procedure for the evaluation of simulation models through statistical techniques, Proceedings of the 1996 Winter Simulation Conference, p.248-254.
O2. Kleijnen J.P.C., Sensitivity analysis and optimization, Proceed. of the 1995 Winter Simulation Conference, p.133-140, 19959.
O3. Kleijnen J.P.C., Validation of models: statistical techniques and data availability, Proceed. of the 1999 Winter Simulation Conference, 1999.
O4. RACEANU, E., Limbaje de simulare, Ed.Militara, Bucuresti, 1981
O5. SANDERSON D.P., R.SHARMA, R.ROZIN, and S.TREU, The Hierarchical Simulation Language HSL: A Versatile Tool for Process-Oriented Simulation, ACM Trans.on Modeling and Computer Simulation, Vol.1, no.2, 1991, pp.113-153.
O6. T.I. Oren, Concepts and Criteria to Asses Acceptability of Simulation Study : a frame of reference, Comm.ACM, vol.24(1981), no.4, 180-184.
O7. Papers on Software Metrics from the Journals:
a. IEEE Software.
b. IEEE Transactions on Software Engineering.
c. Transactions on Modeling and Simulation, ACM.
d. Software -- Practice and Experience, Wiley.
Assessment
The final grade will rezult from the evaluation of the seminars work and of a final exam.
Webpage: http://www.cs.ubbcluj.ro/~per/Val_Sim.html
Links: Syllabus for all subjects
Romanian version for this subject
Rtf format for this subject