Mini Course MAKE-Decisions:
From Data Science to Explainable AIpierre-simon-de-laplace-machine-learning

“It is remarkable that a science which began with the consideration of games of
chance should have become the most important object of human knowledge”
Pierre Simon de Laplace, 1812.

Winter Term 2018 (next lecture: September, 19-20, 2018 Vienna, 3 ECTS at the WU Executive Academy)

Short Description: This Mini-Course is an introduction into a core area of health informatics and helps to understand decision making generally and how human intelligence can be augmented by Artificial Intelligence (AI) and Machine Learning (ML) specifically (-> What is the difference between AI/ML?). Andreas Holzinger has taught this course in various versions, variations and  duration since 2005.

This page is valid as of September, 08, 2018, 14:00 CEST

Welcome

1) Introduction Paper:
HOLZINGER (2016) Machine Learning for Health Informatics
.

2a) German Speaking students can additionally read this :
https://link.springer.com/article/10.1007/s00287-018-1102-5

2b) Explainable-AI for the medical domain:
https://arxiv.org/abs/1712.09923

3) Introduction Video:
https://www.youtube.com/watch?v=lc2hvuh0FwQ

4) Attend class and enjoy the coffee breaks

5) Take the exam successfully!

Module-Quizzes availabe via Socrative:
https://b.socrative.com/login/student/
(Room Name will be given during the lecture)

Module 00 – Primer on Probability and Information (optional)

Topic 00: Mathematical Notations
Topic 01: Probability Distribution and Probability Density
Topic 02: Expectation and Expected Utility Theory
Topic 03: Joint Probability and Conditional Probability
Topic 04: Independent and Identically Distributed Data (IIDD)
Topic 05: Bayes and Laplace
Topic 06: Measuring Information: Kullback-Leibler Divergence and Entropy

Lecture slides 2×2 (10,300 kB): contact lecturer for slide set

Reading for students:

David J.C. Mackay 2003. Information theory, inference and learning algorithms, Boston (MA), Cambridge University Press.
Online available: http://www.inference.org.uk/itprnn/book.html
Slides online available: http://www.inference.org.uk/itprnn/Slides.shtml

Module 01 – Introduction: Information Sciences meets Life Sciences

Topic 01: The HCI-KDD approach: Towards integrative AI/ML
Topic 02: The complexity of the application area Health Informatics
Topic 03: Probabilistic Information
Topic 04: Automatic Machine Learning (aML)
Topic 05: Interactive Machine Learning (iML)
Topic 06: Key Problems (=Challenges) in Biomedical Informatics

Lecture slides 2×2 (pdf, 5,604 kB): 1-INTRO-MAKE-Decision-20180919-final-2×2
Lecture slides full size (pdf, 3,041 kB): 1-INTRO-MAKE-Decision-20180919-final

Exam-Quiz via Socrative

Module 02 – Data, Information and Knowledge Representation

Topic 00 Reflection – follow-up from last lecture
Topic 01 What is data? The underlying physics of data
Topic 02 On Standardization
Topic 03 Knowledge Representation
Topic 04 Biomedical Ontologies
Topic 05 Medical Classifications

Lecture Slides 2×2 (pdf 6,824 kB) 2-DATA-MAKE-Decision-20180919-final-2×2
Lecuture Slides full size (pdf, 3,825 kB) 2-DATA-MAKE-Decision-20180919-final

Exam-Quiz via Socrative

Module 03 – Decision Making and Decision Support

Topic 00 Reflection – follow-up from last lecture
Topic 01 Medical Action = Decision Making
Topic 02 Cognition
Topic 03 Human vs. Computer
Topic 04 Human Information Processing
Topic 05 Probabilistic Decision Theory

Lecture Slides 2×2 (pdf, 4,580 kB) 3-DECISION-MAKE-Decision-20180919-final-2×2
Lecture Slides full size (pdf, 7,546 kB) 3-DECISION-MAKE-Decision-20180919-final

Exam-Quiz via Socrative

Module 04 – From Expert Systems to Explainable AI

Topic 00 Reflection – follow-up from last lecture
Topic 01: Decision Support Systems (DSS)
Topic 02: Computers help making better decisions?
Topic 03: History of DSS = History of Artificial Intelligence
Topic 04: Example: Towards Personalized Medicine
Topic 05: Example: Case Based Reasoning (CBR)
Topic 06: Towards explainable AI (ex-AI)

Lecture slides 2×2 (pdf, 6,167 kB): 4-EXPLANATION-MAKE-Decision-20180919-final-2×2
Lecture slides full size (pdf, 4,278 kB): 4-EXPLANATION-MAKE-Decision-20180919

Exam-Quiz via Socrative

Module 05 – Methods of Explainable AI and Causal Reasoning

Topic 00 Reflection – follow-up from last lecture
Topic 01: Towards explainable AI
Topic 02: Causal Reasoning
Topic 03: Trade-off: Explainability versus Accuracy
Topic 04: (Some) Current State-of-the-Art Methods
Topic 05: Stochastic And-or-graphs (AOG)

Lecture slides 2×2 (pdf, 4,235 kB): 5-METHODS-EXPLAINABLE-AI-MAKE-Decision-20180920-2×2
Lecture slides full size (pdf, 6,548 kB): 5-METHODS-EXPLAINABLE-AI-MAKE-Decision-20180920

Exam-Quiz via Socrative

Practical Work: Planning a 500-bed hospital IT-infrastrucure –
how to bring AI/ML directly into the clincial workflow

Exam-Questions: (personally handed out)

About the Lecturer:

Andreas Holzinger is lead of the Holzinger Group, HCI-KDD, Institute for Medical Informatics/Statistics at the Medical University Graz, and Associate Professor of Applied Computer Science at the Faculty of Computer Science and Biomedical Engineering at Graz University of Technology. He serves as consultant for the Canadian, US, UK, Swiss, French, Italian and Dutch governments, for the German Excellence Initiative, and as national expert in the European Commission. Andreas obtained a Ph.D. in Cognitive Science from Graz University in 1998 and his Habilitation (second Ph.D.) in Computer Science from Graz University of Technology in 2003. Andreas was Visiting Professor for Machine Learning & Knowledge Extraction in Verona, RWTH Aachen, University College London and Middlesex University London. Since 2016 Andreas is Visiting Professor for Machine Learning in Health Informatics at the Faculty of Informatics at Vienna University of Technology.

Personal Homepage: http://www.aholzinger.at

Video for Students: https://youtu.be/lc2hvuh0FwQ

Group Homepage: http://hci-kdd.org

Google Scholar: https://scholar.google.com/citations?hl=en&user=BTBd5V4AAAAJ&view_op=list_works&sortby=pubdate

Additional study material:

Course Biomedical Informatics – Discovering Knowledge in (big) data (1 semester – 12 lectures – 3 ECTS):
https://hci-kdd.org/biomedical-informatics-big-data/