1477 Data Processing 2: Scalable Data Processing, Legal & Ethical Foundations of Data Science
Ines Akaichi, M.A., Assist.Prof. PD Dr. Sabrina Kirrane
Weekly hours
Language of instruction
09/05/23 to 11/26/23
Registration via LPIS
Notes to the course
Day Date Time Room
Tuesday 12/05/23 09:00 AM - 01:00 PM TC.2.02
Tuesday 12/12/23 01:30 PM - 05:00 PM LC.2.064 PC Raum
Tuesday 12/19/23 01:30 PM - 05:00 PM LC.-1.038
Tuesday 01/09/24 09:00 AM - 01:00 PM TC.2.01
Tuesday 01/16/24 01:30 PM - 05:00 PM TC.-1.61
Tuesday 01/23/24 01:30 PM - 05:00 PM TC.-1.61
Tuesday 01/30/24 09:00 AM - 01:00 PM D3.0.225

This fast-paced class is intended for students interested in scalable handling of big data, understanding legal fundamentals and ethical frameworks in dealing with data in an international context. The course focuses on gaining fundamental knowledge in dealing with large amounts of data and learning about efficient and scalable processing methods. Throughout the course there will be an emphasis on important aspects regarding legal and ethical principals related to data processing and data science.

Learning outcomes

Students in the course will learn about the scalable handling of big data, understanding legal fundamentals and ethical frameworks in dealing with data in an international context.

This includes:

  • Basic knowledge about different scalable data processing frameworks and paradigms, including:
    • The Hadoop ecosystem
    • Batch processing with Apache Spark
    • Stream processing with Apache Kafka
  • Legal and Ethical frameworks
    • Codes of Conduct
    • Intellectual Property Rights / handling of different licensing schemes
    • Relevant European Regulations
    • Algorithmic bias
Attendance requirements

According to the examination regulation full attendance is intended for a PI. Absence in one unit is tolerated if a proper reason is given.

If a student cannot attend a particular class, the student should send an email to the course instructor before the class starts, providing a legitimate justification for their absence.

Teaching/learning method(s)
The course will focus on in-class code walkthroughs of high-quality, well-commented code that students can later reference. The course puts a particular emphasis on in-class discussion and project work.

Week 1 - Lecture 1:

  • Introduction to Scalable Data Processing and Legal & Ethical Foundations of Data Science
  • Horizontal & Vertical Scalability
  • The Big Data Ecosystem
  • Ethics from & Data Science
  • Intellectual Property

Week 2 - Lab 1:

  • Deep Dive into Apache Spark
  • Movie Lens code walk through and exercise
  • Friends code walk through and exercise

Week 3 - Lab 2:

  • Deep dive into Machine Learning using Apache Spark
  • California Housing Linear Regression code walk through
  • Deep dive into natural language processing using Apache Spark
  • Classification of Data Science Tweets code walk through

Week 4 - Christmas Break

Week 5 - Lecture 2:

  • Anonymisation & Aggregation
  • Consent, Transparency & Compliance
  • Synthesized Data
  • Bias & Algorithmic Fairness
  • Big Data in Practice

Week 6 - Lab 3:

  • Deep dive into Apache Kafka & Stream Processing
  • Dealing with real world data from Reddit using Kafka and Python
  • Deep dive into Sentiment Analysis
  • Working with TextBlob, Kafka, and Spark to analyze real-time streaming data

Week 7 - Lab 4:

  • Project consultation sessions

Week 8 - Lecture 3:

  • The proposed Data Governance Act
  • The proposed Artificial Intelligence Act
  • The World Wide Web as a Distributed Data Source
  • Industry Trends

Homework and Class participation: 15% 

Project Proposal: 15%

Project: 70% (the project will mainly consist of adaptations and discussion of the practical examples presented in class)

Prerequisites for participation and waiting lists

Successful conclusion of the course 1 of SBWL Data Science.

Please be aware that for all courses in this SBWL registration is only possibly for students who successfully have completed the entry course (Einstieg in die SBWL: Data Science).

Note that for courses within the SBWL "Data Science" we can only accept students enrolled in one of WU's bachelor programmes who qualify for starting an SBWL; particularly, we cannot accept students from other courses and programmes enrolled at WU as 'Mitbeleger' only.


Please log in with your WU account to use all functionalities of read!t. For off-campus access to our licensed electronic resources, remember to activate your VPN connection connection. In case you encounter any technical problems or have questions regarding read!t, please feel free to contact the library at

Availability of lecturer(s)

During the lecture and based on individual appointments. To request an appointment send an email to the lecturers with the subject “[Data Processing 2]”.

Last edited: 2024-03-11