Big Data (Level 8)
Duration
i year
Stage
Award
NFQ Level
Level 8
ECTS Credit
10
The module aims to facilitate learners in engaging with the concept of management strategy, its formulation and implementation.
Module Objectives:
The objective of this module is to provide the learner with knowledge of:
- The theoretical and practical differences between traditional datasets and Big Data datasets.
- An overview of the initial collection of data will be explored for multiple data sources.
- A formal grounding in analytical statistics.
- Apply principles of statistical analytics to solve problems and inform decision making.
- Developing knowledge and understanding of statistical analytics techniques and principles.
Applying these techniques and principles in typical real-world scenarios.
Indicative Syllabus
Introduction
- Introduction to the concept and characteristics of Big Data (volume, velocity, variety) and associated challenges.
- Overview of Big Data applications in domains such as finance, medicine, social media, transportation, etc.
Big Data Platforms
- Challenges associated with programming for big data: Parallelism for computational processes, Storage and compute locality, Distributed computing, Utilisation of cloud computing platforms for big data processing.
- Distributed programming paradigms Distributed programming environments (e.g., Hadoop/HBase) MapReduce algorithm design.
- Big data programming tools and languages (e.g., Pig, Hive)
Big Data Analytics
- Introduction to algorithms for the analysis of high velocity data.
- Creating Spark sessions, dataframes, datasets.
- Performing analytics with the dataset API.
Stream Processing
- Distributed stream processing for data real-time analysis using a distributed framework such as Spark Streaming.
- Advantages and disadvantages of Spark streaming. Architecture and application flow for Spark streaming.
- Stateless and stateful processing. Fault tolerance.
- Spark streaming. Performance monitoring and tuning.
Graph Analytics
- Introduction to graph processing using a package such as Sparks GraphX.
- Graph algorithms and views.
Module Details
Big Data (Level 8)
Learn from the best in your industry
Study your way, on your time
Programmes with purpose, aimed at your future
Here for you, every step of the way
Get in touch
If you have any questions specific to this course, you can speak directly with one of our course lecturers. Please get in touch, we’re happy to help!