Map Reduce explained with example | System Design

8 months ago
4

Understand how big data processing works with MapReduce on a real-world website logs example.

For weekly insights on web development that you won’t want to miss, subscribe to My Newsletter: https://hayksimonyan.substack.com

Connect With Me On Other Platforms:
✍️ Medium: https://hayk-simonyan.medium.com
🆇 Twitter: https://twitter.com/hayksimonyann
💼 LinkedIn: https://linkedin.com/in/hayksimonyan
🧑‍💻 GitHub: https://github.com/hayk-simonyan
🌐 Website: https://hayksimonyandev.web.app

🔖 Sections
0:00 The problem
0:21 What is MapReduce?
0:52 Map Phase
1:15 Reduce Phase
2:10 The Benefits of MapReduce
2:47 Batch vs Stream Processing
3:50 Micro-Batch Processing
4:55 Limitations of MapReduce
5:05 Apache Spark
5:23 Apache Flink
5:44 Hadoop
6:13 AWS EMR, Azure HDInsight, and GCP Solutions

#mapreduce #bigdataprocessing #apachespark

Loading comments...