This project provides an end-to-end data processing and visualization of visa numbers in Japan using PySpark and Plotly. The spark clusters are set up within a Docker container on Azure.
-
Updated
Oct 11, 2023 - HTML
This project provides an end-to-end data processing and visualization of visa numbers in Japan using PySpark and Plotly. The spark clusters are set up within a Docker container on Azure.
The software used to control my cluster
A Python-based distributed video processing system that splits a video into chunks, processes them in parallel using worker nodes, and merges the outputs into a final video using a master–worker architecture.
Learning Node.js-based HTTP server that leverages the cluster module to handle requests across multiple CPU cores, improving performance and scalability.
Add a description, image, and links to the master-worker-architecture topic page so that developers can more easily learn about it.
To associate your repository with the master-worker-architecture topic, visit your repo's landing page and select "manage topics."