SmartEdu : Big Data Solution for Video Processing

Objectif :

This repository introduces a Big Data solution designed for ingesting educational video data into HDFS. The system performs image processing operations on these videos and provides a user-friendly web interface for visualizing valuable insights. The project aims to support teachers in enhancing the educational experience by offering a comprehensive platform for video analysis and insights.

Configuration :

1. Clone the repo

git clone https://github.com/AdnaneAs/BigData_Solution-SmartEdu.git

2. Go to the directory and create a new network

docker network create SmartEdu-network

creating a network serves to establish a communication bridge between Docker containers

3. run the container

docker-compose up

4. in a terminal execute this commande that enable to access to the backend container shell

docker exec -it SmartEdu_backend /bin/bash

then execute this to launch zookeeper server

/usr/local/kafka/bin/zookeeper-server-start.sh /usr/local/kafka/config/zookeeper.properties

5. in another terminale execute:

docker exec -it SmartEdu_backend /bin/bash

then launch kafka server

/usr/local/kafka/bin/kafka-server-start.sh /usr/local/kafka/config/server.properties

6. To stop the containers use

docker-compose down

In the Local machine Video be in

BigData_Solution_SmartEdu\src\videos in the cloned repository.

Inside hdfs the video will be in /kafka_output