A full data analysis project using Python, SSIS & PowerBI.

Blog Post-Part I- • Blog Post-Part II- • Problem • Solution • How To Use • License

Problem

• The client needs interactive data analysis tools to explore and analyze their financial data in an intuitive and user-friendly manner.

Solution

• We offer a comprehensive Business Intelligence solution that includes automated extraction and transformation of financial data from an unstructured web source, as well as the creation of a dynamic and regularly updated dashboard.

• We use Microsoft services such as SSIS, PowerBI, and SQL Server as well as Python with its various libraries for Web Scraping and Data Cleaning.

• We will ensure structured data feeding and the implementation of an audit dashboard to track and evaluate the performance of the solution.

How To Use

To clone and run this application, you'll need Git and Python with a package manager such as Anaconda installed on your computer.

From your command line:

# Clone this repository
$ git clone https://github.com/ismailouahbi/MarketShare_analysis.git

# Go into the repository
$ cd MarketShare_analysis

# Install dependencies
$ pip install -r requirements.txt

# Run the scripts [Using Jupyter Notebook or Google Collab]
### You will need to start by the first script 'scraping.ipynb' followed by data cleaning script and source database population 'data-cleaning.ipynb' 

$ jupyter notebook

Note The data-cleaning.ipynb script contains the data cleaning steps as well as connexion to the source database in Sql Server along with its population

License

MIT

---

By:

• Hamza Khalid
• Ismail Ouahbi