Data Science Portfolio

Objective:

• Exploratory Data Analysis
• Data Visualization
• Create re-useable datascience portfolios.
• Explore various machine learning algoirthms.
• Explore Big Data Tools

Install Anaconda

wget https://3230d63b5fc54e62148e-c95ac804525aac4b6dba79b00b39d1d3.ssl.cf1.rackcdn.com/Anaconda-2.3.0-Linux-x86.sh

bash Anaconda-2.3.0-Linux-x86.sh

Install Jupyter Notebook

Anaconda conveniently installs Python, the Jupyter Notebook, and other commonly used packages for scientific computing and data science [http://jupyter.readthedocs.io/en/latest/install.html#id3]. If your anaconda does not have Jupyter Notebook, you install via:

1. pip3 install --upgrade pip
2. pip3 install jupyter (Use pip if using legacy Python 2.)
3. Done.

(Optional) Install Jupyter Notebook theme

1. pip install jupyterthemes

You can play around with the themes: https://github.com/dunovank/jupyter-themes

2. Select a theme and more e.g.

jt -t onedork -tfs 12 -tf loraserif -nf exosans -alt

Python

Python codes and comments

Installation

1. Go to www.python.org and install python 2.x or 3.x
2. Go to cmd promt and set PATH (e.g. for 2.7)

setx PATH "c:\Python27"

3. Open a new cmd instant and type

python --version

4. Done.

Integrating with Eclipse

1. Run Eclipse in Adminstration mode.
2. Go to Eclipse Market Place (Help > Eclipse Market Place)
3. Search for "PyDev" and install
4. Set PATH for Python Interpreters (Windows > Preferences > PyDev > Interpreters > Python Interpreter) "Click" New... Interpreter Name: Python 2.7 Interpreter Executable: c:\Python27\python.exe
5. Done.

Installing Scala and Apache Spark

Mac OS

https://medium.com/@josemarcialportilla/installing-scala-and-apache-spark-on-mac-os-837ae57d283f

Windows

https://medium.com/@josemarcialportilla/installing-scala-and-spark-on-windows-249632e6b83b