Coursera_Projects/Convolution_model_Application_v1.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Convolutional Neural Networks: Application\n",
    "\n",
    "Welcome to Course 4's second assignment! In this notebook, you will:\n",
    "\n",
    "- Implement helper functions that you will use when implementing a TensorFlow model\n",
    "- Implement a fully functioning ConvNet using TensorFlow \n",
    "\n",
    "**After this assignment you will be able to:**\n",
    "\n",
    "- Build and train a ConvNet in TensorFlow for a classification problem \n",
    "\n",
    "We assume here that you are already familiar with TensorFlow. If you are not, please refer the *TensorFlow Tutorial* of the third week of Course 2 (\"*Improving deep neural networks*\")."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## 1.0 - TensorFlow model\n",
    "\n",
    "In the previous assignment, you built helper functions using numpy to understand the mechanics behind convolutional neural networks. Most practical applications of deep learning today are built using programming frameworks, which have many built-in functions you can simply call. \n",
    "\n",
    "As usual, we will start by loading in the packages. "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "import math\n",
    "import numpy as np\n",
    "import h5py\n",
    "import matplotlib.pyplot as plt\n",
    "import scipy\n",
    "from PIL import Image\n",
    "from scipy import ndimage\n",
    "import tensorflow as tf\n",
    "from tensorflow.python.framework import ops\n",
    "from cnn_utils import *\n",
    "\n",
    "%matplotlib inline\n",
    "np.random.seed(1)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Run the next cell to load the \"SIGNS\" dataset you are going to use."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "# Loading the data (signs)\n",
    "X_train_orig, Y_train_orig, X_test_orig, Y_test_orig, classes = load_dataset()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "As a reminder, the SIGNS dataset is a collection of 6 signs representing numbers from 0 to 5.\n",
    "\n",
    "<img src=\"images/SIGNS.png\" style=\"width:800px;height:300px;\">\n",
    "\n",
    "The next cell will show you an example of a labelled image in the dataset. Feel free to change the value of `index` below and re-run to see different examples. "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "y = 2\n"
     ]
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAP8AAAD8CAYAAAC4nHJkAAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAAIABJREFUeJztfWmMZMeR3hd19D19zMnmzJAcksNzxBmKQ4oUKWrEQ6YO\niOs/9Gq9C9ogwD9rQwuvsaRswMAaMEDDwGL9wzBAeOUlsNrVcrWSSMmyZHJI6uA9FO9jOORw7qNn\nprun767uqvSPqnkZka8yO6u6p4rcFx/Q6Hwv82VmvXpZLyIj4gsyxkChUGQPuXZPQKFQtAe6+BWK\njEIXv0KRUejiVygyCl38CkVGoYtfocgodPErFBnFshY/Ed1DRHuJ6CMienilJqVQKM4/qFknHyLK\nA/gQwN0AjgB4FcC3jTHvrdz0FArF+UJhGdfeBOAjY8x+ACCiHwC4F4B38a9ePWQ2b9xYPaBljLyi\nWP5EKNBF6qe1md/aFbhXjXXRyi+n8RsSvOK8O6yehwFWoEtT6+TI0WMYHR2L+gKXs/g3AjjMjo8A\n+ELogs0bN+IXTz5ePXCnR7EaCNUtpg5TH7/+/aDQyo2cR7oLe8L9XsOCFq/kn9MdwHjryNdFaqzQ\nffTck9CtavoBNnWLAGDI18xtyIqmEhiJNwzc08AUw+0q/laBLz5e+vbcENbH1++9L7KvFmz4EdGD\nRLSHiPacGR0938MpFIpILOfNfxTAZna8qXZOwBjzKIBHAWD757bxV5a3Y/d3kLy1gZrAjyl/Wbo/\nuiTe2qFOQm+RQJXv1RzqJzVJ/gHCTX1DicPwDfe3i0bkdxZ4GTe7NxX70m4nuPQpP2cDUmkTAuxy\n3vyvAthKRFuIqAPA7wN4chn9KRSKFqLpN78xZpGI/g2AXwLIA/ieMebdFZuZQqE4r1iO2A9jzM8B\n/HyF5qJQKFqIZS3+lURIp4veCw3u3BtWCu03xLULTsq/KSsUW3dXXY7dnO5H/k18Zyx/O/9eRyOK\npa+PBr5n796Ds9MtrnGtH+yeBvZKwl+a73uRTYP3O9R99L0iT9keeS01daDuvQpFRqGLX6HIKFos\n9psokTJWok537xHx6syjuRGiPWiiujABeyRF3o909/XnmJ5ipHrjuSbdp2tLrG9PbcjaJuV5ezql\np/CGoRHCyo63CyGyu+9L32dz7pXh36fbMuQwxtvZ69KPjnH+Lw198ysUGYUufoUio9DFr1BkFC03\n9Z0z6YXMXCkIC01z+mlY/10e0i7Cfn06aPGJHs9vX2pmr8A1s/ruj2tKlSq5G2iydH+peUScqfbt\nN7eF9fXmvnk5nN8MGOxjJVzKI77b+PWhb36FIrPQxa9QZBQtF/vPCSVp8SbkdeeJxQ/GfzvithC7\nArHywegxj+rgdhF5lFZ9lh43hVDEXyQoZTeqb8YMfmMpUbY+Gopzj2zXnB4XUB1S3YfEck+d8X+3\nQXoG8T6OfZKag775FYqMQhe/QpFRtGG333M+FHPh8fQK009FitSRO91uL5I4JMSUEdNbvbpYWTag\ntgR2mHldLsD0Edy1D+k+YkqxnbhecbwmtNMdqTBF3o/QAxgWtgNen9zLMdiJn4aML5J0AM85K1o8\n9M2vUGQUuvgVioxCF79CkVG0VOc3COnerNysC15k0FawiyaC9UIEDylyieCUmiDwTM2l/kE4VjFk\nbgvMuIn7HdZ33b2HQKRdJKLNhUGENgsa7qHOfs7yzXbNLBp98ysUGYUufoUio2i9qS9CxDGBbCqS\nhq0BzzcGCpmoOOlCcxa84DyCPHL+iJpQl17EDhU7jZCakjJ3RutxgQ8TpSOGuwhxdPj7cM2/TXiE\nhngGg0M3G4CmYr9CoYiELn6FIqPQxa9QZBSt1/krNQ3H1Z0CZJY+PZlCmlSsOcy9LKAk+klBG9B3\nA7ZEEm6wcaQcLgmoj8wjyHkZtDzF2QvTpJS+wRpB/e89aFo9DzCRGwex+QRj9r2W7qOx8/Ww5Juf\niL5HRCNE9A47t5qIniKifbX/Qw2MqVAoPgWIEfv/GsA9zrmHAew2xmwFsLt2rFAoPkNYUuw3xvya\niC5xTt8LYFet/BiA5wA8FDfk0iaJUFSftCi5ffn79hNPBExxqXn4hKombYIpc5DPzBMSqZ0uhVnU\nrzqEiDhC9COxWBFJ3NvJ8j3k0iK6PyJUtlr+JwuTuIQiFGO5/uLQ7IbfBmPM8Vr5BIANy56JQqFo\nKZa922+qP6H+32iiB4loDxHtGR0dW+5wCoVihdDsbv9JIho2xhwnomEAI76GxphHATwKANd97lpj\nfydi+esCgmdKcovbqQ8Kr54dd/dKOadQwEuz4pm9rhLkrwsEDpn6KoDsvV6fvBj3fgh/ykjTQiNB\nP76qFHde/U7j+RMlUl6fK6HfNGElWInQoGbf/E8CuL9Wvh/AE032o1Ao2oQYU9/fAXgRwJVEdISI\nHgDwCIC7iWgfgLtqxwqF4jOEmN3+b3uq7lzhuSgUihai5R5+Fiml3JYDemxIu3F93cRRdPpuf49S\nc2X6f3lRtKvMzyblXGeXnEehI2o8mba5uf0Rcd4lKhV6fZw3ZOiuhXXQ2CtDRi++NxAyh8X13pCO\nLG5CrDdn4DmN9niMN62e23dSAk+FQrEkdPErFBlFa8V+Y1AxVV7ylAlJ0KQ53OVk2wprXsjs4sbT\nOPPwNYwT3IBKaS4pn3ntV6KufPJwUs4PrhN1A9tvScqdqx3fKB/5RkN8F9wcFOKR95OW+AdfAXaT\nFUgvFuw+WBn6diM/Z7Q35EogHIK2XOibX6HIKHTxKxQZhS5+hSKjaCNvv9/Ul9bl61+VVmP9/OrR\nxJ/+EEIx4OiBj5Ly4Zd+K5r1dXQm5cIpGc8wPX42KQ/f+S1R19E/WHcaYfUuzgW5EVdo316B6yqb\nJu2sjzAZRpzhMto6FtkwbLBzNPkVceGNrYy9pxLNuBnrm1+hyCh08SsUGUXrPfzOyVApr7WAaOgh\n8EiLofwgxHXP1QiXzIOP5PcSnDw7npRPjZ0V7UrdvUm5r0dUoXDyRFI+9vKzom7T7V9LynnmGRgU\nr6PDuwKibIpPsX7DVCRcSNb0fJ2pTyLaRcv28qgZlcCdu/E/V/FziTUluqj//Qav8JgcG5m5vvkV\nioxCF79CkVG0IV2XW6gDcsU6TkrBf6/8AS/xCaKaE/8GNl2SlOc6HNl+1gb2gPKiqo9Nf/HjD0Td\nyODqpHzBDbexKck+xGZ8kwQYbrAQh480oqGNel/fQQ7xwHXxsr1z7AmQamjucTvwAWMTlriTDSOo\n8kZC3/wKRUahi1+hyCh08SsUGUUbTH21f5FmonClY4oLeK35osfS3n719V23bf96G5E3vOMm0e7j\nZ35h+6jIiRTyto9eZ69g9O1XknLXWtv/0Jar/HMOs5GycoAQJJaUshE2D99owa+9WV044Anoeybc\nNGdNexDWvzB+z8nfNjylOKLSEPTNr1BkFLr4FYqMon0cfrGyj3sZJ/pYXBB1lcWS7a7YKery/DhI\nIBGX4oqbHK+45Uui3dG9SU5TTB4/IvtgP7cVx4KXX7Bfx6Hnn0rKXavXi3bdA2vqTbw6Z4+kH60d\nOIehgBdhRkv1ESmGNhM10wihhs90G2AwCXEapmHbVsTZeA+/5pQd91Or2K9QKCKhi1+hyCh08SsU\nGUXb3HvT0V1xOlHp7JmkPPra87LdhI20K/QNirrerdfa8sVbkzIVi8H5+qbITZW9Q0Oi3XVf/WZS\nfvFvvyfq5icnkvLk3JyoG1pr+xnosJ/l2J7nRLuLb/t6Us53dgcmXH++QDz9Y5AQJLYPYW5rYLOn\naZde3oXPFJdiMGG9+TcV0jsFy3fVjXb8Dd3G8+HeS0SbiehZInqPiN4lou/Uzq8moqeIaF/t/9BS\nfSkUik8PYsT+RQB/aoy5BsDNAP6YiK4B8DCA3caYrQB2144VCsVnBDG5+o4DOF4rTxLR+wA2ArgX\nwK5as8cAPAfgoSX78wv+/msq5aR85NUXk/LYm6+Jdp15mworVzgp6k58/HFSHrru+qR84Y3STFfo\nsmJ0WmKssDq/nLXxyquT8hV33CPq9jz5D0m5n6Spso+l/TIVO9bUJ++Jdke7++xYN+4SdXnHxGk7\nDB7GIcDE0bS4GjkTX+rxpVG/bUpqrjCzpTs28c+5snkG6s3FX+H3lAymcfegoQ0/IroEwPUAXgaw\nofbDAAAnAGzwXKZQKD6FiF78RNQH4B8B/IkxZoLXmepPcd2fHiJ6kIj2ENGe0bGxek0UCkUbELX4\niaiI6sL/vjHmR7XTJ4louFY/DGCk3rXGmEeNMTuNMTtXD+meoELxacGSOj9V6U/+CsD7xpi/YFVP\nArgfwCO1/0/EDGhJMF1Ti1+XqjD99+QJq8ufPTsj2vV2Wp2ZcvOiLt9h9wNKb+xJynPMPAgAwzu/\nmJR71kq3Wg6hd6aUROu3e+2tXxZVYyPHk/Lx118SdXPz1j15Zs7OvxsyrfeZt+R1HBtv/EpSzjMz\nZtrA1rju2jx/fXMmu/jx/HsPktSVR//Jzy/fgvHz8D22qZTo/i6ckeOiXdPbAUb+j0CMnf9WAH8E\n4G0ieqN27j+guugfJ6IHABwEcF/0qAqFou2I2e3/Lfw/XHeu7HQUCkWr0AYPv+rvSEpSDgRc5fJ2\nmoOXWWKLj99+R7RbZCJPd6c0eXUsWJWgULLlyY/3inbTp2wU3oVf2CXqVrOxESCD5ESRBceD8Ia7\nvpGUnzl2SNRNnbEqTW7SCqIVhxCkp2jvx8hrMlUYddqcAZs+/0VW4Sd/SPHxR5JvrER27ZD65PN8\nC1Duh02axm/Oa5ZfM6T9yXkESGiiR4vI39DAd6K+/QpFRqGLX6HIKNqXrivAKZeWumzbyz5/Y1Ke\nnJBpst56ynLnrZqX3nODvZYvj3L2Ny9Pcie9cta6MBz8zf8VdbNTtm7D1dZLMN/hBAdxwhEHfUOW\niGPbHV8TdS88/te2ixnL/Z/Lya+pwKwJeZJjHXrpmaTcvW44Ka/ZfKl3Tik+ReGRx9SDlOrghyfj\nV52GfrJ7n/rRpJNg8BLxOV1O/Gjywug74p9L0xaVxuV+ffMrFBmFLn6FIqPQxa9QZBQt1fmNsdFH\nBFcvzol2PuQLVr/esesuUVdhJsGXnviJqJuas558Q73Wk66/V5Jh9PbZ1NimIj0I9//6l0l57OiB\npLz5BhkZ2Lt6XVKmnGTppJz93JuuuFbUbdy2Mykf2POCvabimIbKto+ebmnSLM3bz/nhb+18b/jn\n94t2HV0sZ0BK1+b57eBHnDOaN/dfauhYno/YEMIAQnp8uAdnP8B7g5q1g4ZIbZZPHMKhb36FIqPQ\nxa9QZBQtNvWZhKTCpH53KryVc5UHjsh13RdZWmtH7Hr5p08m5enTNrR41fSUaNc/Z9WAYkGK7N19\ntm7y4L6kvPfUMdFu/bVWfF97+TZRV+yxRBz5nDQRbvuS9ZY+9L71XhwbPSXaFXL2jhQ65FfY3WPF\n+ckj+5PykXck8cmWG25lR34O+2al12gzXazusMRovmt8XaRSXMf2H9JbmkwBnub4T3cdmFHT0De/\nQpFR6OJXKDIKXfwKRUbRWp3fAJVzZipHdxKc+CkyBU7WwEk0/W60227+gjjuG+hPys//zOr/Rw4d\nFO0KE5NJeZVjBhxmZrtCwd66wpw0CZ7Y82xSHj3wgahb/7mbk/LqzZeLuv411vX36ltuT8p7nvx7\n0W6mxEyVpizq+K3rYXsWh19+RjQbHN6clIcuvBg+SL2zOeJMX/7AhroUz0DUsNXhIr1vRVWAqJRM\nyMU5QCoiyiH3Xs8eQrqhU9c4mYe++RWKjEIXv0KRUbTWww8GFa+ozlIdO204h70R4qQj8sIvMm25\n2nLprxm20W6vPS9Tfr3ytE2NXZqVPIA0Zr3nFss2anBoVY9o19VpTXizI9IM+OHTP0rKQ5d/Ts7x\nRsv3d8UNVm059sGbot30cUsCMjEtVQ5+5zihCc1Jk+ZHv7URi9d981+Kus6eVVgufNJns1J/dB+h\n7F8BApPwpAJp2z3dhE2HAZ0XkeZCR/2o1Bo3cj/1za9QZBS6+BWKjKL1HH7n+OhcAgnyHngJH1z6\nZYeFQtaw8VYNDiTl2++RhBrDmzcl5V/9nydF3ZlTlmNvkakic4wfEABWseCg3q4uSFhV5fCe34ia\nMcbpd+WX7Ly23/VN0e6lHz6WlGdLUjXhYn+pbMfqdLwV5w9YD8X9Lz0r6q643Y6dL/BHJCRwx7kC\nNkv/HT1SKkjJ118DhB1Ut1iv06g+YuOXgt6K7hJp4r7qm1+hyCh08SsUGYUufoUio2gDb399T6Rw\njBVXmOzvVdgByjEX8r0Cpq+7ut4V22wU3hDzuAOAX/38p0n50AfvJuWZuZJo1zNpzW/9vdIM2NNl\nCUN7OyR5aInlDPjdE1avv3D7F0W7i7ZbEtOPXvyVqFus2D2ABUb6MV+QX3Vn0e4BHHL2Hjp6Lff/\nJZ+3RCX5opyvtFAF9nAi9dHY1NsNRQZGdpIiMfW2jdsbCPURNFU2ea+a2UpZ8s1PRF1E9AoRvUlE\n7xLRn9fOryaip4hoX+2/ZuFUKD5DiBH75wHcYYzZDmAHgHuI6GYADwPYbYzZCmB37VihUHxGEJOr\nzwA45x5WrP0ZAPcC2FU7/xiA5wA8tHR/Sclzvg5XGbHfqJBJkJn+XDIPw1JemQBxHFcl1l5wgaj7\n2r/4g6T86q+teex3v/q1aDc5ZoODpqZmRd36Ies9t+qCtaKuu9MOPsOChQ69+pxot9C9OimX8pIQ\npLIwZ8tl+9nmczKPQaXbBi31FqSn5IEXLPefKVsz5pab7hDteBq1FFZE1PcZ+PzPjgvxFAQjjOJm\nEey/adRPI5YOcAt00YQNNWrDj4jytQy9IwCeMsa8DGCDMeZcvukTADY0PLpCoWgboha/MaZsjNkB\nYBOAm4hom1Nv4PmBJKIHiWgPEe0ZY77xCoWivWjI1GeMGQfwLIB7AJwkomEAqP0f8VzzqDFmpzFm\n59DQ4HLnq1AoVghL6vxEtA7AgjFmnIi6AdwN4L8CeBLA/QAeqf1/Yqm+jGHppkNBVSkbHovG4nXk\n/naRpwyhzIv9gFQEIR9L1nUxPfm2u76alC/YuEm0e+ZHNnJv7oz8TeRkJPPzc6Iun7OmtGKem9Wk\nTj43bvscOzUq6rZsXJ+U1622psrFRemCzD9Zh5NGHCxi8QAjAekekprd8JXXJeUwD36QwRO+yqaI\nREImsIBpUh7GJyuIpQHlBB6uVzr5bo9xeydfVVOmvhg7/zCAx4goj6qk8Lgx5mdE9CKAx4noAQAH\nAdzXxPgKhaJNiNntfwvA9XXOnwFwZ/oKhULxWUDrPfy88kmAo43JRYZ7+AU8AVNplDyRWen52BNp\n4hHmGcjSfF9+jUy71cUi+V7+uYwMnB89kZTHJiZE3dSMFb9zXE1x5sGGxkUb5D5KJ+P0v2C19dTL\nO2m+Rycsucfsguy/WLQkIHMz1my599e/EO3611+YlHuHpNkyFiFTnzc9VQMyLnm4/9xnR5qa5f0Q\nbZ3nSpoSfRXyRDACL8RVGGvSjIT69isUGYUufoUio2h9uq5EhHUpkAORIHx7VOzAOyIYBcR+Rrud\nY6qDK+IJETvFjuzxEnTabdxyaVK++w/+SNS9+4INxPnkjd+JutLE2aRcZkE5qMgBLt5kd/Ev2iy9\nEE+cOJ2Ux8etX0V3hyQV6WFpviYnz4o6nu04R7ZcciwXh15/MSlftesboo6rRc2GoJDnmQiSYUTu\ngrvqBh8rzO/nep9yKxKzFKXm4WcEIY++0BjfYeOCv775FYqMQhe/QpFR6OJXKDKKNpj6yrX/zu+O\nUO8CnlJcx0rp9bxP2b/YD+CeUjnX5MPzBzj9V/hxmbVzTYK2rm9wtajZ+VVLxnnBJZeJutd+abn0\nJ0dsWu41Q32iXY7N48ypMVHHtwrGGanIbEFG9XUyYo4Oh+hjfNKaAfv67NjFvLwfIx++lZQ3btsp\n6vrX29wIUnNvjrlfZLFKVfqvE9+14O2PRzNmtGiSziWvZH1ErZH4kfTNr1BkFLr4FYqMorXpuoxB\nJeGSd1JthcR50Yx5+OUc0V5YAV3efm4G9PMAEjMJOlZAId4L9aAsg2Zmx88k5dKUDGNenGfkHvMy\nhdbmLTZAqPMCm1V4qF+K/SPHrcnt2MhpUVdg3oUzLN1YR0Hy71HF3v9169eLOv6xzzIVYGiwX7Qr\nz9q6T34n055tu/v3knIuJ3MGcATJPDxROU1S/y+BQPBR4Hnk85c8M6GcEgGOSt815wH65lcoMgpd\n/ApFRqGLX6HIKFpr6jMm0Y/TUXf+NMhCfxK6vGxZYXWp/QBB4MH1R3e0+vz+1WOr25cYweb+lyV3\n/tzx/Um5UJGc/osL1uRGTqTdUI/l+F9k0Xmr+iX3/2LJsqQfPn5G1I2O2D2GCvucq/p6Rbsyy+NH\nHZ2irsT2MPp6LIEJOYSdxPZtju99S9Rt3m5TjA9dIMlOvEi5xHI9OWCmC+jkK6I2B8kx+V4VO5vK\nFVnvijpDRY0Eb3RhI2ZJffMrFBmFLn6FIqNouYdfpSY6u2I5T8OVzrzNzHRMHHYo9qSDnxt8hTyr\nqtQtV0+wOkfsJ2PF3PGTR5PysfffEO3W9Vtz26oeKVKfHbe8fXOz0kTY3285/cdOTyfl7nFJ+tHR\nYUk/enu7Rd2pCXvd1CxP3SVvSEenNf2ddvrv67d9DgxaM+PCvD8d+Lxjtjy69+2kPMhIP9LRnLG8\n/f6zsempBbFHiJQjahbnrvMweARc/GK9/9LnIzxfG5D79c2vUGQUuvgVioyitR5+MNYjKhUMw+Hn\n3wvRL4cENCle1t9Frh7yY2eOTFScGrcBNZWKFN8LefubWnRosRcWbf8lh6RjvmQtATzN16o+SfHN\n1YWSQ8m9dq21BMwcs56AU3NSZO9hAU1zEzLop3+A7fCL7MbSKzPPPlvOCZA6/pHNYrz1pi8n5Y5O\nqaYExW3j++JTLeN69BmN3LrASKkufZaG1CMcojbn/QXGCon95ytdl0Kh+KcHXfwKRUahi1+hyCha\nT+aRKtTAvfNCgV48Oi9FsMm7czupv8eQiioz/v0A0Rvz1CvmZdRagZFj5F2vOBbhNuOk6/rk0Mmk\nXJqxJrvZaenhd3qMkXTMS3191YA1F/YPWK++OafdAmP9yDn3Jsd07dIM81DMO16TOf/extSo/SyT\nZywxydoLLxLtjMfzEkjRs7JrmnPb41flGlPsPXNqcnC/c6uTIyAwpSZJUTii3/y1NN2vE9HPaser\niegpItpX+z+0VB8KheLTg0bE/u8AeJ8dPwxgtzFmK4DdtWOFQvEZQZTYT0SbAHwDwH8B8O9qp+8F\nsKtWfgzAcwAeWrKzmonPBH53UllMRSVv5xfZK44ImTMeU18qMyzn7ffXlRcZUUZR3sYiP3ZsN8WC\nFfunpqX57cARKx5vXGM962YcT8CpWasuuCIwz8Z74QbL73/qjOTmn5i2qkNXXorsA93WQ7HAVIJ8\nQXL/c0WCHNWnMmfVltFjB5PyGkfsl/CLsiZA4hfK5usznTXEsRdpSYxFsItIk2NDwU0exL75/xLA\nn0EqzhuMMcdr5RMANqSuUigUn1osufiJ6JsARowxr/namOrPct0dByJ6kIj2ENGecceHXKFQtA8x\nb/5bAXyLiA4A+AGAO4jobwCcJKJhAKj9H6l3sTHmUWPMTmPMzkGHA06hULQPS+r8xpjvAvguABDR\nLgD/3hjzh0T03wDcD+CR2v8nlhzNWN2NUvp6pPsjj8gL5GUjl4jD4yOcIl0QJJ2yjwpzb12Ys+63\nedcExghCXS/mAjP9LS7Kypk523+x05r3Fiqy/wr7LG7OAE440tVhTX0dRamT8/u/qlfq8uuGrLlQ\nfE1FSQI6ze5HqST3Jfi8Th39JClffsOtol2OQtGcfMKe8w5S7rY+c22Tunvz3CCcjCR28DhXZaf7\naCzHyecRAHcT0T4Ad9WOFQrFZwQNOfkYY55DdVcfxpgzAO5c+SkpFIpW4FPj4cfF0GBKJ16suJ34\nzXS+dM8UMPW5UWyc926REVtUylL0Li+w6xwzWo55xbmRcH29Vqzu7LSi+MSM9AScZdF/cFJodTEe\nwDlmEiw41Pl86HUDA6KuwPoss/tYhhTtOXmKMW4eBnvdmWNHknJpdkY06+yROQl88KXdSh2nSFw8\nCHqRun3EydTBqLvgdXGgoBlQU3QrFIpI6OJXKDKKlov9PvEk5KUVK9LInXq/KUD25uyWsz4qIbGf\nifrzTtDM3LwNhnEz4HLCjvHJaVG3wMY+Pmo98ubnXO48O4+NF8pUW5wAY3HRzqPgWFf6WVqvdQ41\n+Cy7bm6R7egvOqI90x3KTsoyYvdq4owN8hk9eUy0G75kK7vIpVu3CAXzcHE7Wvh1jQKBpiH+mGj+\nPZ+bKqSay5ulnfYCn7NxCj998ysUWYUufoUio9DFr1BkFG3Q+etDmHJCaZucGnEU4EYXKboCewN8\nrIpjSqwwr8EKG2x6xiHHZB5/HQ6ZBzcfdjuedUcnbT8TpyxBqClLXXsNI+koFOTv98SE3Svo6rB1\nZcccObx2MCnnClJTLLHxuD6ac5TQMvMmXFyU+x48bfk8Mzm+/ZunRbv+oXVJubd/UNT5UrV7STOr\ntc6R59lxH7LIqLj0bhTXw/nGUnxegNjB4sg940fSN79CkVHo4lcoMoqWi/0+fj5JzOG3w5gAn1qQ\nG12oBNxbzG3I+3N+G8m6yVGHNY+NnZVea8Qz8TriZaFo+9w4IDPnnpqyJrbTYzb8Oe948fV2W6/B\ns6Ojom6Bmek6O63nXtlRHYp55rlnpJmul3Hr8/s2V5Kqw/QsO3b65x6EOfbdHv/obdHu7RcsDcSO\n2/+ZqOPeipJHz5/yK+iN1wS3vTterLdf0/2vMHFICPrmVygyCl38CkVGoYtfocgo2hDV51P6WTng\nehnMSeYP7nJCtUK/ecwkSK7Ob48Hhi0R5WxFTnh6zurdax2X2J4Om7K7a0Cm7761yx4vlK0JzL1n\nM8zdd3poznYtAAASo0lEQVRWRvzli7aPoX5G5rFGRs/191i9vqvDyS1A9U1Wxtl7WGDH8wG31yIL\n/yuzPQkA2P/680m5s3+1qLtqx86k3M31f/jdgEN6ckhb589VY5z4pm6rVLSoj5sfcBJOxLkqp+vO\n7b/E70nom1+hyCh08SsUGUXrPfwipJI0WUP9o1RX/sxPjkoQ8iYMmAGZ2L/6Aiv2X3z5laLZZtho\nvcFuKdrPz1g1YGZBesUVmSmx2MlSYTli+WCf7bM0L/svsLadrJxzeAYXmToyP++k3uZtBR+hP09C\n2eEjXCybes1SxCdzE+NJ+ZX/9xNRNz56Jilff8uXk3L/oPQEzLEUaEGSi1DkKFdvXO5//1VOu+Z0\nDiNS1cXNwz1yiWdioG9+hSKj0MWvUGQU7dvtb8ARSyTXYjx9rgdegC9BJt8V553gHS52uXWcDpyJ\nWVcPrxXtOidsHwsVSZ63ULR9jk6fkXVzLIVWD/tqHAI+w4Jm3Cy9YMczLOiHHLGfBze5gTIFlnqL\ni9QV56bOzdt5zMxLL8E5xmNY5ipAijPRlicmToi615/5aVKeOm3rtu74gmi36dLLk3Jv3ypRxzMJ\nEwVUOn5NJIdk+kI/D6VQHSJVgNBYLmX7wkzVI9QloAlB3/wKRUahi1+hyCh08SsUGUVLdX4DA3NO\nb3b0TJ9O7tYF3blEn27kFytz1d0ZjB+7ZB6cEGP+9PGkXDp1XLSbZWa0CknCjqkF1gfJ9Fdnp04n\n5V5jv5o5N/WY4WnDpM5fYim6ucnOTSmW4956KZYIZt7j98O5VyVmqhyblp6G3PLH8xOkCEFYNGDF\nMReSsSbTg2++kJSPfPS+aHfRNTuS8hXbbxJ1Gy/ekpS7u62XIOVCz06AQDZlzYsMwwuwgHLSVb6v\nknOfYW5anZfkr9NnqySplbKzBxRA1OKvJemcBFAGsGiM2UlEqwH8PYBLABwAcJ8xZszXh0Kh+HSh\nEbH/K8aYHcaYcw7XDwPYbYzZCmB37VihUHxGsByx/14Au2rlx1DN4fdQ8ApjxTw3JZIRmbZc85vH\nVBTwzguJ/Vycd0XZMjux6Hijca+46TFLojE5Kk12lQXWf06K9pNMKptekNx/M1NWlCvBqgvFBWlG\n4/MqlRyxn4niRZYzoKPDMRdysdf5Mvg9WFhk3meOqLzIRPapORmww6XojiLzNHT6cOfPwVObgZk3\nS+MyG/zHrzyXlI98+K6ou3DrtUn5yu02UGjTRVtEu+5eGwSVc/MHREbYCFKRgLk6nVKMe0PyVGlO\nlmh2D6bH5TM3eqqqMi46z0oIsW9+A+BpInqNiB6sndtgjDmn7J4AsKH+pQqF4tOI2Df/bcaYo0S0\nHsBTRPQBrzTGGKL6BF21H4sHAWD9urX1migUijYg6s1vjDla+z8C4McAbgJwkoiGAaD2f8Rz7aPG\nmJ3GmJ2DA/0rM2uFQrFsLPnmJ6JeADljzGSt/FUA/xnAkwDuB/BI7f8TS/VljEn0RNfFsczcEt3o\nMW5iq4hceo5OFDAX+kx4KXMeO3a57rmuPUuWRHNkQerT06etPrZYkbd4osRdcyXxZ57x4E+zz9bZ\nKfvnc553IgO5m22xaOeYd/j9y/xeueZOVinIQ3OyjxLTL8vOfexhewx59lnmStL9dJ71UXD2A7oK\nbL+ETbIj75oLWW7B00dF3f7xU0n5xMdWYN1w2dWi3VVsP+DiLZeJOp4uPW1djsvWF4pTDbmlcyyU\n7OecnJoQdR/tPwAAmJ+Xey8hxIj9GwD8uPYhCwD+1hjzCyJ6FcDjRPQAgIMA7oseVaFQtB1LLn5j\nzH4A2+ucPwPgzvMxKYVCcf7R+qi+mnhYdkR2Lva74jb3AhMeYSmx32/C46JyWYj9sl05pBJw+bho\nRcGBbbfIdkcPJeWJcSmegZnzMCO9tOZK1ktujnHp04xjvuEqTF6m186tsiarhYVZW3Y8wvgnczNv\n8+9GRLiRvFlck+hzVJMcq1xg93HOMUWJHo1fBVtk5VTMHY9QdMVmZk6dP30kKR8+e0o0O33wQ1t3\nzfWibvtNtyblodVy01qYIwO5BeR8U2ei2vHHccp5JvbtPwgAmCtJ83EI6tuvUGQUuvgVioxCF79C\nkVG0IUV3VXEJBke5abNFeu365wHHRJjqY+n+UhNxzTqsirup9jp6YPfQmqR8YWpPwZ5YcN12hemM\nmT7LcpKcnaa7R/Lxd7LItZkJa3L88PXfiHajJ63+m2IDYuxD3N3UjcjL55hO7tysWeYWzN1S3f2F\nBbaHU0iltbbz6mUuwh1F+c4qsC8m75gjuxmJaZExIpUr8jMvnDqclN/7jXRZOXbgo6S87cYvirqL\nOYtQr/VjyTnzgHAZjtsPcJ/vBWbWnZ13Ij2TCNH497m++RWKjEIXv0KRUbQ+RXdN4nGju3KGEUg4\npo886pt5yo5dh4cXVByRiVup+NBl5+dPkor4CUdkpKHbzk+UIfpwVAJuWhSzJ8eMlrdfWz7n1LHj\nnh5r9lv1ld8T7Q7ufSMpH9onyTFmZ6znIZ+im+Z7dta2m11w5HkZpslOyw/dXbTzXdVTlHXMXNjB\nSEUdXhJ0MXG+KG+HUCXEI+dGlfIHZHFW1I3tfy8pPz8iiVs+ZGQhl19pvQY3DF8o58jUsUJeRnqK\nnAHiXslneGrammtHTx8TdeUaiYurKoSgb36FIqPQxa9QZBStFfvJiqWOxIsCk8PcWAl+WGG7pnkj\nf7sqIUsA50kLeALydsYV2Tn3n+ea6jErO58lxBFY8Xgeuv1X2B1ZTLky2h1h7mWWL3aLZldut7vW\nW7dJ3ruKyKTLOAfnpJfge2+9lpQ/+uA9UTfHVAJ+3/LO+6az04rAA72S77Cvy6oBfIO/kLLCmLpl\nQIr6ghvE1VKEuiefzg7Gi7gwIUk0Dr9jmesO7bOBQ6sGZcbhwTXWAuTmFiiyzM2cd7/iWHkmJqy3\n6LFjUuw/c6o6r9KcVFlC0De/QpFR6OJXKDIKXfwKRUbRUp2fQGnPpxoErbmj03FCRR7B5eaOg+A/\nd6o8ZrqQzp/m9K9PtJiO/mP7Bm4nwoPQ0flTs64/D+7955KMyqhHbiJ1vPOYvYyTfgBAZ0c3q7OP\nSHfvgGh3021DSXn9BRtF3euv/DYpjzGCUzdic2za7i+4Ho9r+7pY2erFnT3SVMate64XongS2EaK\na2ZllsSUmTif49+13CzoZMel6bNJ+ey0jOYcO2YjPStujkmqvyZSZDJs76G8KO9Vrva9k+bqUygU\nS0EXv0KRUbQhsKcK91fHcNE+lUrJij+GXZlzJWp2WUqc95B5uJE9XBx0BUjyqA4pwV6oFX6eQZfQ\nxHhMfaG0YYtOpAwPDuIqgUt8wtUAVxUrcI85phJ0OO5znN9v/cZLRd3OW62Y/u7rLyflk8cOi3YV\nNsfpBfk5FyYsuckUCz4amu0U7Qa6rRrQ2ykf6WKOe8+xz5x3PSN5ajMnrTq7p5Tzq1kFkQbOVemY\nOuY8E75UdRVHLSzxPpx5nPs63aUTgr75FYqMQhe/QpFR6OJXKDKKFuv8JonYa0A18bZ1XWedoeSh\n0MP9JJ2xefxCJKA+s6Lb1tXDfX2m52gr02SnvK6+2Q+QOn9qjjwVtMgLKN8VIu23o8cWugaT8mXX\nWk58ykuz4qmjB1gXcv+Cm3L5fkBlRnLTz7GIwv4u2f+qTnvcWeSRgQ5xCNtXcs2ixQ6W/8CZY5mF\nhfI8Bq5Ldijfn88tveL00ckiNk3FdW2vXqc6v0KhWBK6+BWKjKJtHH5pxzdmkgkkN+J1Lm8BF5nc\n9FG+FF0hsd8JqpJkG/W5KqrtAtGFIsN4k6qJSF/mispMJeCmw1SUIydIcURI34cLzcN1UjMsnVln\nj/UE3HTZ50Q7bnIbP3FQ1BFLX8bFWdcPcr7CzYXS843zHfKaTid9GTfuOdnABC+gYwUU6GLp2Bsh\n1eAQ6egclS7HciO4dee8Pl2SnBCi3vxENEhEPySiD4jofSK6hYhWE9FTRLSv9n9o6Z4UCsWnBbFi\n/38H8AtjzFWopu56H8DDAHYbY7YC2F07VigUnxHEZOkdAHA7gH8FAMaYEoASEd0LYFet2WMAngPw\nUKgvg7ToKCqTokvJzURZvpOOgGgf2mU3AXE4QOsdS/8tjlNSf+TYQjXxi/Y+8a9a5iqAnIdILeWk\n4TJU3yuOXM5EJg7nnB3yHHuvFFhqs1WD60S7TZdtr9sOAMaPf2wPWCZeR2IXO+mLzv2eZ/cnx6wT\nlQV/6rFOhyRQfO/O81tkfIq8IbmZeJk4nrpXQlSv/6y7cNXac9mO/VmD04h5828BcArA/yai14no\nf9VSdW8wxpxjMzyBajZfhULxGUHM4i8A+DyA/2mMuR7ANBwR31RfWXV/p4joQSLaQ0R7zp6dXO58\nFQrFCiFm8R8BcMQYcy4644eo/hicJKJhAKj9H6l3sTHmUWPMTmPMzoGBVfWaKBSKNmBJnd8Yc4KI\nDhPRlcaYvQDuBPBe7e9+AI/U/j+x5GhCPnBJL/0KTrR3XsDE5qsLWOJSnl5CjxPpmCX4L2pK1WZd\nuGaZSqW+fp2eh7hKDuAJETOpSDJ/VJ/s3XaSc98Vhu8pOB5nnDiT3atCQRJx9PVbostNl0ozYFe3\nTUU2csiSY5bmpAQp9gBSjxHbA2H3prsoH31OqLGQch3l88/7qoSJMOfsj/Dv2k0jztV0YkbHkPpe\ncqI5u2qNGzH1xdr5/y2A7xNRB4D9AP41qs/440T0AICDAO6LHlWhULQdUYvfGPMGgJ11qu5c2eko\nFIpWoeUefn4KDN4mwNIRaaYLUeeJnt3Ms0IG85t8OJdCbFovQJpoyDHTcZNbjjGVELm8bNwb0kV9\nE1657CgLwizl60Ei7a3IORMdMdfjkeeKsvmCfQR7+vpF3QUXX5WUu1jdsf3viHaz46eS8qKjBnFR\nnw9eyMv55nluAUey57kiyK0UBDK2z4LjJhgKguIqGZFfxRD8hHmZZbiyWEldvxTUt1+hyCh08SsU\nGYUufoUio2h9VJ/XpMf1+tRFnrK/67TpsL5pjlxSB/Z7SI4JzIg8gXwsV5/mZUcX5u6mjlstP+am\nIpfXnR+nchxwYk62V7BAMtqtErilcg9DGj9lQ7b/4uY19F7l6qTsczr3u7PT5g9Ys+Eie76rT7Q7\n+OHrSXli5IioE1GOggjWvR/+/aIuYZ6Vc+xgz0+BkW3kHB9kaYJzvk9eww6Krs7PyUjdHJB0ftx7\nFQrFP0Ho4lcoMgpqlnSgqcGITqHqELQWwOmWDeyHzkNC5yHxaZhHo3O42BizbulmLV78yaBEe4wx\n9ZyGdB46D51Hi+agYr9CkVHo4lcoMop2Lf5H2zSuC52HhM5D4tMwj/M2h7bo/AqFov1QsV+hyCha\nuviJ6B4i2ktEHxFRy9h+ieh7RDRCRO+wcy2nHieizUT0LBG9R0TvEtF32jEXIuoioleI6M3aPP68\nHfNg88nX+CF/1q55ENEBInqbiN4goj1tnEfLaPJbtviJKA/gfwD4GoBrAHybiK5p0fB/DeAe51w7\nqMcXAfypMeYaADcD+OPaPWj1XOYB3GGM2Q5gB4B7iOjmNszjHL6DKh38ObRrHl8xxuxgprV2zKN1\nNPnGmJb8AbgFwC/Z8XcBfLeF418C4B12vBfAcK08DGBvq+bC5vAEgLvbORcAPQB+B+AL7ZgHgE21\nB/oOAD9r13cD4ACAtc65ls4DwACAT1Dbizvf82il2L8RwGF2fKR2rl1oK/U4EV0C4HoAL7djLjVR\n+w1UiVefMlWC1nbck78E8GeQnB/tmIcB8DQRvUZED7ZpHi2lydcNP4Spx88HiKgPwD8C+BNjzEQ7\n5mKMKRtjdqD65r2JiLa1eh5E9E0AI8aY1wLzbNV3c1vtfnwNVXXs9jbMY1k0+Y2ilYv/KIDN7HhT\n7Vy7EEU9vtIgoiKqC//7xpgftXMuAGCMGQfwLKp7Iq2ex60AvkVEBwD8AMAdRPQ3bZgHjDFHa/9H\nAPwYwE1tmMeyaPIbRSsX/6sAthLRlhoL8O8DeLKF47t4ElXKcSCWenyZoGqw9V8BeN8Y8xftmgsR\nrSOiwVq5G9V9hw9aPQ9jzHeNMZuMMZeg+jw8Y4z5w1bPg4h6iWjVuTKArwJ4p9XzMMacAHCYiK6s\nnTpHk39+5nG+N1KcjYuvA/gQwMcA/mMLx/07AMcBLKD66/oAgDWobjTtA/A0gNUtmMdtqIpsbwF4\no/b39VbPBcB1AF6vzeMdAP+pdr7l94TNaRfshl+r78elAN6s/b177tls0zOyA8Ce2nfzEwBD52se\n6uGnUGQUuuGnUGQUuvgVioxCF79CkVHo4lcoMgpd/ApFRqGLX6HIKHTxKxQZhS5+hSKj+P9b7K4+\nyuoTDQAAAABJRU5ErkJggg==\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x7f8a87b04780>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "# Example of a picture\n",
    "index = 6\n",
    "plt.imshow(X_train_orig[index])\n",
    "print (\"y = \" + str(np.squeeze(Y_train_orig[:, index])))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "In Course 2, you had built a fully-connected network for this dataset. But since this is an image dataset, it is more natural to apply a ConvNet to it.\n",
    "\n",
    "To get started, let's examine the shapes of your data. "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "number of training examples = 1080\n",
      "number of test examples = 120\n",
      "X_train shape: (1080, 64, 64, 3)\n",
      "Y_train shape: (1080, 6)\n",
      "X_test shape: (120, 64, 64, 3)\n",
      "Y_test shape: (120, 6)\n"
     ]
    }
   ],
   "source": [
    "X_train = X_train_orig/255.\n",
    "X_test = X_test_orig/255.\n",
    "Y_train = convert_to_one_hot(Y_train_orig, 6).T\n",
    "Y_test = convert_to_one_hot(Y_test_orig, 6).T\n",
    "print (\"number of training examples = \" + str(X_train.shape[0]))\n",
    "print (\"number of test examples = \" + str(X_test.shape[0]))\n",
    "print (\"X_train shape: \" + str(X_train.shape))\n",
    "print (\"Y_train shape: \" + str(Y_train.shape))\n",
    "print (\"X_test shape: \" + str(X_test.shape))\n",
    "print (\"Y_test shape: \" + str(Y_test.shape))\n",
    "conv_layers = {}"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "collapsed": true
   },
   "source": [
    "### 1.1 - Create placeholders\n",
    "\n",
    "TensorFlow requires that you create placeholders for the input data that will be fed into the model when running the session.\n",
    "\n",
    "**Exercise**: Implement the function below to create placeholders for the input image X and the output Y. You should not define the number of training examples for the moment. To do so, you could use \"None\" as the batch size, it will give you the flexibility to choose it later. Hence X should be of dimension **[None, n_H0, n_W0, n_C0]** and Y should be of dimension **[None, n_y]**.  [Hint](https://www.tensorflow.org/api_docs/python/tf/placeholder)."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "# GRADED FUNCTION: create_placeholders\n",
    "\n",
    "def create_placeholders(n_H0, n_W0, n_C0, n_y):\n",
    "    \"\"\"\n",
    "    Creates the placeholders for the tensorflow session.\n",
    "    \n",
    "    Arguments:\n",
    "    n_H0 -- scalar, height of an input image\n",
    "    n_W0 -- scalar, width of an input image\n",
    "    n_C0 -- scalar, number of channels of the input\n",
    "    n_y -- scalar, number of classes\n",
    "        \n",
    "    Returns:\n",
    "    X -- placeholder for the data input, of shape [None, n_H0, n_W0, n_C0] and dtype \"float\"\n",
    "    Y -- placeholder for the input labels, of shape [None, n_y] and dtype \"float\"\n",
    "    \"\"\"\n",
    "\n",
    "    ### START CODE HERE ### (≈2 lines)\n",
    "    X = tf.placeholder(tf.float32, shape=(None, n_H0, n_W0, n_C0))\n",
    "    Y = tf.placeholder(tf.float32, shape=(None,n_y))\n",
    "    ### END CODE HERE ###\n",
    "    \n",
    "    return X, Y"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "X = Tensor(\"Placeholder:0\", shape=(?, 64, 64, 3), dtype=float32)\n",
      "Y = Tensor(\"Placeholder_1:0\", shape=(?, 6), dtype=float32)\n"
     ]
    }
   ],
   "source": [
    "X, Y = create_placeholders(64, 64, 3, 6)\n",
    "print (\"X = \" + str(X))\n",
    "print (\"Y = \" + str(Y))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "**Expected Output**\n",
    "\n",
    "<table> \n",
    "<tr>\n",
    "<td>\n",
    "    X = Tensor(\"Placeholder:0\", shape=(?, 64, 64, 3), dtype=float32)\n",
    "\n",
    "</td>\n",
    "</tr>\n",
    "<tr>\n",
    "<td>\n",
    "    Y = Tensor(\"Placeholder_1:0\", shape=(?, 6), dtype=float32)\n",
    "\n",
    "</td>\n",
    "</tr>\n",
    "</table>"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### 1.2 - Initialize parameters\n",
    "\n",
    "You will initialize weights/filters $W1$ and $W2$ using `tf.contrib.layers.xavier_initializer(seed = 0)`. You don't need to worry about bias variables as you will soon see that TensorFlow functions take care of the bias. Note also that you will only initialize the weights/filters for the conv2d functions. TensorFlow initializes the layers for the fully connected part automatically. We will talk more about that later in this assignment.\n",
    "\n",
    "**Exercise:** Implement initialize_parameters(). The dimensions for each group of filters are provided below. Reminder - to initialize a parameter $W$ of shape [1,2,3,4] in Tensorflow, use:\n",
    "```python\n",
    "W = tf.get_variable(\"W\", [1,2,3,4], initializer = ...)\n",
    "```\n",
    "[More Info](https://www.tensorflow.org/api_docs/python/tf/get_variable)."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "# GRADED FUNCTION: initialize_parameters\n",
    "\n",
    "def initialize_parameters():\n",
    "    \"\"\"\n",
    "    Initializes weight parameters to build a neural network with tensorflow. The shapes are:\n",
    "                        W1 : [4, 4, 3, 8]\n",
    "                        W2 : [2, 2, 8, 16]\n",
    "    Returns:\n",
    "    parameters -- a dictionary of tensors containing W1, W2\n",
    "    \"\"\"\n",
    "    \n",
    "    tf.set_random_seed(1)                              # so that your \"random\" numbers match ours\n",
    "        \n",
    "    ### START CODE HERE ### (approx. 2 lines of code)\n",
    "    W1 = tf.get_variable(\"W1\", shape=[4, 4, 3, 8],initializer=tf.contrib.layers.xavier_initializer(seed = 0))\n",
    "    W2 = tf.get_variable(\"W2\", shape=[2, 2, 8, 16],initializer=tf.contrib.layers.xavier_initializer(seed = 0))\n",
    "    ### END CODE HERE ###\n",
    "\n",
    "    parameters = {\"W1\": W1,\n",
    "                  \"W2\": W2}\n",
    "    \n",
    "    return parameters"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "W1 = [ 0.00131723  0.14176141 -0.04434952  0.09197326  0.14984085 -0.03514394\n",
      " -0.06847463  0.05245192]\n",
      "W2 = [-0.08566415  0.17750949  0.11974221  0.16773748 -0.0830943  -0.08058\n",
      " -0.00577033 -0.14643836  0.24162132 -0.05857408 -0.19055021  0.1345228\n",
      " -0.22779644 -0.1601823  -0.16117483 -0.10286498]\n"
     ]
    }
   ],
   "source": [
    "tf.reset_default_graph()\n",
    "with tf.Session() as sess_test:\n",
    "    parameters = initialize_parameters()\n",
    "    init = tf.global_variables_initializer()\n",
    "    sess_test.run(init)\n",
    "    print(\"W1 = \" + str(parameters[\"W1\"].eval()[1,1,1]))\n",
    "    print(\"W2 = \" + str(parameters[\"W2\"].eval()[1,1,1]))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "** Expected Output:**\n",
    "\n",
    "<table> \n",
    "\n",
    "    <tr>\n",
    "        <td>\n",
    "        W1 = \n",
    "        </td>\n",
    "        <td>\n",
    "[ 0.00131723  0.14176141 -0.04434952  0.09197326  0.14984085 -0.03514394 <br>\n",
    " -0.06847463  0.05245192]\n",
    "        </td>\n",
    "    </tr>\n",
    "\n",
    "    <tr>\n",
    "        <td>\n",
    "        W2 = \n",
    "        </td>\n",
    "        <td>\n",
    "[-0.08566415  0.17750949  0.11974221  0.16773748 -0.0830943  -0.08058 <br>\n",
    " -0.00577033 -0.14643836  0.24162132 -0.05857408 -0.19055021  0.1345228 <br>\n",
    " -0.22779644 -0.1601823  -0.16117483 -0.10286498]\n",
    "        </td>\n",
    "    </tr>\n",
    "\n",
    "</table>"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### 1.2 - Forward propagation\n",
    "\n",
    "In TensorFlow, there are built-in functions that carry out the convolution steps for you.\n",
    "\n",
    "- **tf.nn.conv2d(X,W1, strides = [1,s,s,1], padding = 'SAME'):** given an input $X$ and a group of filters $W1$, this function convolves $W1$'s filters on X. The third input ([1,f,f,1]) represents the strides for each dimension of the input (m, n_H_prev, n_W_prev, n_C_prev). You can read the full documentation [here](https://www.tensorflow.org/api_docs/python/tf/nn/conv2d)\n",
    "\n",
    "- **tf.nn.max_pool(A, ksize = [1,f,f,1], strides = [1,s,s,1], padding = 'SAME'):** given an input A, this function uses a window of size (f, f) and strides of size (s, s) to carry out max pooling over each window. You can read the full documentation [here](https://www.tensorflow.org/api_docs/python/tf/nn/max_pool)\n",
    "\n",
    "- **tf.nn.relu(Z1):** computes the elementwise ReLU of Z1 (which can be any shape). You can read the full documentation [here.](https://www.tensorflow.org/api_docs/python/tf/nn/relu)\n",
    "\n",
    "- **tf.contrib.layers.flatten(P)**: given an input P, this function flattens each example into a 1D vector it while maintaining the batch-size. It returns a flattened tensor with shape [batch_size, k]. You can read the full documentation [here.](https://www.tensorflow.org/api_docs/python/tf/contrib/layers/flatten)\n",
    "\n",
    "- **tf.contrib.layers.fully_connected(F, num_outputs):** given a the flattened input F, it returns the output computed using a fully connected layer. You can read the full documentation [here.](https://www.tensorflow.org/api_docs/python/tf/contrib/layers/fully_connected)\n",
    "\n",
    "In the last function above (`tf.contrib.layers.fully_connected`), the fully connected layer automatically initializes weights in the graph and keeps on training them as you train the model. Hence, you did not need to initialize those weights when initializing the parameters. \n",
    "\n",
    "\n",
    "**Exercise**: \n",
    "\n",
    "Implement the `forward_propagation` function below to build the following model: `CONV2D -> RELU -> MAXPOOL -> CONV2D -> RELU -> MAXPOOL -> FLATTEN -> FULLYCONNECTED`. You should use the functions above. \n",
    "\n",
    "In detail, we will use the following parameters for all the steps:\n",
    "     - Conv2D: stride 1, padding is \"SAME\"\n",
    "     - ReLU\n",
    "     - Max pool: Use an 8 by 8 filter size and an 8 by 8 stride, padding is \"SAME\"\n",
    "     - Conv2D: stride 1, padding is \"SAME\"\n",
    "     - ReLU\n",
    "     - Max pool: Use a 4 by 4 filter size and a 4 by 4 stride, padding is \"SAME\"\n",
    "     - Flatten the previous output.\n",
    "     - FULLYCONNECTED (FC) layer: Apply a fully connected layer without an non-linear activation function. Do not call the softmax here. This will result in 6 neurons in the output layer, which then get passed later to a softmax. In TensorFlow, the softmax and cost function are lumped together into a single function, which you'll call in a different function when computing the cost. "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "# GRADED FUNCTION: forward_propagation\n",
    "\n",
    "def forward_propagation(X, parameters):\n",
    "    \"\"\"\n",
    "    Implements the forward propagation for the model:\n",
    "    CONV2D -> RELU -> MAXPOOL -> CONV2D -> RELU -> MAXPOOL -> FLATTEN -> FULLYCONNECTED\n",
    "    \n",
    "    Arguments:\n",
    "    X -- input dataset placeholder, of shape (input size, number of examples)\n",
    "    parameters -- python dictionary containing your parameters \"W1\", \"W2\"\n",
    "                  the shapes are given in initialize_parameters\n",
    "\n",
    "    Returns:\n",
    "    Z3 -- the output of the last LINEAR unit\n",
    "    \"\"\"\n",
    "    \n",
    "    # Retrieve the parameters from the dictionary \"parameters\" \n",
    "    W1 = parameters['W1']\n",
    "    W2 = parameters['W2']\n",
    "    \n",
    "    ### START CODE HERE ###\n",
    "    # CONV2D: stride of 1, padding 'SAME'\n",
    "    Z1 = tf.nn.conv2d(X,W1, strides = [1,1,1,1], padding = 'SAME')\n",
    "    # RELU\n",
    "    A1 = tf.nn.relu(Z1)\n",
    "    # MAXPOOL: window 8x8, sride 8, padding 'SAME'\n",
    "    P1 = tf.nn.max_pool(A1, ksize = [1,8,8,1], strides = [1,8,8,1], padding = 'SAME')\n",
    "    # CONV2D: filters W2, stride 1, padding 'SAME'\n",
    "    Z2 = tf.nn.conv2d(P1,W2, strides = [1,1,1,1], padding = 'SAME')\n",
    "    # RELU\n",
    "    A2 = tf.nn.relu(Z2)\n",
    "    # MAXPOOL: window 4x4, stride 4, padding 'SAME'\n",
    "    P2 = tf.nn.max_pool(A2, ksize = [1,4,4,1], strides = [1,4,4,1], padding = 'SAME')\n",
    "    # FLATTEN\n",
    "    P2 = tf.contrib.layers.flatten(P2)\n",
    "    # FULLY-CONNECTED without non-linear activation function (not not call softmax).\n",
    "    # 6 neurons in output layer. Hint: one of the arguments should be \"activation_fn=None\" \n",
    "    Z3 = tf.contrib.layers.fully_connected(P2, 6,activation_fn=None)\n",
    "    ### END CODE HERE ###\n",
    "\n",
    "    return Z3"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Z3 = [[-0.44670227 -1.57208765 -1.53049231 -2.31013036 -1.29104376  0.46852064]\n",
      " [-0.17601591 -1.57972014 -1.4737016  -2.61672091 -1.00810647  0.5747785 ]]\n"
     ]
    }
   ],
   "source": [
    "tf.reset_default_graph()\n",
    "\n",
    "with tf.Session() as sess:\n",
    "    np.random.seed(1)\n",
    "    X, Y = create_placeholders(64, 64, 3, 6)\n",
    "    parameters = initialize_parameters()\n",
    "    Z3 = forward_propagation(X, parameters)\n",
    "    init = tf.global_variables_initializer()\n",
    "    sess.run(init)\n",
    "    a = sess.run(Z3, {X: np.random.randn(2,64,64,3), Y: np.random.randn(2,6)})\n",
    "    print(\"Z3 = \" + str(a))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "**Expected Output**:\n",
    "\n",
    "<table> \n",
    "    <td> \n",
    "    Z3 =\n",
    "    </td>\n",
    "    <td>\n",
    "    [[-0.44670227 -1.57208765 -1.53049231 -2.31013036 -1.29104376  0.46852064] <br>\n",
    " [-0.17601591 -1.57972014 -1.4737016  -2.61672091 -1.00810647  0.5747785 ]]\n",
    "    </td>\n",
    "</table>"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### 1.3 - Compute cost\n",
    "\n",
    "Implement the compute cost function below. You might find these two functions helpful: \n",
    "\n",
    "- **tf.nn.softmax_cross_entropy_with_logits(logits = Z3, labels = Y):** computes the softmax entropy loss. This function both computes the softmax activation function as well as the resulting loss. You can check the full documentation  [here.](https://www.tensorflow.org/api_docs/python/tf/nn/softmax_cross_entropy_with_logits)\n",
    "- **tf.reduce_mean:** computes the mean of elements across dimensions of a tensor. Use this to sum the losses over all the examples to get the overall cost. You can check the full documentation [here.](https://www.tensorflow.org/api_docs/python/tf/reduce_mean)\n",
    "\n",
    "** Exercise**: Compute the cost below using the function above."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "# GRADED FUNCTION: compute_cost \n",
    "\n",
    "def compute_cost(Z3, Y):\n",
    "    \"\"\"\n",
    "    Computes the cost\n",
    "    \n",
    "    Arguments:\n",
    "    Z3 -- output of forward propagation (output of the last LINEAR unit), of shape (6, number of examples)\n",
    "    Y -- \"true\" labels vector placeholder, same shape as Z3\n",
    "    \n",
    "    Returns:\n",
    "    cost - Tensor of the cost function\n",
    "    \"\"\"\n",
    "    \n",
    "    ### START CODE HERE ### (1 line of code)\n",
    "    cost = tf.reduce_mean(tf.nn.softmax_cross_entropy_with_logits(logits = Z3, labels = Y))\n",
    "    ### END CODE HERE ###\n",
    "    \n",
    "    return cost"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "cost = 2.91034\n"
     ]
    }
   ],
   "source": [
    "tf.reset_default_graph()\n",
    "\n",
    "with tf.Session() as sess:\n",
    "    np.random.seed(1)\n",
    "    X, Y = create_placeholders(64, 64, 3, 6)\n",
    "    parameters = initialize_parameters()\n",
    "    Z3 = forward_propagation(X, parameters)\n",
    "    cost = compute_cost(Z3, Y)\n",
    "    init = tf.global_variables_initializer()\n",
    "    sess.run(init)\n",
    "    a = sess.run(cost, {X: np.random.randn(4,64,64,3), Y: np.random.randn(4,6)})\n",
    "    print(\"cost = \" + str(a))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "**Expected Output**: \n",
    "\n",
    "<table>\n",
    "    <td> \n",
    "    cost =\n",
    "    </td> \n",
    "    \n",
    "    <td> \n",
    "    2.91034\n",
    "    </td> \n",
    "</table>"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## 1.4 Model \n",
    "\n",
    "Finally you will merge the helper functions you implemented above to build a model. You will train it on the SIGNS dataset. \n",
    "\n",
    "You have implemented `random_mini_batches()` in the Optimization programming assignment of course 2. Remember that this function returns a list of mini-batches. \n",
    "\n",
    "**Exercise**: Complete the function below. \n",
    "\n",
    "The model below should:\n",
    "\n",
    "- create placeholders\n",
    "- initialize parameters\n",
    "- forward propagate\n",
    "- compute the cost\n",
    "- create an optimizer\n",
    "\n",
    "Finally you will create a session and run a for loop  for num_epochs, get the mini-batches, and then for each mini-batch you will optimize the function. [Hint for initializing the variables](https://www.tensorflow.org/api_docs/python/tf/global_variables_initializer)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 15,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "# GRADED FUNCTION: model\n",
    "\n",
    "def model(X_train, Y_train, X_test, Y_test, learning_rate = 0.009,\n",
    "          num_epochs = 100, minibatch_size = 64, print_cost = True):\n",
    "    \"\"\"\n",
    "    Implements a three-layer ConvNet in Tensorflow:\n",
    "    CONV2D -> RELU -> MAXPOOL -> CONV2D -> RELU -> MAXPOOL -> FLATTEN -> FULLYCONNECTED\n",
    "    \n",
    "    Arguments:\n",
    "    X_train -- training set, of shape (None, 64, 64, 3)\n",
    "    Y_train -- test set, of shape (None, n_y = 6)\n",
    "    X_test -- training set, of shape (None, 64, 64, 3)\n",
    "    Y_test -- test set, of shape (None, n_y = 6)\n",
    "    learning_rate -- learning rate of the optimization\n",
    "    num_epochs -- number of epochs of the optimization loop\n",
    "    minibatch_size -- size of a minibatch\n",
    "    print_cost -- True to print the cost every 100 epochs\n",
    "    \n",
    "    Returns:\n",
    "    train_accuracy -- real number, accuracy on the train set (X_train)\n",
    "    test_accuracy -- real number, testing accuracy on the test set (X_test)\n",
    "    parameters -- parameters learnt by the model. They can then be used to predict.\n",
    "    \"\"\"\n",
    "    \n",
    "    ops.reset_default_graph()                         # to be able to rerun the model without overwriting tf variables\n",
    "    tf.set_random_seed(1)                             # to keep results consistent (tensorflow seed)\n",
    "    seed = 3                                          # to keep results consistent (numpy seed)\n",
    "    (m, n_H0, n_W0, n_C0) = X_train.shape             \n",
    "    n_y = Y_train.shape[1]                            \n",
    "    costs = []                                        # To keep track of the cost\n",
    "    \n",
    "    # Create Placeholders of the correct shape\n",
    "    ### START CODE HERE ### (1 line)\n",
    "    X, Y = create_placeholders(64, 64, 3, 6)\n",
    "    ### END CODE HERE ###\n",
    "\n",
    "    # Initialize parameters\n",
    "    ### START CODE HERE ### (1 line)\n",
    "    parameters = initialize_parameters()\n",
    "    ### END CODE HERE ###\n",
    "    \n",
    "    # Forward propagation: Build the forward propagation in the tensorflow graph\n",
    "    ### START CODE HERE ### (1 line)\n",
    "    Z3 = forward_propagation(X, parameters)\n",
    "    ### END CODE HERE ###\n",
    "    \n",
    "    # Cost function: Add cost function to tensorflow graph\n",
    "    ### START CODE HERE ### (1 line)\n",
    "    cost = compute_cost(Z3,Y)\n",
    "    ### END CODE HERE ###\n",
    "    \n",
    "    # Backpropagation: Define the tensorflow optimizer. Use an AdamOptimizer that minimizes the cost.\n",
    "    ### START CODE HERE ### (1 line)\n",
    "    optimizer = tf.train.AdamOptimizer(learning_rate=learning_rate).minimize(cost)\n",
    "    ### END CODE HERE ###\n",
    "    \n",
    "    # Initialize all the variables globally\n",
    "    init = tf.global_variables_initializer()\n",
    "     \n",
    "    # Start the session to compute the tensorflow graph\n",
    "    with tf.Session() as sess:\n",
    "        \n",
    "        # Run the initialization\n",
    "        sess.run(init)\n",
    "        \n",
    "        # Do the training loop\n",
    "        for epoch in range(num_epochs):\n",
    "\n",
    "            minibatch_cost = 0.\n",
    "            num_minibatches = int(m / minibatch_size) # number of minibatches of size minibatch_size in the train set\n",
    "            seed = seed + 1\n",
    "            minibatches = random_mini_batches(X_train, Y_train, minibatch_size, seed)\n",
    "\n",
    "            for minibatch in minibatches:\n",
    "                \n",
    "                # Select a minibatch\n",
    "                (minibatch_X, minibatch_Y) = minibatch\n",
    "                # IMPORTANT: The line that runs the graph on a minibatch.\n",
    "                # Run the session to execute the optimizer and the cost, the feedict should contain a minibatch for (X,Y).\n",
    "                ### START CODE HERE ### (1 line)\n",
    "                _ , temp_cost = sess.run([optimizer,cost], feed_dict={X : minibatch_X, Y : minibatch_Y })\n",
    "                ### END CODE HERE ###\n",
    "                \n",
    "                minibatch_cost += temp_cost / num_minibatches\n",
    "                \n",
    "\n",
    "            # Print the cost every epoch\n",
    "            if print_cost == True and epoch % 5 == 0:\n",
    "                print (\"Cost after epoch %i: %f\" % (epoch, minibatch_cost))\n",
    "            if print_cost == True and epoch % 1 == 0:\n",
    "                costs.append(minibatch_cost)\n",
    "        \n",
    "        \n",
    "        # plot the cost\n",
    "        plt.plot(np.squeeze(costs))\n",
    "        plt.ylabel('cost')\n",
    "        plt.xlabel('iterations (per tens)')\n",
    "        plt.title(\"Learning rate =\" + str(learning_rate))\n",
    "        plt.show()\n",
    "\n",
    "        # Calculate the correct predictions\n",
    "        predict_op = tf.argmax(Z3, 1)\n",
    "        correct_prediction = tf.equal(predict_op, tf.argmax(Y, 1))\n",
    "        \n",
    "        # Calculate accuracy on the test set\n",
    "        accuracy = tf.reduce_mean(tf.cast(correct_prediction, \"float\"))\n",
    "        print(accuracy)\n",
    "        train_accuracy = accuracy.eval({X: X_train, Y: Y_train})\n",
    "        test_accuracy = accuracy.eval({X: X_test, Y: Y_test})\n",
    "        print(\"Train Accuracy:\", train_accuracy)\n",
    "        print(\"Test Accuracy:\", test_accuracy)\n",
    "                \n",
    "        return train_accuracy, test_accuracy, parameters"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Run the following cell to train your model for 100 epochs. Check if your cost after epoch 0 and 5 matches our output. If not, stop the cell and go back to your code!"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 16,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "Cost after epoch 0: 1.917929\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "Cost after epoch 5: 1.506757\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "Cost after epoch 10: 0.955359\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "Cost after epoch 15: 0.845802\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "Cost after epoch 20: 0.701174\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "Cost after epoch 25: 0.571977\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "Cost after epoch 30: 0.518435\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "Cost after epoch 35: 0.495806\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "Cost after epoch 40: 0.429827\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "Cost after epoch 45: 0.407291\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "Cost after epoch 50: 0.366394\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "Cost after epoch 55: 0.376922\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "Cost after epoch 60: 0.299491\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "Cost after epoch 65: 0.338870\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "Cost after epoch 70: 0.316400\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "Cost after epoch 75: 0.310413\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "Cost after epoch 80: 0.249549\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "Cost after epoch 85: 0.243457\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "Cost after epoch 90: 0.200031\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "Cost after epoch 95: 0.175452\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n",
      "lol\n"
     ]
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAYwAAAEWCAYAAAB1xKBvAAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAAIABJREFUeJzt3Xd8lFXWwPHfSSMJhBRSgBQI0lsoASwg2EFBBFFBxbYu\n6ur2fffVLeoWXV9dXfsqNnTtrqLYBRsiUoK00CMthBZaIIT08/7xPOAACUwgk0lmzvfzmU9m7tPO\nZd05c+99nntFVTHGGGOOJ8TfARhjjGkaLGEYY4zxiiUMY4wxXrGEYYwxxiuWMIwxxnjFEoYxxhiv\nWMIwQUVEPhaRa/0dhzFNkSUM0yBEZL2InOvvOFR1hKq+6O84AETkKxG5sQGu00xEnheRvSKyVUR+\nc5z9rxSRDSKyX0TeFZEEb88lIqNEJFdEikVktoh091W9TMOzhGEChoiE+TuGgxpTLMDdQCegHXAW\n8HsRGV7TjiLSA3gamAikACXAk96cS0Q6Aa8ANwNxwPvAtEb2b2FOgiUM43ciMlJEFonIHvdXaW+P\nbbeLyA8isk9ElovIGI9t14nItyLyLxHZCdztls0SkX+KyG4RWSciIzyOOfSr3ot9M0VkpnvtGSLy\nhIi8XEsdhonIJhH5XxHZCrwgIvEi8oGIFLrn/0BE0tz97wGGAI+7v8Yfd8u7ish0EdklIqtE5PJ6\n+Ce+Fvibqu5W1RXAZOC6Wva9CnhfVWeqajHwZ2CsiMR4ca4LgFmqOktVK4H/A1KBofVQB9MIWMIw\nfiUifYHngZuAVji/bqeJSDN3lx9wvlhjgb8AL4tIG49TDALW4vwavsejbBWQCNwPPCciUksIx9r3\nVWCeG9fdOL+6j6U1kIDz63sSzv+/XnA/ZwAHgMcBVPWPwDfAbaraQlVvE5HmwHT3usnAeODJ2rp1\nRORJN8nW9Fri7hMPtAEWexy6GOhRSx16eO6rqj8AZUDnEziXuK+etWw3TYwlDONvk4CnVXWuqla5\n4wtlwKkAqvqWqm5W1WpVfQNYAwz0OH6zqj6mqpWqesAt26Cqz6hqFfAizpdcSi3Xr3FfEckABgB3\nqmq5qs4Cph2nLtXAXapapqoHVHWnqr6tqiWqug8noR3r1/ZIYL2qvuDWZyHwNnBZTTur6s9UNa6W\n18FWWgv3b5HHoXuBGGrW4oh9Pfc/3rlmAEPd1lYE8AcgAog+Rp1NE2IJw/hbO+C3nr+OgXSgLYCI\nXOPRXbUH59dqosfx+TWcc+vBN6pa4r5tUcN+x9q3LbDLo6y2a3kqVNXSgx9EJFpEnnYHkPcCM4E4\nEQmt5fh2wKAj/i2uwmm5nKhi929Lj7JYYN8x9m95RNnB/Y95LlVdidNl9TiwBed/p+XAphOM3TQy\nljCMv+UD9xzx6zhaVV8TkXbAM8BtQCtVjQNycbo5DvLVdMtbgAQR8fx1nH6cY46M5bdAF2CQqrYE\nznTLpZb984Gvj/i3aKGqt9R0MRF5yh3/qOm1DEBVd7t1yfI4NAtYVksdlnnuKyKn4LQSVntzLlX9\nr6r2VNVWwF1Ae2B+LdcyTYwlDNOQwkUk0uMVhpMQbhaRQeJoLiIXuYOszXG+VAsBROR6Gqg/XFU3\nADk4A+kRInIaMKqOp4nBGbfYI86tqXcdsX0b0MHj8wc4YwUTRSTcfQ0QkW61xHizm1BqenmOK7wE\n/MkdhO8G/BSYUkvMrwCjRGSIO6byN+Adt0vtuOcSkf4iEioiSTgD4tPclocJAJYwTEP6COcL9ODr\nblXNwfnSeRzYDeTh3nWjqsuBB4HvcL5cewHfNmC8VwGnATuBvwNv4IyveOthIArYAcwBPjli+yPA\nOPcOqkfdL+XzcQa7N+N0l/0f0IyTcxfOzQMbgK+A+1X1UCxui2QIgKouw7kt9hVgO07S/pm353Lr\ntAfnRoLdOP/bmgAhtoCSMd4RkTeAlap6ZEvBmKBgLQxjauF2B50iIiHiPJw2GnjX33EZ4y/2BKYx\ntWsNvIPzHMYm4Bb3VldjgpLPWhgiki4iX4rzdO4yEfllDfuIiDwqInkiskRE+nlsG+4+6ZonIrf7\nKk5jaqOq76tqunvXVmdVfcHfMRnjT77skqoEfquq3XEewrq1hidWR+DMS9MJ5wGufwO496k/4W7v\nDkyo7WlXY4wxDcNnXVKqugXnnm1UdZ+IrMCZV2a5x26jgZfUGXmfIyJx7rQP7YE8VV0LICKvu/t6\nHnuUxMREbd++fX1XxRhjAtaCBQt2qGqSN/s2yBiGiLQH+gJzj9iUyuFPz25yy2oqH1TLuSfhtE7I\nyMggJyenXmI2xphgICIbvN3X53dJiUgLnPlwfqWqe+v7/Ko6WVWzVTU7KcmrJGmMMeYE+LSFISLh\nOMniFVV9p4ZdCjh8uoU0tyy8lnJjjDF+4su7pAR4Dlihqg/Vsts04Br3bqlTgSJ37GM+0Emc9Qgi\ncJ58Pd5MocYYY3zIly2MM3DWD1gqIovcsj/grAuAqj6FM1XEhTjTQZQA17vbKkXkNuBTIBR43p2y\nwBhjjJ/48i6pWRw+q2hN+yhway3bPsJJKMYYYxoBmxrEGGOMVyxhGGOM8YolDODRz9fw/cbd/g7D\nGGMataBPGEUHKnh17kbGPjmbX7+xiK1Fpcc/yBhjglDQJ4zYqHA+/+1Qbj3rFD5csoWzH/yKv7y/\njJz1u6iutrVCjDHmoIBaQCk7O1tPZmqQjTtLuP/TlXy2bBvlVdUkxzTjdxd04fLs4y3lbIwxTZOI\nLFDVbG/2tfUwPGS0iubxK/uxr7SCL1ZuZ8rs9fxpai79MuLomBzj7/CMMcavgr5LqiYxkeGM7pPK\nM9dkE90slN//dwlV1j1ljAlyljCOIbFFM+4c2Z3vN+7hP9+t93c4xhjjV5YwjmNM31TO7JzE/Z+u\nYtPuEn+HY4wxfmMJ4zhEhHvH9ATgHx+v9HM0xhjjP5YwvJAWH83FWW35Nm8HgXRXmTHG1IUlDC9l\npcexp6SCjbusW8oYE5wsYXipd1osAIvy9/g5EmOM8Q9LGF7qnBJDZHgISzYV+TsUY4zxC0sYXgoP\nDaFH21gWWwvDGBOkLGHUQVZaHLmbi6isqvZ3KMYY0+AsYdRBVnospRXVrN5W7O9QjDGmwVnCqIOs\ntDgAlmyybiljTPDxWcIQkedFZLuI5Nay/X9EZJH7yhWRKhFJcLetF5Gl7rYTn362nrVrFU1sVDiL\nLWEYY4KQL1sYU4DhtW1U1QdUtY+q9gHuAL5W1V0eu5zlbvdq2t2GICL0Totlcb7dKWWMCT4+Sxiq\nOhPYddwdHROA13wVS33KSotj1bZ9HCiv8ncoxhjToPw+hiEi0Tgtkbc9ihWYISILRGTScY6fJCI5\nIpJTWFjoy1AB54nvqmpl+RZrZRhjgovfEwYwCvj2iO6owW5X1QjgVhE5s7aDVXWyqmaranZSUpKv\nYyXr0BPfljCMMcGlMSSM8RzRHaWqBe7f7cBUYKAf4qpRcstI2sRG2p1Sxpig49eEISKxwFDgPY+y\n5iISc/A9cD5Q451W/tIrNZalBdbCMMYEF5+t6S0irwHDgEQR2QTcBYQDqOpT7m5jgM9Udb/HoSnA\nVBE5GN+rqvqJr+I8EZmJzflqdSHV1UpIiPg7HGOMaRA+SxiqOsGLfabg3H7rWbYWyPJNVPUjLT6K\n8spqCovLSGkZ6e9wjDGmQTSGMYwmJy0hGoB8WxvDGBNELGGcgPR4N2HYGt/GmCBiCeMEpMVHAbBp\n1wE/R2KMMQ3HEsYJiAwPJSmmmbUwjDFBxRLGCUqPjyLfWhjGmCBiCeMEpSdEWwvDGBNULGGcoLT4\nKLYUldrqe8aYoGEJ4wSlx0dTVa1sKSr1dyjGGNMgLGGcoPQEu7XWGBNcLGGcoIPPYmzabQPfxpjg\nYAnjBLWJiyREYJM97W2MCRKWME5QeGgIbWKjyLcWhjEmSFjCOAlp8VE2n5QxJmhYwjgJafHRNoZh\njAkaljBOQnpCFNv2lVJWWeXvUIwxxucsYZyE9PhoVKHAWhnGmCBgCeMk/PgshiUMY0zgs4RxEg5N\nc24P7xljgoAljJOQ0jKS8FCxWWuNMUHBZwlDRJ4Xke0iklvL9mEiUiQii9zXnR7bhovIKhHJE5Hb\nfRXjyQoNEVLjomx6EGNMUPBlC2MKMPw4+3yjqn3c118BRCQUeAIYAXQHJohIdx/GeVLSE+zWWmNM\ncPBZwlDVmcCuEzh0IJCnqmtVtRx4HRhdr8HVo7T4aDbu3O/vMIwxxuf8PYZxuogsEZGPRaSHW5YK\n5Hvss8ktq5GITBKRHBHJKSws9GWsNeqY3ILdJRXsKC5r8GsbY0xD8mfC+B7IUNXewGPAuydyElWd\nrKrZqpqdlJRUrwF6o0tKDACrt+5r8GsbY0xD8lvCUNW9qlrsvv8ICBeRRKAASPfYNc0ta5Q6p7QA\nYPU2SxjGmMDmt4QhIq1FRNz3A91YdgLzgU4ikikiEcB4YJq/4jyepJhmxEWHs2pbsb9DMcYYnwrz\n1YlF5DVgGJAoIpuAu4BwAFV9ChgH3CIilcABYLyqKlApIrcBnwKhwPOqusxXcZ4sEaFzcgxrrIVh\njAlwPksYqjrhONsfBx6vZdtHwEe+iMsXOrduwXuLNqOquI0mY4wJOP6+SyogdE6JYV9pJdv22p1S\nxpjAZQmjHnR275RaZd1SxpgAZgmjHhxMGDaOYYwJZJYw6kFC8wgSWzRjlT2LYYwJYJYw6knnlBas\n3m631hpjApcljHrSOcW5tba6Wv0dijHG+IQljHrSOSWGkvIqCvbYzLXGmMBkCaOedGltU4QYYwKb\nJYx60jHZbq01xgQ2Sxj1JDYqnDaxkayxOaWMMQHKEkY96pQSY7fWGmMCliWMetQlpQV5hcVUVFX7\nOxRjjKl3ljDqUZ/0eMorq1m2ea+/QzHGmHpnCaMeZbePByBn/YksZW6MMY2bJYx6lNIykoyEaHLW\n7/Z3KMYYU+8sYdSz7Pbx5GzYhbMWlDHGBA5LGPUsu10CO4rLWb+zxN+hGGNMvbKEUc8GuOMY820c\nwxgTYCxh1LNTkloQFx1uA9/GmIDjs4QhIs+LyHYRya1l+1UiskRElorIbBHJ8ti23i1fJCI5vorR\nF0JChOx28eRssIFvY0xg8WULYwow/Bjb1wFDVbUX8Ddg8hHbz1LVPqqa7aP4fCa7fQJrC/ezs9jW\n+DbGBA6fJQxVnQnU2i+jqrNV9eDP8DlAmq9iaWgHxzGslWGMCSSNZQzjJ8DHHp8VmCEiC0Rk0rEO\nFJFJIpIjIjmFhYU+DdJbPVNjiQgLsXEMY0xACfN3ACJyFk7CGOxRPFhVC0QkGZguIivdFstRVHUy\nbndWdnZ2o3j4oVlYKFlpscy3B/iMMQHEry0MEekNPAuMVtWdB8tVtcD9ux2YCgz0T4QnLrt9ArkF\nRRwor/J3KMYYUy/8ljBEJAN4B5ioqqs9ypuLSMzB98D5QI13WjVmAzMTqKxWvt9orQxjTGDwWZeU\niLwGDAMSRWQTcBcQDqCqTwF3Aq2AJ0UEoNK9IyoFmOqWhQGvquonvorTV7LbxRMiMHftTs7omOjv\ncIwx5qT5LGGo6oTjbL8RuLGG8rVA1tFHNC0xkeH0So1lzlob+DbGBIbGcpdUQBrUoRWL8vdQWmHj\nGMaYps8Shg+d2iGB8qpqG8cwxgQESxg+lN0+wR3HsG4pY0zTZwnDh1pGhtOjbSxz1u48/s7GGNPI\nWcLwsUGZCSy0cQxjTACwhOFjp3ZoRXllNYvy9/g7FGOMOSmWMHxsQGYCYuMYxpgAYAnDx2Kjwune\npiVz19k4hjGmabOE0QAGZbZiwYbdlFXaOIYxpumyhNEAhnRKpKyymllrdvg7FGOMOWFeJQwRucyb\nMlOzwZ0SSWgewTsLC/wdijHGnDBvWxh3eFlmahAeGsKo3m2Yvnwbe0sr/B2OMcackGNOPigiI4AL\ngVQRedRjU0ug0peBBZox/dJ48bsNfLx0C1cMyPB3OMYYU2fHa2FsBnKAUmCBx2sacIFvQwssWWmx\ndEhsztvfW7eUMaZpOmYLQ1UXA4tF5FVVrQAQkXggXVVtRr06EBHG9E3lwemryd9VQnpCtL9DMsaY\nOvF2DGO6iLQUkQTge+AZEfmXD+MKSJf0TQXgvUXWyjDGND3eJoxYVd0LjAVeUtVBwDm+CyswpSdE\nM6B9PO8sLEBV/R2OMcbUibcJI0xE2gCXAx/4MJ6AN6ZvGmsL97Ns815/h2KMMXXibcL4K/Ap8IOq\nzheRDsAa34UVuIb3bE2IwGfLtvo7FGOMqROvEoaqvqWqvVX1FvfzWlW99FjHiMjzIrJdRHJr2S4i\n8qiI5InIEhHp57FtuIiscrfdXpcKNXYJzSPIbpfAZ8u3+TsUY4ypE2+f9E4TkaluAtguIm+LSNpx\nDpsCDD/G9hFAJ/c1Cfi3e61Q4Al3e3dggoh09ybOpuK87ims3LqP/F0l/g7FGGO85m2X1As4z160\ndV/vu2W1UtWZwLHm9B6NM4CuqjoHiHPHSQYCeW4rphx43d03YJzXPQWA6dbKMMY0Id4mjCRVfUFV\nK93XFCDpJK+dCuR7fN7kltVWHjDaJzanU3ILSxjGmCbF24SxU0SuFpFQ93U10CgWeBCRSSKSIyI5\nhYWF/g7Ha+d1T2He+l3sKSn3dyjGGOMVbxPGDTi31G4FtgDjgOtO8toFQLrH5zS3rLbyGqnqZFXN\nVtXspKSTbfQ0nPO6p1BVrXy5aru/QzHGGK/U5bbaa1U1SVWTcRLIX07y2tOAa9y7pU4FilR1CzAf\n6CQimSISAYx39w0oWWlxJMc0s24pY0yTccy5pDz09pw7SlV3iUjfYx0gIq8Bw4BEEdkE3AWEu8c/\nBXyEMxNuHlACXO9uqxSR23Ce+wgFnlfVZXWpVFMQEiKc0y2FaYsKyC0o4kBFFeWV1QzMTCA81Na1\nMsY0Pt4mjBARiT+YNNw5pY43ceGE42xX4NZatn2Ek1AC2gU9Unht3kZGPjbrUNm9Y3px5SCb/twY\n0/h4mzAeBL4Tkbfcz5cB9/gmpOAxtHMST0/sj6rSolk4d0xdwowV2yxhGGMaJa8Shqq+JCI5wNlu\n0VhVXe67sIKDiHBBj9aHPp/bLYVX527kQHkVURGhfozMGGOO5nVnuaouV9XH3ZclCx84p2sKZZXV\nzP5hh79DMcaYo9joaiMyMDOB5hGhfL7SbrU1xjQ+ljAakYiwEM7snMQXK7bbehnGmEbHEkYjc3bX\nZLbuLbX1MowxjY4ljEZmWJdkROAL65YyxjQyljAamaSYZmSlxdk4hjGm0bGE0Qid2y2Zxfl7KNxX\n5u9QjDHmEEsYjdDZXZ31MqbMXufnSIwx5keWMBqhbm1iGNM3lSe+/IGHPltld0wZYxoFb6cGMQ1I\nRPjnZVlEhIbw6Bd5lJRXMaZfKks3FbGkoIgd+8ooKa9if3kl4wekc8UAm0rEGON7ljAaqdAQ4R9j\nexEVEcqzs9bx7Cyne6plZBht46KIjghly55SHp6xhsv6pxMSIn6O2BgT6CxhNGIhIcJdo7qT3T6e\nqmqld1oc7VtFI+Ikh/cWFfDL1xcxf/0uBnVo5edojTGBzhJGIycijOzdtsZt53VPISo8lPcWb7aE\nYYzxORv0bsKiI8I4r3sKHy3dQnlltb/DMcYEOEsYTdzoPm3ZU1LBrLxCf4dijAlwljCauCGdkoiL\nDue9RZv9HYoxJsBZwmjiIsJCuLBXG6Yv30ZJeaW/wzHGBDBLGAHg4qy2lJRXMWOFzT9ljPEdnyYM\nERkuIqtEJE9Ebq9h+/+IyCL3lSsiVSKS4G5bLyJL3W05voyzqRvYPoE2sZG8Pm+jPRVujPEZnyUM\nEQkFngBGAN2BCSLS3XMfVX1AVfuoah/gDuBrVd3lsctZ7vZsX8UZCEJChBuHdGD2Dzv5bPk2f4dj\njAlQvmxhDATyVHWtqpYDrwOjj7H/BOA1H8YT0K49rR1dW8fw1/eXc6C8yt/hGGMCkC8TRiqQ7/F5\nk1t2FBGJBoYDb3sUKzBDRBaIyKTaLiIik0QkR0RyCguD99bSsNAQ/nJxDwr2HODJr/L8HY4xJgA1\nlkHvUcC3R3RHDXa7qkYAt4rImTUdqKqTVTVbVbOTkpIaItZGa1CHVlzSpy1Pf72W9Tv2+zscY0yA\n8WXCKADSPT6nuWU1Gc8R3VGqWuD+3Q5MxeniMsfxhwu7EREWwu/fXmJdU8aYeuXLhDEf6CQimSIS\ngZMUph25k4jEAkOB9zzKmotIzMH3wPlArg9jDRjJLSP5+yU9mb9+F9e9MI/iMufZjP1lldz70Qqu\nenYOUxdusqlEjDF15rPJB1W1UkRuAz4FQoHnVXWZiNzsbn/K3XUM8JmqevahpABT3VlZw4BXVfUT\nX8UaaC7pm4oI/ObNxVz97FxuGJzJfR+tYHNRKalxUfz6jcXc+9FKbhycyaQzOxya/dYYY45FAum+\n/ezsbM3JsUc2Dvps2VZue3Uh5VXVdEmJ4d6xPembHs/MNYU8+806ZuXtYNKZHbhjRFdLGsYEKRFZ\n4O2jCza9eQA7v0drXr5xEKu27mX8wAzCQ50eyGFdkhnaOYm7pi1j8sy1xEWH87NhHf0crTGmsbOE\nEeAGZiYwMDPhqHIR4e5RPdhTUsH9n6wiLiqCKwfZUq/GmNpZwghiISHCg5dnsbe0gj++u5QqVSae\n2s7fYRljGqnG8hyG8ZPw0BCeuro/Z3dJ5s/v5vLo52tsPipjTI0sYRgiw0N5amJ/xvZL5aHpq/nL\n+8uprj48aRTuK+PvHyxn+75SP0VpjPE365IygNPS+Oe4LBKiI3h21jq27S3lX1f0ITI8lK1FpVz5\n7BzWFu53Hgoc3tXf4Rpj/MBaGOaQkBDhjxd1408XdeOTZVuZ8MwccguKuGLyd2wrKqVzSgveW7TZ\nuqyMCVKWMMxhRJyp0v99VT+Wb97LyMdmsWt/Of+5cRA3Dz2Fgj0H+H7jbn+HaYzxA0sYpkbDe7bh\ntUmnMqxLEq/eeCr9MuI5v0drIsNDeHehrR9uTDCyhGFq1S8jninXD6RXWiwALZqFcW63FD5cuoWK\nKpuLyphgYwnD1MnoPqns2l/OrDU7/B2KMaaB2V1Spk6Gdk4iNiqc9xYVcFbXZL5ctZ0HPllFTGQY\np5+SyOkdW9EvI57QEJubyphAYy0MUycRYSFc2Ks1ny3fxi9eW8j1L8yntLKK/eWVPPz5ai576jtu\ne/X7o57jMMY0fdbCMHU2uk8qr83L5+PcLfzq3E7cMuwUmoWFsqeknBdnb+BfM1bzj49X8MeLuvs7\nVGNMPbKEYepsUGYC/xjbi+x28XRKiTlUHhcdwS/O6ciu/WU88806Mlo1t7mpjAkgljBMnYkIEwbW\nPLOtiHDnqB5s2n2Au97LZc22fURHhBEWIpzdLZl+GfGH7V9aUUVpRRVx0RGHlW/fW8oHS7agQKhA\n69hIhvds46sqGWO8YAsoGZ/YX1bJT1/KYVH+HiqrlYqqapqFhfDmTafROy0OgN37y7li8nfsKC5n\n6s9Op12r5gAUl1Uy5olvWbO9+LBzvj7pVE7t0KrB62JMIKvLAkqWMEyDKNxXxpgnv6WsspqpPzud\nuOgIrnpmDiu27CMyPITEmGZMveUMWkaF8bNXvufTZVt57roB9EuPp6yyipGPzaJ9q+a8cdOptjqg\nMfWoLgnD7pIyDSIpphkvXDeA0ooqfjIlhxtfnE/u5r08fmVfnrkmm/xdJdz88gIe+XwNH+du5Y4R\n3TirSzKx0eEkt4zk1rM6Mm/9Lr7N2+nvqhgTtHyaMERkuIisEpE8Ebm9hu3DRKRIRBa5rzu9PdY0\nPZ1SYnjq6v78UFjM3HW7ePCyLM7v0ZpBHVpx39jefLd2Jw/PWMPoPm25cUjmYceOH5hOm9hIHpy+\nyiY/NMZPfDboLSKhwBPAecAmYL6ITFPV5Ufs+o2qjjzBY00Tc0bHRJ67bgBlFVWc36P1ofJL+6ex\no7iMuet2cd/Y3kd1OzULC+W2szvyx6m5fLWqkLO6Jjd06MYEPV+2MAYCeaq6VlXLgdeB0Q1wrGnk\nhnZOOixZHHTT0FN4/roBREWE1njcZf3TSYuP4qHpq62VYYwf+DJhpAL5Hp83uWVHOl1ElojIxyLS\no47HIiKTRCRHRHIKCwvrI27TSEWEhfDLczqxtKCIV+Zu9Hc4xgQdfw96fw9kqGpv4DHg3bqeQFUn\nq2q2qmYnJSXVe4Cmcbm0XxpDOiVyz4crWFtYfPwDjDH1xpcJowBI9/ic5pYdoqp7VbXYff8REC4i\nid4ca4JTSIjwwLgsIsJC+PWbi6msYZr1iqpq3l1YwJ6Scj9EaEzg8mXCmA90EpFMEYkAxgPTPHcQ\nkdbijm6KyEA3np3eHGuCV+vYSO4Z05PF+Xt44ssfDttWVFLBdS/M41dvLGLic/PYW1rhpyiNCTw+\nu0tKVStF5DbgUyAUeF5Vl4nIze72p4BxwC0iUgkcAMarM5pZ47G+itU0PSN7t2XG8m08+sUa8gqL\nuaRPWzISornpPwvI313CTwZn8uLs9dzwwnxe+slAoiNsFhxjTpY96W2arH2lFTzw6SreX7yZ3SVO\nSyI+OpynJ2YzMDOBD5ds4eevfc9pp7TimWuyD0saqsqi/D1kJETTqkWzeovp8xXbmLqwgP+7tDfN\nm/kmSW3bW0pYiNRr3CZ42dQgJqiUV1Yzc3Uh32/czfgBGWS0ij607e0Fm/jtW4uJjQrnsv5pjB+Y\nztKCIp79Zh3LNu+lY3IL3r7ldGKjwk86jtfnbeQPU5dSrXDf2F6Mr2WCxpNRVa2c8+BXRISF8OEv\nhhAe6u/7VkxTZwnDGA8563fxwuz1fJq7lUp3YaeOyS24sFcbnvwyj9NOacUL1w0g7AS/fFWVx7/I\n48HpqxnaOYnNew4QFRHKtNsG12c1APhi5TZumOL8N/7nkd35yeDM4xxhzLHVJWFYx64JeNntE8hu\nn3BoyvTMpOYM7ZRESIiQGhfJ/769lLvfX8bfRvekokrJ215MWkIULSO9a3U8+nke/5qxmrF9U/m/\ncb15Zc4LPZZcAAAVVElEQVQG7n5/ObkFRfRMja3Xurw4ewPJMc3o0jqGh6ev5uKstiTFNEzXVHW1\n8ugXaxjZuy0dk1s0yDVN42LtWRM0kltGcsPgTM7qkkyIu+b4FQMyuOnMDrw8ZyPnPPg13e/8hAsf\n/YbzH5rJ1qLSw45fv2M/s9bsOKzs46Vb+NeM1VzaL41/XpZFeGgIY/qlERkeUu8PF64tLObr1YVc\nNagdd1/cg9LKKu7/ZGW9XuNYFubv5uEZa/jrBzZDT7CyhGGC3v8O78pPh2SS0SqaSWd24N4xvSgu\nq+T6KfMpLqsEYHbeDkY9Nourn5vLr99YRNGBCpZtLuI3by6mX0Yc947teSgJxUaFM7J3W6YtKjh0\nfH34z5wNhIcKEwalc0pSC244I5O3Fmxi4cbd9XaNY5m2aDMAM1cXsnRTUYNc0zQu1iVlgl5IiBy1\n/nhafBTXT5nPra98z6isttzxzhIyE5szsVsKT89cy9y1zjTrcdHhPDWxP83CDp//asLADP67YBPT\nFm3mykEnP/i9v6yS/+ZsYkTPNiTHRALw83M6MXVhAfd+tIK3bj79pK9xLJVV1Xy4dAtDOiWyKH8P\nT36Vx7+v7u/Ta5rGx1oYxtTgzM5J3HNJT75eXcjv3lpM/3bxvHXz6fx+eFfevuV0moWHsquknMkT\nsw99gXvqlxFH19YxvDpvw1HbqquVnPW7eCsnn0c/X8Pd05axKH/PMeOZurCAfWWVXHv6j2ukt2gW\nxs1DT2H++t0+/8U/d90udhSXM2FgBted3p5Plm0lb/s+n17TND7WwjCmFuMHZlBcVknBngPcPqLr\noVZEn/Q4Pv7lEPYeqCC55dHJApy1za8alMGf31vGFU9/x/VnZDKsSxIfLd3CU1//wOptP86DFREW\nwkvfrefWszry87M7ERF2+O+4ogMVTJ65lp6pLY9aE31cdhoPfraKKbPX8+DlWfX7D+Dh/cWbaR4R\nytldkzm1Qyue/WYdT371Aw9d3sdn1zSNjyUMY47hxiEdaiyPDA8lMrzmadgPmjAwg9KKaqbMXs/N\nLy8gIjSE8qpquqTE8NDlWfRvF09Ky0jKq6r56/vLeeyLPL5YuZ2HLu9Dl9YxgPOMyc3/WcCWogPc\nP27QUeuEtIwM59L+abw+L587LuxKog8e5iuvrObj3K2c36P1oXpfOSiDKbPX8+tzO5OeEH38k5iA\nYF1SxvhIWGgIPz2zA1//zzCeuro/Y/ul8ty12Xz8yyGM7ZdGu1bNiQwPpWVkOP+8LIunJ/Zna1Ep\nox6bxRNf5lFRVc3t7yzhu7U7uX9cb07t0KrG61xzWnvKq6p5fZ5vpnz/Zk0hRQcqGJXV5lDZT4d0\nIFSE+z9d5ZNrmsbJWhjG+FhYaAjDe7ZmeM+jF43ydEGP1mS3i+fOact44NNV/Oe7DWzdW8qvz+3M\nmL5ptR7XMbkFQzol8p85G7hp6Ckn/fR3eWU1b+bk065VNP3bxfP+4s3ERoUzuOOPywe0jo3ktrM7\n8tD01Yzo2ZoLe7U5xhlNoLCEYUwj0qpFM564sh8X9drCne8tY8LAdH5xTsfjHnf9Ge25YUoOn+Ru\nZVRW25OK4cHPVvH0zLUAhLm3Cl+WnXbU2Motw05hxopt/OndXAZmJvikO8w0LjY1iDGNVHW1Hnq2\nw5t9z3rwK3bsKyMxphkRoSH0aNuS+y7tfdyxFk+z1uzg6ufmckV2Ohf2bsPctTvJ3byXP1zYla6t\nWx61/5pt+7josVkM65zE0xP7s3zLXr5aVUhSi2Zc3Kdtna5t/MPmkjImCM3O28HUhQWUV1VTUl7F\n9OXbuKh3Gx4b3/dQ4nl93kaenrmW/WWVlFdV0ywshJ8O6cA1p7VnX2kFIx75hpjIMD74+ZBa11Y/\n0tNf/8A/Pl5Jq+YR7Nz/46JViS0iuPa09kw8rR1x0RFenatgzwG+zdvBqZmtDptE0viOJQxjzKEv\n8puGduD3F3Tlng9X8Py36+ibEUeXlBgiwkL4obCYb/N2kpnYnMQWESzOL2LqrafTo633c2BVVSu/\nfXMRpRXVnNMtmWFdklmzfR/PzFzLl6sKadcqmrdvOf24XVaz83Zw66vfH5qqvmvrGC7o0ZorB2WQ\nUsvty+bkWcIwxqCq/Pm9XF6es5GurWNYuXUf15/Rnj9e2O2wmXm/XLWdez5cQd72Yv50UbdabyU+\nEfPX72Lic3PpkhLDa5NOrXEhK1Xl+W/Xc+9HK8hMbM7fL+nJss17+WzZVuav30VoiHBxVio/PTOz\nxm4xc3IsYRhjAGdKj5v+s4CvVhfy19E9uGpQuxr3q6iqZvnmvfROiz3qWY+T9fmKbfz0pRyGdk7i\nmWuyD0tWqsrfPnBaPud3T+GhK/rQwmPhqY07S3j+23W8mZPPgYoqJk/M5rzuKYe2V1Urn+Ru5czO\nicR4ObuwOZwlDGPMIZVV1ewoLqd1rP+6dV6d6ywuNSqrLf8Y2+tQUnj08zU8NH01153enjtHdq91\nkH9PSTkTn5vH+p37ef+2wbRPbE51tXL7O0t4M2cTA9sn8NJPBtog+wmoS8KwB/eMCXBhoSF+TRYA\nVw7K4H8u6MIHSzZzwb9mMjtvB//5bj0PTV/N2H6px0wWAHHRETx5VT9CQ4SbX17AgfIq/v7hCt7M\n2cR53VOYv2EXt726kMqq6oarVBDyaQtDRIYDjwChwLOqet8R268C/hcQYB9wi6oudretd8uqgEpv\nMqC1MIxp3BZs2MXv3lrCuh37EYFzuibz76v7e/2w4VertnP9lPlkJjZnbeF+rju9PXeN6s7Lczbw\n5/eWMa5/Gg+M613v3WqBrFGsuCciocATwHnAJmC+iExTVc/VV9YBQ1V1t4iMACYDgzy2n6Wqh69Y\nY4xpsvq3S+CjXwzhXzNWs6WolAfG9a7Tk+nDuiTzy3M68fCMNYzrn8adI7sjIkw8rT07ist55PM1\nrNlezC1DT+H87ils21fKC9+u59W5G0mNi+LWsztyUa82hNbQmqmqVlT1hJfqDQY+a2GIyGnA3ap6\ngfv5DgBV/Uct+8cDuaqa6n5eD2TXJWFYC8OYwFddrSzatIestLjDvvhVlTfm5/PkVz+wcVcJqXFR\nbN9XSrXCBT1SWL2tmLztxXRIbM7oPql0b9uSbm1iyN91gGmLN/Nx7haqqpQLe7VhTL9UBrZP8PrB\nyaasUQx6i8g4YLiq3uh+nggMUtXbatn/d0BXj/3XAUU4XVJPq+rkWo6bBEwCyMjI6L9hw9HrDxhj\ngkdllTO77hvz8+mY3IKfDM4kPSGa6mrl02VbeerrH1hSUITnV190RCjndU8hNET4JHcrJeVVdEmJ\n4ZEJfQL+Vt4mlzBE5CzgSWCwqu50y1JVtUBEkoHpwM9VdeaxrmktDGOMN/aXVbJy6z5Wbt1LXFQE\nZ3dNPvRke0l5JZ/kbuXej1ayr7SCO0d158qBGQE7LtIoxjCAAiDd43OaW3YYEekNPAuMOJgsAFS1\nwP27XUSmAgOBYyYMY4zxRvNmYfRvF0//dvFHbYuOCGNsvzSGdEriN28u4o9Tc/lyZSG/Pb8z3dr8\n2NrYtreUzXsO0Cc9zmfJZNveUsorqxvNmiO+TBjzgU4ikomTKMYDV3ruICIZwDvARFVd7VHeHAhR\n1X3u+/OBv/owVmOMOUxSTDNevH4gk79Zy2Ofr2HEI9s4u2syQzol8tmybcxZtxNVGNsvlXsu6VXj\n3Fub9xzg02VbuTirLa3qOJvv3tIKRj02i+37ymjfKpozOycxpm8qfTOOTnINxde31V4IPIxzW+3z\nqnqPiNwMoKpPicizwKXAwYGHSlXNFpEOwFS3LAx4VVXvOd71rEvKGOMLe0rKeem7Dbzw7Tp2l1SQ\nmdici7PaUlWtPPFVHl1bt+Tpq/uTnhBFaUU1a3cU89ysdUxbtJnKaiU1LorJ1/Sv0xxdd76Xy8tz\nNvDzszuxZNMevlu7k9KKaiYMTOf24d2Ija6fJ9sbxRiGP1jCMMb4Ukl5JVuLSslMbH6oG+rLldv5\n5esL2V9eBTi354IzkH7FgHQGd0zkj1NzKTpQwT8vy+Ki3sdfbGpR/h7GPPkt157Wnrsv7gE44y6P\nfL6G52atIz46gnvH9OT8HsdelMsbljCMMaYBbdxZwivzNhAWIjRvFkZCdATDe7Y+NK379n2l3PLy\n9yzYsJtTkpqTlR5Hn/Q4RvZuS0Lzw6d+r6yq5uLHv2Xn/jJm/GboUXNk5RYUcfs7S1ixZR9Trh/A\nkE5JnAxLGMYY08iUVVbx4uz1zFu3i0X5RewoLiM2KpzfD+/C+AEZhIYIZZVV/PurH3h4xhr+fVU/\nRtSy9G1xWSXj/j2bgj0HmPqz0+mYHHPCcVnCMMaYRkxVWbVtH3dPW8actbvolRpLfPMI5q1zxinO\n7ZbCM9f0P+bdV5t2l3DJE7OJigjh3Z+dUedB9YMsYRhjTBOgqkxbvJn7P1lFVEQogzsmckbHRM7s\nnEizsOPPvLtw427GT55D77RYXr5xkFfHHKmxPIdhjDHmGESE0X1SGd0n9YSO75sRz4OXZzFrzQ4E\n3z9YaAnDGGOasJG92zKyd9sGuZZNy2iMMcYrljCMMcZ4xRKGMcYYr1jCMMYY4xVLGMYYY7xiCcMY\nY4xXLGEYY4zxiiUMY4wxXgmoqUFEpJAf19aoq0RgRz2G0xQEY50hOOsdjHWG4Kx3XevcTlW9mvI2\noBLGyRCRHG/nUwkUwVhnCM56B2OdITjr7cs6W5eUMcYYr1jCMMYY4xVLGD+a7O8A/CAY6wzBWe9g\nrDMEZ719VmcbwzDGGOMVa2EYY4zxiiUMY4wxXgn6hCEiw0VklYjkicjt/o7HV0QkXUS+FJHlIrJM\nRH7plieIyHQRWeP+jfd3rPVNREJFZKGIfOB+DoY6x4nIf0VkpYisEJHTAr3eIvJr97/tXBF5TUQi\nA7HOIvK8iGwXkVyPslrrKSJ3uN9vq0TkgpO5dlAnDBEJBZ4ARgDdgQki0t2/UflMJfBbVe0OnArc\n6tb1duBzVe0EfO5+DjS/BFZ4fA6GOj8CfKKqXYEsnPoHbL1FJBX4BZCtqj2BUGA8gVnnKcDwI8pq\nrKf7//HxQA/3mCfd770TEtQJAxgI5KnqWlUtB14HRvs5Jp9Q1S2q+r37fh/OF0gqTn1fdHd7EbjE\nPxH6hoikARcBz3oUB3qdY4EzgecAVLVcVfcQ4PXGWXI6SkTCgGhgMwFYZ1WdCew6ori2eo4GXlfV\nMlVdB+ThfO+dkGBPGKlAvsfnTW5ZQBOR9kBfYC6Qoqpb3E1bgRQ/heUrDwO/B6o9ygK9zplAIfCC\n2xX3rIg0J4DrraoFwD+BjcAWoEhVPyOA63yE2upZr99xwZ4wgo6ItADeBn6lqns9t6lzj3XA3Gct\nIiOB7aq6oLZ9Aq3OrjCgH/BvVe0L7OeIrphAq7fbZz8aJ1m2BZqLyNWe+wRanWvjy3oGe8IoANI9\nPqe5ZQFJRMJxksUrqvqOW7xNRNq429sA2/0Vnw+cAVwsIutxuhvPFpGXCew6g/MrcpOqznU//xcn\ngQRyvc8F1qlqoapWAO8ApxPYdfZUWz3r9Tsu2BPGfKCTiGSKSATO4NA0P8fkEyIiOH3aK1T1IY9N\n04Br3ffXAu81dGy+oqp3qGqaqrbH+d/2C1W9mgCuM4CqbgXyRaSLW3QOsJzArvdG4FQRiXb/Wz8H\nZ5wukOvsqbZ6TgPGi0gzEckEOgHzTvQiQf+kt4hciNPPHQo8r6r3+DkknxCRwcA3wFJ+7M//A844\nxptABs7U8Jer6pEDak2eiAwDfqeqI0WkFQFeZxHpgzPQHwGsBa7H+YEYsPUWkb8AV+DcEbgQuBFo\nQYDVWUReA4bhTGO+DbgLeJda6ikifwRuwPl3+ZWqfnzC1w72hGGMMcY7wd4lZYwxxkuWMIwxxnjF\nEoYxxhivWMIwxhjjFUsYxhhjvGIJwzR6IjLb/dteRK6s53P/oaZr+YqIXCIid/ro3H84/l51Pmcv\nEZlS3+c1TZPdVmuaDM9nKepwTJiqVh5je7GqtqiP+LyMZzZwsaruOMnzHFUvX9VFRGYAN6jqxvo+\nt2larIVhGj0RKXbf3gcMEZFF7toHoSLygIjMF5ElInKTu/8wEflGRKbhPOGMiLwrIgvc9RImuWX3\n4cxuukhEXvG8ljgecNdWWCoiV3ic+yuPtSZecZ8sRkTuE2e9kSUi8s8a6tEZKDuYLERkiog8JSI5\nIrLanfvq4PodXtXL49w11eVqEZnnlj19cFprESkWkXtEZLGIzBGRFLf8Mre+i0Vkpsfp38d5Ut4E\nO1W1l70a9Qsodv8OAz7wKJ8E/Ml93wzIwZl8bhjOhHuZHvsmuH+jgFyglee5a7jWpcB0nBkAUnCm\nnmjjnrsIZ06eEOA7YDDQCljFj632uBrqcT3woMfnKcAn7nk64cwBFVmXetUUu/u+G84Xfbj7+Ung\nGve9AqPc9/d7XGspkHpk/Dhzcr3v7/8O7OX/V5i3icWYRuh8oLeIjHM/x+J88ZYD89SZ//+gX4jI\nGPd9urvfzmOcezDwmqpW4Uzs9jUwANjrnnsTgIgsAtoDc4BS4DlxVvb7oIZztsGZdtzTm6paDawR\nkbVA1zrWqzbnAP2B+W4DKIofJ6Qr94hvAXCe+/5bYIqIvIkzed9B23FmgDVBzhKGacoE+LmqfnpY\noTPWsf+Iz+cCp6lqiYh8hfNL/kSVebyvAsJUtVJEBuJ8UY8DbgPOPuK4Azhf/p6OHERUvKzXcQjw\noqreUcO2ClU9eN0q3O8BVb1ZRAbhLDi1QET6q+pOnH+rA15e1wQwG8MwTck+IMbj86fALeJM246I\ndBZnoaAjxQK73WTRFWeJ2oMqDh5/hG+AK9zxhCScFexqneVTnHVGYlX1I+DXOMuiHmkF0PGIsstE\nJERETgE64HRreVuvI3nW5XNgnIgku+dIEJF2xzpYRE5R1bmqeidOS+jgtNidcbrxTJCzFoZpSpYA\nVSKyGKf//xGc7qDv3YHnQmpegvMT4GYRWYHzhTzHY9tkYImIfK+qV3mUTwVOAxbj/Or/vapudRNO\nTWKA90QkEufX/W9q2Gcm8KCIiMcv/I04iaglcLOqlorIs17W60iH1UVE/gR8JiIhQAVwK85MprV5\nQEQ6ufF/7tYd4CzgQy+ubwKc3VZrTAMSkUdwBpBnuM83fKCq//VzWLUSkWbA18BgPcbtySY4WJeU\nMQ3rXiDa30HUQQZwuyULA9bCMMYY4yVrYRhjjPGKJQxjjDFesYRhjDHGK5YwjDHGeMUShjHGGK/8\nPypHYdmk//r2AAAAAElFTkSuQmCC\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x7f8a6397b8d0>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Tensor(\"Mean_1:0\", shape=(), dtype=float32)\n",
      "Train Accuracy: 0.940741\n",
      "Test Accuracy: 0.783333\n"
     ]
    }
   ],
   "source": [
    "_, _, parameters = model(X_train, Y_train, X_test, Y_test)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "**Expected output**: although it may not match perfectly, your expected output should be close to ours and your cost value should decrease.\n",
    "\n",
    "<table> \n",
    "<tr>\n",
    "    <td> \n",
    "    **Cost after epoch 0 =**\n",
    "    </td>\n",
    "\n",
    "    <td> \n",
    "      1.917929\n",
    "    </td> \n",
    "</tr>\n",
    "<tr>\n",
    "    <td> \n",
    "    **Cost after epoch 5 =**\n",
    "    </td>\n",
    "\n",
    "    <td> \n",
    "      1.506757\n",
    "    </td> \n",
    "</tr>\n",
    "<tr>\n",
    "    <td> \n",
    "    **Train Accuracy   =**\n",
    "    </td>\n",
    "\n",
    "    <td> \n",
    "      0.940741\n",
    "    </td> \n",
    "</tr> \n",
    "\n",
    "<tr>\n",
    "    <td> \n",
    "    **Test Accuracy   =**\n",
    "    </td>\n",
    "\n",
    "    <td> \n",
    "      0.783333\n",
    "    </td> \n",
    "</tr> \n",
    "</table>"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Congratulations! You have finised the assignment and built a model that recognizes SIGN language with almost 80% accuracy on the test set. If you wish, feel free to play around with this dataset further. You can actually improve its accuracy by spending more time tuning the hyperparameters, or using regularization (as this model clearly has a high variance). \n",
    "\n",
    "Once again, here's a thumbs up for your work! "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 17,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "<matplotlib.image.AxesImage at 0x7f8a61826ac8>"
      ]
     },
     "execution_count": 17,
     "metadata": {},
     "output_type": "execute_result"
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAP8AAAD8CAYAAAC4nHJkAAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAAIABJREFUeJztfWmsZMd13nd6fetsnH3hKpIitZCSxtQahyIlm1IE80cQ\nwUZsMIYA/nECGXFgUQkQwAECMAhgOD+CAESsmIAdy4JlmYQi2KDGoh0FEsWhREkkZ0bDZYYzw1nf\nmzdv6dd75cfruXXOuX3rVfe86R76ng94eHW76lbVvX2r7zl1zvkOOedgMBjyh8K4J2AwGMYDW/wG\nQ05hi99gyCls8RsMOYUtfoMhp7DFbzDkFLb4DYac4poWPxE9QkTHiOh1InpioyZlMBiuP2hYJx8i\nKgL4BYDPAjgN4EUAv+Gce23jpmcwGK4XStdw7gMAXnfOvQkARPR1AI8CyFz827ZtdQf27V234xvH\n55ACdTfOLLMRmv8w0Nc8RP+BUzZ6tmHo0VygbhhsxPMxyDzWxjt1+gzm5y9HnXgti38fgFPs+DSA\nj4ZOOLBvL77z13/RO8qen75tLvJGBltFf7eUUdboRszoWh6BuC8+1D+xPlK98Q9Sa5qf51gzp5rx\ndnqEjPlT9nWlayhUOTBEF6l5ONZuAwZLSdTsWI/t+j+clJpj6Etbex5/9Qv/PHqK133Dj4geJ6LD\nRHR4bv7y9R7OYDBE4lre/GcAHGDH+3ufCTjnngLwFADc94H3Rb4IA83Cr7qB69KCbNwAzgV+hTfk\nLcXGGuCis4ZO9cBfRIHWwbHZG8tFXjMFNId0VUZlqJMAZBf6O6O+7foOl9Unhd7uQVGLlfg81Hcb\n6EK3jcG1vPlfBHAnEd1GRBUAvw7g2Wvoz2AwjBBDv/mdc20i+tcA/hZAEcDXnHOvbtjMDAbDdcW1\niP1wzn0HwHc2aC4Gg2GEuKbFPygcuOqjlZZsnSuzv4CaE9IKgxv/LvNAjhdQBGN9J9K7uR5dYU0Y\nbhPBiR3s1Oh92/U+YBPp+I+X5Iata9aTcmHzdlFXqE6woUJjUb9mvbYZ9yBbXY82RoauOW0HCOnr\nvCquXWq7IfMsdRR6rIYwK5l7r8GQU9jiNxhyipGK/Wu4Kp+Q+tSlWvTFkGa0rD4HGivDGUP3Eikk\npsW/LFtOUJYNCIoB/YaL1Klb2vV1y28dTcqNt46IZkXn25X23S7qZu/5sD8o+HdMyoGGi+xBi2ac\nyTGkSqmTomtie+wGHb8Gt1EP4mw0jDOZvfkNhpzCFr/BkFPY4jcYcoqR6/xePYs1xkldMKTTxbrB\nhk1xISW0/xy1bhYy1wQhmg5gx8xsFtg3COyx1OcvJuWLr76clKtO6rTlcjkpNy6cE3WTt3szYGly\nKjCNSH09YIKVX1msbq33aeKeq/Acgz7TUf3LvZ7Quzl7zywW9uY3GHIKW/wGQ04xBlPfVSixJSSh\nMnRjmYfCrnuRiI0WC8RuD4BhzoqN5w97pklxfv6t40l5dWkpKRenpkW7QqGYlLsd2Ue70fDnTUzy\nSak5smkEPPdC4KJ+2pSYxc8wHFFL+vHLUJ8Cz2k4Tp/3HK8aD2MBtze/wZBT2OI3GHKK0Yv9mbv9\nEacMNU4/bCxbXIgNLtw6lgEje4Dw2HFebJ1mQ9RdOes5WVrNti9XpWhf7Pign3Z3VdTVFuaTcnXz\nlsz5Zs9KOyjGMbWkSC0yduAH+c6i1afIJzUU2BNLXbYRT7C9+Q2GnMIWv8GQU9jiNxhyitF7+F0t\npKLMYj3whsXG6vkc8Tr+kPMIcG3En5Z9Vqsu9fXG0qI/q+V1/m67I9p12H4AleR75MrpE0l58/5b\nknKhJB+5IP0oN/9uhP7LTJqO9MghD7/so+yZDLKnxSMs2X1UFx12LjQPP4PBEAlb/AZDTjGGwJ7+\nZB5hr6oscUp5OcmULIH+h+TEy5hiZAKWgUYelscwxHmRhfaqFPubq8w7r8tlb2nqc8zUVyyKKqxc\n9ObC2sKlpDxz0y7ZB3//RDrd6dwKsTkDBD/+AKpU+LmKg3x24syF6aRCG6u62pvfYMgpbPEbDDmF\nLX6DIacYX1Sf0waUwXn7g10G87kFIq6C+QP6R4+l9wKyCUEkX0dojtlc9/EklVl9y3m1Wy1R1Wo2\n2Vj+805HmvpcySv6BKn0Fzu+j7NHfpqUb//op2W7crXvnAD5TFAoT0LmQUBDH4RsQ0QNxtF7hp6d\n4Fih5IUhv+4hsO6bn4i+RkQXiOgV9tk2InqOiI73/m+99qkYDIZRIkbs/xMAj6jPngBwyDl3J4BD\nvWODwfAuwrpiv3PuH4joVvXxowAe7JWfBvA8gK+sO5pDIrmkrRbZ9rFo7yUeEJUy5bh+zdJjBY4Q\nrZqERNSQ21qkWOeyriU2jg/iBmmvO+791mKifkNF/5UYH3+KeIJNbPHtN5LyuZt2i2Z77/lg/5PU\nYfB+h3hKMnpPPVMimC7k7XftJCCh3AXh/m4MU98u59zZXvkcgF2hxgaD4cbDNe/2u7Wf0MyfPCJ6\nnIgOE9Hh+cuXs5oZDIYRY9jd/vNEtMc5d5aI9gC4kNXQOfcUgKcA4IPvf5/z4uGwdNfZ6kFIXEvv\n0g7efzxiRcPhrjM0FFd3YgkqipWqrCz6d0KTBf2s1HQzv8NfVu+RDlMdSmwmZ157WbTbeuDWpDw5\nsyk446sYROWS33shoxWUXB4MNwqOlz2PgCqRMXRsCNFaY1r/JIVh3/zPAnisV34MwDND9mMwGMaE\nGFPfnwP4AYC7ieg0EX0JwJMAPktExwF8pndsMBjeRYjZ7f+NjKqHN3guBoNhhBiDh9+1miuyCQ7j\ntfXh+Piz9LbBPBKHZJHMajYktwQ/LE1MiDp+vLKwkJTrdWnqazR8Sq5qRXn4VXwqr2KVpfWqXRTt\nLr39VlI+cO99cpIZnPj6e4jfz8nuQ6SIdzrVNvc0zO4zbJLu7x3a7zimj42I8DPffoMhp7DFbzDk\nFCMV+9ccAtZEl1jTx7odZnywEbwHaak8i80j8EF01th+/fiRIxtmnhbqoTQxJeqmtu9MymdPeLG8\n0WiLdkUmA09NlkXdlq2eq7/MmD4mi3LuF994LSnvvuNuUVeuZqX5ChmG4wK60q2yxXJxXmzgUNQs\n+nwSzFqcHeyV3Xc27M1vMOQUtvgNhpzCFr/BkFOMjcwjpQoHdLoskovocC4NEfIXy9eerVtSIDov\nmGY5Oid1qP9YV9TsmkJBPgY73nNPUj7+8k+ScqsmTX0d5gY8qSID28xcxtOqT0xIV+LaFU/ueenE\ncVG3++4P9J3vIHqtfFqydf74/mId0UPu6xKCLCSW+n8UZB4Gg+EfJ2zxGww5xYjFfpdtLgva5oYx\na8SZxwbhb5cn+v66SnwPSm4BlYMywrsGEVFjvRxDfd50y+1Jee/7PNnG8R/9UDZkYn+jJfn9Jjpc\n7PflSlWaBIsszdf5ozLib9Oe/Ul5clMozXds1GM2CUq0OhkaS5hWs5+/FB9h5jOhVYzskL9htAB7\n8xsMOYUtfoMhpxjbbn+09xzkbmgowCOWAy8oRkuit8y64DyCObMig4qydoCxHo8cbxc5qqoslr1o\n/t6Pfyopz586IdotXvAcLu2uyuDLd/u7vlxQg03Pzvr5Li+Juouve++/A/d9jE1QvrMocKWx3I1Z\nVoG1uoBnXbRONrhdIGTJSX+fg9sv7M1vMOQUtvgNhpzCFr/BkFOMXufvqSYDRd0xpTftTTc4Qiq5\n0B4D0Xpcz3QD5cUO7G1kjDWsN9rQYBe+6SYf4XfzvdLj7hcLzyflTkfOss30/FbLRwM2WSowAJiZ\nnU7KN23dLOoWLpxIyrXLdyTl6e0hpnitk2eRp2R76qUscSFSzWF4OFJWwKyIwhDbS7wHYRbszW8w\n5BS2+A2GnGL0Yv8QUnssF31058EgIl6TzRUXO49BTJpSz9gA9SZQF20GZCm59r/vg6Lq1M990E+N\ncf0BQLvpM//Wy57Mo7ZaF+1mGl4NmN00Letavm7u6I+TcvUj/1S0K09KMhKBIW7jIKnkZLNQuzhd\nU5gmSasmGxDNw2BvfoMhp7DFbzDkFLb4DYacYmymvsHUl8ENGcEzAl7AFGBTiNaTxTmBPlK2xGFG\nCI197e34LGZv2iHqdt3pCTffPPwDUddm5r060+tXalLnX15eScqVkuT+n2Ruxu3F80n50pEXRbsd\nH/hoUi6VZQ4CZLiGB/PxxT486TNjO4nE9TXyxqTrOkBE3yOi14joVSL6cu/zbUT0HBEd7/3fel1n\najAYNhQxYn8bwO855+4F8DEAv0NE9wJ4AsAh59ydAA71jg0Gw7sEMbn6zgI42ysvEdERAPsAPArg\nwV6zpwE8D+Ar6/bnO5YVwosv45zs3npHAVesDOks1XekDBzkZAuSRrB2IU5/CvWxsSafWFBRiuUH\nmOnv7Z//WNTVaz6fN7FXTF1x/bWYSbDTkN5/KHixf4Zx/105/bpoNsfmtf3eB1QXFT8PXuGyn53B\nlLE4opmhvrHIqNLANIIYaMOPiG4F8CEALwDY1fthAIBzAEI+lwaD4QZD9OInohkA3wTwu865RV7n\n1l5hfX97iOhxIjpMRIfnLy/0a2IwGMaAqMVPRGWsLfw/c879Ve/j80S0p1e/B8CFfuc6555yzh10\nzh3cxlI4GQyG8WJdnZ/W7FF/DOCIc+4PWdWzAB4D8GTv/zPXNJMsk4xuFtSns6KjAMd8Nl1Anw66\n3wpk64jDa+T9lbqU/hiZd+B6Y/OuvUl5y87dou4iS71dUHsFHN2uvxZNhNrueHagCksbPlGWJKC1\nk8eS8lypIuq23/3hpExF9rinvvjs509E9QWU+dhU20MbC/vzuw6NGDv/JwH8FoCfE9FVetV/j7VF\n/w0i+hKAkwC+eO3TMRgMo0LMbv/3kf3j9PDGTsdgMIwKYyDwzHLxi/Osk+KZJs7MPEtNIdvFL55M\nIRthMsgQMq4tQOCp00dlz2Q4hHovVr35bcctt4m6OS728++MkXwAQIuTfuj8B03vJdjpMM9AkmpE\nEd5ceOX1n4u6yuy2pLz5gCcESZHCBGj7wwQvGUiZEgNNRf/DfmdO/V8f5ttvMOQUtvgNhpxi5GL/\nVbE6LZzE8ZoPw1kPhHf4s84LcToQGC99py2bdbwYSorPXrRTomGH7W5TwYu2VJXBKkLsJ/X7zT0l\nebmgf+djiUP4RWfLw9NbNomqMkvDVSwQK8t5lEp+594pcb7B72Pbe/8VlZegY/eg25SBQ5defzUp\nz+y5mfUhLQZBbsig5YXVhSwGWR3qoWJ39FNfxeAufvbmNxhyClv8BkNOYYvfYMgpbqBcfYFal3mQ\n2Wt0TrWAYq918ubi5aS8fMpHlnUZ0QQATBT9fkBZ6bgVpq9SQUW4ra4m5RorF2ckn/1yw/e/UpOR\ncG3mMeeYXluakTr5Tfu9/su5+QGgzLzphHeevodsr6N27oyoKrHr5rn6+F4GADRZVN9ybVXUFdi+\nCt8rqCqPwQLfH1F7ICvz3uu8sexDUia33IRYBHeZMp6rYT1Hxf5WduBr9DxCsDe/wZBT2OI3GHKK\nG9LDL8Rx0a+nvieGLDcBb65u24uh828eE3VzRzxhBa1eScqTE0oMnZ70ByoIpc0mVq5IE16Zia+F\nhjdZLV66KNpt2uHF9AVVt7LaSMotpgKcPieDLmc3e1ViapNUK6a3+OjLTdv9WFObJVNbscvF/tOi\nbmrK34NG24vvOpX30vJyUl5eWRF11WqZlb03YVeJ9tPsfheUCa/DOAJXLl9KypObpdgfChhz3GSq\n65CFaEaagGeqVn+516fiIBzCMdDe/AZDTmGL32DIKWzxGww5xfhSdIci91JEHJGbAAFdPsuG0m42\nRLPTP30hKV8+LiPEiLmbFvmcOlKPdcwUN8V0VQAol/0tb6+2RB2K/c1jq4tSF965y1/MlqokrwAz\nnXXLvj9uRgSAyuaZpEwrkl5t4bLfR7j0+tGkPFGR+vSWGZ8jT9N1TDE9vMxuD9+HACByAcLJiL8O\nu8etlr+uRlOOVmb3oKBMq9zFeWXO73tsv+UuqIasLKtCPrf82Rw6hjLDfTitx3MzdKCTSNib32DI\nKWzxGww5xQ1k6tu4noF408f5NyUH/NEf/oPvoyO957ptP0KRiejTFSl6zzJRv9mUKkGZnVdQcyyV\nuKcai4Qryt9ozm+/eUqaCzm5R52pAFU1WIUdzijVgStCmzd5MoyCEi0nGZf+akOqTx2WrssxcV4H\nBhJ7/0zNyhTdE9y8JyInlcrICUKK8jpLLLpwlakznbb8botlqZ5lIVoF3RAMklvAxH6DwRAJW/wG\nQ04xBrF/cHE/kt1POUrFcbSdO/GmaPbOKb8j3FV8c6WyF8vLVX/rlivyNq4wMXpmQorUVSbaazG6\nyL3/WNBPVakVi5d9gEpJEVtwvrxuy4u205NSrOVBM9SVZCS7tnmPPy6+l8pqLKZKuJTHGRNR2Q5/\nQX0vfN++25b3G1XftlLx8y8q0b7M7n9KlWIelo0V75XZrC2LdpNb2P0ZpWSvEMgdjBB3d5CMJAP2\n5jcYcgpb/AZDTmGL32DIKUau80epU8rTK+ucwUhAedQg9xyT+i4fudWR/XWL3KvPtyy0pTmv0/UR\neTVlAqswpbRckp5qJabHlVnkWklFsU0seX21qj0I2R5AgZXfs3efaNd1HdZOXmej5j0K68ysOD07\nK9ux6262pOmMW8QK7N4XlNmSH+scBDVG7lFh+ygTah+lzFOx6X0Udk87qz5t+PK8jHIchNyDY6MN\n1iECWZFTYgP2JdZ98xPRBBH9iIh+SkSvEtEf9D7fRkTPEdHx3v+t6/VlMBhuHMSI/Q0ADznn7gNw\nP4BHiOhjAJ4AcMg5dyeAQ71jg8HwLkFMrj4H4KqcWe79OQCPAniw9/nTAJ4H8JV1R7wqDwZd8LJN\nHPGeTMooKKwkvv+dt8o0U+6H/y8ptxrSHNRueTG33WVBOE7eRs5ZL4VhYJmJyiUVhDLJzFKTzKym\n262serWCsCQHYCIwMUPa1IT0npuZZMEwZXmvriyyQB+mOnSXZIARt6t1U0ZYP2fnmFejEvtlYIz+\nzrxq1WDqk4MyCTK3wbIyfYLz+7H+rrxzUjTjgT6aZ5AyD6L5Y4ZDKEnAuo3XR9SGHxEVexl6LwB4\nzjn3AoBdzrmzvSbnAOwaeHSDwTA2RC1+51zHOXc/gP0AHiCi96t6h4yfHiJ6nIgOE9Hh+fnL/ZoY\nDIYxYCBTn3NuAcD3ADwC4DwR7QGA3v8LGec85Zw76Jw7uG2b7QkaDDcK1tX5iWgHgJZzboGIJgF8\nFsB/AfAsgMcAPNn7/8xAIwfICHQ+PqHnB5PpBfonofQnxZvvvlc0u/+hX0nKP/ib/yPqFhfmkzJ3\n9a03lO4+4XX3inKJBXN1XW1KMo+lFW/a4tF/FU1Q4bJvQqvh9xS6zFQ5Oyt3H3Zu3Z6UN89IHbfb\n8uddvsKISmfkfEtlv29A2oTH3JOL5VA+BUbuqUhRuhnmWW0KFrkAlesvd0EuMb7/lTmZa6G56vd3\nJqYloWl02ogNQDhFfDaGmVaMnX8PgKeJqIg1SeEbzrlvE9EPAHyDiL4E4CSALw4xvsFgGBNidvt/\nBuBDfT6fA/Dw9ZiUwWC4/hhfiu6AyQTalCM6CPGah8bt366keN7fc+cdSfnS0b2i7vRJb2JbWvHl\n1RXJj7fEOPeqVXmLebouna66zcyALaYSOB1dyD0BVcovHt1FzOQIpWLgkldhFq/I+9ho+KjBC5e9\n2W/nHpnWa3LCz7esCEFKnC2EmfpIk2EUOC+dvM6u+J6YyU7vVPHzlOrAz6uyOS7XpRmXqwET0zK1\nWUj8jhXMQyQgwvuUf66YT2I13liYb7/BkFPY4jcYcorRB/b05JVBgnIkIgWeVLP+bB6XT70hWp39\n8fNJ+fYdU6Lujp3evaHJRPQrilr7/CUvKp+7KH0bFq54cbPZUqI4uwVdJvO22zL4iAfKlItK7Oft\nmMjbbMr7u8TUg5ISLxdW/fU0WPqyyS0ysIcTZUAFNxHLVFzg8ntH7dSzHXj9lfGgHE7JXVRyf5f1\n2Vb3lFsCCpR9zVfOvp2Utx24Q9St7XX3n+MwCPNLBtQDka5L1Q0xD3vzGww5hS1+gyGnsMVvMOQU\nY0jXtabThJ3zsqP6Yp36KKAUtereTHf8R98XzdqM272i9Gmeaqtc8Xrgnp3bRLsDe3Yk5Y4yPS0t\nep3//CW5H3D6HZ9Cen7Bt6s1pHdeve73ANrKDCj037rXf5c6ddFukpkBtdfdXM23nZny5jE9FldB\nNdmpyGbG9gNciliVR/xlp/LixKSklOaiYO2UdR12P7osPbiysmL50jtJuVmTkZITM97jL5QFLmW/\nFg0DNLSBawt0qI6Mt99gMETCFr/BkFOMgbe/By3ehKInmFjE+eFTHGeRIlNt0QernHv7lKhrr3iR\nTwflVBh3XIWJ/dPTkkdvqspJOVRm21mfvfamLdKUeNete5Jyo+lF/WZdmvpaLSbKqltVY/x7jaY/\nr7aSnXqsoXgGT855dWSO8QWSkpW5SqO9FYXXHSM+4R59a818H8IjEVKK5kE/pMj5id2PlPjLmhYC\n/Im1mvdqXLzwjqirikCf4Yx9IT5+7cmXjYD6O0Rkj735DYacwha/wZBT2OI3GHKK8en8Q6Y6zjaY\nhAP+eGMePVdvSHfQ1ZrXjQsFqSdXWGQcN/WtNhU3PyOvmFD7BhNM16wUpd5ZYTnnOPHEpplJ0a7E\n3E2dUvqXGAf/0ornqe8qc2GT/e5vmlX0iywScfVtf216T4UfF3QdK3fZd51qx/V3/UzwvINM52+p\ndnyvQOvPRbGPwPaL1DwKLI/B/NvS5Xv7LXf6dgW5h5OFNGlJv1n0P5NNMrNPvU1gKboNBkM0bPEb\nDDnF+MT+FEICPasJ8NfJLrLNKbNbvUfe7O79ot3c3M/YWCoCjUWMTTBzXqcrRcEqUwkaKspsmZue\n1GVyJaDC1IOy4pEvE0vJJbvAChP1eQTh4opUTWa27vZzVBF/rVVmVmOfa0sqN53piXS4qM/Fd+UJ\n2OlQZp1j3n/cxFtUZjqEVAeWRqzILKaliuqDnbd04bSoqrM8BlNbtiMLsVx/QS9BMSWl3rB7oMX8\nYZRoe/MbDDmFLX6DIacYQ2BPREXI4yng4Rcr/FQn/O75hx7+VVF34aLntrt45m1RV2HcgkUmorYU\nQQWYeNnWmaWI72CroByWDox7yBVVHwU2tr5Vq3Uv5jYafiINRbYBZqFoLEsOwstXvLdbnXkJdpVl\nocWIPlLelQU2/wzm9bUTeVkF5XC1K0BMwu9/t6OIPpj1g9N6OydVNW4B4hyGALBwzqsB0yqbr+DX\nCIr6Q6TaUqQlQS9B2+03GAyxsMVvMOQUtvgNhpxi9ASeV3WTUAReSH3hEX6p6KjsTpzw7vKf77n5\nFtHuc//yt5LyD//uu6Lu+Es/TMory8x7riXNRpwrvqQi1bga11WmHMfSa7VbTNduqTRWzCtRk4Vw\n8ySxwbj+DwBXzvjItdWaNAPOr3gTYZGZxHR6bb4V0ekqAk8+L3aa0x5+bP+ipEx4fB+hxUym+vHo\ntpkur7Y2XNkPzlOnO71Pw78Y1ckc8/jbdcc9oq5U8ZGefF7pRzg7F4Xk6ud7WtlGwdTyCRGJZCD6\nzd9L0/0TIvp273gbET1HRMd7/y0Lp8HwLsIgYv+XARxhx08AOOScuxPAod6xwWB4lyBK7Cei/QD+\nGYD/DODf9j5+FMCDvfLTAJ4H8JWhZyLE+eiTMo9SHH4i0y+3z8h2u/b5FF0HPywz+G5aZSQPTMxt\nqlRYi1c8IchKTZrR6qxtW5nfOGEF573TYj8XWbUXWJeJ/dwDT3PnFZkpbnZKkpEsNTyHn8hyqzwN\nOZd+Wg7l2XeZt59qBS6yp1J5Me8/barkIzEbW7st+1hlX02bqRVFFVSVRRwCAM2330zK5944Iur2\n3uVzORT4/RlECs8I+hlMkL9+pr4/AvD7kIrLLufc2V75HIBdqbMMBsMNi3UXPxF9AcAF59xLWW3c\n2k92358eInqciA4T0eH5+cv9mhgMhjEg5s3/SQC/RkQnAHwdwENE9KcAzhPRHgDo/b/Q72Tn3FPO\nuYPOuYPbttmeoMFwo2Bdnd8591UAXwUAInoQwL9zzv0mEf1XAI8BeLL3/5mBRtZmrvAckrJULQfQ\nisSGQPZoy5d8qua5Yz8RdXu3eyLHEk+1rfTHYiFbj+Wpt+t1yaVfY3z5S0ueiHN5qSbadVjuPq1q\ncxfWKiMH0RGEnPt/VU4Ds9OeWPT0nM9j4JQJrFDwZi5NJNrucJMjN8VJkyM/rZPi/uf7NJykU5Fc\nsPvdVv13O/5+c1NlymzJLqCgzLNldi2vv/i8qCtN+Hu1bc/N/vOKTFkeoO3XV4NMBKL6gr7FGbgW\nJ58nAXyWiI4D+Ezv2GAwvEswkJOPc+55rO3qwzk3B+DhjZ+SwWAYBUbr4ce3BYdMU8wlwbSXU4go\nLWNAJZafe+t4Uj5/WvK3M4kahaKPCisqEbJaZpz+UxOijh9v27pZ1O3iab8C7mKc677TkmJuo+69\n9a4seBIKTvIBSDG31ZWPwVTZ13EiEZ3+2nW9idCpCDSe2qvA1KKUqMnE+Y4yafLU5F3hQahJXLia\npVQHfh7n/FBiMveG5KoTAEywPksLc6LuzRcOJeXa+x5Iytv33yraTc9sYv0rIpFoxKWti4X59hsM\nOYUtfoMhpxhfYE82s3F8X0GOMwkeJMG93bTqsMKCWi5dltlauVhaZhx+pMT+Eut0oqKou3kqr2o5\ns67MrAk64KUAvnuuRGWW5usKywisPQ2bzBNuVQX9rLDtf+7tVlapx7hVo6kDjJgYTY6n6xLNBG+f\n9qzj3opdds1prr/sp4e35apDKuUX83jUlhHU/QcVpRLULp1Jyid++LdJeW7vHaLd7rvuS8rb90re\nyGrVq4JahYxGshbiV5K9+Q2GnMIWv8GQU9jiNxhyihuItz+ELD0mO3Iv5QUmzsrm/t+8+0BSbhVU\ntFvNxyZ5gV8NAAAT8klEQVQUGKFGqax49VmKrtW21KfLLB12SemdZaZP8pTXRWVGKwTcxbjpb3nJ\n71loPbnV9Prv3KJM5bXMyD24yW5qUqUin2JpxFYlIUidRyXyvRk1D05iqr9lTvzByUK0F5+MhlQe\nftw7lN3vgtLd+S0tqXTjxPYeajWVy4F5PVadH3vp5Cui3dKlc758z4dF3fZ9tyblbdt3JuWK8hIM\nPd/+OY43Atqb32DIKWzxGww5xQ0p9qeF/Ix0TCEawFDwRIA/cN8ddyXluz7+oKh76Xvem2tlxXO7\nV/REmNlISewijZW2UBUE4QgzTeqoGd6fEnM5CUiLqxhKzG01mWcdpIltmZF5cN67iQkt9nsTVYpX\nr+7VoiYT7TnXP6AJTbLTr/FAlo4OlmKqTlN5IfI++Nde6MixSszERipRQouZhutq7BLrpsL4ArVJ\nsLnoA8bOvPT3oq427wNil2/xz98e5SU4NT3t51jQaq2Z+gwGQyRs8RsMOYUtfoMhpxhfrr6Avh4K\n1gudGEjeHahT5rayN6/80oMPibpdBzxZw6s/PpyUTxx9VbRbuOJNgtWy/H3lAV0pN1JmUnLcLVWT\ndDJCzE5Lmuk4uadwadZDdbgZTdatMh16irueqj4q7GKIEYCsjef3DUrMlbihdH7uot3RuQszXH/b\nap+D6/na5Zu7y1aqjIBFbcY4ZYLk4CSmOuKvUvX3gLsPdxSRKI+OdF0ZYVljZsHmon922nXpkr1z\n/21JectWyYo1TKSgvfkNhpzCFr/BkFOMWOxnbB4uW/hOGyv6i68Fp80dvMPsVEdZ/a21YiJeSd6e\n29/73qR84DYvgn3vm1L0PvPGL5Ly6qoU3a4seBNhq6nMdEy05aQUKT57bvpTVeUy4/BjnofVkozI\n27J1u59HQ85/qc5NhIz3LuBpOKmiF3nk4RLjJiwVpbmQ8wx2OvJi2l3OM+j7KCpTLSdImZqW5Clc\nTG81efpypS6xyMOiMqNVmLlzsqL4GkXabz//piJZ4QGclYq+jyz92oJPB37+58ui3eqy99is3yyj\nBrduX/s+tSdnCPbmNxhyClv8BkNOMUYPv2zqbi3luoy9+hQPm3QJyxxPZOzVzSK9BmtLV5JysSFJ\nP27f67n42kqUra3elJTrKs1Xg6kBPCttvS5FVO65p8lCNm3yYu8kE1e7SsWo1b14uNKSQTkdtiM/\nOTvryzyQB0CZkYxooo8JFpTCyUgWGCU5ALBYGChpW6QDKzDvwkJJB1LxYyn2dlgQEPegnJqQQTNc\nfFcb+iLTslPZiNsZgUkF9SBxS0ZHpR6jUn+ykHZDJrmZe+1HSXn1yryou3LgdgBAU9HBh2BvfoMh\np7DFbzDkFLb4DYacYow6/3BEHCFfPZnWazhm89g+GjXvpbV4aUHUuabXa0mZC4sVrxvPTkuz101b\nfNQWJ/rQnm8ttgdAOoUWsQg6Zs5aUqanFUbYsdyUemKVkZHMznjPvU2zM6Ld1ATX85VnXSEjnZni\n1V9c9vex0dTef/7aKjxVeCpC0V9LU3kQ8o2aCtsfmVA6P987KSsSzQbbf2k2FXkK8zbk34RTz067\nywhIlZmx0mH3hz0SpaIif2WegSsnXhN1q5fX0qo1V+WeSghRi7+XpHMJa9fXds4dJKJtAP4CwK0A\nTgD4onPO0vAaDO8SDCL2f9o5d79z7mDv+AkAh5xzdwI41Ds2GAzvElyL2P8ogAd75aexlsPvK6ET\neLaudfLyiqNhBPhUFtMM895gffvWM1u9ya6ydadodfGE9/Brd5TphYmsmo+f8/Zzsb+grqXLRHhS\nXPcETpzhy0s1ac5bZaa/suIg3LrHe/9t2eRVkbJSYWYYuURTmQtLRSZWs+lPlZWJjWkSq3XFA8iC\nljhvvyZIqZS9rDzhlKchMxdySbysMvHOTnszpvYgLLPgrJp6YBrs4roZmYkBaRLUtmzelpjq40q6\nHVNNnPo+L615Brq2VClCiH3zOwDfJaKXiOjx3me7nHNne+VzAHZFj2owGMaO2Df/p5xzZ4hoJ4Dn\niOgor3TOOaL+aVN6PxaPA8DePbuvabIGg2HjEPXmd86d6f2/AOBbAB4AcJ6I9gBA7/+FjHOfcs4d\ndM4d3Lp1y8bM2mAwXDPWffMT0TSAgnNuqVf+FQD/CcCzAB4D8GTv/zMxA141pYXMaEEKQpd9XjAy\nUFQGdh74vFK6mS9PzXi314989vOi3fe/4/Wut4//QtTxyL1SSemWTC8XuQV0bjrmHqr3A/h9bbDc\ngtzECACFqte9t6hIuK2bvCI+w0xibWVGE5z4kOC5C7gO3VWc+9z0V55ReyAtP2d+FiniCsf2ObqK\njJSb4rjLdFFx8ze5y3RV7kuIvIlFZUpk19kpcjIWtU8jcgbKLlo8nTkzCTrtBizISFVa+OLaeNpF\nOoQYsX8XgG/1HqoSgP/tnPsbInoRwDeI6EsATgL4YvywBoNh3Fh38Tvn3gRwX5/P5wA8fD0mZTAY\nrj/Gx+Gn/fbiAvKiTXPpdEbrTOfqecKBME412X3LLaLuc7/520n52M9+KurOvPVWUu5oswzzaONp\nt+YvXBTNLs9d8qcoNajFOPcrjDdu+ybpnddg0V8VzcfPzF5TrK6t5FVOVELqThbIi9GTE4xsY0Kq\nGJyYpNWVIjXnzmNWS3TV19JifaRyHLC2m7d4Va1ekzx63MzYUZF71Up/EywAVFgKM87hx82sa30y\nPkIlzvM5c1VKk9VIL1jZ/0TPXDuIY6v59hsMOYUtfoMhp7DFbzDkFGPQ+TOI+13mQahKguI2DijU\njvoW144zAwply5nZzUn5I5/8ZVH3kU/8EzZ0ik0/KXHdb/7CJdHqR//X53p789gxUbc07xleCvA6\n9GpD6tNNZgast6T+WGOuv5yRR+cPuLLidf6qclVuM52XR6eVitLkWK0yl1i1BbLaZno405NVmj3U\nOetRUxKmTjJTZYWxDRWnJSsRv/da528yl9uSivibZGZBPq2GyhnI3XvrJOt4rkH+TXRVBGSR7eF0\n1P5LaYj3uL35DYacwha/wZBTjI3MQ5N0huT5aPOFEMsD8nzQnDd8zF8/pDwZeQRX4MK4RWnXvn2i\n7vP/wvtTXb4kVYK3jvmwi1NvHE/Ki3PSXLjICCBXldfdxQXPF99lZqhp5fm2UmNkG2VFPMHVAGay\nmqxKsyL/KrrKtNVs+v4XV7xprqNeWc2OF6NbynxaYvO6vOBJVyercr7TTA3QnPtNxvffVqZEniqb\nX1tFEavWVr1pVXPr82hAkaNBp+HmZsCsuvgM3fbmNxjyClv8BkNOMVqxn7N59I8Azj7vKq5dEh+6\nDycsAdnc/xSwGATHzlAD9Kcllnprx+49om7Hbh82/ZFPestCoyFJRZYXvQh89uSbou7EsSNJubYw\nl5SXWrKP5oo/1rx3VRZ8U1/1Yvn0pNzt55fcUuL2MrMmzC97brqCSpnVYWm9ylVZV2N8h5zTcGpC\nPvpbN2eTljh2rHfZRV4Gdi0VFUjVZQFd3VQ2Yt8Hz0as1UKRLk1ncBsgTVfS38BnGAyGfxSwxW8w\n5BS2+A2GnGIMpr4MDz+G7Fgm6RWXitzLdsELZALQuhL/Pcz2QpTqWDwxiTwtcvNhgFAtTvJQKvOy\n1EGnGRnJrn37Rd0HH/hEUm6sehPbhVMnRbuX/v5QUp5754yoW2ZRg8s1r2tXZNZpwWzRUl5xdbYH\nUGekHIWmvB88l96s4uOv1ZkZkHku6hyKnY7Pt7iN6f+ANGOWtS7P03IzT8AJ1Y7vI1TKKqqPlRtt\nFsnYku2E96l6JDq9fYO012g27M1vMOQUtvgNhpxi5GK/l5IGMPVl9RXi5g/EDQW0A2glQ3ZPfWt0\nOub+M+ozx1Rdpl6ROY+NsXxqMdqLrOXZTUl5+p4PiHa7b74tKZ88LgidcfQnLyXld173noYLS5JE\no5vBsQcA9Tbn5vP3pqy4D2emvGcdrUgPP8eCY3hgTEuZ25ZrnHNfznGW9T87OyXquNjfYsFHOs03\nzx9QUSqY+D7Z67ihHr8WUwPKisdQk6nEwN78BkNOYYvfYMgpbPEbDDnFiHV+lxAUxBJsphHynWVE\njpGkH6FZ6D2FQlBfX3+s9HnaVMmL/fcXBhk72Eek+ZAC+yhTM34/4J4P/ZKou+Pe9yflk6/73AVv\nHT0i2p0/fSopn3vntKhrXvapz9ttRrahXMOJEZV01ZWWmfJdZKQimviUG9VqDbkfQIx8o1yR+xJl\nFr3I59giRbbBVXT1cBZZhF6RKf2Fgibz8HWdQL6/WNib32DIKWzxGww5xUjFfocA6UDAeykzEVco\nJ9fQNjAu2geIPgKhe9L0pwR9yjrQ/Wd2H32ZxH7bB7kd2RJkKHW6PKpOeHKMu97vc768515pLmzU\nfeTepfNnRd2J495EePrk20n53NsyCvHKnE8T2VRkG5zMw7E5FgrKVMamr/zqsMo4DssrMrJxZtqb\nAXnab+VAKFJvORWBV+Rp25kJr6xSdHNKP82nqPuMQdSbn4i2ENFfEtFRIjpCRB8nom1E9BwRHe/9\n3zrw6AaDYWyIFfv/G4C/cc69F2upu44AeALAIefcnQAO9Y4NBsO7BDFZejcD+GUA/woAnHNNAE0i\nehTAg71mTwN4HsBX1uvvqtivd9IpICpzlzxy2TJviMJviM3QlNifNcP0TmtAhxFVIS++yKpU94Nf\naOgcOcdsqvG0caX/eVrcnpzyacQO3PYeUXfgtjuSMs+2e1nxEb70/X9Iyq+88H01D0aiwSRj0q+9\nQvZ3xlWJ5brc7edNZ6ZkUBGH8Pjr6kzC7PlmO/ollUm4U2T3uyP76A7xvce8+W8DcBHA/yKinxDR\n/+yl6t7lnLuqpJ3DWjZfg8HwLkHM4i8B+DCA/+Gc+xCAFSgR3629zvta1onocSI6TESHLzO7rcFg\nGC9iFv9pAKedcy/0jv8Saz8G54loDwD0/l/od7Jz7inn3EHn3MGtW7dsxJwNBsMGYF2d3zl3johO\nEdHdzrljAB4G8Frv7zEAT/b+P7PuaM4TDQ7ikSS0x9iItkidOUi+qfXpDM790LXE9pGaTaw5L2gW\n5Z/qlOhsHgGTafhrCuwHZHlYpvZpuOk22yxaZGQYO3ZK0tJPf/7X/IHSp1978QdJucnMbWX12isw\n0xknB9FTbiu+/Frd70Xw+U4pUhGUuNlV9s/JN0lEIap5sLGpK+t80/h1FWvn/zcA/oyIKgDeBPDb\nWJMavkFEXwJwEsAXA+cbDIYbDFGL3zn3MoCDfaoe3tjpGAyGUWHkgT3ew0/b4pgYk9qJ4KI+Ny8F\nvOeiEfaRk/1zcZiLcfHmPAroFVnmw7Rkn+2F6DLzIch2hYBeESY7yejdZc8jljvFBcaSiZXlNVYm\nJpLyJz7zOVFXW1pMyieOvpqUW0o9KLMBVJXwwOso170GJwURmbaUyE6ewCOVaosHYLH+nQ7e4XMq\n6GeHeuMgGubbbzDkFLb4DYacwha/wZBTjD6q76pZI2UDY/pNgEo/5NoaVi6H8u/N/iAQnSfV+sC+\nQXBPITSvbHPhcCQpAVfr4A3P7kO27a8XA+u4D3ez9i+yMbtpszj+1K9+ISkvLvi05PPn3pFDcZ1f\n31Ome+s8e5xYhNh11hty44Cb7bQpscjyHHL3Xj0WV/P1vsEwG1725jcYcgpb/AZDTkHanHBdByO6\niDWHoO0ALo1s4GzYPCRsHhI3wjwGncMtzrkdMQ1HuviTQYkOO+f6OQ3ZPGweNo8RzcHEfoMhp7DF\nbzDkFONa/E+NaVwNm4eEzUPiRpjHdZvDWHR+g8EwfpjYbzDkFCNd/ET0CBEdI6LXiWhkbL9E9DUi\nukBEr7DPRk49TkQHiOh7RPQaEb1KRF8ex1yIaIKIfkREP+3N4w/GMQ82n2KPH/Lb45oHEZ0gop8T\n0ctEdHiM8xgZTf7IFj8RFQH8dwCfA3AvgN8gontHNPyfAHhEfTYO6vE2gN9zzt0L4GMAfqd3D0Y9\nlwaAh5xz9wG4H8AjRPSxMczjKr6MNTr4qxjXPD7tnLufmdbGMY/R0eQ750byB+DjAP6WHX8VwFdH\nOP6tAF5hx8cA7OmV9wA4Nqq5sDk8A+Cz45wLgCkAPwbw0XHMA8D+3gP9EIBvj+u7AXACwHb12Ujn\nAWAzgLfQ24u73vMYpdi/D8Apdny699m4MFbqcSK6FcCHALwwjrn0RO2XsUa8+pxbI2gdxz35IwC/\nDxnONY55OADfJaKXiOjxMc1jpDT5tuGHMPX49QARzQD4JoDfdc4t8rpRzcU513HO3Y+1N+8DRPR+\nVX/d50FEXwBwwTn3UmCeo/puPtW7H5/Dmjr2y2OYxzXR5A+KUS7+MwAOsOP9vc/GhSjq8Y0GrfE5\nfRPAnznn/mqccwEA59wCgO9hbU9k1PP4JIBfI6ITAL4O4CEi+tMxzAPOuTO9/xcAfAvAA2OYxzXR\n5A+KUS7+FwHcSUS39ViAfx3AsyMcX+NZrFGOA7HU49cIWgte/2MAR5xzfziuuRDRDiLa0itPYm3f\n4eio5+Gc+6pzbr9z7lasPQ9/55z7zVHPg4imiWj2ahnArwB4ZdTzcM6dA3CKiO7ufXSVJv/6zON6\nb6SojYvPA/gFgDcA/IcRjvvnAM4CaGHt1/VLAG7C2kbTcQDfBbBtBPP4FNZEtp8BeLn39/lRzwXA\nBwH8pDePVwD8x97nI78nbE4Pwm/4jfp+3A7gp72/V68+m2N6Ru4HcLj33fw1gK3Xax7m4Wcw5BS2\n4Wcw5BS2+A2GnMIWv8GQU9jiNxhyClv8BkNOYYvfYMgpbPEbDDmFLX6DIaf4/6QoW8nvSx1MAAAA\nAElFTkSuQmCC\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x7f8a61927fd0>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "fname = \"images/thumbs_up.jpg\"\n",
    "image = np.array(ndimage.imread(fname, flatten=False))\n",
    "my_image = scipy.misc.imresize(image, size=(64,64))\n",
    "plt.imshow(my_image)"
   ]
  }
 ],
 "metadata": {
  "coursera": {
   "course_slug": "convolutional-neural-networks",
   "graded_item_id": "bwbJV",
   "launcher_item_id": "0TkXB"
  },
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.6.0"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 1
}