Traffic_Sign_Classifier.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {
    "deletable": true,
    "editable": true
   },
   "source": [
    "# Self-Driving Car Engineer Nanodegree\n",
    "\n",
    "## Deep Learning\n",
    "\n",
    "## Project: Build a Traffic Sign Recognition Classifier\n",
    "\n",
    "In this notebook, a template is provided for you to implement your functionality in stages, which is required to successfully complete this project. If additional code is required that cannot be included in the notebook, be sure that the Python code is successfully imported and included in your submission if necessary. \n",
    "\n",
    "> **Note**: Once you have completed all of the code implementations, you need to finalize your work by exporting the iPython Notebook as an HTML document. Before exporting the notebook to html, all of the code cells need to have been run so that reviewers can see the final implementation and output. You can then export the notebook by using the menu above and navigating to  \\n\",\n",
    "    \"**File -> Download as -> HTML (.html)**. Include the finished document along with this notebook as your submission. \n",
    "\n",
    "In addition to implementing code, there is a writeup to complete. The writeup should be completed in a separate file, which can be either a markdown file or a pdf document. There is a [write up template](https://github.com/udacity/CarND-Traffic-Sign-Classifier-Project/blob/master/writeup_template.md) that can be used to guide the writing process. Completing the code template and writeup template will cover all of the [rubric points](https://review.udacity.com/#!/rubrics/481/view) for this project.\n",
    "\n",
    "The [rubric](https://review.udacity.com/#!/rubrics/481/view) contains \"Stand Out Suggestions\" for enhancing the project beyond the minimum requirements. The stand out suggestions are optional. If you decide to pursue the \"stand out suggestions\", you can include the code in this Ipython notebook and also discuss the results in the writeup file.\n",
    "\n",
    "\n",
    ">**Note:** Code and Markdown cells can be executed using the **Shift + Enter** keyboard shortcut. In addition, Markdown cells can be edited by typically double-clicking the cell to enter edit mode."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "deletable": true,
    "editable": true
   },
   "source": [
    "---\n",
    "## Step 0: Load The Data"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {
    "collapsed": false,
    "deletable": true,
    "editable": true
   },
   "outputs": [],
   "source": [
    "# Load pickled data\n",
    "import pickle\n",
    "\n",
    "# Import other usefull libraries\n",
    "from sklearn.utils import shuffle\n",
    "import tensorflow as tf\n",
    "import cv2\n",
    "import numpy as np\n",
    "\n",
    "# TODO: Fill this in based on where you saved the training and testing data\n",
    "\n",
    "training_file = r'E:\\Udacity\\self-driving-engineering\\CarND-TrafficSignClassifier-P2\\traffic-signs-data\\train.p'\n",
    "validation_file= r'E:\\Udacity\\self-driving-engineering\\CarND-TrafficSignClassifier-P2\\traffic-signs-data\\valid.p'\n",
    "testing_file = r'E:\\Udacity\\self-driving-engineering\\CarND-TrafficSignClassifier-P2\\traffic-signs-data\\test.p'\n",
    "\n",
    "with open(training_file, mode='rb') as f:\n",
    "    train = pickle.load(f)\n",
    "with open(validation_file, mode='rb') as f:\n",
    "    valid = pickle.load(f)\n",
    "with open(testing_file, mode='rb') as f:\n",
    "    test = pickle.load(f)\n",
    "    \n",
    "X_train, y_train = train['features'], train['labels']\n",
    "X_valid, y_valid = valid['features'], valid['labels']\n",
    "X_test, y_test = test['features'], test['labels']"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "deletable": true,
    "editable": true
   },
   "source": [
    "---\n",
    "\n",
    "## Step 1: Dataset Summary & Exploration\n",
    "\n",
    "The pickled data is a dictionary with 4 key/value pairs:\n",
    "\n",
    "- `'features'` is a 4D array containing raw pixel data of the traffic sign images, (num examples, width, height, channels).\n",
    "- `'labels'` is a 1D array containing the label/class id of the traffic sign. The file `signnames.csv` contains id -> name mappings for each id.\n",
    "- `'sizes'` is a list containing tuples, (width, height) representing the original width and height the image.\n",
    "- `'coords'` is a list containing tuples, (x1, y1, x2, y2) representing coordinates of a bounding box around the sign in the image. **THESE COORDINATES ASSUME THE ORIGINAL IMAGE. THE PICKLED DATA CONTAINS RESIZED VERSIONS (32 by 32) OF THESE IMAGES**\n",
    "\n",
    "Complete the basic data summary below. Use python, numpy and/or pandas methods to calculate the data summary rather than hard coding the results. For example, the [pandas shape method](http://pandas.pydata.org/pandas-docs/stable/generated/pandas.DataFrame.shape.html) might be useful for calculating some of the summary results. "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "deletable": true,
    "editable": true
   },
   "source": [
    "### Provide a Basic Summary of the Data Set Using Python, Numpy and/or Pandas"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {
    "collapsed": false,
    "deletable": true,
    "editable": true
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Number of training examples = 34799\n",
      "Number of validation examples = 4410\n",
      "Number of testing examples = 12630\n",
      "Image data shape = (32, 32, 3)\n",
      "Number of classes = 43\n"
     ]
    }
   ],
   "source": [
    "### Replace each question mark with the appropriate value. \n",
    "### Use python, pandas or numpy methods rather than hard coding the results\n",
    "\n",
    "# TODO: Number of training examples\n",
    "n_train = X_train.shape[0]\n",
    "# TODO: Number of testing examples.\n",
    "n_test = X_test.shape[0]\n",
    "\n",
    "n_valid = X_valid.shape[0]\n",
    "# TODO: What's the shape of a traffic sign image?\n",
    "image_shape = X_train[0].shape\n",
    "\n",
    "# TODO: How many unique classes/labels there are in the dataset.\n",
    "n_classes = y_train.max() + 1\n",
    "\n",
    "print(\"Number of training examples =\", n_train)\n",
    "print(\"Number of validation examples =\", n_valid)\n",
    "print(\"Number of testing examples =\", n_test)\n",
    "print(\"Image data shape =\", image_shape)\n",
    "print(\"Number of classes =\", n_classes)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "deletable": true,
    "editable": true
   },
   "source": [
    "### Include an exploratory visualization of the dataset"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "deletable": true,
    "editable": true
   },
   "source": [
    "Visualize the German Traffic Signs Dataset using the pickled file(s). This is open ended, suggestions include: plotting traffic sign images, plotting the count of each sign, etc.\n",
    "\n",
    "The [Matplotlib](http://matplotlib.org/) [examples](http://matplotlib.org/examples/index.html) and [gallery](http://matplotlib.org/gallery.html) pages are a great resource for doing visualizations in Python.\n",
    "\n",
    "**NOTE:** It's recommended you start with something simple first. If you wish to do more, come back to it after you've completed the rest of the sections."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {
    "collapsed": false,
    "deletable": true,
    "editable": true
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "33\n",
      "2\n",
      "17\n",
      "38\n",
      "38\n"
     ]
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAFsAAABZCAYAAABR/liSAAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAAEE9JREFUeJztnEuoZWdWx3/r26/zuI9T76o8TLpDFNtGukV04EQQQZy0\nDhR7IApCnDQoOLBx5LAH6lSI2OBAEEHBHjRIIzpwoHQMoWMbYmJSqUdu3WfVvefcc85+fZ+DtfY+\nN5VK3ZO61TtF6iy47Hv243us/f/W+9sSQmBF3ZD7rAfwNNGK2R3Sitkd0orZHdKK2R3Sitkd0orZ\nHdKZmC0ivyIib4vIuyLyzcc1qM8ryaM6NSISAf8L/DJwC/g+8PUQwv88vuF9vig+w7M/B7wbQngP\nQET+Dvga8InMjpMkZFkGIu2SEqf/JbEORcSRphkALlIglEXVDrSoSz1Xe70HQQwvdVUA4MsSvJ0U\nO8SJDSImSxPrWy8WRQVACB7va23Da/uBQJr1AIhEx1pWOoaiKolcTD7PKctSTmPYWZj9LHDzxO9b\nwM/ff5OIvAK8ApCmKV/68pcJScIgMib3dCJXL13W32mPF59/GYDhmk7q5q1tLtlUPjjcAWD38BiA\nvo9Jgl482rkBwGTrDmGmjBcXAZBduqQNXLnCC89d02czHcMHW3sA5MWM2WwMwGw6BaCoK158Wcez\nluhYt3b1/tt7W4wG53jj9TeXYthZmP2gN/kxmRRCeBV4FWBtbS3EMUSJMExTALwhuyyVOVVdcbD9\nNgD1sU5O6oLD3joAw2wIwCSaADCt5gwGfQDSS+e1zaMxVanIjFNto+zpasmGET7VocdOz13bXAPg\nw8NA1B8AsDnSF/3hneuEvo5192AGwP6+Mnt94xIbm+tEcXQqs+BszL4FPH/i93PAhw97QASyCK4N\nekSxTmBsTBn0lGH9IFyNcwDO2z2JA7ehjJzMlQmjzQ0A0rrkwkifnY6Vedt3DqgKEzOZnkvWlekb\n6ylFpszZi5SxpdcXXftAbIyNy7m2f9Dn6FiZvHfvLgDXRiM9Pvci1cCTJMux8SzWyPeBl0XkCyKS\nAr8FfOcM7X3u6ZGRHUKoROQbwD8DEfDtEMIPH/aMD55pXnCLnPWevmdn2q2eKZpxMaHUa7kpw6N5\nTbSjS3c+UZkaSlVkKYI/1mcTk6m+N+C4p9fzTKe42VdR0fMZ9YHK42RNr/WD9nf54gXiWMfz3vVd\nAKbHBZMbqgueGW0C8DM/+VUA4tRxcLTDckLkbGKEEMJ3ge+epY2nic7E7E9NAXxVU6ZCaRYEJhtL\nryg+TgK3p4quK5kehxsj0kxRVdSmSMtgv2P2944AOJwfAnCQpxROkRwHneL2RI8z78kSledDr31f\nOa/64PK5C9SiKyJydwCo65rEdMfVZ74AgO+pks7zmvHBlLqql5r+yl3vkDpFduIczw2H3AslVa5I\nrip1KO6NFZ1pFTMWRd681uFdGPWYF2oRHByqfP7grsrdu0cVs7meO85N/vsECSpJRbvhuNB/9sY1\nvVSvbawZ1hK91luryUxmT+eK+tjBtfPqA2yu6eqqczU7t7fH3N7dpbA5nEadMjsApXNkaYqvdVJq\nyECc6NKsq4LpTBmfT9VsG8/uMTPvcMtExo45HbM8gIkkaU1/YeGjmhda6XFe1IydvszDqR7HcxUZ\ndyczRqZYZzNtf2MwIIu13fGRiqnZXF/81p0P8MGxbMhjJUY6pE6RXQMHVY3UOUOLNwRb53WpiA1U\nODHPMVHHZXvquLWzD8B4anLB0CQIwTAjJn4I4JuYiCE7Nlj5AN7iJnmuKN7dV9d/Os05t2Giq6ci\nY2Po8KZI93av63gO7wGwmQ24OFznB9Fyxt8K2R1St6afD0hRE1zAx010TZVLbY5MVZWIxU2mhSLm\n1u6E41ndNAEs5LMe9aRvzolgIReGPZ3ilfXM2iwZW5BqbuZjZctgMq0wVUIa6/2j4TmcKLLvHR4A\n4MzNv3rlGYYEomg5zHbLbCDUEOGpmnCoeW84jW9ETgiiynLnQCc5nVVtiMs1OvCEThJpTkl7ognd\nnj+n4uDHn9V4RlkV7N5VkbVtFs3hsb7wvILZXF/qzqGKq2GasW7WS27tDze1zd3JjO18Sr6ys588\n6tb0C4GqKogQIqcB/CjSYzbUpVkVMfsTVXSTqSLOh4VRF04oRpr/muxBI2JEWgU6t9CtT/T+axc2\nuTRSBXzlnCrGW3tmN9/LGVtUcWbHnbHDrSuyX7h4BYCNdfVO3795nXI2JfgVsp846l5m44ldSmZp\nqjrSIQxMId0rY3YtslcbYFwA37bgrB37JZBEitrMZGu/F5GYrTcwLzG2rEySxWSZ3t/rm5lnyYO9\ne1M+3FeU3znU4ySvyIeqQy488xwAI1O6+7dvsD/PF1r7FFohu0Pq3F2vA1QE5oVF78xsSvUnB8cV\nFp5uLRXBL9xvE9VNcmS0MeDla5Y5uahOUK8f0VpjZr4klrpKZOEERZb4baJ6g0HGxZHqjmfuKZqv\n708IQe8Lotd61laVVxwdHVPXi3X3MOpcjOAcntDoL8SW4KxQM+x4VuJt8CeVIOYdpolO9Ceuqvn1\n8hevcs4UXmSMnVdVa/qlrXen/QThRNzko3akSxy9oYkfC1zN9gLlTBX13j1VqJk3ZjvhuCjxq9jI\nk0edIls9u4jKQ18UHQ0aS0uB5WW9QLQskNcksF+4rFn2n3r5WQBG53oEW8WTmUbjPtw/ojTT0nQm\nG0P9fWltQBSdWDEsnKFJUXJ9Rx2eGzc0ErhzNKOXqcM1PlalGZ1XsXVuc8gwiRaO1im0QnaH1LlT\nE+oKiaMWvVGiyin3Zgr6wP0lKSKwuabo+tJLWmCzPtLngoebu4rG9z7cAuDOzpTcK476fT3+9Eua\nALjcT0F02qW52bd2dUW8s7XDbUN2Pje9EYQ6suRxbZo7Uv2SZYHz54bEt3/0dSOfnkQg6kHk8a7x\nBJWCKUVfh0Wsow0KRfzY1XMAnDdroZEdN3cOef2d2wBs7SsTxDtCUKXWz/T+kR3jGrbGytz3tzRs\n+383tB7kaF61pWxyYtE3ZnRtJWlXrqknORp4XLbO6+/eWWr6KzHSIXVs+gk4IURDsBq8up7bFf3t\nxBHCR+3WLEu4ZIhOLMYxs0jde1sH7FodCNVCsTorgkxNTI1nCs83d/d5Z1eRvH2kz4WqCdeepCbe\nEeHsSmpL7sUrKpLqzWOOJzPiJcvPVsjukLo1/Qg4qajLCT5VD80ZWiJzQuKI1oFpKEkj0p4pUAuY\nHFr93dHRFF9/FJMhhDYSeGjy+bW3tappNi+oTDGGpnblxONy3zGcMDubCE2tTVIewnxctcnr0+hU\nZIvI8yLyryLyloj8UET+wM6fF5Hvicg7djy3VI9PMS2D7Ar4oxDC6yKyDvyXiHwP+F3gX0II37It\nHt8E/vhhDYUQ8FVJXdfUPZWltZlhzuo14sQhuTkbBpjIubZwvZHnhaGzqk64/rKAaBP3nk016DJr\nXHLxONeUDOuxDot4+P1ZH5FAL/moefQfb2lJ83xyh/dv3mZmcZ7T6FRmhxC2gC37fywib6GF8F8D\nftFu+xvg3ziV2VCWgchFxCYpKltbUVDmDbOYIw1BULaK0rfx1qqyNd0sXQ12tO1Dk1G/T7QYs5M4\nYmOg4dzYPMm8tJ0HfmF7z63ORJywZiHZaqrFnW+++YGOr84ZTyZU9XJFOp9KQYrIi8BXgf8ErtiL\naF7I5U945hUReU1EXquXHNTnlZZWkCKyBvwD8IchhKOTS/ZhdHLnQb/fD8EHAp7S0NQs777Tpbie\npoxVwnCUN45OyXSqcE+DZcanpqV8gVhaahGGPVGlZMfInKg0jUmtjFjsWmKh3KoO2AJrV8IgS+g7\nHet0omXE80KTGz6Ai5a3MZZCtogkKKP/NoTwj3Z6W0Su2fVrwM7SvT6ldOprEYXwXwNvhRD+4sSl\n7wC/A3zLjv90WlvOCYOBw/nAyOLMsTkfzWaiQVpRDM1xMblZVSXjYytgR2PXzQ4vQo2YSRbCx7ET\n7vP9fV0xnZ+Q99Dm2ELwbWw6tuzDxb6jLNUJmlp9YbOjTJKIaMlqKFhOjPwC8NvAmyLyhp37E5TJ\nfy8ivwfcAH5j6V6fUlrGGvl3HrwzDOCXPlVnkePC5oDJcYm3hG9qDkwvUVn8xVHChg1rUipqShfh\nXLO7TJF9bMJ1VkcE7k9LBdrMTINo+z3PqzaN1ZiA0iaRA8HaHTSB8HDIeKaVUM3eyMa5SSQiTRzL\n6q9OPUjvA7NZSVEGJqboskQnN7J84MhNqW3n2MWhTnhn6njPInMeLWo8tj01ee7BEhELr8+3/zeB\n/eCb2m3wZcPsdmTtvWsWkt3sa8xmPt+mthK51HwDJ82LgKIsPhbL+SRaxUY6pI6TBzAvdCu0WEG6\nMyU1ttq663lFYWZaTxTt55OMPVOWh1Zg2RS3wwLR/iPW3qJ8GBbeZQgLj7MtorRt26OhMEg1QTCb\n3LF+poh5uc1W7na5uICr/LJlIytkd0ndlzKgdXiNwqq8DmHPygVmwVFZjHs21W0VcbLGyHZoNQni\nsSG8KENb8ruoA6TN5DTURPhEaBO+lgNmYE5U4o4Y31XHpT7xMQBp9IvpFZeYQo2cmohLljJ0zOyg\ndrGvSW3LnFgsokk5zcUxy9WeLXOdZFJV+FjPDSK1RuK+TrxM47bOOjelGfyC0W0dd1Pck0i7Na8v\nKjKKuXqE96ojsHRa3Cjd4NowsJhPENnvrBcRJGqDZKfRSox0SJ2nxUQiIle3UbyMRuGZ3VzmFE3A\n6kR5sFQqWvJKYyS1Kc9e1KdnVVK52exVTZu4XSQnmqVeUdlWvnGhbVVWVlw7T2T2tTcx5FnEUJpt\nhLWxzc9rfKjaPTqn0QrZHVLnCjICXOQIJv+aHG1h8YZZXrQJ1kY2qj/Y2GuKSgmK9Lqc0uyymJeL\nhEJdWd1HU/PXKDXxOENi3BSx+6YO0OFN/tcn9pE0wG2coWZDa1mX1GXV1iaeRitkd0idJ3wjXxGA\nvkXVcpODzuRi8BAiiz00342qCwZNaYFZGlPfpLkCmXknkcWWc+eorY0oacqCtb+imLUOjjfdUBky\nZ2XdroQmbuKDX7j8jTVi7rv4gK/8A74f9GDqltkhkPkC7yISp103YsR8M1wkYHawVZARqprUzlW2\nhGv7ikNd14TGFbSibXERiSnQxLb5BVls7cvsRTWKrdkT40JYVGY1kkHANTtWmxfgG3ESlraxYSVG\nOqVH/q7fI3UmsgscA3uddfrodJHlx/lCCOHSaTd1ymwAEXkthPCznXb6CPSjGOdKjHRIK2Z3SJ8F\ns1/9DPp8FHrs4+xcZj/NtBIjHVJnzH6Sv7X9kErdPxWR2yLyhv396pn66UKMPOnf2raKrmsnK3WB\nXwN+E5iEEP7scfTTFbLbb22HEAqg+db2E0EhhK0Qwuv2/xhoKnUfK3XF7Ad9a/uxT+Zx0H2VugDf\nEJEfiMi3z1rw3xWzl/rW9mdN91fqAn8JvAR8Ba1R//OztN8Vsz/1t7a7pgdV6oYQtkMIddCSp79C\nxeEjU1fMfqK/tf1JlbpNSbTRrwP/fZZ+OolnP8q3tjumT6rU/bqIfAUVedeB3z9LJysPskNaeZAd\n0orZHdKK2R3Sitkd0orZHdKK2R3Sitkd0orZHdL/A7CCRf8y18DYAAAAAElFTkSuQmCC\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x1cbdfcd4630>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAFsAAABZCAYAAABR/liSAAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAAEFpJREFUeJztnEuMHdlZx3/fqbp1H/1yt7vdbtszfsw4M2NnmIGQRCIo\nQkJIEZvAAkQWCCSksIkEEgsiViyzALZIg4jEAgkhgUQWkVCEYMEiMJMwk8x4mBl74rfbbrsf9/Z9\n1a06h8X3VXW7x49rt6mxxveTWtW36tQ5p776zv97npIQAhOqhtynPYFniSbMrpAmzK6QJsyukCbM\nrpAmzK6QJsyukPbFbBH5moh8ICLnReTbT2pSn1WSx3VqRCQCPgR+DbgKvAl8I4Rw7slN77NF8T7u\n/RJwPoTwMYCI/APwdeC+zHZOQhQ5BBA7J6L/CaH8LXvuC0AhFGX7spHg7VrurQ3gdl0H8NZ/CDvX\nypF2DbjntrvmsjNn7jo7GOWMMr932p+g/TD7KHBl1++rwJf3NhKRbwLfBHBOWDzQouagZk8cOUWy\nSJQZtdiRRHqtwLhBCGSZB6BRXIv0qriIfpYD0O6P9JyHVmzPbu36dr/PA/VYz+3MoZgsSDEfF8o5\niDVIrFlczMHe6o/Obz6YU8V9Y7W6N93rTX4Ck0IIbwBvACS1KER2W27XTRh3fmceEX248qFCKF+A\nuLsl2wdfMq1R08fpDjIGuZ4rGFSTCIAUz3CkjHfG9NjGCyHg8daxPaTbGWtUPp4em0mERNEeSb8/\n7YfZV4Hndv0+Blx/2E0uEpUIm7cPJnF2XZyUyzsuJCoSvNcWBVS4UDA9lNyIbXU0ao4s1/+HJtG1\nSJntnDCyF9G1FTGyPuuxQwq4shcYALGx6zafVk37imNH+rAH3v3sj9B2L70JnBaRkyKSAL8DfG8f\n/X3m6bElO4SQici3gH8FIuC7IYT3HnSPwI7kmPSGUq+YApNAVkiaHUMkeAqclLIvgEQcwXC23qoB\nkIkjLVZ8pOckzQDw3tNPFdvTLLurLxEpV5OhFkkkJK5Yadgcdo41caXSfhjtB0YIIXwf+P5++niW\naF/MflQKQO4F8KUFsGPKmYkWYJgVZppKnouiEuObsU55uq6q79CBaebnZwFoTB8EIGlNl1aOS+oA\nZEPtq9ftcm39JgBXbq8DsNXu6NhpWpqRUbmChGCDp6bFs1z/SQhEkTCurzJx1yukaiU7qOYPAZzh\ncVLgoEliIJR4m2cqXXVgrqkSemxhBoDnD63o78VFGjW1FoaGwfloQOipnVBIqtiKWJ6qc2xBjajn\njx4D4NLaFgBXrlyk393Qefjc5uPIC8uJu6V+kEGeZaX5+jCqHEYy75FdXl+BD+VERMqHqZvdvDRV\n55UjSwCcOXEUgFZNYSRKU7IthYEw6APquORmS+Y2jjPmRZGjkei9M41pAJ5bVhi6NPMyF27fAWD1\n5iW9v9enUKGF+RgZBqYBesMMPya3JzBSIVUq2btjFjsKUaUiM1GMnaNeVxk4NNMC4PNHF3n9xeMA\n1MwJyrvmIgdPZBDhZlVB4hoE8xhza+9GQ22eDpDRQNv1tI/GsA3A52YXmT+mK+dcU6X/o8s/I+t2\nbSyd68DgKvPqZI0byptIdoVUuWTXnJSusJ4zfC5d4ZjF6QYAZ4+opJ49dYLEqTSl2yplsXkY8dQC\n8azieWNRpTKeWUJqTe3fXPisvw1Af3ON/upFPXfnhrbvK+ZLb4PlpmJ7urAMwCjPuXJN8TsznWCW\nH94HYvfJKOX9qFJmK3liIlwZObs73rA0VefU4TkAXntZrYZWBGlfYaDWUqVWP7AAwOzxs9SXTgIQ\nTaml4uOIUTAzp4gmGpw0/Uvk7c8DMLxxEYD2hXf0vjtXiLMeAEcbOr9s+TA94+7NyxcAyEeZPUp4\nJGiYwEiFVL0HmauSjCliyjvwAXCg1eD4UZPUWKV4NNjCJQoL7oBCRfP4Ge106RgDu2ZCTJTnpcmH\n9Z8bTOUSEc0pPLVslcRTupLaH7xFflult+V1JS0nNZ47dBiArdubNp9VQOMs44PIRLIrpeqdmuDI\nswDmZNQbeyR7qsHstP4vmZlckZDPTAEwOqie46UNi2v87CIh1/a1wlmZarAwPw/A/LIqup7Fvzdu\nbzJs39Z25r4eNpNx+vmz9Lwp4nVVitN5n6NNlfwbS9qu11HHJ4ScUZ4zbhp3ItkVUrXWSFBzSZAy\nM1O41YlTKTtycJmaWSYhV1Orlkwjh9QyWW2pdL351pv6+9z/khi2101SD8xOcfKktl8y5+nCVcXZ\nj975H0ZbKpmtusa6Xz2pOuLLZ84yd+wlAO70tU002KaFrrDZeV1dtZa694PhJmkeymd5GFVv+lns\nwxV2snl/Uw1VcvNz80TemC2WQWzNkRw8AYDPjbGxwsTrp7/A6TOv6rm5xIbIy6DRjZ4mCrpX1KY+\n1axx9JVfBuBaV4NVH1/7EIAjC9O8fOI0AMncoo497NNEoWXWFHGSKLPTbOMR1OMERiqlaj1IB0ni\niERIDCqatvSnp3RJ1xqCBCtJiGx6U7OILd28Y+HUXKWylw5op2qmzXuVncXZKbylwy52CjjQ9ieO\nHePUa18CIF7X+9ptdWTWN7tkttKSuSMA+M1b1HONpTRsPkndlLUXosA9agruTRPJrpAqjo0IcaSY\nHcx9juxYMwkPsSAWrY+cmYCNJlmkeDwKGsfoDNX0u3z+A969rJjbqmv7sycOc/pziuNRrlLozD4L\nrRqp5iGoN+1YL+pHYkJsK2xaV9KonhAPdVXYbTQtIhgcpGlg3LhftQpSduoxiiRkEQotKpEQiEy/\nF3nKuJZApI/aSPTaykH16pZeCEzPqy3dGSr8XFz9GJHz2n5BszEuqF3vHBT2g4glFKxEKHYOX8RU\nDE6Cc4jFcRqmDht1bVOLY0bZiHvXK32SJjBSIVVu+jlx5OyUg0kpvroUPTnBKpDK8AbQMEh58eAh\nAFZ+6auA5htzp0v/iuUS//uHA2501DY+OKcQUFQ1RU5KszA3Cc/KfGNUpuTKeriws+qCVVJZcyT4\nien3tFLlHmTwARd2VY6a9AaryYt8wJt05UWcYtAlMfOOmimwRI9Jfaf6KW5aeixJiMz7lJ4qVGd9\nRUS4wmmysHSZPneCN7H1qSUKgi/r+XpmWnb7lprLc4If3/Z7qGSLyHMi8u8i8r6IvCcif2TnF0Tk\nByLykR3nxxrxGaZxJDsD/iSE8GMRmQF+JCI/AH4f+LcQwndsi8e3gT99UEca9fOID6SZvuehZT22\nOyZmIylrr/NMrQu6HXpdq+3oa3L2wqUPAFipxSwtnwKgt62przBsM2tOU6uhK6Aj2ldnvc3MHcXz\n7XU95gN1WtzBJnhtl1tshDBiaMqjbYGcjiWAQx5Usp9U3UgI4QZww/7viMj7aCH814FfsWZ/B/wH\nD2G2kpD7QGoaqD8qlqZ5hN2UxqzZ1+Yl0mmTtbVkrNbUQFTbmP/B++eYTd7W9rHmLueaOa+8cBaA\nYUvTZ1dv3gLgh+/9hLnLa9qvmaGziULG0vIJ/EBhp791zZ4/pWvFn5upvuje8KZd84+UXX8kzBaR\nE8DPA/8FLNuLIIRwQ0QO3eeeu3YePMs0NrNFZBr4J+CPQwjtcctk79p5kMQhjiOyXdH21BTSVk8V\n4K3NLeYO6HuTkXl9vQ5hXSXt8HHNpH/xzC8A8G48RWdVJW0u0TqTsy+9wLHjGjbdrqkz1LNqpvPn\npkjXVbKX6tr+5156HYD56TnSda3nL7LxqYeuV1dzbU3va29tF882tlTDmKafiNRQRv99COGf7fRN\nEVmx6yvArUcY95mkh0q2qAj/LfB+COGvdl36HvB7wHfs+C8PH07wXhBxpZORm2RvDlSyL926zZFD\nirNzdcVgn3ZJ11Sy6y01ek4ffQWAE1/5Kr1Msb2Ifyf1hCjRR1swh+SLZxTDXzt1iryveB/ZNo+G\nKeJ09TyDVU34kul8OuK43VXlvbGqRZfZwJRovrPFZBwaB0a+Avwu8FMRedvO/RnK5H8UkT8ALgO/\nNfaozyiNY438J/ePtPzqowwWQiAbjYhk11YJk7wCu1fb21w1t3vmuAabxA3xbY3y9S5qQY3LVbqa\nz79CPKMrIdQUg4PPCGbCFYGupu0Mm2oleFEM9lua+O1d16BV79qHhJFZHGZ+3shbvLeq7dbMoklt\ny0ieB3btxXooVRwbUW/L+1BaJsVm02DLsT0ccfGmKryVRc1qLzSm8EMN8OfGoM5QF9lou01yWO3s\n+qK+HF+rEyyWEqyYJMoVFny/S7qm/Q/XNIM+WLuq19IemSnSO14h7PzNlCuXNH85Mi82FNv2UKEZ\nF0gmsZEK6bH3rj8O1WpRWDwwDSGUMBIXexhNoTknzFgS4MXDKqmvHj/BSkvP+a55drktZRy+ruZd\nPHsAgKg5i7PMQPF8zmIdYbBNvt25+5zNoVdL2IgUin56U8X33Qvn2LqjqykbWbiv3PEGtUhY29wm\nLTZXPoAmkl0hVZsWC7oPMtgeLD2ph0ICgzh65h5/eFtNrUGe84VT6qQsT2tWJh6qY5H1t6Cj/+dt\ni3VwXbPLUGriIhHkXCjHLJK7PSsvvuWmOXdDpf7cBU21dTbWy6pVv+tDBMXkfQhjV0RVnF0XGokj\nuAgxLRPK/SjGbO/LLdYDs58/vnOb1K6ffV6Lb45M2Xa82WlkYIGhVANK4sFZrUdRUFmEZr2DLFZ7\nfDtSJl/pKZy8c/0i1yxuMujoi/ZZXjLX7bGpQ9DdB+PSBEYqpEoVZLMehxNH5kAcuYUrvW0wLXYS\nOEdZLeWsTiP3oUwkFDu1ZhqqDJ8/tMJzZiIemFFJbSDEQaW8Z5tOhwZN/V6H61u6Ei5tWL3ImtrP\nm5vrZOndKbkiRadzs89u2O+AfvTgzuY2oyybKMiniSpP+ArqBZRftrHXXcTP4iShZuXDOfaNkDSj\nN1DJHpn5dStXqby6epO5Ka0NObyg0n786BKHjmrR/FpP77tujtLW2vVy+3QRacxLjzDH78Xg3V/2\nKUBAwu7Ld/1+EE0ku0KquEhHiGox3glxIdllWUCxZzkvy4hHVvM3GmWMbJe+Ly5a86H3bLQVn6dj\nxeLayRWWT2o1an9DLY2OVbHeWt/Aj9TKiYquCvNTBNxe827nVzF22HU1hCeYFnvS5BFGvnQAyz01\nljIkkkBmmzpTs29Hwx3zq1CQRXwiz3e299WsxvvATItDK1ryu1lXxtZqFq7NPZmFVgvI2Nl+Izj2\nxGx2XS+YnpexkcD4kZEJjFRKlZp+IrIGdIHblQ36+LTI+PM8HkJYelijSpkNICJvhRB+sdJBH4P+\nP+Y5gZEKacLsCunTYPYbn8KYj0NPfJ6VY/azTBMYqZAqY/bT/K3tB1Tq/rmIXBORt+3v1/c1ThUw\n8rR/a9squlZ2V+oCvwH8NrAdQviLJzFOVZJdfms7hJACxbe2nwoKIdwIIfzY/u8ARaXuE6WqmH2v\nb20/8Yd5ErSnUhfgWyLyExH57n4L/qti9ljf2v60aW+lLvDXwAvA62iN+l/up/+qmP1Y39quku5V\nqRtCuBlCyIPukP0bFA4fm6pi9lP9re37VeoWJdFGvwm8u59xKolnP863tium+1XqfkNEXkch7yLw\nh/sZZOJBVkgTD7JCmjC7Qpowu0KaMLtCmjC7Qpowu0KaMLtCmjC7Qvo/D5Kl/H5voyYAAAAASUVO\nRK5CYII=\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x1cbe38de6a0>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAFsAAABZCAYAAABR/liSAAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAAEHFJREFUeJztnEuMJddZx3/fqcd9dPft9/SMZ2xDHEOQFYgRwkiwsIR4\niE2CBIgsEEhIZhMJJBZErFhmAWyRjIiEEBJCCoJAgiAgsmAT2UQRdjyyx/bEnkd7Hj39vq+qOofF\n9526Pc++nh7Klud+0kzdrjp1zqmv/ud7n5IQAjNqhtxHPYHHiWbMbpBmzG6QZsxukGbMbpBmzG6Q\nZsxukE7EbBH5ZRF5U0TeFpEvP6pJfVJJHtapEZEEeAv4BeAy8ArwxRDCG49uep8sSk9w708Db4cQ\n3gUQkb8DPg/cl9mtVh46nQ5OpD4X33V9RiZ/xGuBgNSLcHLvnSTWr9g98e7b20z6uBfM7u5d4k33\naBWAwOHBIcPh8P4TMzoJs88Cl478fRl44c5GIvIS8BJAp9PmxRd/jswliD2p9z62A8AlrhZupV2r\nvEdcrtcljz1PxogPkyTaxjlCGGv/dhTr0yUJOGfX4luNL8mT2MQE7SuQEpz1m6Q213h/Cb7iX//l\nGw9g04ROwux7vcm7wBJCeBl4GWB5ZSVIa47ghSTCNjGGWvtSBFf3oj+c+JohIZR3jCSTh7eTZRkg\naL9BEmtmDC0DoH04p+eyTNuMhgWFjysozquy1pM+JmvMIxLwlb8HK+6mkzD7MvDkkb/PAVcfdINL\nUjqLG0jhyQy1pS/0mOgjuDzBjQ2NlTKvKkFEX0ci9mBB//a+ql97lunjpGmCL/V6YeNgqM+yFGeM\n9KWOE+zFtLpzJEnHrunYQx/wqfVrL6UGSlVS+RJnyD+OTmKNvAI8KyI/LCI58JvA10/Q3yeeHhrZ\nIYRSRL4E/BuQAF8NIXz/Qfckac7q6hOM9ofkhqb+8BCAvKXoWFyexw/6AJRDbbO7O2RjY1H7cIrG\nYnRg86hotfUxWi2V574qKUYjG1TxlOQtQOVtVWgfValtEmuTpUvs7Oi5Vj4HwPb+Ie35eZtjZvMa\n6N+pY2t7q9Y3x9FJxAghhG8C3zxJH48TnYjZH5YkBFxZ0U5zxCu68KasSkVx5j2SKYL6I7MofDXp\nw2QvJid9VVJWej01+eyrirIsjnZPZoJdXEJZ6MnSEB6RjYypTIdUPqK/oBor2n1UmqZTSi8UoxHB\nT+erzNz1BqlRZPuqZLB/nW6nh/dDABJnstXQMTwQssxkr1fZ2GqX7B/cAiDPM7umaB6PCvyhojFL\nR3ZMKG2ljA2VLlE0Z1m7nk9VRYtI55KNPEuLqhsGh/s6dga+MB0SzBoxk7EcF8x18tqEPI4aZXaW\nJWysLyGS1k7DCqq4ajtYMuKC6/XUDBPnQWyqQY/RXCOURKO79jKdO+L1+duuiSSTS6IvwNsxyYUn\nN9YA2N1SBTwaBqoQTTsb54jXGyTQaremev6ZGGmQGkX23NwcL7zwMwgOb5rLR0VpaEtcDjUKDb0S\nKCKQvXmSUWn6Aokot05KhLGdctaXk+iNauQEoIqOkQF3fmmR08sqRqqBip/+fp/hOCrNGGOw0URA\nHJ12Z6rnnyG7QWrW9BNH1mrhK8Bc8bzdBaA7r05EnnXqa6FQdB0M+xSGtBADV9Zn6oQ0ylBTioeH\nh/i+tm/PLQEwv6D9SwqFIboIirWx3b+3O2R4YMrWBqj8mMpMxbiAXJhER6qggbJpqFFml1XFrd1d\nxFMvfW/aaneoD7TQq1i0GMf+1gcA7Az2GVYWcYtTrpQpSdXHDVWZDW7tArC3tcvwUC2ZsYmdzoJ6\ngQurS3TM4ki6Pe2zq9eq1HH1xnXt34JbSZKSxN/2HIkJhBA8PoSpmT0TIw1So8gOIVAWhYoCExXj\nUpE33tMYya2b15lLTVQUis6lxS6JIbm/qzZvf28bgMPtS+xtvg/AzgdbAJSDEj/S9lFRhlRx2V1c\nYGF1HYDeKQ1arj79DAAr5zZo9RTlLlPxVvmEJFXbvjanK12Fgmc4HJC46TA7Q3aD1Ciy0zRheXkJ\nCb5WNpXJ1HEdrxiRWLi+NadK7VQvZ6evqB3cUjk+2LwMwNbld7l1RZFdHKgnKJXgqhiv0P69mX6H\nu7cottQbHd7c0ePeHgBJeI6zTz0NQLu7YJNugyFbJCpuNVdHwz5hVCAPSNUdpRmyG6SGkZ2yvrZa\nOxgwSU0hih5CTmpeRktUZpe3LrGzqzJ6eO0iALvv2XHzGuWutsusWxcCiaXRYqos2gvleEyo1Grp\nm2k5HCqyq6piLlEL5dQ5ldntpS4ut3ykzTumzsZFxfWbO5RlnTh78PNP1eoRkQhkbUeaTJicpha4\nb6nI6OSrzIsGi9yeioz33tvn4KrmlrcvvQvAztUrAIz3RrjKTDFjbCAQJOYsw21HB4QYfh2Y6LIM\n6I2LF7nY1tiIN1u8V6ySmdI0XU7fbP6t7QNef+cSAwsFH0czMdIgNYrsohyyee0tWllGZohOLIna\n6uiyXVo8ZL6jymlnU0tQBlvvsX3lPQB2N9XpqMxDTPwEtRKRLROxEY/hSDGKi3UjMbwyVKS71gHX\n39fMXhFUIS/urSHzKlqGqKgzYHNrt+KdK7cYjSfJjQfRDNkNUqPI3tne4p//8W8MiSZDM33faUtj\nwuc2zvCTz3wagBsXVD5vnn+LDy6qeTccKAoLr1P34pHa24jKMNRhgHBHMjZAHeuObSpTpsXBNq6r\n8+nvqjzfL64wzHXVDVG9Mih0rv1xl8q3J6vmGGrWg/QwOAha0WW5RCmt2qjSB7h6LTDYUuV3uGl2\n8AcB8bqUS9EMist06WZpqO3cmOX2TuocpZh35+qqpqQeO7EYTJLGSqpAkWofSWW1KyHFhajMdY5Z\nUOaPDoS9w9Ek9HoMzcRIg9Qosnu9ZX7xl34Nl0ht8tVFeGbuDQ8Ttq+q3Xtu6TkALpSvcfZZDdAv\nWJy+k+vU8yyps+MulqE5qcvOnCF7UgeYHEH7HaVm1YgPtq8BcGNHj6MwxBd673hg7QZWnTXOyEOG\nhJkH+bGjRpHtkpTO/BIO4a6EtHmNkgrenIiqrxG++fV1WmuqnOZXFdrtjlW1Jm5S9xG7ChDkdrTL\nEdOvplqvKlLL4R5pqrqh09H5pOMR+UAb9rq6+vYP9Vo5OORQuPtZ7vf8xzUQkSdF5L9E5LyIfF9E\nft/Or4jIt0Tkgh2Xpxvy8aVpkF0CfxhC+K6ILAD/IyLfAn4H+M8Qwldsi8eXgT96UEfeB8ajCrkX\nuGLpUgXtzGLXpWZgsjAiDVYvMlK5WVQaDwn4umK1sph3WVaUFvWLSZRYI1KVJb6MaS5/231FsUvI\n9feuBhBZWDxNu6upteiADawWJc9SEjedJQJTMDuEsAls2u99ETmPFsJ/HnjRmv018G2OYTYAVaDy\nk/LquLxjXCMJJVlQ8eHGavqxf4P9vsZJdsf6AsTiG8F7fBFLzZSJVVVRxHJjO5aR2VVJqKq6HUBp\nL7piSJiz+cxpgqH1qTVaXTX5QjRX29o+7aRwODr2kSN9KAUpIj8EPA98B9iwFxFfyKn73POSiLwq\nIq/uW9z4caWpFaSIzANfA/4ghLA3bZns0Z0HP/qZz4Qz585RjCfFkBFdRaHr1pV9uuZsVFuK2BYH\n3PyBRv32blpsxBK6Uvpa6Ukd4ePIjhpzdI7sZrjd34TKTvgkUC4oild7mkTI0haSxZJkFWU9ixLu\n7I/I9ka19XocTdVMtCbsa8DfhhD+wU5fE5Ezdv0McH26IR9fOhbZohD+K+B8COHPj1z6OvDbwFfs\n+E/H9dXudvn0889TjQq8VRmVVrQ+7quIkXKPTlDUbnUUC7mM8Ac3AfAHavINLPRW+RLvb0evD0f3\nisWikrhJ6e59ZJVBMyQtFk8poufXzgLQ6S3T7qjJl1h+I7Gyit5Ci4XukGRKZE8jRn4W+C3gNRH5\nnp37Y5TJfy8ivwu8D/z6dEM+vjSNNfLf3H/z4c9/mMEOh0NeOX+eXqvDek+dh40lLZjpnV7RCUmB\neLVGzm2ozn3+uWd5bVXbfec/vg3AJdtqMSgKCj+J9oFlau4ITtUZm6MxOjPbokzuLq2QL6gV0l7S\nY97rkeW6mlIrk0othbe4GOjtHNQlxMdRox7keDjk8vk3yF3K+5axbtlOrNyW4tJ8xvqaepAHFp84\n28u5OlIxUy5aeW5Pj+NRQRWZHE1AJsytpYjNwYtQxJSCDZotqXeaLK+yfOZTOo/103qt1cLZHGtN\naNsJF5cXON3v11v7jqNZbKRBajbh6z3pYIR3BUNRBVfUETir6+h7buxqSiq3hIKXDp0nfwKAJy0q\n0G5vAHDlrQtsXVWHxw+symo8xoXbE2OxGN6LI2lpPDpfVM+wtabiaunJZ1g5ewaApG07FFxCsHtj\nTV+wWEqrnfPUuQ3ybDo2zpDdIDVcyiC0spyyLCmsXi6mreImsCQVEkv+zi0/BUC7s87qGavdOK11\neYNzmjq78tTTXHjjdQC2NhXh+1vb9PdsdXRVuR0WFg6YW6SzrKuivaSIjjV/y6dPk1hpcawNDJLU\nJmIMf8coo+DIkvxIXPzB1CyzEZwIzrl6S7KPpcNmK5c+ZeytkLGjFsvyxgYrxrT8lIqRcFqthZXT\n6/TOqk186V3NwG+9f4nNd97UdnN6X2Ibl/KldTpmabQX1AJa6Okx77QpojfpojUz8UxdLQhC/f8k\nm3o8zcRIg9QosiMFcVTxYwn2vhNLyLbSLt2Worc3p/Uji3MtOm1TcGM9DsyYG7e6dE+rGFgJmlhw\n2RI4Va7Xbdt1t6fKsL28TrunNnu7q+IqTeMOtFDvJIsVW4kIqcQteabM7Tl88ExXBs9t982oAWoW\n2aKpscoJ2N7BtjkEK+alrS2usH76CQCWVlRmz7shwepFbmzeAODKdXV4dvZ2GI80YhjrG/38It0n\nNMYxsEoqbON/3uriWrYCLGlc1wgGSOvksSHbJaQuve1c9Jec95SBqT8UMEN2g9QoshOX0ptfIXEZ\n80+oRbBo1sKGleVu9BbodNQaGQ+0WGc42OXymxrBffeKOkPb9vGV0hWIxZcTk+N5O2Hc1n6HFqpL\nM3OQshxvMtiHuEnJvpAjrk7euvqrOcF2ER+Jicev+hCY0urTOUzf9OTUaXf47I99lu7iGt1li1fa\n/vTxgabADnavcfmCLv1LF18BYH90hW/8+9sAJO0fB+DM0z8CwNqpOebmYmbe6juKAmLwyERGHo9Z\nfkTRWU2JizUo6REzL3qL/shXIewFuCOiRtzd3+u6D83ESIP00N/1e6jBRG4Ah8DNxgZ9eFpj+nk+\nHUJYP65Ro8wGEJFXQwg/1eigD0H/H/OciZEGacbsBumjYPbLH8GYD0OPfJ6Ny+zHmWZipEFqjNkf\n529tP6BS909E5IqIfM/+/cqJxmlCjHzcv7VtFV1njlbqAl8AfgM4CCH86aMYpylk19/aDvqt5fit\n7Y8FhRA2Qwjftd/7QKzUfaTUFLPv9a3tR/4wj4LuqNQF+JKI/K+IfPWkBf9NMXuqb21/1HRnpS7w\nF8AzwOfQGvU/O0n/TTH7Q39ru2m6V6VuCOFaCKEK+sXGv0TF4UNTU8z+WH9r+36VurEk2uhXgddP\nMk4j8eyH+dZ2w3S/St0visjnUJH3A+D3TjLIzINskGYeZIM0Y3aDNGN2gzRjdoM0Y3aDNGN2gzRj\ndoM0Y3aD9H9wL53cy8Q/lgAAAABJRU5ErkJggg==\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x1cbe38f5438>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAFsAAABZCAYAAABR/liSAAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAADDJJREFUeJztnE2ILUcVx3+nqu+dmTcvBoMfBA0qkoWuIogKbtwI4ia6\nUMxCXAhxYUDBheLKpQt1K0QMuBBEUDCLgEjQrURDUGNQg4hGH1FByUve3Hu7u46LOlVdfT/e3Dcz\n1hve6/9wp7qrq7qqT586deqcUy2qyoQ6cLe7A3cTJmJXxETsipiIXRETsStiInZFTMSuiHMRW0Q+\nIiJ/EJEXReQrF9WpOxVy1kWNiHjgj8CHgZeAZ4BHVPX3F9e9OwvNOeq+D3hRVf8MICI/AB4GdhJb\nnFPnPDLOtfRmL12LclZLUiob1xRITKTBUg25tdTStpbTfW+FB1UDqiqnlTsPsd8C/K04fwl4/3oh\nEXkUeDQeO67ecx8i4CRJsNhHJVjHtXjSlAaSxHP2SAc+HjTzOep8LKVDrWUXT1Yny3itPbHWdAux\nB8qKUTuPeAVdey0jqoqwWNxYf+ytOA+xt73JDX5Q1ceBxwGaZqaJc0J+mEjkYfbQTHjRkgiJQ+N5\nHyQdoL3dIr0JcTsHyoiLcyo5Q4vcocbazQr2vxUxfB5ivwQ8UJy/FfjHqbXWuFYy9Ydc2fIe8yNZ\n/ZDOg6JG7cTZ4hxofHsqfpSKdplWm+JHGXjAXi4h9zG9zCQx9KaibxPn0UaeAR4UkXeIyBz4FPDk\nOe53x+PMnK2qnYg8BvwU8MATqvr8KbWy2Bh4avy+VaNczeVT6bXhmk5D0Fw+SaSgipqYcTKLd2hs\nTugCeVxkSbF7knbOFX2NR4MUka11duE8YgRVfQp46jz3uJtwLmLfKlSh7zuADW6h4JZBTTO57oTE\njcpY8/AacD7mORslIs0wJqRPB7G+b9DQpx6tpQPEJS4eJkGbo3HO2vGeEMJG3V2YlusVUZWzwWSy\nlPO4jpJ4OFbzJOigtVgqzYGdN4jp2X3SIPpi3Bg7+dk8pu4IsZGTNI52FXXxvj/JeVnr0c3FT+Z0\nUZx3Q99OQWUxovShRzQUxLPFShqaAn5tYSEi+OYoHvs44XUhlm+7wDKJhUE/3BAMSU9vnDBv4mMf\nHsQXcHBwCMDJ8oDV8jUA+nY56kPsauxXVjEJWXTtg0mMVERVzo7LdACXFwiJo52JAtVBlROb+GgO\n6TVyYdfGa32fVkHb1oRlzniUtAG6rgVg2a4AODqIo+X48CreuP7GjesAhNUJG1KisJ8EAvuqfxNn\nV0T1CdI5B6qZs4cFQjJEgc+qVeTmtp/R9rYkH2tyjO145IvZ6lfI/VQ+le5scNxYtFb2VeaHV2I7\nV14HwCL0hG45qjnMN/nfXqgsRhwHszmrPhCMahKSLm26tfPgo6bRhkTsgJo+K7I2GIvFpaxpMVC+\nBreRkw57I9hi2QHRgndsxA5HyuLGf6xgt/Y87K2JlD2YUAFVOds5z+HRvWi3ol1EFSv0cQiLDenG\nN3S2SmxtEgxBmXmbSLNoMbESuoKjt0yQSUwVtuhBbx7zWq+BxSred95E+/fV42PELIjd8r9WMXK4\nM87el7snzq6IuhOkCG4+x4eWLq0ESSpgKtLQmcUumDxvRLhyeGQ9jmoaXeTA1WKxIUu32jpye4ON\nYx3K4JS4sYxq4b0Hc46P4mi63hu5+jRK6tmzJ9wi6i7XQ89i8Qqh60lWYufHi5oWz7pRLjJlzPTm\ncTmaz6yesFwsYvG2tXqlDB17cCUK2jJri3oYzQAA7ckSOWrKjhRL+E27zs1Ql9gofd9Hb3TONZEh\nyXTqNjzbvQYWy0jQA7uY7FCHc4+4KGIWJ0aMtsuUTPdK7snGu+wgTkaO0BViKE+o8WDZdjRzE0Gu\nsWsL0s23eCh3YhIjFVF3glQIIbqvBu96TJJY6YOyztpBhVWXTJ5xNXdo12bzA45mjd0jrv6WbkVn\nVjv6sUwS0WztMy2PZRoFfb8hGbqgSJcmxHH4BWbn2RcTZ1dEfdsI0Ck5/GAwcZgc3RrZMUREmcbH\nwlQzDYG5qYUHTZo0D1gYG3VL4/BkHlClsYku2CTbG/d3odsQwEElO5J9CmVIeqoGhP0XNZVtI4Jz\nHhcoLEljzUC0fN40fKUgeyFugFXbg01Yc5Mt86YBExVGarqVvRzphyAgN9ZCoklrHC9VRmgls4wY\nsbUPoP2G2NuFSYxURH23WN8RQp99fYlb3MhsaYcF94fC7xfvFa90QdFVVN2CRg4/PJgxTz7Hw6gj\nLswREdpVVsNztNpILR+760pjSh59Sd92Ep9jT8PfxNkVUZ+zu5W52AcrnF20g80JJ3rkd7NPn2Lv\nEoeHwFFa/MwjhyfXV2g8jbFYn11yiYs9kuS5NedlWHGGEO+fbeukle8FWf1E5AER+bmIvCAiz4vI\nFyz/PhH5mYj8ydLX79XiXYx9xEgHfElV3wV8APi8iLwb+ArwtKo+CDxt56dAzUNjKlMWiCniKRiT\n7F4EJ/vxyI5stwgIAaHrlZNly8mypV2taFcrGlEaUeZzj2ua+HMuxvKle4mQGDn3zAlO4k/o7Rf/\n5rM5V64cDyPjFJwqRlT1GnDNjq+LyAvEQPiHgQ9Zse8BvwC+fPO7xUfQLYEvyVzpnCM5zktDVIrZ\nSDXLM/EphDfFnjhS+HZnE7E3Pbvxkssl/VlyzIogYewbdc5lsdF3UX10Q8AyIazYxRjruCWZLSJv\nB94D/BJ4s70IVPWaiLxpR51i58H+/ro7EXsTW0SuAj8Cvqiqr+xLuHLngfdeVWMoWXZT5b0v0Tzq\n3Yxgatd2VxajI3HCfBbVutk8qnnON7lG8uKn1Z8UIspbO3mUjNRO8v2TczrYkFPz4fXLFpHV3sGV\newkbEZkRCf19Vf2xZb8sIvfb9fuBf+7V4l2MUzlbIgt/F3hBVb9VXHoS+AzwdUt/sk+DqhqD1Ycc\nAJJlpPEdwZy6pbdLdizvgyp9Gzlr7iMHOvGoqZYhudiyKytkx3BSGfsuOR2G6KbGN7m/bWvOiRxO\nMbjFVGTvnWX7iJEPAp8Gfisiz1neV4lE/qGIfBb4K/CJ/Zq8e3HmTadngfdejw6PR7saU+tJns2a\nBm2iXbpTs8qFMJii1lxZMFiuvGklTmTQF2StvA5O5pCLDGHC3tx0syaOta5b0OVtfYmzB+EuwKuv\nXafvu1MnseomVrFosSK615IUMNnhfZQfPgVbMpg5tyHXTXtqStudbE6tu+p7JzRG7KBRtPTdIhN5\neL/JTgN7G0aYbCNVcRt2HtgugsTRG1a8gLYx3s7bDq/GX6HNE+L6brOb6+864sLtZZMK2DQONY5e\nrWzXbuFQWK+qmkbFZM++dKjP2TDsW2HwvJQIOdA9TkyOwNxH11cwOd7lMqWjJO0oY3Czre3GVdVs\nx06B700aXWFBuzpJnYipbM4v2WQg+d/pD85t8K6PJsecWZypZi0hhZ/51QJTe/HJz2iECnhCn0yg\nA2Gzq2swcuSkcWkDUxQZne1ACN2y2LYXIVvORuJEJzFyKVFdjEBy6qZZJ+fm/1ocQ4xjDLaKc7YL\nIHG49wfDaq9JNhWX2c/lHQ1pRdnlPTXBrHjJ5ebQYSLd4tkfxMlgs3G3YFybOLsi6rrFBFRkzfW/\nzhmyuTurWHKmmm0Komy7wkKXAuYb8GkjqnF23pPTFzErMkpVNnuzbQLXHcenYeLsiqgbpGM/HMWW\njLXltAwfWJFi9t/4wk2uNpQnWeX8UDokZ21pU8lr+fGCKhpO1vvjtnwtZ91muR/q20aIIV3rz6RF\niWG73kCMnRaOcruzpQ7JIiUk8ZEnylC+p9Fd47mO2hGKrzKkvEKyTGLkkqKqiVVE/gW8Bvy7WqNn\nxxvYv59vU9U3nlaoKrEBRORXqvreqo2eAf+Pfk5ipCImYlfE7SD247ehzbPgwvtZXWbfzZjESEVU\nI/Zl/tb2TSJ1vyYifxeR5+z30XO1U0OMXPZvbVtE1/2q+qyI3AP8GvgY8EngVVX9xkW0U4uz87e2\nVXUFpG9tXwqo6jVVfdaOrwMpUvdCUYvY2761feEPcxFYi9QFeExEfiMiT5w34L8Wsbe5My6dGrQe\nqQt8G3gn8BAxRv2b57l/LWKf7VvbFbEtUldVX1bVXuPXwr5DFIdnRi1iX+pvbe+K1E0h0YaPA787\nTztV7Nln+9Z2VeyK1H1ERB4iiry/AJ87TyPTCrIiphVkRUzEroiJ2BUxEbsiJmJXxETsipiIXRET\nsSvif5XzlOboO8I8AAAAAElFTkSuQmCC\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x1cbe397fe48>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAFsAAABZCAYAAABR/liSAAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAAELlJREFUeJztnEuMJedVx3+nXvfefk4/ZnreDzu2E0VINqAEYVBQECFC\nQoEFiCwQSCCziQQSCyxWLLMAtiAjIrFAQpFAIhKRICIgwSIhg2USD+PH2GN73jPdPd1937eqvsPi\nnLrTtsfuO9NDzchzj9Sq2/X6vjr1//7n8Z2vRFWZSj0SPewOPE4yVXaNMlV2jTJVdo0yVXaNMlV2\njTJVdo2yL2WLyJdF5HURuSAiLz6oTn1SRe43qBGRGHgD+AXgMvAD4Kuq+r8PrnufLEn2ce3ngAuq\n+jaAiPwd8BXgI5U9M7eoB1YO2z8ffMfy4fOrXQpoGQAY9ju+rwAgazaJ44af6QNVw7iBorDzRvnI\nDwUI5a7zdnVFQKpW5S4duqso/V6X0XCw5wX7UfYx4NKu/y8Dn//gSSLyAvACwOLyGr/74l8iqohW\nXbU+qnc1jgRC8GtNeYVC3ukD8NaP/gOAIDcBOP6pz7Cw9Cm7VkzpoRgSiiEAG+vrAFy9dgWAQa+N\nDu2FSWn3LNVeiMQxEiX+O/H+xPaCgFCxgHdeIiFo4Hvf/adJ9LUvZd/tTX6Ik1T1JeAlgKMnn1EN\nAZGYKI78+Psv1RD4ILOpCrji7yDOTooiiHxfRYkRSuLKWpxZBKC/YMje1hTNZgHIkty2qd86SugP\nBgAMRnYskmj8VGW1xZRPpAgKEt9FFR+W/Sj7MnBi1//Hgat7XSSAaqAMlXJtSMeuTAXUlVchSasL\n2f3DzjfQ6fuPiJD6UJlvGdr7czMADAbdOwjF2o4yu1eazrK1Y8reaRv6y3xIc6YJQHPWXtL2zrad\n02mzuLxC6XS0l+zHG/kB8JSInBGRDPgN4Fv7uN8nXu4b2apaiMjXgH8GYuAbqnpur+uECqmGhigq\nq/vZcYmRyFG+CzAVVUhFGT6mQwhoqDg08nMiIqmGuvfXn7SMdYywLDH+mJ9tet9mKcotADqObNUB\npRraW7N2fpF3AWikUAwHTOrR7YdGUNVvA9/ezz0eJ9mXsu9ZxOybqo4taRgDsNqjYx6vYKkKUnkA\nlSGtPAgdgZhXkRdu3Podgp+Xpo5a5+V4JqMc5N62NZ6PrL1mIx67fvnIXUVGZA27NhJrM/K24yhC\ntEAmRPY0XK9R6kU27suGsHuH/6gc73DH6R6jXca8OPaJ3ZNIJWdlwe6xtbMDwMbgKpplACzNHgNg\nttECIGwro6jy3+26ZmRcXAYd24TgoysPOdHI+luSe68c2ZKQShiPur2kdmWXqqiWiA+qaGwM/QVo\nGA+3wi2kkFIG72pk7lciSwAsNNc4deQpAM6cMjdvq9MmuJ+dtRYA6A39pq3T3NrZBGBn6wYAw769\npFbcRMYv3xRa0kdTayv3Pkhi7ZSjEVHRv8OFe8iURmqUWpGtuFHSgEQVVVQunQcp6Pi3UOUuEkY+\nlJN4GYCZWdsuH3+OPDNkd/uGuO1hoO82ttyp6Mm22ewax5YN5odG1wHoXX7bztnpkDilzBgLMdPK\n6Lqb2TGPjzSd9VtGJFpOnEeZIrtGqZezVSHo+5AQ1CAobhQVGYfr4wBchTQ2xJ08Zkmn1soKADvN\nk7zzrqH+5jXj3l5PyKtEBubCJYmd02olHFqz0P3IwVMAHDpl/29depcjBy0UT4vjADRXhettw2Qr\nszYbDetXrAWiBdnZ7030+LUbSPMqYrSiiJD7gcqnju+kPn0bRyWtJRu6B06cASBPjUbe3gy8e9No\nYafrhqpMSN1zmJvxCDU25d/ayukNPNvnWdEza6bEpSMJqVPYgTn362cLVl1NkW8rj0XUaDHNmhM9\n+5RGapTakY2aLztODVdMEe5k7qooUZxiGmlCa9ncr9vxPAC9bTu2GifMHbU06hsd27ex0WfO/eSn\nT9mIiBbMz37trYK8bfe/dvOWHYvN3Tt+eIb544cASJqG/kF/k0YwN7CiPDznjcQEFaJoshTrFNk1\nSq3IFiCSgFIQHMmxBxGVu6c6zguOt7MzB0jmjwJw7qpl5eK+Gb5f/PRBlo+a8VywyRteezOwODA0\nPn3a7nHglPFqksJrZ80Iht5tAK6vm2HN5po8ddBUkmAjobyRkZQ2/IZFFcWaPYijkoCMR+JeMkV2\njVIzZysiSggF1cySVnN+1Vyk7sK183nSWmR93XBx66rlmU8cNC5ePJxx2GiWz6d2zqlskWHP0L5q\njgbHjPKRQ4Gu56PLgSE6XjGktq9d53ZhjT6x9iQA/c0ODmxGQ+PxrS0bQjJq0yQi5IOJnv4hRJA+\nnKIqN1Ilfip3b9d0mB/TOGNj0x4o7xgdXNjqAfAv2uaXv2AG8pmDRkkLwyG3PQRcPmxRZdG2PnQv\nF3x22fad/Mxztu+QtffN757l/DWjmKM/ba5llo1oj9xAOo20N68BsPHOD5ktS0a9zkTPP6WRGqXm\nCNJcPImE2GfXy/FEgUdlsYz9wYpGVKHIDallaVm8PNjB8+/1mPu+wfbAz5hbeOJog/ymGdCLl2xE\n3CoMzd25lNUnDbWbud3jv35o9LBTPMliaiNss2+8MzMf6HQM7Uver9UlizgvXh+SlQVpNM36PXJS\nr+snYDQc8AIn8tynmqKqNEHHqI9934W3LrO5ddSPG0Jzh/12EfM/b1h+esUnFr70hWWOH7aR8F7X\nUPnqurl5gzDLs4t2j0Uvcxje9OmxNCFPfCLCp8oOrCyQe8EPt6zQZ6FjefAnmilSQhZNlvWr10Cq\nkpcFjTQiy+yhEu9npXSRO6nVnhukhSNHuTGaA6Dse/FMNfVeRPQxA3n2ohvRaJsv/ewBAH78hB3b\n7HpupD3gx07ZvmVzpTn7pteNNFMkMyq63TdqOp20KEtrs1+YIXzilL3426++SVYO318G8DEypZEa\n5SEgOycUI8au6bi0606Ro3iuYeA+uMaBgc9sF54lrAotJQgDzKe+OrRhUl64zmpiDXzxeSvk/OLT\nNjIuXk1ZSc0gzmQG7XnP8OVFQc+pK10yB12TIcHnKrcHRi1tMfczF8juoQh4iuwapf7Z9VASUYw5\nt9u1KC6UhpqAUrpbJ02LEtco6TSsq53IUNkrvEYwyggY8opgRlFnDnN+243aOcvsPf8TBwH4qaei\ncQXtlp+SJl6QKULkEWS+Y+3oSoS4mkpNvY/utmqwyY671ph+WPZEtoicEJF/E5HzInJORH7f9y+L\nyHdE5E3fLk3U4mMskyC7AP5QVV8WkXngv0XkO8BvA/+qql/3JR4vAn/0cTcKoWTQbxOG24i7U/nI\nEbSrBlrFEDTrXkBy6wrLaoHEZe9xN/cMXNBx3caSBxsrJxvEyxbUdGbNgxi0zT1caM2hczYC2j5J\nlDjkIgnMeVBzcMZd0dFtcDtRjYiiqKqyrC5x0rL5PZWtqteAa/67LSLnsUL4rwA/56f9DfDv7KFs\nDSXDfhvKHpGnKctgyi6q/ENQqgHX8xdy5cpFdiJTZFmaoYskG59fJfXz0oxiI4bPnjEj9sxho5hD\nThXSSMal3v4uGbqxTmNhZc5UcmTRXlZ/+zJ4YWXiOZs496m2kRW5TWoj78lAishp4Dng+8Cav4jq\nhRz6iGteEJGzInJ20O/eS3OfOJnYQIrIHPD3wB+o6o5MWCuxe+XB6tpxzYcjQhiSeKFjNfmqeVXo\n4TPwQFft5QyjS6TLFmw0GmsA9EvLbxQqBDeoPUfo5vWc7ddtVGx3HE9zXlPSimg4FK9a8o6en5Mk\nGQstry/xAGarfQsJduPYCzc3L1nNfzkcMNA7Jct7yUTIFpEUU/Tfquo/+O4bInLEjx8Bbk7U4mMs\neyJbDMJ/DZxX1T/fdehbwG8BX/ftP+51L1UoRyUaaQXe8TqVfGicrUVB8NB9UBipdkfnWJANAA4e\neR6AVmau3Ho7op9Xpb+Gnes3lFfalu/euGaP2DKqp8hLWs73/b6d3+3a9nCjyWLTR1Xfpt/yvEsk\nxt8tX3vTuWm4ijTQaM2Pg7C9ZBIaeR74TeBHIvKK7/tjTMnfFJHfAd4Dfm2iFh9jmcQb+U/uvjIM\n4OfvpTENJcPeNiHq04gsVO73DIFF3zi2GJUUvmYxz21f1LuN5ua6LWbG1YfWVgEoo1WKtnkeZeGB\nz0C56Fm7da8RTN2lGwxj4th+z7rdOJrZ/6cXAi13Fbd9MjjXclftoSE4dnuVJELaaOyqW/x4qTWC\nLMuczs4NyEpCYlTR90Wkea9SNpROH8F9syyOGO6Y8i5feBmA5dKU0Tz0ORaSZwCIsUxfI9Vx7iSM\nTBF956u4ETM/b8pbmbXtkdT6cqixSS8YRYxGboIUYgdGElu2MPGcimrMVt6tZbXYVO5RakV2CCW9\n/jYxQlKYkco9/ZePDNlaJrsmf73iP0Tj5V7rPrPdvmjlvmvEzHiZ7+GmrTI4trTIoO/ra9RcvmzV\nUNk60ODwAWs79qCp8PzMzugS3f571teh14YEGdPI/LLdo9vxYvh4gY2tDvmDdP2m8mCk9nz2qMhJ\nchB5fxVr7P/HWUReOKI9AxeJ4uV4JF46nA/MiG5dvchiw8uO5y2IbbbWSIe2bya1CeKl5U8DMLfa\nZMHXXm7dtKDp1oZFN53+FcrCXMxQViuQdZy3mRXP56Smtl65yI1BSR4mw2ztS/OIbLFnNW+3OGdp\n1CKyB0mSJoUbtzz3iYKgNBrmcRRtizjFo8bRzjqd1GjgSt8MV2e7yWJquZSlw6cB2Fg3r+fyekHS\nt9/uPrPjlLPTu8lwsD1uE6oPGdiJM8G2mc+RrrehLzMEmUzZUxqpUWpFdhLHrC4vMRz2SL34vXRU\nLCwYwuM0G688GDpVqCYIZtRGjspq6VwjjZhpGMc0PMRL0hZJYig/6ZOzc2fsmwavvH6OzoYZV18Q\nRtt9/K2dWwy8JC1N3YgmCUnmVVtVLrbys2ebLDQbxMm0ZPiRk1qRncUxxxbn2dpWZpyzl5YtEGlW\nCfxIx98WKbyuoygTtnaqT2V4CYRPzC61Mg4esMTH8rxFl6oz5D5JG815qXBs/J93NimHZhhTx1q1\nJOTAbJPUJxZSt8hxElEBt+E5eA84iSPY6HWZMICcIrtOqbkYPpCVAxayiCgYTzac/2LnYCFQeD6j\nmr0pQ0LqlVCRewax19e1IvGydWj4Z4hCAsxZ/jtbMqS6M0Nc9in65nFUi6YqxEk+QEsPrrxfRSTj\n+bBGtcjYp+0yjSy/UMcnMO5VzM8eoNxx6/APZmX+QHEEkS9XpvJfNaI/sKFfRZwa+3WtJiE2xXRz\nV7YO2PA06OpNS1g1521h6ogRbTeC6l9nqNbURFEAqV66K7sIBK/QKlxdQ29ve5BbHmf6VYZHT+77\nu3731ZjILaALrNfW6P3LKpP385SqHtzrpFqVDSAiZ1X1J2tt9D7k/6OfUxqpUabKrlEehrJfeght\n3o888H7WztmPs0xppEapTdmP8re2P6ZS909E5IqIvOJ/v7SvduqgkUf9W9te0XVkd6Uu8CvArwMd\nVf3TB9FOXcgef2tbVUdA9a3tR0JU9Zqqvuy/20BVqftApS5l3+1b2w/8YR6EfKBSF+BrIvJDEfnG\nfgv+61L2RN/aftjywUpd4C+AJ4FnsRr1P9vP/etS9n19a7tOuVulrqreUNVSrYDlrzA6vG+pS9mP\n9Le2P6pStyqJdvlV4NX9tFNLPvt+v7Vdo3xUpe5XReRZjPLeAX5vP41MI8gaZRpB1ihTZdcoU2XX\nKFNl1yhTZdcoU2XXKFNl1yhTZdco/wdY4UtqM5WQcwAAAABJRU5ErkJggg==\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x1cbe3994828>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "### Data exploration visualization code goes here.\n",
    "### Feel free to use as many code cells as needed.\n",
    "import matplotlib.pyplot as plt\n",
    "import random\n",
    "# Visualizations will be shown in the notebook.\n",
    "%matplotlib inline\n",
    "\n",
    "# Prints the class label corresponding to the image below (in order)\n",
    "for i in range(0,5):\n",
    "    index = random.randint(0, len(X_train))\n",
    "    image = X_train[index].squeeze()\n",
    "\n",
    "    plt.figure(figsize=(1,1))\n",
    "    plt.imshow(image, cmap=\"gray\")\n",
    "    print(y_train[index])\n",
    "\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "deletable": true,
    "editable": true
   },
   "source": [
    "----\n",
    "\n",
    "## Step 2: Design and Test a Model Architecture\n",
    "\n",
    "Design and implement a deep learning model that learns to recognize traffic signs. Train and test your model on the [German Traffic Sign Dataset](http://benchmark.ini.rub.de/?section=gtsrb&subsection=dataset).\n",
    "\n",
    "The LeNet-5 implementation shown in the [classroom](https://classroom.udacity.com/nanodegrees/nd013/parts/fbf77062-5703-404e-b60c-95b78b2f3f9e/modules/6df7ae49-c61c-4bb2-a23e-6527e69209ec/lessons/601ae704-1035-4287-8b11-e2c2716217ad/concepts/d4aca031-508f-4e0b-b493-e7b706120f81) at the end of the CNN lesson is a solid starting point. You'll have to change the number of classes and possibly the preprocessing, but aside from that it's plug and play! \n",
    "\n",
    "With the LeNet-5 solution from the lecture, you should expect a validation set accuracy of about 0.89. To meet specifications, the validation set accuracy will need to be at least 0.93. It is possible to get an even higher accuracy, but 0.93 is the minimum for a successful project submission. \n",
    "\n",
    "There are various aspects to consider when thinking about this problem:\n",
    "\n",
    "- Neural network architecture (is the network over or underfitting?)\n",
    "- Play around preprocessing techniques (normalization, rgb to grayscale, etc)\n",
    "- Number of examples per label (some have more than others).\n",
    "- Generate fake data.\n",
    "\n",
    "Here is an example of a [published baseline model on this problem](http://yann.lecun.com/exdb/publis/pdf/sermanet-ijcnn-11.pdf). It's not required to be familiar with the approach used in the paper but, it's good practice to try to read papers like these."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "deletable": true,
    "editable": true
   },
   "source": [
    "### Pre-process the Data Set (normalization, grayscale, etc.)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "deletable": true,
    "editable": true
   },
   "source": [
    "Use the code cell (or multiple code cells, if necessary) to implement the first step of your project."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {
    "collapsed": false,
    "deletable": true,
    "editable": true
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "(32, 32, 3)\n"
     ]
    },
    {
     "data": {
      "text/plain": [
       "<matplotlib.image.AxesImage at 0x1cbf1bf1e10>"
      ]
     },
     "execution_count": 5,
     "metadata": {},
     "output_type": "execute_result"
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAFsAAABZCAYAAABR/liSAAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAADWtJREFUeJztnE2IJVtSx39xMu+turequqp7WoenDn7vRxBduBFEEDej\nC8VZiIIwbgYUXDi4cjkLdSs8ccCFIIKCsxiQQXThRkaHQR0f6iCib2x63rzXXR/3Kz9OuIg4J/Pe\nquq+XdUvq3h9o2mybn6cczLyf+JE/CMyRVXZyTAS7noAb5LslD2g7JQ9oOyUPaDslD2g7JQ9oOyU\nPaDcStki8jMi8u8i8g0R+dzrGtRHVeSmQY2IFMB/AD8NvAt8Bfi0qv7b6xveR0vKW1z7Y8A3VPW/\nAETkz4BPAdcqO4SgZVnAVc9Xuj/KYBNOHAiqihQFAOO9PWursKE3bUvCS+HnhABtWwEQ2whA23pb\nUQlinZXBtrGu7RiSxxG90agxD/fysO3kpmloY5RLhzfkNsr+buB/e7/fBX780nBEPgN8BqAoAh9/\n/BibTbp5IgAhBB4fHtrgKlNYU7eMjh4A8F0/8EMAHJ48AuDbp+c0pk+Ojg4AmE7h/Pk3ATh/vgDg\n4nRpba1apuMRAA99O3v6FICI0I7sgS1aewDzekHtQ/Vu8lZVAOHJt967Vkl9uY2yr3qSlx6+qr4N\nvA0wHo9VRFD0issTiqF27SUEEpSmNqWdPzsFoKlNUaEosvL2CtuOQuBo8hiAaTClnUzswdXLOW01\nA2Dx3JTcNPabYkKrNqsaR3ar0kP25u1d3vMiuY2y3wU+0fv9PcD/vewidSVvDjKpXlWp6wYwc5CO\nqU/1xVlSth07OHrA/sSV7RcEFQ7GUwDaaIgu69auF5j5jLk4O7djDlUpI43ajyq6+cEQvz7mm61z\nt/FGvgL8sIh8v4iMgV8CvniL9j7ycmNkq2ojIp8F/hoogC+o6te3uA7VKyZgMhmq1K0jG7OfhRZo\ntPPrpU35plnZMRaMCzu/VIN7s4QWQ3J1cQHA4sJQPJvNmF9YG6uVtz82NUQRqmhtpDFEBQ1pbNfc\nz5ZIv40ZQVW/BHzpNm28SXIrZd9EbIHkMkp8QRIgitnL6AueaIE2htTlcm7H3BZfnL7H+0+fADCd\nmhcz2d+jXtmCmrZNZTMhNhGN1m65d2x9Twzhq3bOws+rfSaFUBJ8LVC3592KqXnc28guXB9QhkW2\nKjGuoyN5IdnLE8FBxbJxWywwCu4aenAy3ZvmdtRdxfrsue07E9qEQofTOHkqo4IY7e+4Z9szt//L\nuqLx8SWvKcYImj3rtdsRteZfGs24DKtscaVqN7y8uKRoUQKJQpDkfkmTp2C6shEbelkGitH6+QWB\nIK7ckJ1KAGLT0LpJqtqlb31hjbELWPx8kZ6Cs8lIMYF0KNlCdmZkQBl8gQwYLq5bVlSVDKa0UErE\nYxiiIym2hs5xUTAajQEoC1/IipIy8SQ+F1qPgmJV0QQLaqomuXfXsx/QC7g2x/pqwN4he0gZFNlC\nb0HMeztmzySycQgVUIeQui1OC6CqoGLIltE+AOV+STFKAZE34ihuRyNY+m2vPDAKjvBGUZ8xaYAi\nAnlRT+tKd0ykf1cvlkGVrbgqbZXsdm6cI/0bBQiCujfR+vbw0Bi+B4cPOZg+9H0nAHzs0QEjJ6DS\nDc48knz/g2c80zOAzBbKyP35RmicN2ld6TFqR9L4YPNinUm17XztnRkZUAZfIBNy5QqDYj+F6CZC\nJNF+AUozFfvOa588ND775OiEowOLBKf7EwD2xsLIV9noEWFw81QUHVDLPUN0MhOhUAp3FauVIXy1\nqi5RrGkBD/JqJOsO2QPK4Mg26dAgl3wnydEbjuyiGDGeWMR4fPIxAB4c+/boiIN9WxjHZeEtdKmy\nxtm7yqPEpl2h7lKORnb7E08+BCbUS+NS5mo2vq0b2pwiWx++5n/byQ7ZA8rA3AhdyCvrNrv7JSAp\ncetJ3vE+R1Oz1Y8Obfvg4AiA6WTKeOT5y551bWtD78ozPDNH7KJaZedy5F7I0aG1tTcqqBbGdQcP\n6etqReVZnia7fskNBVG5p9wInWo3mck04JB9V8svAoxHEw6nppBDNxnHB5ZlL0YBCettaKs00czH\nxdyUdzEzHmRZRdQfZumLbopAHxweEsfWbjO38+ezi0x0pfRYFwmkbPx26t6ZkQHlDlg/sWgxm5G0\n+CSWrYsmsxnZm+SA5eGJbYPY1NYYc/I35cHHJczOLTF8cW7psNXSkwdRCc6h7DmKD/YtQCqKMZTW\nxt6B7StPS0JlHYQ2jbgzeuam7oKaeyd35Pr1uRD/7duo3QIkeYEcM90f+wlmi1fVws+XXprKNvO2\n5uy5heTzmZ1XOTojggObAw+CUsqsCYJ4UFO6O1iOysxpZxohV2p1s2kbuTNlX0tb9o6m3F85LihK\n27daOeHvRTuxhcQdpXqT1WLObGZ+8tLNRxvtJAmB4BfMl9ZWol+PNDKZ2gJcuA+eTM5V8io+NuzM\nyKAyMLI7tv3S9OtlrJPrV4QutZUSVgtn5SrPmscGlitD9GxuKF4sZjSO1tapVQnOjYhkuvXp+x8A\n4IEnjEqKfVOJpJ0iyIadyr8k1Y1sJztkDygDI1st7YVeyq53fIj0YoRedZ1HLqkG76lXjjarhsYz\n7pXb7ia2ucYjzY4i1aCEgsIjx7G7fqNUERUCKw9gctlyCDm1trnORNVLC/2L5KXIFpFPiMjfisg7\nIvJ1EfkN3/9IRL4sIv/p24db9/qGyjbIboDfUtWvisgR8E8i8mXgV4G/UdXP+ysenwN+e5tOrwKD\ndOmZDs/JxYoRzfV/tu/xQ3+2UZnNzFY/O7fQXFpFgt1aQvTBgVVLHR8fc3RoDKJ6PWD2fgjZfrfJ\n26mbroo1V128iLW8Xl6qbFV9Ajzxv89F5B2sEP5TwE/6aX8C/B3bKpt+cc66m2fJA48q3WQ0TU3r\ntR2l+977Th7FuiY66bR0cxBqJZROn7qSU7Lh+PiESUoaYA8w1/MotJW5g+fnXjxfNzTOraZHkx+O\nR8QfChElIt8H/AjwD8DH/UGgqk9E5DuvuWbtzYM3WbZWtogcAn8B/Kaqnm07fdbfPBjp5lU969G/\nCuiSrlW1onKX79A5i+AtNW2FultYFomVK9ibWHR48shSZsfHNhMm+2OCR4SFz5IimYmmZT73dNjM\nS5PrmjaXpG2MfSsNdLIV1ERkhCn6T1X1L333UxF5y4+/BXzrFft+4+SlyBaD8B8D76jqH/QOfRH4\nFeDzvv2rl7aF9BaU9XqRZJ+LosgrUfRFcbFYcO7h9/TIELp0vrlarnIBZpOwNyp5cGKIPjm27f6+\np76kIZX/lXlrmJuvZpktTOH+qpcW21zYFV+8X3bjLtuYkZ8Afhn4FxH5mu/7HUzJfy4ivwb8D/AL\nW/b5xso23sjfc715+qlX7TCIEPHiF+vB+4l5m19ycs66Wi344PSZ7XOCqEzn1xUrt+2tvxs5nhyw\n7+mzwvdJDqI6NtojeJYzYwhn52dcnNvfKcNT1Q2tjzVuqkE/RG/kdYiIuK+1WZKbXMDO9UO9Kqmp\ncm7wudEZTD0KDNpVh5V7xtgdTA8ppFxrN7/ZIF3h5mzhmXR/3+b09DnP/G20i7m94dAvI758M6/m\nZ7/ZvtjAcgd89joRn1PAvd+bRZexbaide47OS4d9T/hKQQjpHRm7ctTjM1Jpce3XtdrSerLgzFNm\nyXScnp5y7ihfpmSD9se4juJXqfODHbIHlcGRHdUXqGtsnfb47OwCasxv+CZXcenbMhR4JQKjxrnu\nxYzaSY66coub3musFizcrTv3ytaZ2+fZYkGd++mGEKSjEqBPSr4a6zdwybDSxmgsqmxMzd4XGDZv\nQHqV3cksVCvnTaSg8S8vNH5ssVjw7P331tpXz13Guqat/YUl50Fq51ZiVH/5v0c2Se/NhFRQGVKO\nNORFfBvZmZEB5Q5Khh2leZquV/X3yuR7HnGHtDQRure62hx95g8MyCJnyfs0LVikGh2N2i94v9Q7\n3lbovXPD2vmpxmWXFruHcmeFlS8KBTJS+u5gRva6Te3b94RUQXIJQlrc0ocG2hgzynVjLP2X/pMD\nqr33TvqLJlj9yC6ouacyfLiu/tbYZZphO9lEdO/CRJYrmo16SAXyRVdW3ObPOW2isssh9cuCry8p\n8nFsOfg7KRkWuhKuS2n2HrGTCan+1w/ieu1GX/rmp/E0Wio7Tln2deIoPZ0e+7HhkuZC0Ct6vcpN\nfZHszMiAcuPv+t2oM5H3gBnw7cE6vbk8Zvtxfq+qfsfLThpU2QAi8o+q+qODdnoD+TDGuTMjA8pO\n2QPKXSj77Tvo8yby2sc5uM1+k2VnRgaUwZR9n7+1/YJK3d8VkW+KyNf8/8/eqp8hzMh9/9a2V3S9\n1a/UBX4O+EXgQlV/73X0MxSy87e2VbUC0re274Wo6hNV/ar/fQ6kSt3XKkMp+6pvbb/2m3kdslGp\nC/BZEflnEfnCbQv+h1L2VaTvvXODNit1gT8EfhD4JFaj/vu3aX8oZd/oW9tDylWVuqr6VFVbtdzd\nH2Hm8MYylLLv9be2r6vUTSXRLj8P/Ott+hmEz77pt7YHlOsqdT8tIp/ETN5/A79+m052EeSAsosg\nB5SdsgeUnbIHlJ2yB5SdsgeUnbIHlJ2yB5SdsgeU/wdyPVD7JdiZAgAAAABJRU5ErkJggg==\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x1cbe39d93c8>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAFsAAABZCAYAAABR/liSAAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAACoFJREFUeJztnE+IHFkdxz+/qZnKdNKTzkySyZ9x1wwmDExIiETiwYsg\ngnhZPSjuQRQC62VBwYOLJ497UK9CxAUPgggK7mFBFqMHIciaTXDcTKIhkTGdZNOZSWamMz2pdM3z\n0P17/bqmqrtmera6ydQXhuqpflWv+lff+r7f7/d+r8QYQ45sMNTvC9hNyI2dIXJjZ4jc2BkiN3aG\nyI2dIXJjZ4iejC0iXxGRWyJyW0Te2qmLelkh2w1qRMQD/g18GbgHfAC8boy5sXOX93JhuIdjLwC3\njTF3AETkt8BrQKKxRcSISMeTDg0NsWfPHgDCMLTb0dFRAA4dOgTAvn37AKjVamxsbADYNsPDw1Sr\nVQDW19cBeP78OQD1ep3h4WHbDmB1dbWtf8Ces16v042QGxsbbGxsdP5h9GbsKeB/zv/3gM9HG4nI\nG8Abzc+Mjo5aI7rwPA8A3/eZmZkBYHl52W5138WLFwE4f/48AHNzcwRBAMDJkycBOHz4MFeuXAHg\n1q1bbdvl5WUmJiZsO4DLly/b6ygWiwD2ZlUqlbabHgdt2w29GDvuTm6igDHmEnAJwPM8o0aNwv1B\n0Yv3PI/FxUWgYVy3ve/7jI+PAy1DFYtFe3PUoHojHj58yKNHjwC4fv06AEtLSwCUSiV7Xr2BSQbe\nDnox9j3gFef/TwH3e7ucxo9TRo+MjNj9KysrANy40VApvSEzMzMcPXoUgEKhYNvrPr25tVoNaBhW\nzzU/Pw+0DAstuXH3KfRc270BvXgjHwCnRGRaRHzgW8C7PZzvpce2mW2MqYvIm8CfAA94xxjzUZdj\nCMOwo2aHYWhZ6EKZVi6XgZaeB0GwiXGuVN29exeA27dv2//1sz4dquHQGlD1uzAM8X0/9vz6W9J6\ndL3ICMaY94D3ejnHbsK2/eztwPM8s3fv3kR2K3Sg279/P9Bw0ZTtepzLPB0EX331VaCh15VKBWgM\niNAaBN2nZmpqCsAOsCsrK/Y4bef7vh0LojoeBAFBELC+vp7K9cvD9QyRKbOHhoaMehhRZqsOep5n\nNTK6hRa7SqUS0Ag6VGddTdV2rv+u/2s7Zbbq/9LSUux40cldDcMwNbN70uztwP2xLlxDxfm6SYOg\nSo7b3vf9tpvnolqtsra2BrQHTe7xbj/ujY4LbjzPo1tUrMhlJENkzuxucAfPOHZGg5RCoWAlRVlY\nLBbb8iTQzmKNRt1B1t2mhed5ObMHFX1hdpxud9PxKMtVX+v1us3UaUbw4MGDlu16Dv1/cXHRPgHq\n5in7ofXEuP0l5Unc60qDvslImjyD60G4nwFOnDgBwOnTp22SaXZ2FoBz585tOpdGjVevXuXatWtA\n64bpIDs6OsqTJ08A2vz6pMF2K4aGXEYyRd9kpNN30UjN8zzLPk2daj57dnbW7tNMn0oGtCJHhe/7\nVjY0J6L9jYyM2IkLlZjo8dDuFm4lN5IzO0P03fWLY3lUI4vFIsePHwdaeqzMdvPZyn7XfVTtjQYw\n0HoC3CdBcymKarW6KchSbDXrlzM7Q2TO7LiccxTRfMb4+DinTp0CWh6HeiBTU1NtIbvCnZmBVh7c\n1WBltGp+qVRiYWGh7fjFxUU7s5P0FKYNavomI0kun+u7amrz8OHDTE9PA61BUNOppVJpkxFqtZo1\nlhpPt8vLy/YmRmVkZmbGpmtVTu7cucOzZ88SrxXII8hBRN+yflE2xmX9NB07OTlpH/VowFKtVjcN\nXIVCwU4MawmDMjUIAis76vppqrVYLNpz6ZNz4MABG+jERZL5ADmgGDjNdlmvAcbExITVamWX66JF\nz1WtVm19iavVCmW2MloHTd/3rZ4r6+PGhG6/IQl997M7QWWkVCrZwVIjO93qPCC0DFoul20uxJUP\naJSXaemaeihafhaGYZukQPvkQa/IZSRDZMpsEen6SLp1GiojmoMANs2a12o1Oxlw/36jIGthYcFO\nDERL2YrFovWbtR5Q+xsbG7PyoZMPSdN47nXnA+QAIlNma0UUdA5qOu1X7dXK06WlJbtPAxlXx5W1\nqvmFQsHWo0xOTgK0Tavpk6DHjYyMdJ1dT4uuzBaRV0TkLyIyLyIficj3m/snROR9EflPczueutdd\nijTMrgM/NMZ8KCJjwFUReR/4LvBnY8zbzSUebwE/StNpp1o/l0Vuti1aEaVZvzAMrXunAUy1WrUe\nx9jYGIAN98+cOWPzKnHTXMpoHQfcUD36VKqb+uLFizQ/u7uxjTEPgAfNz6siMk+jEP414IvNZr8G\n/kpKY7voVETjunT6eKscuAXz+p2WkXmeZ9upkS9cuAA0jK2DoPZTr9ft9Tx+/Lhtu7y8HFs+rNcc\nN9mRhC1ptoicAD4L/B040rwRGGMeiMhkwjFtKw92M1IbW0SKwO+BHxhjVtIazl15MDQ0tMlHSppM\nBWzl0tLSko3ylKku+/WzuoruZIPKzZkzZ4BG1jCpz1qtZp8SLTXuxOytIpXrJyIjNAz9G2PMH5q7\nPxaRY83vjwGPduSKXmJ0ZbY0KPwrYN4Y83Pnq3eB7wBvN7d/THGuxGyfsqdQKNh9WjBZLpct01Sr\ndVB8+PBh22ovaDD77NmzQIvRmqeOg44Xd+/etYOs9vf06dOO7moQBHZlWTekkZEvAN8G5kTkenPf\nj2kY+XcichFYAL6RqsddjDTeyN+IXxkG8KWtdOYyO27y1N1CS1MrlYpd2eVO6kJDU9U9U4ZOTU3Z\nJyDaPg7K5hs3bmxi9srKSqJmq+s3sNNiSbkGd9CKc/1UNjSf4bpv2l7Lz6anpztm67S9Zv3UwHNz\nc5tSs50Gx7ywcoDR91q/NPtrtVpb/hrgyJEjQMPd0wBGme2yWiNPNwJVNzK6+ndubo6bN28CrQmF\nOFlzkWf9BhQDVzcSt6QjCAI7CxPVe9/3rVunA2W5XLaZvOjqr0qlsmltpOpzuVze1I+bX49zW7fC\n7MwXMLlJeXer6JayjMulqGHV6O40WnSlwurqqp0t1xvhrkDo5BUp3L6DIGBtbY0wDPOleYOEvpcM\nbzXvkBTFQYuhbqpUM3qaBnUnFqJp2zi4U3LR/pTZ+QA5gOjLotNuyyPiVoslDaxJAVJ0waqy0WV2\nmnU97prKpL7y5dQDiIEu0olDmjWL7nfuRK8izTiRdnHSViZ8+27sNAtMk1yyJHie17YoFUj0laPn\njF5HJ6Pv+Ox6jp1DpgOkiFSAZ8DjzDrdPg6R/jo/bYxJnp1oIlNjA4jIP4wxn8u0023gk7jOXEYy\nRG7sDNEPY1/qQ5/bwY5fZ+aavZuRy0iGyMzYg/yu7Q6Vuj8RkbKIXG/+fbWnfrKQkUF/13azouuY\nW6kLfA34JlA1xvx0J/rJitn2XdvGmADQd20PBIwxD4wxHzY/rwJaqbujyMrYce/a3vEfsxOIVOoC\nvCki/xSRd3ot+M/K2Knetd1vRCt1gV8AnwHO0ahR/1kv58/K2J/Iu7Z3EnGVusaYj40xoTFmA/gl\nDTncNrIy9kC/azupUldLopv4OvCvXvrJJJ+9nXdtZ4ykSt3XReQcDcn7L/C9XjrJI8gMkUeQGSI3\ndobIjZ0hcmNniNzYGSI3dobIjZ0hcmNniP8DwnUbQNvErHcAAAAASUVORK5CYII=\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x1cbe3bdbcf8>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "### Preprocess the data here. Preprocessing steps could include normalization, converting to grayscale, etc.\n",
    "### Feel free to use as many code cells as needed.\n",
    "print(X_train[0].shape)\n",
    "#display image before grayscaling\n",
    "plt.figure(figsize=(1,1))\n",
    "plt.imshow(X_train[0], cmap=\"gray\")\n",
    "\n",
    "\n",
    "# rgb to gray scale\n",
    "def rgbToGray(temp_array):\n",
    "    new_array = []\n",
    "    for i in range(len(temp_array)):\n",
    "        gray_img = cv2.cvtColor(temp_array[i], cv2.COLOR_BGR2GRAY)\n",
    "        gray_img = np.reshape(gray_img, gray_img.shape + (1,))\n",
    "        new_array.append(gray_img)\n",
    "    return new_array\n",
    "\n",
    "X_train = rgbToGray(X_train)\n",
    "X_test = rgbToGray(X_test)\n",
    "X_valid = rgbToGray(X_valid)\n",
    "## display image after grayscaling\n",
    "\n",
    "temp_gray_img = cv2.resize(X_train[0], (32,32))\n",
    "plt.figure(figsize=(1,1))\n",
    "plt.imshow(temp_gray_img, cmap=\"gray\")\n",
    "\n",
    "# # Add extra images to the training set in order to compensate for data in certain classes.\n",
    "# def addAlteredImages(data):\n",
    "    \n",
    "#     ##5 sets of len(data)\n",
    "#     for i in range(0,5)\n",
    "    \n",
    "#     ##shift([-2,2] pixels)\n",
    "    \n",
    "#     ##sclaed([.9,1.1] ratio)\n",
    "    \n",
    "#     ##rotated([-15,+15] degrees)\n",
    "    \n",
    "    \n",
    "#     pass\n",
    "    \n",
    "    \n",
    "    \n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {
    "collapsed": false,
    "deletable": true,
    "editable": true
   },
   "outputs": [],
   "source": [
    "# normalize\n",
    "def normalize(img_array):\n",
    "    new_array = []\n",
    "    img_array = np.array(img_array)\n",
    "    for i in range(len(img_array)):\n",
    "        new_array.append((img_array[i] - 128/128))\n",
    "    new_array = np.array(new_array)\n",
    "    return new_array\n",
    "X_train = normalize(X_train)\n",
    "X_test = normalize(X_test)\n",
    "X_valid = normalize(X_valid)\n",
    "\n",
    "X_train, y_train = shuffle(X_train, y_train)\n",
    "\n",
    "\n",
    "EPOCHS = 3000\n",
    "BATCH_SIZE = 128"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "deletable": true,
    "editable": true
   },
   "source": [
    "### Model Architecture"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {
    "collapsed": true,
    "deletable": true,
    "editable": true
   },
   "outputs": [],
   "source": [
    "### Define your architecture here.\n",
    "### Feel free to use as many code cells as needed.\n",
    "\n",
    "from tensorflow.contrib.layers import flatten\n",
    "keep_prob = tf.placeholder(tf.float32)\n",
    "\n",
    "def LeNet(x):    \n",
    "    # Arguments used for tf.truncated_normal, randomly defines variables for the weights and biases for each layer\n",
    "    mu = 0\n",
    "    sigma = 0.1\n",
    "    \n",
    "    \n",
    "    # C1: Convolutional. Input = 32x32x1. Output = 28x28x6.\n",
    "    conv1_W = tf.Variable(tf.truncated_normal(shape=(5, 5, 1, 6), mean = mu, stddev = sigma))\n",
    "    conv1_b = tf.Variable(tf.zeros(6))\n",
    "    conv1   = tf.nn.conv2d(x, conv1_W, strides=[1, 1, 1, 1], padding='VALID') + conv1_b\n",
    "\n",
    "    # Activation.\n",
    "    activate = tf.nn.relu(conv1)\n",
    "    \n",
    "    \n",
    "    # S3. Input = 28x28x6. Output = 14x14x6.\n",
    "    pool = tf.nn.max_pool(activate, ksize=[1, 2, 2, 1], strides=[1, 2, 2, 1], padding='VALID')\n",
    "    \n",
    "#     # Dropout\n",
    "#     drop = tf.nn.dropout(pool, keep_prob)\n",
    "    \n",
    "    \n",
    "   \n",
    "    # C4: Convolutional. Output = 10x10x16.\n",
    "    conv3_W = tf.Variable(tf.truncated_normal(shape=(5, 5, 6, 16), mean = mu, stddev = sigma))\n",
    "    conv3_b = tf.Variable(tf.zeros(16))\n",
    "    conv3   = tf.nn.conv2d(pool, conv3_W, strides=[1, 1, 1, 1], padding='VALID') + conv3_b\n",
    "    \n",
    "    # Activation.\n",
    "    activate = tf.nn.relu(conv3)\n",
    "    \n",
    "    \n",
    "    # S5: Pooling. Input = 10x10x16. Output = 5x5x16.\n",
    "    pool2 = tf.nn.max_pool(activate, ksize=[1, 2, 2, 1], strides=[1, 2, 2, 1], padding='VALID')\n",
    "    \n",
    "#     # Dropout\n",
    "#     drop = tf.nn.dropout(pool2, keep_prob)\n",
    "    \n",
    "\n",
    "    # Flatten. Input = 5x5x16. Output = 400.\n",
    "    fc0 = flatten(pool2)\n",
    "\n",
    "    \n",
    "    # F6: Fully Connected. Input = 400. Output = 120.\n",
    "    fc1_W = tf.Variable(tf.truncated_normal(shape=(400, 120), mean = mu, stddev = sigma))\n",
    "    fc1_b = tf.Variable(tf.zeros(120))\n",
    "    fc1   = tf.matmul(fc0, fc1_W) + fc1_b\n",
    "    \n",
    "    # Activation.\n",
    "    activate = tf.nn.relu(fc1)\n",
    "    \n",
    "#     # Dropout\n",
    "#     drop = tf.nn.dropout(activate, keep_prob)\n",
    "    \n",
    "    # F7: Fully Connected. Input = 120. Output = 84.\n",
    "    fc2_W  = tf.Variable(tf.truncated_normal(shape=(120, 84), mean = mu, stddev = sigma))\n",
    "    fc2_b  = tf.Variable(tf.zeros(84))\n",
    "    fc2    = tf.matmul(activate, fc2_W) + fc2_b\n",
    "    \n",
    "    # Activation.\n",
    "    activate = tf.nn.relu(fc2)\n",
    "    \n",
    "#     # Dropout\n",
    "#     drop = tf.nn.dropout(activate, keep_prob)\n",
    "    \n",
    "    # F8: Fully Connected. Input = 84. Output = 43.\n",
    "    fc3_W  = tf.Variable(tf.truncated_normal(shape=(84, 43), mean = mu, stddev = sigma))\n",
    "    fc3_b  = tf.Variable(tf.zeros(43))\n",
    "    logits = tf.matmul(activate, fc3_W) + fc3_b\n",
    "    \n",
    "    \n",
    "    return logits\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "deletable": true,
    "editable": true
   },
   "source": [
    "### Train, Validate and Test the Model"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "deletable": true,
    "editable": true
   },
   "source": [
    "A validation set can be used to assess how well the model is performing. A low accuracy on the training and validation\n",
    "sets imply underfitting. A high accuracy on the training set but low accuracy on the validation set implies overfitting."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {
    "collapsed": false,
    "deletable": true,
    "editable": true
   },
   "outputs": [],
   "source": [
    "### Train your model here.\n",
    "### Calculate and report the accuracy on the training and validation set.\n",
    "### Once a final model architecture is selected, \n",
    "### the accuracy on the test set should be calculated and reported as well.\n",
    "### Feel free to use as many code cells as needed.\n",
    "\n",
    "x = tf.placeholder(tf.float32, (None, 32, 32, 1))\n",
    "y = tf.placeholder(tf.int32, (None))\n",
    "one_hot_y = tf.one_hot(y, 43)\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {
    "collapsed": false,
    "deletable": true,
    "editable": true
   },
   "outputs": [],
   "source": [
    "rate = 0.001\n",
    "\n",
    "logits = LeNet(x)\n",
    "cross_entropy = tf.nn.softmax_cross_entropy_with_logits(logits=logits, labels=one_hot_y)\n",
    "loss_operation = tf.reduce_mean(cross_entropy)\n",
    "optimizer = tf.train.AdamOptimizer(learning_rate = rate)\n",
    "training_operation = optimizer.minimize(loss_operation)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {
    "collapsed": true,
    "deletable": true,
    "editable": true
   },
   "outputs": [],
   "source": [
    "correct_prediction = tf.equal(tf.argmax(logits, 1), tf.argmax(one_hot_y, 1))\n",
    "accuracy_operation = tf.reduce_mean(tf.cast(correct_prediction, tf.float32))\n",
    "saver = tf.train.Saver()\n",
    "\n",
    "def evaluate(X_data, y_data):\n",
    "    num_examples = len(X_data)\n",
    "    total_accuracy = 0\n",
    "    sess = tf.get_default_session()\n",
    "    for offset in range(0, num_examples, BATCH_SIZE):\n",
    "        batch_x, batch_y = X_data[offset:offset+BATCH_SIZE], y_data[offset:offset+BATCH_SIZE]\n",
    "        accuracy = sess.run(accuracy_operation, feed_dict={x: batch_x, y: batch_y, keep_prob: 1})\n",
    "        total_accuracy += (accuracy * len(batch_x))\n",
    "    return total_accuracy / num_examples"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {
    "collapsed": false,
    "deletable": true,
    "editable": true,
    "scrolled": true
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Training...\n",
      "\n",
      "EPOCH 1 ...\n",
      "Validation Accuracy = 0.737\n",
      "\n",
      "EPOCH 2 ...\n",
      "Validation Accuracy = 0.831\n",
      "\n",
      "EPOCH 3 ...\n",
      "Validation Accuracy = 0.845\n",
      "\n",
      "EPOCH 4 ...\n",
      "Validation Accuracy = 0.878\n",
      "\n",
      "EPOCH 5 ...\n",
      "Validation Accuracy = 0.881\n",
      "\n",
      "EPOCH 6 ...\n",
      "Validation Accuracy = 0.881\n",
      "\n",
      "EPOCH 7 ...\n",
      "Validation Accuracy = 0.885\n",
      "\n",
      "EPOCH 8 ...\n",
      "Validation Accuracy = 0.872\n",
      "\n",
      "EPOCH 9 ...\n",
      "Validation Accuracy = 0.889\n",
      "\n",
      "EPOCH 10 ...\n",
      "Validation Accuracy = 0.867\n",
      "\n",
      "EPOCH 11 ...\n",
      "Validation Accuracy = 0.893\n",
      "\n",
      "EPOCH 12 ...\n",
      "Validation Accuracy = 0.878\n",
      "\n",
      "EPOCH 13 ...\n",
      "Validation Accuracy = 0.908\n",
      "\n",
      "EPOCH 14 ...\n",
      "Validation Accuracy = 0.905\n",
      "\n",
      "EPOCH 15 ...\n",
      "Validation Accuracy = 0.906\n",
      "\n",
      "EPOCH 16 ...\n",
      "Validation Accuracy = 0.883\n",
      "\n",
      "EPOCH 17 ...\n",
      "Validation Accuracy = 0.904\n",
      "\n",
      "EPOCH 18 ...\n",
      "Validation Accuracy = 0.913\n",
      "\n",
      "EPOCH 19 ...\n",
      "Validation Accuracy = 0.884\n",
      "\n",
      "EPOCH 20 ...\n",
      "Validation Accuracy = 0.918\n",
      "\n",
      "EPOCH 21 ...\n",
      "Validation Accuracy = 0.898\n",
      "\n",
      "EPOCH 22 ...\n",
      "Validation Accuracy = 0.920\n",
      "\n",
      "EPOCH 23 ...\n",
      "Validation Accuracy = 0.900\n",
      "\n",
      "EPOCH 24 ...\n",
      "Validation Accuracy = 0.921\n",
      "\n",
      "EPOCH 25 ...\n",
      "Validation Accuracy = 0.909\n",
      "\n",
      "EPOCH 26 ...\n",
      "Validation Accuracy = 0.905\n",
      "\n",
      "EPOCH 27 ...\n",
      "Validation Accuracy = 0.918\n",
      "\n",
      "EPOCH 28 ...\n",
      "Validation Accuracy = 0.921\n",
      "\n",
      "EPOCH 29 ...\n",
      "Validation Accuracy = 0.907\n",
      "\n",
      "EPOCH 30 ...\n",
      "Validation Accuracy = 0.903\n",
      "\n",
      "EPOCH 31 ...\n",
      "Validation Accuracy = 0.896\n",
      "\n",
      "EPOCH 32 ...\n",
      "Validation Accuracy = 0.910\n",
      "\n",
      "EPOCH 33 ...\n",
      "Validation Accuracy = 0.921\n",
      "\n",
      "EPOCH 34 ...\n",
      "Validation Accuracy = 0.914\n",
      "\n",
      "EPOCH 35 ...\n",
      "Validation Accuracy = 0.911\n",
      "\n",
      "EPOCH 36 ...\n",
      "Validation Accuracy = 0.908\n",
      "\n",
      "EPOCH 37 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 38 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 39 ...\n",
      "Validation Accuracy = 0.900\n",
      "\n",
      "EPOCH 40 ...\n",
      "Validation Accuracy = 0.922\n",
      "\n",
      "EPOCH 41 ...\n",
      "Validation Accuracy = 0.914\n",
      "\n",
      "EPOCH 42 ...\n",
      "Validation Accuracy = 0.910\n",
      "\n",
      "EPOCH 43 ...\n",
      "Validation Accuracy = 0.916\n",
      "\n",
      "EPOCH 44 ...\n",
      "Validation Accuracy = 0.893\n",
      "\n",
      "EPOCH 45 ...\n",
      "Validation Accuracy = 0.909\n",
      "\n",
      "EPOCH 46 ...\n",
      "Validation Accuracy = 0.910\n",
      "\n",
      "EPOCH 47 ...\n",
      "Validation Accuracy = 0.920\n",
      "\n",
      "EPOCH 48 ...\n",
      "Validation Accuracy = 0.902\n",
      "\n",
      "EPOCH 49 ...\n",
      "Validation Accuracy = 0.922\n",
      "\n",
      "EPOCH 50 ...\n",
      "Validation Accuracy = 0.927\n",
      "\n",
      "EPOCH 51 ...\n",
      "Validation Accuracy = 0.935\n",
      "\n",
      "EPOCH 52 ...\n",
      "Validation Accuracy = 0.936\n",
      "\n",
      "EPOCH 53 ...\n",
      "Validation Accuracy = 0.935\n",
      "\n",
      "EPOCH 54 ...\n",
      "Validation Accuracy = 0.895\n",
      "\n",
      "EPOCH 55 ...\n",
      "Validation Accuracy = 0.899\n",
      "\n",
      "EPOCH 56 ...\n",
      "Validation Accuracy = 0.927\n",
      "\n",
      "EPOCH 57 ...\n",
      "Validation Accuracy = 0.927\n",
      "\n",
      "EPOCH 58 ...\n",
      "Validation Accuracy = 0.924\n",
      "\n",
      "EPOCH 59 ...\n",
      "Validation Accuracy = 0.922\n",
      "\n",
      "EPOCH 60 ...\n",
      "Validation Accuracy = 0.912\n",
      "\n",
      "EPOCH 61 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 62 ...\n",
      "Validation Accuracy = 0.922\n",
      "\n",
      "EPOCH 63 ...\n",
      "Validation Accuracy = 0.925\n",
      "\n",
      "EPOCH 64 ...\n",
      "Validation Accuracy = 0.925\n",
      "\n",
      "EPOCH 65 ...\n",
      "Validation Accuracy = 0.927\n",
      "\n",
      "EPOCH 66 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 67 ...\n",
      "Validation Accuracy = 0.924\n",
      "\n",
      "EPOCH 68 ...\n",
      "Validation Accuracy = 0.919\n",
      "\n",
      "EPOCH 69 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 70 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 71 ...\n",
      "Validation Accuracy = 0.936\n",
      "\n",
      "EPOCH 72 ...\n",
      "Validation Accuracy = 0.915\n",
      "\n",
      "EPOCH 73 ...\n",
      "Validation Accuracy = 0.918\n",
      "\n",
      "EPOCH 74 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 75 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 76 ...\n",
      "Validation Accuracy = 0.917\n",
      "\n",
      "EPOCH 77 ...\n",
      "Validation Accuracy = 0.924\n",
      "\n",
      "EPOCH 78 ...\n",
      "Validation Accuracy = 0.921\n",
      "\n",
      "EPOCH 79 ...\n",
      "Validation Accuracy = 0.920\n",
      "\n",
      "EPOCH 80 ...\n",
      "Validation Accuracy = 0.927\n",
      "\n",
      "EPOCH 81 ...\n",
      "Validation Accuracy = 0.920\n",
      "\n",
      "EPOCH 82 ...\n",
      "Validation Accuracy = 0.922\n",
      "\n",
      "EPOCH 83 ...\n",
      "Validation Accuracy = 0.919\n",
      "\n",
      "EPOCH 84 ...\n",
      "Validation Accuracy = 0.928\n",
      "\n",
      "EPOCH 85 ...\n",
      "Validation Accuracy = 0.928\n",
      "\n",
      "EPOCH 86 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 87 ...\n",
      "Validation Accuracy = 0.927\n",
      "\n",
      "EPOCH 88 ...\n",
      "Validation Accuracy = 0.926\n",
      "\n",
      "EPOCH 89 ...\n",
      "Validation Accuracy = 0.921\n",
      "\n",
      "EPOCH 90 ...\n",
      "Validation Accuracy = 0.928\n",
      "\n",
      "EPOCH 91 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 92 ...\n",
      "Validation Accuracy = 0.915\n",
      "\n",
      "EPOCH 93 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 94 ...\n",
      "Validation Accuracy = 0.920\n",
      "\n",
      "EPOCH 95 ...\n",
      "Validation Accuracy = 0.911\n",
      "\n",
      "EPOCH 96 ...\n",
      "Validation Accuracy = 0.914\n",
      "\n",
      "EPOCH 97 ...\n",
      "Validation Accuracy = 0.927\n",
      "\n",
      "EPOCH 98 ...\n",
      "Validation Accuracy = 0.938\n",
      "\n",
      "EPOCH 99 ...\n",
      "Validation Accuracy = 0.917\n",
      "\n",
      "EPOCH 100 ...\n",
      "Validation Accuracy = 0.934\n",
      "\n",
      "EPOCH 101 ...\n",
      "Validation Accuracy = 0.919\n",
      "\n",
      "EPOCH 102 ...\n",
      "Validation Accuracy = 0.921\n",
      "\n",
      "EPOCH 103 ...\n",
      "Validation Accuracy = 0.916\n",
      "\n",
      "EPOCH 104 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 105 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 106 ...\n",
      "Validation Accuracy = 0.938\n",
      "\n",
      "EPOCH 107 ...\n",
      "Validation Accuracy = 0.905\n",
      "\n",
      "EPOCH 108 ...\n",
      "Validation Accuracy = 0.925\n",
      "\n",
      "EPOCH 109 ...\n",
      "Validation Accuracy = 0.927\n",
      "\n",
      "EPOCH 110 ...\n",
      "Validation Accuracy = 0.937\n",
      "\n",
      "EPOCH 111 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 112 ...\n",
      "Validation Accuracy = 0.941\n",
      "\n",
      "EPOCH 113 ...\n",
      "Validation Accuracy = 0.919\n",
      "\n",
      "EPOCH 114 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 115 ...\n",
      "Validation Accuracy = 0.934\n",
      "\n",
      "EPOCH 116 ...\n",
      "Validation Accuracy = 0.934\n",
      "\n",
      "EPOCH 117 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 118 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 119 ...\n",
      "Validation Accuracy = 0.938\n",
      "\n",
      "EPOCH 120 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 121 ...\n",
      "Validation Accuracy = 0.925\n",
      "\n",
      "EPOCH 122 ...\n",
      "Validation Accuracy = 0.927\n",
      "\n",
      "EPOCH 123 ...\n",
      "Validation Accuracy = 0.927\n",
      "\n",
      "EPOCH 124 ...\n",
      "Validation Accuracy = 0.928\n",
      "\n",
      "EPOCH 125 ...\n",
      "Validation Accuracy = 0.923\n",
      "\n",
      "EPOCH 126 ...\n",
      "Validation Accuracy = 0.935\n",
      "\n",
      "EPOCH 127 ...\n",
      "Validation Accuracy = 0.922\n",
      "\n",
      "EPOCH 128 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 129 ...\n",
      "Validation Accuracy = 0.936\n",
      "\n",
      "EPOCH 130 ...\n",
      "Validation Accuracy = 0.926\n",
      "\n",
      "EPOCH 131 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 132 ...\n",
      "Validation Accuracy = 0.927\n",
      "\n",
      "EPOCH 133 ...\n",
      "Validation Accuracy = 0.923\n",
      "\n",
      "EPOCH 134 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 135 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 136 ...\n",
      "Validation Accuracy = 0.936\n",
      "\n",
      "EPOCH 137 ...\n",
      "Validation Accuracy = 0.936\n",
      "\n",
      "EPOCH 138 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 139 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 140 ...\n",
      "Validation Accuracy = 0.934\n",
      "\n",
      "EPOCH 141 ...\n",
      "Validation Accuracy = 0.936\n",
      "\n",
      "EPOCH 142 ...\n",
      "Validation Accuracy = 0.934\n",
      "\n",
      "EPOCH 143 ...\n",
      "Validation Accuracy = 0.937\n",
      "\n",
      "EPOCH 144 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 145 ...\n",
      "Validation Accuracy = 0.917\n",
      "\n",
      "EPOCH 146 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 147 ...\n",
      "Validation Accuracy = 0.920\n",
      "\n",
      "EPOCH 148 ...\n",
      "Validation Accuracy = 0.935\n",
      "\n",
      "EPOCH 149 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 150 ...\n",
      "Validation Accuracy = 0.923\n",
      "\n",
      "EPOCH 151 ...\n",
      "Validation Accuracy = 0.918\n",
      "\n",
      "EPOCH 152 ...\n",
      "Validation Accuracy = 0.926\n",
      "\n",
      "EPOCH 153 ...\n",
      "Validation Accuracy = 0.934\n",
      "\n",
      "EPOCH 154 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 155 ...\n",
      "Validation Accuracy = 0.926\n",
      "\n",
      "EPOCH 156 ...\n",
      "Validation Accuracy = 0.918\n",
      "\n",
      "EPOCH 157 ...\n",
      "Validation Accuracy = 0.935\n",
      "\n",
      "EPOCH 158 ...\n",
      "Validation Accuracy = 0.924\n",
      "\n",
      "EPOCH 159 ...\n",
      "Validation Accuracy = 0.924\n",
      "\n",
      "EPOCH 160 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 161 ...\n",
      "Validation Accuracy = 0.922\n",
      "\n",
      "EPOCH 162 ...\n",
      "Validation Accuracy = 0.926\n",
      "\n",
      "EPOCH 163 ...\n",
      "Validation Accuracy = 0.934\n",
      "\n",
      "EPOCH 164 ...\n",
      "Validation Accuracy = 0.922\n",
      "\n",
      "EPOCH 165 ...\n",
      "Validation Accuracy = 0.928\n",
      "\n",
      "EPOCH 166 ...\n",
      "Validation Accuracy = 0.926\n",
      "\n",
      "EPOCH 167 ...\n",
      "Validation Accuracy = 0.918\n",
      "\n",
      "EPOCH 168 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 169 ...\n",
      "Validation Accuracy = 0.928\n",
      "\n",
      "EPOCH 170 ...\n",
      "Validation Accuracy = 0.925\n",
      "\n",
      "EPOCH 171 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 172 ...\n",
      "Validation Accuracy = 0.927\n",
      "\n",
      "EPOCH 173 ...\n",
      "Validation Accuracy = 0.916\n",
      "\n",
      "EPOCH 174 ...\n",
      "Validation Accuracy = 0.927\n",
      "\n",
      "EPOCH 175 ...\n",
      "Validation Accuracy = 0.922\n",
      "\n",
      "EPOCH 176 ...\n",
      "Validation Accuracy = 0.935\n",
      "\n",
      "EPOCH 177 ...\n",
      "Validation Accuracy = 0.923\n",
      "\n",
      "EPOCH 178 ...\n",
      "Validation Accuracy = 0.942\n",
      "\n",
      "EPOCH 179 ...\n",
      "Validation Accuracy = 0.915\n",
      "\n",
      "EPOCH 180 ...\n",
      "Validation Accuracy = 0.942\n",
      "\n",
      "EPOCH 181 ...\n",
      "Validation Accuracy = 0.935\n",
      "\n",
      "EPOCH 182 ...\n",
      "Validation Accuracy = 0.937\n",
      "\n",
      "EPOCH 183 ...\n",
      "Validation Accuracy = 0.925\n",
      "\n",
      "EPOCH 184 ...\n",
      "Validation Accuracy = 0.926\n",
      "\n",
      "EPOCH 185 ...\n",
      "Validation Accuracy = 0.923\n",
      "\n",
      "EPOCH 186 ...\n",
      "Validation Accuracy = 0.915\n",
      "\n",
      "EPOCH 187 ...\n",
      "Validation Accuracy = 0.924\n",
      "\n",
      "EPOCH 188 ...\n",
      "Validation Accuracy = 0.914\n",
      "\n",
      "EPOCH 189 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 190 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 191 ...\n",
      "Validation Accuracy = 0.935\n",
      "\n",
      "EPOCH 192 ...\n",
      "Validation Accuracy = 0.938\n",
      "\n",
      "EPOCH 193 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 194 ...\n",
      "Validation Accuracy = 0.939\n",
      "\n",
      "EPOCH 195 ...\n",
      "Validation Accuracy = 0.936\n",
      "\n",
      "EPOCH 196 ...\n",
      "Validation Accuracy = 0.939\n",
      "\n",
      "EPOCH 197 ...\n",
      "Validation Accuracy = 0.939\n",
      "\n",
      "EPOCH 198 ...\n",
      "Validation Accuracy = 0.939\n",
      "\n",
      "EPOCH 199 ...\n",
      "Validation Accuracy = 0.938\n",
      "\n",
      "EPOCH 200 ...\n",
      "Validation Accuracy = 0.938\n",
      "\n",
      "EPOCH 201 ...\n",
      "Validation Accuracy = 0.938\n",
      "\n",
      "EPOCH 202 ...\n",
      "Validation Accuracy = 0.938\n",
      "\n",
      "EPOCH 203 ...\n",
      "Validation Accuracy = 0.938\n",
      "\n",
      "EPOCH 204 ...\n",
      "Validation Accuracy = 0.938\n",
      "\n",
      "EPOCH 205 ...\n",
      "Validation Accuracy = 0.938\n",
      "\n",
      "EPOCH 206 ...\n",
      "Validation Accuracy = 0.938\n",
      "\n",
      "EPOCH 207 ...\n",
      "Validation Accuracy = 0.938\n",
      "\n",
      "EPOCH 208 ...\n",
      "Validation Accuracy = 0.938\n",
      "\n",
      "EPOCH 209 ...\n",
      "Validation Accuracy = 0.938\n",
      "\n",
      "EPOCH 210 ...\n",
      "Validation Accuracy = 0.938\n",
      "\n",
      "EPOCH 211 ...\n",
      "Validation Accuracy = 0.938\n",
      "\n",
      "EPOCH 212 ...\n",
      "Validation Accuracy = 0.938\n",
      "\n",
      "EPOCH 213 ...\n",
      "Validation Accuracy = 0.938\n",
      "\n",
      "EPOCH 214 ...\n",
      "Validation Accuracy = 0.938\n",
      "\n",
      "EPOCH 215 ...\n",
      "Validation Accuracy = 0.938\n",
      "\n",
      "EPOCH 216 ...\n",
      "Validation Accuracy = 0.938\n",
      "\n",
      "EPOCH 217 ...\n",
      "Validation Accuracy = 0.938\n",
      "\n",
      "EPOCH 218 ...\n",
      "Validation Accuracy = 0.938\n",
      "\n",
      "EPOCH 219 ...\n",
      "Validation Accuracy = 0.938\n",
      "\n",
      "EPOCH 220 ...\n",
      "Validation Accuracy = 0.938\n",
      "\n",
      "EPOCH 221 ...\n",
      "Validation Accuracy = 0.938\n",
      "\n",
      "EPOCH 222 ...\n",
      "Validation Accuracy = 0.938\n",
      "\n",
      "EPOCH 223 ...\n",
      "Validation Accuracy = 0.938\n",
      "\n",
      "EPOCH 224 ...\n",
      "Validation Accuracy = 0.938\n",
      "\n",
      "EPOCH 225 ...\n",
      "Validation Accuracy = 0.938\n",
      "\n",
      "EPOCH 226 ...\n",
      "Validation Accuracy = 0.938\n",
      "\n",
      "EPOCH 227 ...\n",
      "Validation Accuracy = 0.938\n",
      "\n",
      "EPOCH 228 ...\n",
      "Validation Accuracy = 0.938\n",
      "\n",
      "EPOCH 229 ...\n",
      "Validation Accuracy = 0.938\n",
      "\n",
      "EPOCH 230 ...\n",
      "Validation Accuracy = 0.938\n",
      "\n",
      "EPOCH 231 ...\n",
      "Validation Accuracy = 0.938\n",
      "\n",
      "EPOCH 232 ...\n",
      "Validation Accuracy = 0.938\n",
      "\n",
      "EPOCH 233 ...\n",
      "Validation Accuracy = 0.938\n",
      "\n",
      "EPOCH 234 ...\n",
      "Validation Accuracy = 0.938\n",
      "\n",
      "EPOCH 235 ...\n",
      "Validation Accuracy = 0.938\n",
      "\n",
      "EPOCH 236 ...\n",
      "Validation Accuracy = 0.937\n",
      "\n",
      "EPOCH 237 ...\n",
      "Validation Accuracy = 0.937\n",
      "\n",
      "EPOCH 238 ...\n",
      "Validation Accuracy = 0.937\n",
      "\n",
      "EPOCH 239 ...\n",
      "Validation Accuracy = 0.937\n",
      "\n",
      "EPOCH 240 ...\n",
      "Validation Accuracy = 0.937\n",
      "\n",
      "EPOCH 241 ...\n",
      "Validation Accuracy = 0.937\n",
      "\n",
      "EPOCH 242 ...\n",
      "Validation Accuracy = 0.937\n",
      "\n",
      "EPOCH 243 ...\n",
      "Validation Accuracy = 0.937\n",
      "\n",
      "EPOCH 244 ...\n",
      "Validation Accuracy = 0.937\n",
      "\n",
      "EPOCH 245 ...\n",
      "Validation Accuracy = 0.937\n",
      "\n",
      "EPOCH 246 ...\n",
      "Validation Accuracy = 0.937\n",
      "\n",
      "EPOCH 247 ...\n",
      "Validation Accuracy = 0.937\n",
      "\n",
      "EPOCH 248 ...\n",
      "Validation Accuracy = 0.937\n",
      "\n",
      "EPOCH 249 ...\n",
      "Validation Accuracy = 0.937\n",
      "\n",
      "EPOCH 250 ...\n",
      "Validation Accuracy = 0.937\n",
      "\n",
      "EPOCH 251 ...\n",
      "Validation Accuracy = 0.937\n",
      "\n",
      "EPOCH 252 ...\n",
      "Validation Accuracy = 0.937\n",
      "\n",
      "EPOCH 253 ...\n",
      "Validation Accuracy = 0.937\n",
      "\n",
      "EPOCH 254 ...\n",
      "Validation Accuracy = 0.937\n",
      "\n",
      "EPOCH 255 ...\n",
      "Validation Accuracy = 0.937\n",
      "\n",
      "EPOCH 256 ...\n",
      "Validation Accuracy = 0.937\n",
      "\n",
      "EPOCH 257 ...\n",
      "Validation Accuracy = 0.937\n",
      "\n",
      "EPOCH 258 ...\n",
      "Validation Accuracy = 0.937\n",
      "\n",
      "EPOCH 259 ...\n",
      "Validation Accuracy = 0.937\n",
      "\n",
      "EPOCH 260 ...\n",
      "Validation Accuracy = 0.937\n",
      "\n",
      "EPOCH 261 ...\n",
      "Validation Accuracy = 0.937\n",
      "\n",
      "EPOCH 262 ...\n",
      "Validation Accuracy = 0.937\n",
      "\n",
      "EPOCH 263 ...\n",
      "Validation Accuracy = 0.937\n",
      "\n",
      "EPOCH 264 ...\n",
      "Validation Accuracy = 0.937\n",
      "\n",
      "EPOCH 265 ...\n",
      "Validation Accuracy = 0.937\n",
      "\n",
      "EPOCH 266 ...\n",
      "Validation Accuracy = 0.937\n",
      "\n",
      "EPOCH 267 ...\n",
      "Validation Accuracy = 0.937\n",
      "\n",
      "EPOCH 268 ...\n",
      "Validation Accuracy = 0.937\n",
      "\n",
      "EPOCH 269 ...\n",
      "Validation Accuracy = 0.937\n",
      "\n",
      "EPOCH 270 ...\n",
      "Validation Accuracy = 0.937\n",
      "\n",
      "EPOCH 271 ...\n",
      "Validation Accuracy = 0.937\n",
      "\n",
      "EPOCH 272 ...\n",
      "Validation Accuracy = 0.938\n",
      "\n",
      "EPOCH 273 ...\n",
      "Validation Accuracy = 0.938\n",
      "\n",
      "EPOCH 274 ...\n",
      "Validation Accuracy = 0.938\n",
      "\n",
      "EPOCH 275 ...\n",
      "Validation Accuracy = 0.938\n",
      "\n",
      "EPOCH 276 ...\n",
      "Validation Accuracy = 0.937\n",
      "\n",
      "EPOCH 277 ...\n",
      "Validation Accuracy = 0.937\n",
      "\n",
      "EPOCH 278 ...\n",
      "Validation Accuracy = 0.938\n",
      "\n",
      "EPOCH 279 ...\n",
      "Validation Accuracy = 0.937\n",
      "\n",
      "EPOCH 280 ...\n",
      "Validation Accuracy = 0.937\n",
      "\n",
      "EPOCH 281 ...\n",
      "Validation Accuracy = 0.937\n",
      "\n",
      "EPOCH 282 ...\n",
      "Validation Accuracy = 0.937\n",
      "\n",
      "EPOCH 283 ...\n",
      "Validation Accuracy = 0.937\n",
      "\n",
      "EPOCH 284 ...\n",
      "Validation Accuracy = 0.937\n",
      "\n",
      "EPOCH 285 ...\n",
      "Validation Accuracy = 0.937\n",
      "\n",
      "EPOCH 286 ...\n",
      "Validation Accuracy = 0.937\n",
      "\n",
      "EPOCH 287 ...\n",
      "Validation Accuracy = 0.937\n",
      "\n",
      "EPOCH 288 ...\n",
      "Validation Accuracy = 0.937\n",
      "\n",
      "EPOCH 289 ...\n",
      "Validation Accuracy = 0.937\n",
      "\n",
      "EPOCH 290 ...\n",
      "Validation Accuracy = 0.937\n",
      "\n",
      "EPOCH 291 ...\n",
      "Validation Accuracy = 0.937\n",
      "\n",
      "EPOCH 292 ...\n",
      "Validation Accuracy = 0.937\n",
      "\n",
      "EPOCH 293 ...\n",
      "Validation Accuracy = 0.937\n",
      "\n",
      "EPOCH 294 ...\n",
      "Validation Accuracy = 0.938\n",
      "\n",
      "EPOCH 295 ...\n",
      "Validation Accuracy = 0.937\n",
      "\n",
      "EPOCH 296 ...\n",
      "Validation Accuracy = 0.938\n",
      "\n",
      "EPOCH 297 ...\n",
      "Validation Accuracy = 0.937\n",
      "\n",
      "EPOCH 298 ...\n",
      "Validation Accuracy = 0.937\n",
      "\n",
      "EPOCH 299 ...\n",
      "Validation Accuracy = 0.937\n",
      "\n",
      "EPOCH 300 ...\n",
      "Validation Accuracy = 0.937\n",
      "\n",
      "EPOCH 301 ...\n",
      "Validation Accuracy = 0.938\n",
      "\n",
      "EPOCH 302 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 303 ...\n",
      "Validation Accuracy = 0.921\n",
      "\n",
      "EPOCH 304 ...\n",
      "Validation Accuracy = 0.923\n",
      "\n",
      "EPOCH 305 ...\n",
      "Validation Accuracy = 0.924\n",
      "\n",
      "EPOCH 306 ...\n",
      "Validation Accuracy = 0.921\n",
      "\n",
      "EPOCH 307 ...\n",
      "Validation Accuracy = 0.934\n",
      "\n",
      "EPOCH 308 ...\n",
      "Validation Accuracy = 0.935\n",
      "\n",
      "EPOCH 309 ...\n",
      "Validation Accuracy = 0.935\n",
      "\n",
      "EPOCH 310 ...\n",
      "Validation Accuracy = 0.935\n",
      "\n",
      "EPOCH 311 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 312 ...\n",
      "Validation Accuracy = 0.921\n",
      "\n",
      "EPOCH 313 ...\n",
      "Validation Accuracy = 0.914\n",
      "\n",
      "EPOCH 314 ...\n",
      "Validation Accuracy = 0.936\n",
      "\n",
      "EPOCH 315 ...\n",
      "Validation Accuracy = 0.937\n",
      "\n",
      "EPOCH 316 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 317 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 318 ...\n",
      "Validation Accuracy = 0.926\n",
      "\n",
      "EPOCH 319 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 320 ...\n",
      "Validation Accuracy = 0.934\n",
      "\n",
      "EPOCH 321 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 322 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 323 ...\n",
      "Validation Accuracy = 0.935\n",
      "\n",
      "EPOCH 324 ...\n",
      "Validation Accuracy = 0.937\n",
      "\n",
      "EPOCH 325 ...\n",
      "Validation Accuracy = 0.934\n",
      "\n",
      "EPOCH 326 ...\n",
      "Validation Accuracy = 0.926\n",
      "\n",
      "EPOCH 327 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 328 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 329 ...\n",
      "Validation Accuracy = 0.934\n",
      "\n",
      "EPOCH 330 ...\n",
      "Validation Accuracy = 0.937\n",
      "\n",
      "EPOCH 331 ...\n",
      "Validation Accuracy = 0.939\n",
      "\n",
      "EPOCH 332 ...\n",
      "Validation Accuracy = 0.941\n",
      "\n",
      "EPOCH 333 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 334 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 335 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 336 ...\n",
      "Validation Accuracy = 0.923\n",
      "\n",
      "EPOCH 337 ...\n",
      "Validation Accuracy = 0.937\n",
      "\n",
      "EPOCH 338 ...\n",
      "Validation Accuracy = 0.940\n",
      "\n",
      "EPOCH 339 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 340 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 341 ...\n",
      "Validation Accuracy = 0.928\n",
      "\n",
      "EPOCH 342 ...\n",
      "Validation Accuracy = 0.925\n",
      "\n",
      "EPOCH 343 ...\n",
      "Validation Accuracy = 0.934\n",
      "\n",
      "EPOCH 344 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 345 ...\n",
      "Validation Accuracy = 0.924\n",
      "\n",
      "EPOCH 346 ...\n",
      "Validation Accuracy = 0.916\n",
      "\n",
      "EPOCH 347 ...\n",
      "Validation Accuracy = 0.937\n",
      "\n",
      "EPOCH 348 ...\n",
      "Validation Accuracy = 0.937\n",
      "\n",
      "EPOCH 349 ...\n",
      "Validation Accuracy = 0.940\n",
      "\n",
      "EPOCH 350 ...\n",
      "Validation Accuracy = 0.940\n",
      "\n",
      "EPOCH 351 ...\n",
      "Validation Accuracy = 0.940\n",
      "\n",
      "EPOCH 352 ...\n",
      "Validation Accuracy = 0.940\n",
      "\n",
      "EPOCH 353 ...\n",
      "Validation Accuracy = 0.940\n",
      "\n",
      "EPOCH 354 ...\n",
      "Validation Accuracy = 0.940\n",
      "\n",
      "EPOCH 355 ...\n",
      "Validation Accuracy = 0.940\n",
      "\n",
      "EPOCH 356 ...\n",
      "Validation Accuracy = 0.940\n",
      "\n",
      "EPOCH 357 ...\n",
      "Validation Accuracy = 0.940\n",
      "\n",
      "EPOCH 358 ...\n",
      "Validation Accuracy = 0.940\n",
      "\n",
      "EPOCH 359 ...\n",
      "Validation Accuracy = 0.940\n",
      "\n",
      "EPOCH 360 ...\n",
      "Validation Accuracy = 0.941\n",
      "\n",
      "EPOCH 361 ...\n",
      "Validation Accuracy = 0.941\n",
      "\n",
      "EPOCH 362 ...\n",
      "Validation Accuracy = 0.941\n",
      "\n",
      "EPOCH 363 ...\n",
      "Validation Accuracy = 0.941\n",
      "\n",
      "EPOCH 364 ...\n",
      "Validation Accuracy = 0.941\n",
      "\n",
      "EPOCH 365 ...\n",
      "Validation Accuracy = 0.941\n",
      "\n",
      "EPOCH 366 ...\n",
      "Validation Accuracy = 0.941\n",
      "\n",
      "EPOCH 367 ...\n",
      "Validation Accuracy = 0.941\n",
      "\n",
      "EPOCH 368 ...\n",
      "Validation Accuracy = 0.941\n",
      "\n",
      "EPOCH 369 ...\n",
      "Validation Accuracy = 0.941\n",
      "\n",
      "EPOCH 370 ...\n",
      "Validation Accuracy = 0.942\n",
      "\n",
      "EPOCH 371 ...\n",
      "Validation Accuracy = 0.941\n",
      "\n",
      "EPOCH 372 ...\n",
      "Validation Accuracy = 0.941\n",
      "\n",
      "EPOCH 373 ...\n",
      "Validation Accuracy = 0.941\n",
      "\n",
      "EPOCH 374 ...\n",
      "Validation Accuracy = 0.941\n",
      "\n",
      "EPOCH 375 ...\n",
      "Validation Accuracy = 0.941\n",
      "\n",
      "EPOCH 376 ...\n",
      "Validation Accuracy = 0.941\n",
      "\n",
      "EPOCH 377 ...\n",
      "Validation Accuracy = 0.941\n",
      "\n",
      "EPOCH 378 ...\n",
      "Validation Accuracy = 0.941\n",
      "\n",
      "EPOCH 379 ...\n",
      "Validation Accuracy = 0.941\n",
      "\n",
      "EPOCH 380 ...\n",
      "Validation Accuracy = 0.941\n",
      "\n",
      "EPOCH 381 ...\n",
      "Validation Accuracy = 0.941\n",
      "\n",
      "EPOCH 382 ...\n",
      "Validation Accuracy = 0.941\n",
      "\n",
      "EPOCH 383 ...\n",
      "Validation Accuracy = 0.941\n",
      "\n",
      "EPOCH 384 ...\n",
      "Validation Accuracy = 0.941\n",
      "\n",
      "EPOCH 385 ...\n",
      "Validation Accuracy = 0.941\n",
      "\n",
      "EPOCH 386 ...\n",
      "Validation Accuracy = 0.941\n",
      "\n",
      "EPOCH 387 ...\n",
      "Validation Accuracy = 0.941\n",
      "\n",
      "EPOCH 388 ...\n",
      "Validation Accuracy = 0.942\n",
      "\n",
      "EPOCH 389 ...\n",
      "Validation Accuracy = 0.942\n",
      "\n",
      "EPOCH 390 ...\n",
      "Validation Accuracy = 0.942\n",
      "\n",
      "EPOCH 391 ...\n",
      "Validation Accuracy = 0.942\n",
      "\n",
      "EPOCH 392 ...\n",
      "Validation Accuracy = 0.942\n",
      "\n",
      "EPOCH 393 ...\n",
      "Validation Accuracy = 0.942\n",
      "\n",
      "EPOCH 394 ...\n",
      "Validation Accuracy = 0.942\n",
      "\n",
      "EPOCH 395 ...\n",
      "Validation Accuracy = 0.942\n",
      "\n",
      "EPOCH 396 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 397 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 398 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 399 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 400 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 401 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 402 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 403 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 404 ...\n",
      "Validation Accuracy = 0.944\n",
      "\n",
      "EPOCH 405 ...\n",
      "Validation Accuracy = 0.944\n",
      "\n",
      "EPOCH 406 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 407 ...\n",
      "Validation Accuracy = 0.944\n",
      "\n",
      "EPOCH 408 ...\n",
      "Validation Accuracy = 0.944\n",
      "\n",
      "EPOCH 409 ...\n",
      "Validation Accuracy = 0.944\n",
      "\n",
      "EPOCH 410 ...\n",
      "Validation Accuracy = 0.944\n",
      "\n",
      "EPOCH 411 ...\n",
      "Validation Accuracy = 0.944\n",
      "\n",
      "EPOCH 412 ...\n",
      "Validation Accuracy = 0.944\n",
      "\n",
      "EPOCH 413 ...\n",
      "Validation Accuracy = 0.944\n",
      "\n",
      "EPOCH 414 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 415 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 416 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 417 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 418 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 419 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 420 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 421 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 422 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 423 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 424 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 425 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 426 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 427 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 428 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 429 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 430 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 431 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 432 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 433 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 434 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 435 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 436 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 437 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 438 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 439 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 440 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 441 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 442 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 443 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 444 ...\n",
      "Validation Accuracy = 0.944\n",
      "\n",
      "EPOCH 445 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 446 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 447 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 448 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 449 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 450 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 451 ...\n",
      "Validation Accuracy = 0.942\n",
      "\n",
      "EPOCH 452 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 453 ...\n",
      "Validation Accuracy = 0.944\n",
      "\n",
      "EPOCH 454 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 455 ...\n",
      "Validation Accuracy = 0.942\n",
      "\n",
      "EPOCH 456 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 457 ...\n",
      "Validation Accuracy = 0.942\n",
      "\n",
      "EPOCH 458 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 459 ...\n",
      "Validation Accuracy = 0.942\n",
      "\n",
      "EPOCH 460 ...\n",
      "Validation Accuracy = 0.916\n",
      "\n",
      "EPOCH 461 ...\n",
      "Validation Accuracy = 0.936\n",
      "\n",
      "EPOCH 462 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 463 ...\n",
      "Validation Accuracy = 0.935\n",
      "\n",
      "EPOCH 464 ...\n",
      "Validation Accuracy = 0.937\n",
      "\n",
      "EPOCH 465 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 466 ...\n",
      "Validation Accuracy = 0.937\n",
      "\n",
      "EPOCH 467 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 468 ...\n",
      "Validation Accuracy = 0.908\n",
      "\n",
      "EPOCH 469 ...\n",
      "Validation Accuracy = 0.914\n",
      "\n",
      "EPOCH 470 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 471 ...\n",
      "Validation Accuracy = 0.936\n",
      "\n",
      "EPOCH 472 ...\n",
      "Validation Accuracy = 0.935\n",
      "\n",
      "EPOCH 473 ...\n",
      "Validation Accuracy = 0.936\n",
      "\n",
      "EPOCH 474 ...\n",
      "Validation Accuracy = 0.939\n",
      "\n",
      "EPOCH 475 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 476 ...\n",
      "Validation Accuracy = 0.934\n",
      "\n",
      "EPOCH 477 ...\n",
      "Validation Accuracy = 0.937\n",
      "\n",
      "EPOCH 478 ...\n",
      "Validation Accuracy = 0.936\n",
      "\n",
      "EPOCH 479 ...\n",
      "Validation Accuracy = 0.938\n",
      "\n",
      "EPOCH 480 ...\n",
      "Validation Accuracy = 0.936\n",
      "\n",
      "EPOCH 481 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 482 ...\n",
      "Validation Accuracy = 0.934\n",
      "\n",
      "EPOCH 483 ...\n",
      "Validation Accuracy = 0.924\n",
      "\n",
      "EPOCH 484 ...\n",
      "Validation Accuracy = 0.926\n",
      "\n",
      "EPOCH 485 ...\n",
      "Validation Accuracy = 0.940\n",
      "\n",
      "EPOCH 486 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 487 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 488 ...\n",
      "Validation Accuracy = 0.935\n",
      "\n",
      "EPOCH 489 ...\n",
      "Validation Accuracy = 0.939\n",
      "\n",
      "EPOCH 490 ...\n",
      "Validation Accuracy = 0.942\n",
      "\n",
      "EPOCH 491 ...\n",
      "Validation Accuracy = 0.939\n",
      "\n",
      "EPOCH 492 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 493 ...\n",
      "Validation Accuracy = 0.939\n",
      "\n",
      "EPOCH 494 ...\n",
      "Validation Accuracy = 0.937\n",
      "\n",
      "EPOCH 495 ...\n",
      "Validation Accuracy = 0.935\n",
      "\n",
      "EPOCH 496 ...\n",
      "Validation Accuracy = 0.913\n",
      "\n",
      "EPOCH 497 ...\n",
      "Validation Accuracy = 0.939\n",
      "\n",
      "EPOCH 498 ...\n",
      "Validation Accuracy = 0.940\n",
      "\n",
      "EPOCH 499 ...\n",
      "Validation Accuracy = 0.927\n",
      "\n",
      "EPOCH 500 ...\n",
      "Validation Accuracy = 0.922\n",
      "\n",
      "EPOCH 501 ...\n",
      "Validation Accuracy = 0.938\n",
      "\n",
      "EPOCH 502 ...\n",
      "Validation Accuracy = 0.935\n",
      "\n",
      "EPOCH 503 ...\n",
      "Validation Accuracy = 0.920\n",
      "\n",
      "EPOCH 504 ...\n",
      "Validation Accuracy = 0.925\n",
      "\n",
      "EPOCH 505 ...\n",
      "Validation Accuracy = 0.934\n",
      "\n",
      "EPOCH 506 ...\n",
      "Validation Accuracy = 0.939\n",
      "\n",
      "EPOCH 507 ...\n",
      "Validation Accuracy = 0.936\n",
      "\n",
      "EPOCH 508 ...\n",
      "Validation Accuracy = 0.936\n",
      "\n",
      "EPOCH 509 ...\n",
      "Validation Accuracy = 0.934\n",
      "\n",
      "EPOCH 510 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 511 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 512 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 513 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 514 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 515 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 516 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 517 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 518 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 519 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 520 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 521 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 522 ...\n",
      "Validation Accuracy = 0.926\n",
      "\n",
      "EPOCH 523 ...\n",
      "Validation Accuracy = 0.942\n",
      "\n",
      "EPOCH 524 ...\n",
      "Validation Accuracy = 0.945\n",
      "\n",
      "EPOCH 525 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 526 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 527 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 528 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 529 ...\n",
      "Validation Accuracy = 0.934\n",
      "\n",
      "EPOCH 530 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 531 ...\n",
      "Validation Accuracy = 0.920\n",
      "\n",
      "EPOCH 532 ...\n",
      "Validation Accuracy = 0.922\n",
      "\n",
      "EPOCH 533 ...\n",
      "Validation Accuracy = 0.935\n",
      "\n",
      "EPOCH 534 ...\n",
      "Validation Accuracy = 0.938\n",
      "\n",
      "EPOCH 535 ...\n",
      "Validation Accuracy = 0.923\n",
      "\n",
      "EPOCH 536 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 537 ...\n",
      "Validation Accuracy = 0.938\n",
      "\n",
      "EPOCH 538 ...\n",
      "Validation Accuracy = 0.934\n",
      "\n",
      "EPOCH 539 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 540 ...\n",
      "Validation Accuracy = 0.928\n",
      "\n",
      "EPOCH 541 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 542 ...\n",
      "Validation Accuracy = 0.936\n",
      "\n",
      "EPOCH 543 ...\n",
      "Validation Accuracy = 0.935\n",
      "\n",
      "EPOCH 544 ...\n",
      "Validation Accuracy = 0.942\n",
      "\n",
      "EPOCH 545 ...\n",
      "Validation Accuracy = 0.944\n",
      "\n",
      "EPOCH 546 ...\n",
      "Validation Accuracy = 0.926\n",
      "\n",
      "EPOCH 547 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 548 ...\n",
      "Validation Accuracy = 0.921\n",
      "\n",
      "EPOCH 549 ...\n",
      "Validation Accuracy = 0.926\n",
      "\n",
      "EPOCH 550 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 551 ...\n",
      "Validation Accuracy = 0.921\n",
      "\n",
      "EPOCH 552 ...\n",
      "Validation Accuracy = 0.939\n",
      "\n",
      "EPOCH 553 ...\n",
      "Validation Accuracy = 0.942\n",
      "\n",
      "EPOCH 554 ...\n",
      "Validation Accuracy = 0.937\n",
      "\n",
      "EPOCH 555 ...\n",
      "Validation Accuracy = 0.925\n",
      "\n",
      "EPOCH 556 ...\n",
      "Validation Accuracy = 0.941\n",
      "\n",
      "EPOCH 557 ...\n",
      "Validation Accuracy = 0.946\n",
      "\n",
      "EPOCH 558 ...\n",
      "Validation Accuracy = 0.947\n",
      "\n",
      "EPOCH 559 ...\n",
      "Validation Accuracy = 0.947\n",
      "\n",
      "EPOCH 560 ...\n",
      "Validation Accuracy = 0.947\n",
      "\n",
      "EPOCH 561 ...\n",
      "Validation Accuracy = 0.947\n",
      "\n",
      "EPOCH 562 ...\n",
      "Validation Accuracy = 0.947\n",
      "\n",
      "EPOCH 563 ...\n",
      "Validation Accuracy = 0.947\n",
      "\n",
      "EPOCH 564 ...\n",
      "Validation Accuracy = 0.947\n",
      "\n",
      "EPOCH 565 ...\n",
      "Validation Accuracy = 0.947\n",
      "\n",
      "EPOCH 566 ...\n",
      "Validation Accuracy = 0.947\n",
      "\n",
      "EPOCH 567 ...\n",
      "Validation Accuracy = 0.947\n",
      "\n",
      "EPOCH 568 ...\n",
      "Validation Accuracy = 0.947\n",
      "\n",
      "EPOCH 569 ...\n",
      "Validation Accuracy = 0.947\n",
      "\n",
      "EPOCH 570 ...\n",
      "Validation Accuracy = 0.947\n",
      "\n",
      "EPOCH 571 ...\n",
      "Validation Accuracy = 0.947\n",
      "\n",
      "EPOCH 572 ...\n",
      "Validation Accuracy = 0.947\n",
      "\n",
      "EPOCH 573 ...\n",
      "Validation Accuracy = 0.947\n",
      "\n",
      "EPOCH 574 ...\n",
      "Validation Accuracy = 0.947\n",
      "\n",
      "EPOCH 575 ...\n",
      "Validation Accuracy = 0.947\n",
      "\n",
      "EPOCH 576 ...\n",
      "Validation Accuracy = 0.947\n",
      "\n",
      "EPOCH 577 ...\n",
      "Validation Accuracy = 0.947\n",
      "\n",
      "EPOCH 578 ...\n",
      "Validation Accuracy = 0.947\n",
      "\n",
      "EPOCH 579 ...\n",
      "Validation Accuracy = 0.947\n",
      "\n",
      "EPOCH 580 ...\n",
      "Validation Accuracy = 0.947\n",
      "\n",
      "EPOCH 581 ...\n",
      "Validation Accuracy = 0.947\n",
      "\n",
      "EPOCH 582 ...\n",
      "Validation Accuracy = 0.947\n",
      "\n",
      "EPOCH 583 ...\n",
      "Validation Accuracy = 0.947\n",
      "\n",
      "EPOCH 584 ...\n",
      "Validation Accuracy = 0.947\n",
      "\n",
      "EPOCH 585 ...\n",
      "Validation Accuracy = 0.947\n",
      "\n",
      "EPOCH 586 ...\n",
      "Validation Accuracy = 0.947\n",
      "\n",
      "EPOCH 587 ...\n",
      "Validation Accuracy = 0.947\n",
      "\n",
      "EPOCH 588 ...\n",
      "Validation Accuracy = 0.947\n",
      "\n",
      "EPOCH 589 ...\n",
      "Validation Accuracy = 0.947\n",
      "\n",
      "EPOCH 590 ...\n",
      "Validation Accuracy = 0.947\n",
      "\n",
      "EPOCH 591 ...\n",
      "Validation Accuracy = 0.947\n",
      "\n",
      "EPOCH 592 ...\n",
      "Validation Accuracy = 0.947\n",
      "\n",
      "EPOCH 593 ...\n",
      "Validation Accuracy = 0.947\n",
      "\n",
      "EPOCH 594 ...\n",
      "Validation Accuracy = 0.947\n",
      "\n",
      "EPOCH 595 ...\n",
      "Validation Accuracy = 0.947\n",
      "\n",
      "EPOCH 596 ...\n",
      "Validation Accuracy = 0.947\n",
      "\n",
      "EPOCH 597 ...\n",
      "Validation Accuracy = 0.947\n",
      "\n",
      "EPOCH 598 ...\n",
      "Validation Accuracy = 0.947\n",
      "\n",
      "EPOCH 599 ...\n",
      "Validation Accuracy = 0.947\n",
      "\n",
      "EPOCH 600 ...\n",
      "Validation Accuracy = 0.947\n",
      "\n",
      "EPOCH 601 ...\n",
      "Validation Accuracy = 0.947\n",
      "\n",
      "EPOCH 602 ...\n",
      "Validation Accuracy = 0.947\n",
      "\n",
      "EPOCH 603 ...\n",
      "Validation Accuracy = 0.947\n",
      "\n",
      "EPOCH 604 ...\n",
      "Validation Accuracy = 0.947\n",
      "\n",
      "EPOCH 605 ...\n",
      "Validation Accuracy = 0.947\n",
      "\n",
      "EPOCH 606 ...\n",
      "Validation Accuracy = 0.947\n",
      "\n",
      "EPOCH 607 ...\n",
      "Validation Accuracy = 0.947\n",
      "\n",
      "EPOCH 608 ...\n",
      "Validation Accuracy = 0.947\n",
      "\n",
      "EPOCH 609 ...\n",
      "Validation Accuracy = 0.947\n",
      "\n",
      "EPOCH 610 ...\n",
      "Validation Accuracy = 0.947\n",
      "\n",
      "EPOCH 611 ...\n",
      "Validation Accuracy = 0.948\n",
      "\n",
      "EPOCH 612 ...\n",
      "Validation Accuracy = 0.948\n",
      "\n",
      "EPOCH 613 ...\n",
      "Validation Accuracy = 0.948\n",
      "\n",
      "EPOCH 614 ...\n",
      "Validation Accuracy = 0.948\n",
      "\n",
      "EPOCH 615 ...\n",
      "Validation Accuracy = 0.948\n",
      "\n",
      "EPOCH 616 ...\n",
      "Validation Accuracy = 0.948\n",
      "\n",
      "EPOCH 617 ...\n",
      "Validation Accuracy = 0.948\n",
      "\n",
      "EPOCH 618 ...\n",
      "Validation Accuracy = 0.948\n",
      "\n",
      "EPOCH 619 ...\n",
      "Validation Accuracy = 0.948\n",
      "\n",
      "EPOCH 620 ...\n",
      "Validation Accuracy = 0.948\n",
      "\n",
      "EPOCH 621 ...\n",
      "Validation Accuracy = 0.948\n",
      "\n",
      "EPOCH 622 ...\n",
      "Validation Accuracy = 0.948\n",
      "\n",
      "EPOCH 623 ...\n",
      "Validation Accuracy = 0.948\n",
      "\n",
      "EPOCH 624 ...\n",
      "Validation Accuracy = 0.948\n",
      "\n",
      "EPOCH 625 ...\n",
      "Validation Accuracy = 0.948\n",
      "\n",
      "EPOCH 626 ...\n",
      "Validation Accuracy = 0.948\n",
      "\n",
      "EPOCH 627 ...\n",
      "Validation Accuracy = 0.948\n",
      "\n",
      "EPOCH 628 ...\n",
      "Validation Accuracy = 0.948\n",
      "\n",
      "EPOCH 629 ...\n",
      "Validation Accuracy = 0.948\n",
      "\n",
      "EPOCH 630 ...\n",
      "Validation Accuracy = 0.948\n",
      "\n",
      "EPOCH 631 ...\n",
      "Validation Accuracy = 0.948\n",
      "\n",
      "EPOCH 632 ...\n",
      "Validation Accuracy = 0.948\n",
      "\n",
      "EPOCH 633 ...\n",
      "Validation Accuracy = 0.948\n",
      "\n",
      "EPOCH 634 ...\n",
      "Validation Accuracy = 0.948\n",
      "\n",
      "EPOCH 635 ...\n",
      "Validation Accuracy = 0.948\n",
      "\n",
      "EPOCH 636 ...\n",
      "Validation Accuracy = 0.948\n",
      "\n",
      "EPOCH 637 ...\n",
      "Validation Accuracy = 0.948\n",
      "\n",
      "EPOCH 638 ...\n",
      "Validation Accuracy = 0.948\n",
      "\n",
      "EPOCH 639 ...\n",
      "Validation Accuracy = 0.948\n",
      "\n",
      "EPOCH 640 ...\n",
      "Validation Accuracy = 0.948\n",
      "\n",
      "EPOCH 641 ...\n",
      "Validation Accuracy = 0.948\n",
      "\n",
      "EPOCH 642 ...\n",
      "Validation Accuracy = 0.948\n",
      "\n",
      "EPOCH 643 ...\n",
      "Validation Accuracy = 0.948\n",
      "\n",
      "EPOCH 644 ...\n",
      "Validation Accuracy = 0.948\n",
      "\n",
      "EPOCH 645 ...\n",
      "Validation Accuracy = 0.948\n",
      "\n",
      "EPOCH 646 ...\n",
      "Validation Accuracy = 0.948\n",
      "\n",
      "EPOCH 647 ...\n",
      "Validation Accuracy = 0.948\n",
      "\n",
      "EPOCH 648 ...\n",
      "Validation Accuracy = 0.948\n",
      "\n",
      "EPOCH 649 ...\n",
      "Validation Accuracy = 0.948\n",
      "\n",
      "EPOCH 650 ...\n",
      "Validation Accuracy = 0.948\n",
      "\n",
      "EPOCH 651 ...\n",
      "Validation Accuracy = 0.948\n",
      "\n",
      "EPOCH 652 ...\n",
      "Validation Accuracy = 0.948\n",
      "\n",
      "EPOCH 653 ...\n",
      "Validation Accuracy = 0.948\n",
      "\n",
      "EPOCH 654 ...\n",
      "Validation Accuracy = 0.948\n",
      "\n",
      "EPOCH 655 ...\n",
      "Validation Accuracy = 0.948\n",
      "\n",
      "EPOCH 656 ...\n",
      "Validation Accuracy = 0.948\n",
      "\n",
      "EPOCH 657 ...\n",
      "Validation Accuracy = 0.947\n",
      "\n",
      "EPOCH 658 ...\n",
      "Validation Accuracy = 0.947\n",
      "\n",
      "EPOCH 659 ...\n",
      "Validation Accuracy = 0.948\n",
      "\n",
      "EPOCH 660 ...\n",
      "Validation Accuracy = 0.948\n",
      "\n",
      "EPOCH 661 ...\n",
      "Validation Accuracy = 0.947\n",
      "\n",
      "EPOCH 662 ...\n",
      "Validation Accuracy = 0.947\n",
      "\n",
      "EPOCH 663 ...\n",
      "Validation Accuracy = 0.948\n",
      "\n",
      "EPOCH 664 ...\n",
      "Validation Accuracy = 0.948\n",
      "\n",
      "EPOCH 665 ...\n",
      "Validation Accuracy = 0.948\n",
      "\n",
      "EPOCH 666 ...\n",
      "Validation Accuracy = 0.948\n",
      "\n",
      "EPOCH 667 ...\n",
      "Validation Accuracy = 0.947\n",
      "\n",
      "EPOCH 668 ...\n",
      "Validation Accuracy = 0.947\n",
      "\n",
      "EPOCH 669 ...\n",
      "Validation Accuracy = 0.947\n",
      "\n",
      "EPOCH 670 ...\n",
      "Validation Accuracy = 0.948\n",
      "\n",
      "EPOCH 671 ...\n",
      "Validation Accuracy = 0.947\n",
      "\n",
      "EPOCH 672 ...\n",
      "Validation Accuracy = 0.948\n",
      "\n",
      "EPOCH 673 ...\n",
      "Validation Accuracy = 0.947\n",
      "\n",
      "EPOCH 674 ...\n",
      "Validation Accuracy = 0.947\n",
      "\n",
      "EPOCH 675 ...\n",
      "Validation Accuracy = 0.947\n",
      "\n",
      "EPOCH 676 ...\n",
      "Validation Accuracy = 0.947\n",
      "\n",
      "EPOCH 677 ...\n",
      "Validation Accuracy = 0.912\n",
      "\n",
      "EPOCH 678 ...\n",
      "Validation Accuracy = 0.934\n",
      "\n",
      "EPOCH 679 ...\n",
      "Validation Accuracy = 0.928\n",
      "\n",
      "EPOCH 680 ...\n",
      "Validation Accuracy = 0.936\n",
      "\n",
      "EPOCH 681 ...\n",
      "Validation Accuracy = 0.940\n",
      "\n",
      "EPOCH 682 ...\n",
      "Validation Accuracy = 0.942\n",
      "\n",
      "EPOCH 683 ...\n",
      "Validation Accuracy = 0.927\n",
      "\n",
      "EPOCH 684 ...\n",
      "Validation Accuracy = 0.938\n",
      "\n",
      "EPOCH 685 ...\n",
      "Validation Accuracy = 0.940\n",
      "\n",
      "EPOCH 686 ...\n",
      "Validation Accuracy = 0.925\n",
      "\n",
      "EPOCH 687 ...\n",
      "Validation Accuracy = 0.927\n",
      "\n",
      "EPOCH 688 ...\n",
      "Validation Accuracy = 0.937\n",
      "\n",
      "EPOCH 689 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 690 ...\n",
      "Validation Accuracy = 0.935\n",
      "\n",
      "EPOCH 691 ...\n",
      "Validation Accuracy = 0.934\n",
      "\n",
      "EPOCH 692 ...\n",
      "Validation Accuracy = 0.937\n",
      "\n",
      "EPOCH 693 ...\n",
      "Validation Accuracy = 0.935\n",
      "\n",
      "EPOCH 694 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 695 ...\n",
      "Validation Accuracy = 0.937\n",
      "\n",
      "EPOCH 696 ...\n",
      "Validation Accuracy = 0.919\n",
      "\n",
      "EPOCH 697 ...\n",
      "Validation Accuracy = 0.938\n",
      "\n",
      "EPOCH 698 ...\n",
      "Validation Accuracy = 0.939\n",
      "\n",
      "EPOCH 699 ...\n",
      "Validation Accuracy = 0.941\n",
      "\n",
      "EPOCH 700 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 701 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 702 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 703 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 704 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 705 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 706 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 707 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 708 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 709 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 710 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 711 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 712 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 713 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 714 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 715 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 716 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 717 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 718 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 719 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 720 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 721 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 722 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 723 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 724 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 725 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 726 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 727 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 728 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 729 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 730 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 731 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 732 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 733 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 734 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 735 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 736 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 737 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 738 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 739 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 740 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 741 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 742 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 743 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 744 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 745 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 746 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 747 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 748 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 749 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 750 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 751 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 752 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 753 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 754 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 755 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 756 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 757 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 758 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 759 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 760 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 761 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 762 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 763 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 764 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 765 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 766 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 767 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 768 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 769 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 770 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 771 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 772 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 773 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 774 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 775 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 776 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 777 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 778 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 779 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 780 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 781 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 782 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 783 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 784 ...\n",
      "Validation Accuracy = 0.943\n",
      "\n",
      "EPOCH 785 ...\n",
      "Validation Accuracy = 0.944\n",
      "\n",
      "EPOCH 786 ...\n",
      "Validation Accuracy = 0.944\n",
      "\n",
      "EPOCH 787 ...\n",
      "Validation Accuracy = 0.944\n",
      "\n",
      "EPOCH 788 ...\n",
      "Validation Accuracy = 0.944\n",
      "\n",
      "EPOCH 789 ...\n",
      "Validation Accuracy = 0.944\n",
      "\n",
      "EPOCH 790 ...\n",
      "Validation Accuracy = 0.944\n",
      "\n",
      "EPOCH 791 ...\n",
      "Validation Accuracy = 0.944\n",
      "\n",
      "EPOCH 792 ...\n",
      "Validation Accuracy = 0.944\n",
      "\n",
      "EPOCH 793 ...\n",
      "Validation Accuracy = 0.944\n",
      "\n",
      "EPOCH 794 ...\n",
      "Validation Accuracy = 0.944\n",
      "\n",
      "EPOCH 795 ...\n",
      "Validation Accuracy = 0.944\n",
      "\n",
      "EPOCH 796 ...\n",
      "Validation Accuracy = 0.944\n",
      "\n",
      "EPOCH 797 ...\n",
      "Validation Accuracy = 0.944\n",
      "\n",
      "EPOCH 798 ...\n",
      "Validation Accuracy = 0.944\n",
      "\n",
      "EPOCH 799 ...\n",
      "Validation Accuracy = 0.944\n",
      "\n",
      "EPOCH 800 ...\n",
      "Validation Accuracy = 0.944\n",
      "\n",
      "EPOCH 801 ...\n",
      "Validation Accuracy = 0.944\n",
      "\n",
      "EPOCH 802 ...\n",
      "Validation Accuracy = 0.944\n",
      "\n",
      "EPOCH 803 ...\n",
      "Validation Accuracy = 0.944\n",
      "\n",
      "EPOCH 804 ...\n",
      "Validation Accuracy = 0.944\n",
      "\n",
      "EPOCH 805 ...\n",
      "Validation Accuracy = 0.945\n",
      "\n",
      "EPOCH 806 ...\n",
      "Validation Accuracy = 0.945\n",
      "\n",
      "EPOCH 807 ...\n",
      "Validation Accuracy = 0.945\n",
      "\n",
      "EPOCH 808 ...\n",
      "Validation Accuracy = 0.945\n",
      "\n",
      "EPOCH 809 ...\n",
      "Validation Accuracy = 0.945\n",
      "\n",
      "EPOCH 810 ...\n",
      "Validation Accuracy = 0.945\n",
      "\n",
      "EPOCH 811 ...\n",
      "Validation Accuracy = 0.945\n",
      "\n",
      "EPOCH 812 ...\n",
      "Validation Accuracy = 0.945\n",
      "\n",
      "EPOCH 813 ...\n",
      "Validation Accuracy = 0.945\n",
      "\n",
      "EPOCH 814 ...\n",
      "Validation Accuracy = 0.945\n",
      "\n",
      "EPOCH 815 ...\n",
      "Validation Accuracy = 0.945\n",
      "\n",
      "EPOCH 816 ...\n",
      "Validation Accuracy = 0.945\n",
      "\n",
      "EPOCH 817 ...\n",
      "Validation Accuracy = 0.945\n",
      "\n",
      "EPOCH 818 ...\n",
      "Validation Accuracy = 0.945\n",
      "\n",
      "EPOCH 819 ...\n",
      "Validation Accuracy = 0.945\n",
      "\n",
      "EPOCH 820 ...\n",
      "Validation Accuracy = 0.945\n",
      "\n",
      "EPOCH 821 ...\n",
      "Validation Accuracy = 0.918\n",
      "\n",
      "EPOCH 822 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 823 ...\n",
      "Validation Accuracy = 0.937\n",
      "\n",
      "EPOCH 824 ...\n",
      "Validation Accuracy = 0.940\n",
      "\n",
      "EPOCH 825 ...\n",
      "Validation Accuracy = 0.938\n",
      "\n",
      "EPOCH 826 ...\n",
      "Validation Accuracy = 0.926\n",
      "\n",
      "EPOCH 827 ...\n",
      "Validation Accuracy = 0.936\n",
      "\n",
      "EPOCH 828 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 829 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 830 ...\n",
      "Validation Accuracy = 0.940\n",
      "\n",
      "EPOCH 831 ...\n",
      "Validation Accuracy = 0.938\n",
      "\n",
      "EPOCH 832 ...\n",
      "Validation Accuracy = 0.940\n",
      "\n",
      "EPOCH 833 ...\n",
      "Validation Accuracy = 0.940\n",
      "\n",
      "EPOCH 834 ...\n",
      "Validation Accuracy = 0.940\n",
      "\n",
      "EPOCH 835 ...\n",
      "Validation Accuracy = 0.940\n",
      "\n",
      "EPOCH 836 ...\n",
      "Validation Accuracy = 0.940\n",
      "\n",
      "EPOCH 837 ...\n",
      "Validation Accuracy = 0.940\n",
      "\n",
      "EPOCH 838 ...\n",
      "Validation Accuracy = 0.940\n",
      "\n",
      "EPOCH 839 ...\n",
      "Validation Accuracy = 0.940\n",
      "\n",
      "EPOCH 840 ...\n",
      "Validation Accuracy = 0.940\n",
      "\n",
      "EPOCH 841 ...\n",
      "Validation Accuracy = 0.940\n",
      "\n",
      "EPOCH 842 ...\n",
      "Validation Accuracy = 0.939\n",
      "\n",
      "EPOCH 843 ...\n",
      "Validation Accuracy = 0.939\n",
      "\n",
      "EPOCH 844 ...\n",
      "Validation Accuracy = 0.939\n",
      "\n",
      "EPOCH 845 ...\n",
      "Validation Accuracy = 0.939\n",
      "\n",
      "EPOCH 846 ...\n",
      "Validation Accuracy = 0.939\n",
      "\n",
      "EPOCH 847 ...\n",
      "Validation Accuracy = 0.939\n",
      "\n",
      "EPOCH 848 ...\n",
      "Validation Accuracy = 0.939\n",
      "\n",
      "EPOCH 849 ...\n",
      "Validation Accuracy = 0.939\n",
      "\n",
      "EPOCH 850 ...\n",
      "Validation Accuracy = 0.939\n",
      "\n",
      "EPOCH 851 ...\n",
      "Validation Accuracy = 0.939\n",
      "\n",
      "EPOCH 852 ...\n",
      "Validation Accuracy = 0.939\n",
      "\n",
      "EPOCH 853 ...\n",
      "Validation Accuracy = 0.939\n",
      "\n",
      "EPOCH 854 ...\n",
      "Validation Accuracy = 0.939\n",
      "\n",
      "EPOCH 855 ...\n",
      "Validation Accuracy = 0.939\n",
      "\n",
      "EPOCH 856 ...\n",
      "Validation Accuracy = 0.939\n",
      "\n",
      "EPOCH 857 ...\n",
      "Validation Accuracy = 0.939\n",
      "\n",
      "EPOCH 858 ...\n",
      "Validation Accuracy = 0.939\n",
      "\n",
      "EPOCH 859 ...\n",
      "Validation Accuracy = 0.939\n",
      "\n",
      "EPOCH 860 ...\n",
      "Validation Accuracy = 0.939\n",
      "\n",
      "EPOCH 861 ...\n",
      "Validation Accuracy = 0.939\n",
      "\n",
      "EPOCH 862 ...\n",
      "Validation Accuracy = 0.939\n",
      "\n",
      "EPOCH 863 ...\n",
      "Validation Accuracy = 0.939\n",
      "\n",
      "EPOCH 864 ...\n",
      "Validation Accuracy = 0.939\n",
      "\n",
      "EPOCH 865 ...\n",
      "Validation Accuracy = 0.939\n",
      "\n",
      "EPOCH 866 ...\n",
      "Validation Accuracy = 0.939\n",
      "\n",
      "EPOCH 867 ...\n",
      "Validation Accuracy = 0.939\n",
      "\n",
      "EPOCH 868 ...\n",
      "Validation Accuracy = 0.939\n",
      "\n",
      "EPOCH 869 ...\n",
      "Validation Accuracy = 0.939\n",
      "\n",
      "EPOCH 870 ...\n",
      "Validation Accuracy = 0.938\n",
      "\n",
      "EPOCH 871 ...\n",
      "Validation Accuracy = 0.938\n",
      "\n",
      "EPOCH 872 ...\n",
      "Validation Accuracy = 0.938\n",
      "\n",
      "EPOCH 873 ...\n",
      "Validation Accuracy = 0.938\n",
      "\n",
      "EPOCH 874 ...\n",
      "Validation Accuracy = 0.938\n",
      "\n",
      "EPOCH 875 ...\n",
      "Validation Accuracy = 0.938\n",
      "\n",
      "EPOCH 876 ...\n",
      "Validation Accuracy = 0.938\n",
      "\n",
      "EPOCH 877 ...\n",
      "Validation Accuracy = 0.938\n",
      "\n",
      "EPOCH 878 ...\n",
      "Validation Accuracy = 0.938\n",
      "\n",
      "EPOCH 879 ...\n",
      "Validation Accuracy = 0.939\n",
      "\n",
      "EPOCH 880 ...\n",
      "Validation Accuracy = 0.939\n",
      "\n",
      "EPOCH 881 ...\n",
      "Validation Accuracy = 0.939\n",
      "\n",
      "EPOCH 882 ...\n",
      "Validation Accuracy = 0.939\n",
      "\n",
      "EPOCH 883 ...\n",
      "Validation Accuracy = 0.939\n",
      "\n",
      "EPOCH 884 ...\n",
      "Validation Accuracy = 0.939\n",
      "\n",
      "EPOCH 885 ...\n",
      "Validation Accuracy = 0.939\n",
      "\n",
      "EPOCH 886 ...\n",
      "Validation Accuracy = 0.939\n",
      "\n",
      "EPOCH 887 ...\n",
      "Validation Accuracy = 0.939\n",
      "\n",
      "EPOCH 888 ...\n",
      "Validation Accuracy = 0.939\n",
      "\n",
      "EPOCH 889 ...\n",
      "Validation Accuracy = 0.939\n",
      "\n",
      "EPOCH 890 ...\n",
      "Validation Accuracy = 0.939\n",
      "\n",
      "EPOCH 891 ...\n",
      "Validation Accuracy = 0.939\n",
      "\n",
      "EPOCH 892 ...\n",
      "Validation Accuracy = 0.939\n",
      "\n",
      "EPOCH 893 ...\n",
      "Validation Accuracy = 0.939\n",
      "\n",
      "EPOCH 894 ...\n",
      "Validation Accuracy = 0.939\n",
      "\n",
      "EPOCH 895 ...\n",
      "Validation Accuracy = 0.939\n",
      "\n",
      "EPOCH 896 ...\n",
      "Validation Accuracy = 0.939\n",
      "\n",
      "EPOCH 897 ...\n",
      "Validation Accuracy = 0.939\n",
      "\n",
      "EPOCH 898 ...\n",
      "Validation Accuracy = 0.939\n",
      "\n",
      "EPOCH 899 ...\n",
      "Validation Accuracy = 0.939\n",
      "\n",
      "EPOCH 900 ...\n",
      "Validation Accuracy = 0.939\n",
      "\n",
      "EPOCH 901 ...\n",
      "Validation Accuracy = 0.939\n",
      "\n",
      "EPOCH 902 ...\n",
      "Validation Accuracy = 0.939\n",
      "\n",
      "EPOCH 903 ...\n",
      "Validation Accuracy = 0.939\n",
      "\n",
      "EPOCH 904 ...\n",
      "Validation Accuracy = 0.939\n",
      "\n",
      "EPOCH 905 ...\n",
      "Validation Accuracy = 0.939\n",
      "\n",
      "EPOCH 906 ...\n",
      "Validation Accuracy = 0.939\n",
      "\n",
      "EPOCH 907 ...\n",
      "Validation Accuracy = 0.939\n",
      "\n",
      "EPOCH 908 ...\n",
      "Validation Accuracy = 0.939\n",
      "\n",
      "EPOCH 909 ...\n",
      "Validation Accuracy = 0.939\n",
      "\n",
      "EPOCH 910 ...\n",
      "Validation Accuracy = 0.939\n",
      "\n",
      "EPOCH 911 ...\n",
      "Validation Accuracy = 0.939\n",
      "\n",
      "EPOCH 912 ...\n",
      "Validation Accuracy = 0.939\n",
      "\n",
      "EPOCH 913 ...\n",
      "Validation Accuracy = 0.939\n",
      "\n",
      "EPOCH 914 ...\n",
      "Validation Accuracy = 0.940\n",
      "\n",
      "EPOCH 915 ...\n",
      "Validation Accuracy = 0.940\n",
      "\n",
      "EPOCH 916 ...\n",
      "Validation Accuracy = 0.940\n",
      "\n",
      "EPOCH 917 ...\n",
      "Validation Accuracy = 0.940\n",
      "\n",
      "EPOCH 918 ...\n",
      "Validation Accuracy = 0.940\n",
      "\n",
      "EPOCH 919 ...\n",
      "Validation Accuracy = 0.940\n",
      "\n",
      "EPOCH 920 ...\n",
      "Validation Accuracy = 0.940\n",
      "\n",
      "EPOCH 921 ...\n",
      "Validation Accuracy = 0.940\n",
      "\n",
      "EPOCH 922 ...\n",
      "Validation Accuracy = 0.940\n",
      "\n",
      "EPOCH 923 ...\n",
      "Validation Accuracy = 0.940\n",
      "\n",
      "EPOCH 924 ...\n",
      "Validation Accuracy = 0.940\n",
      "\n",
      "EPOCH 925 ...\n",
      "Validation Accuracy = 0.941\n",
      "\n",
      "EPOCH 926 ...\n",
      "Validation Accuracy = 0.941\n",
      "\n",
      "EPOCH 927 ...\n",
      "Validation Accuracy = 0.941\n",
      "\n",
      "EPOCH 928 ...\n",
      "Validation Accuracy = 0.940\n",
      "\n",
      "EPOCH 929 ...\n",
      "Validation Accuracy = 0.940\n",
      "\n",
      "EPOCH 930 ...\n",
      "Validation Accuracy = 0.940\n",
      "\n",
      "EPOCH 931 ...\n",
      "Validation Accuracy = 0.940\n",
      "\n",
      "EPOCH 932 ...\n",
      "Validation Accuracy = 0.941\n",
      "\n",
      "EPOCH 933 ...\n",
      "Validation Accuracy = 0.941\n",
      "\n",
      "EPOCH 934 ...\n",
      "Validation Accuracy = 0.941\n",
      "\n",
      "EPOCH 935 ...\n",
      "Validation Accuracy = 0.941\n",
      "\n",
      "EPOCH 936 ...\n",
      "Validation Accuracy = 0.941\n",
      "\n",
      "EPOCH 937 ...\n",
      "Validation Accuracy = 0.941\n",
      "\n",
      "EPOCH 938 ...\n",
      "Validation Accuracy = 0.941\n",
      "\n",
      "EPOCH 939 ...\n",
      "Validation Accuracy = 0.941\n",
      "\n",
      "EPOCH 940 ...\n",
      "Validation Accuracy = 0.941\n",
      "\n",
      "EPOCH 941 ...\n",
      "Validation Accuracy = 0.941\n",
      "\n",
      "EPOCH 942 ...\n",
      "Validation Accuracy = 0.940\n",
      "\n",
      "EPOCH 943 ...\n",
      "Validation Accuracy = 0.940\n",
      "\n",
      "EPOCH 944 ...\n",
      "Validation Accuracy = 0.940\n",
      "\n",
      "EPOCH 945 ...\n",
      "Validation Accuracy = 0.940\n",
      "\n",
      "EPOCH 946 ...\n",
      "Validation Accuracy = 0.940\n",
      "\n",
      "EPOCH 947 ...\n",
      "Validation Accuracy = 0.940\n",
      "\n",
      "EPOCH 948 ...\n",
      "Validation Accuracy = 0.940\n",
      "\n",
      "EPOCH 949 ...\n",
      "Validation Accuracy = 0.940\n",
      "\n",
      "EPOCH 950 ...\n",
      "Validation Accuracy = 0.940\n",
      "\n",
      "EPOCH 951 ...\n",
      "Validation Accuracy = 0.940\n",
      "\n",
      "EPOCH 952 ...\n",
      "Validation Accuracy = 0.940\n",
      "\n",
      "EPOCH 953 ...\n",
      "Validation Accuracy = 0.940\n",
      "\n",
      "EPOCH 954 ...\n",
      "Validation Accuracy = 0.940\n",
      "\n",
      "EPOCH 955 ...\n",
      "Validation Accuracy = 0.940\n",
      "\n",
      "EPOCH 956 ...\n",
      "Validation Accuracy = 0.940\n",
      "\n",
      "EPOCH 957 ...\n",
      "Validation Accuracy = 0.940\n",
      "\n",
      "EPOCH 958 ...\n",
      "Validation Accuracy = 0.940\n",
      "\n",
      "EPOCH 959 ...\n",
      "Validation Accuracy = 0.940\n",
      "\n",
      "EPOCH 960 ...\n",
      "Validation Accuracy = 0.940\n",
      "\n",
      "EPOCH 961 ...\n",
      "Validation Accuracy = 0.940\n",
      "\n",
      "EPOCH 962 ...\n",
      "Validation Accuracy = 0.940\n",
      "\n",
      "EPOCH 963 ...\n",
      "Validation Accuracy = 0.940\n",
      "\n",
      "EPOCH 964 ...\n",
      "Validation Accuracy = 0.940\n",
      "\n",
      "EPOCH 965 ...\n",
      "Validation Accuracy = 0.940\n",
      "\n",
      "EPOCH 966 ...\n",
      "Validation Accuracy = 0.941\n",
      "\n",
      "EPOCH 967 ...\n",
      "Validation Accuracy = 0.940\n",
      "\n",
      "EPOCH 968 ...\n",
      "Validation Accuracy = 0.940\n",
      "\n",
      "EPOCH 969 ...\n",
      "Validation Accuracy = 0.941\n",
      "\n",
      "EPOCH 970 ...\n",
      "Validation Accuracy = 0.941\n",
      "\n",
      "EPOCH 971 ...\n",
      "Validation Accuracy = 0.940\n",
      "\n",
      "EPOCH 972 ...\n",
      "Validation Accuracy = 0.941\n",
      "\n",
      "EPOCH 973 ...\n",
      "Validation Accuracy = 0.941\n",
      "\n",
      "EPOCH 974 ...\n",
      "Validation Accuracy = 0.912\n",
      "\n",
      "EPOCH 975 ...\n",
      "Validation Accuracy = 0.915\n",
      "\n",
      "EPOCH 976 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 977 ...\n",
      "Validation Accuracy = 0.927\n",
      "\n",
      "EPOCH 978 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 979 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 980 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 981 ...\n",
      "Validation Accuracy = 0.940\n",
      "\n",
      "EPOCH 982 ...\n",
      "Validation Accuracy = 0.934\n",
      "\n",
      "EPOCH 983 ...\n",
      "Validation Accuracy = 0.941\n",
      "\n",
      "EPOCH 984 ...\n",
      "Validation Accuracy = 0.927\n",
      "\n",
      "EPOCH 985 ...\n",
      "Validation Accuracy = 0.937\n",
      "\n",
      "EPOCH 986 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 987 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 988 ...\n",
      "Validation Accuracy = 0.934\n",
      "\n",
      "EPOCH 989 ...\n",
      "Validation Accuracy = 0.927\n",
      "\n",
      "EPOCH 990 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 991 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 992 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 993 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 994 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 995 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 996 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 997 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 998 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 999 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1000 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1001 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1002 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1003 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1004 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1005 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1006 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1007 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1008 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1009 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1010 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1011 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1012 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1013 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1014 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1015 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1016 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1017 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1018 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1019 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1020 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1021 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1022 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1023 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1024 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1025 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1026 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1027 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1028 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1029 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1030 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1031 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1032 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1033 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1034 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1035 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1036 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1037 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1038 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1039 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1040 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1041 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1042 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1043 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1044 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1045 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1046 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1047 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1048 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1049 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1050 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1051 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1052 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1053 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1054 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1055 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1056 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1057 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1058 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1059 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1060 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1061 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1062 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1063 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1064 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1065 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1066 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1067 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1068 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1069 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1070 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1071 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1072 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1073 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1074 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1075 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1076 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1077 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1078 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1079 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1080 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1081 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1082 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1083 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1084 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1085 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1086 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1087 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1088 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1089 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1090 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1091 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1092 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1093 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1094 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1095 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1096 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1097 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1098 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1099 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1100 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1101 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1102 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1103 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1104 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1105 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1106 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1107 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1108 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1109 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1110 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1111 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1112 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1113 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1114 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1115 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1116 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1117 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1118 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1119 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1120 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1121 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1122 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1123 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1124 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1125 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1126 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1127 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1128 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1129 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1130 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1131 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1132 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1133 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1134 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1135 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1136 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1137 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1138 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1139 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1140 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1141 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1142 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1143 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1144 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1145 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1146 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1147 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1148 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1149 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1150 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1151 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1152 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1153 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1154 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1155 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1156 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1157 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1158 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1159 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1160 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1161 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1162 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1163 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1164 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1165 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1166 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1167 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1168 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1169 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1170 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1171 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1172 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1173 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1174 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1175 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1176 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1177 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1178 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1179 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1180 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1181 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1182 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1183 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1184 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1185 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1186 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1187 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1188 ...\n",
      "Validation Accuracy = 0.929\n",
      "\n",
      "EPOCH 1189 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1190 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1191 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1192 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1193 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1194 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1195 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1196 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1197 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1198 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1199 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1200 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1201 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1202 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1203 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1204 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1205 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1206 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1207 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1208 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1209 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1210 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1211 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1212 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1213 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1214 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1215 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1216 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1217 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1218 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1219 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1220 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1221 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1222 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1223 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1224 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1225 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1226 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1227 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1228 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1229 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1230 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1231 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1232 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1233 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1234 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1235 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1236 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1237 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1238 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1239 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1240 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1241 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1242 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1243 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1244 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1245 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1246 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1247 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1248 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1249 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1250 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1251 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1252 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1253 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1254 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1255 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1256 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1257 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1258 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1259 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1260 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1261 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1262 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1263 ...\n",
      "Validation Accuracy = 0.930\n",
      "\n",
      "EPOCH 1264 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1265 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1266 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1267 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1268 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1269 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1270 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1271 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1272 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1273 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1274 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1275 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1276 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1277 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1278 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1279 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1280 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1281 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1282 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1283 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1284 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1285 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1286 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1287 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1288 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1289 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1290 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1291 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1292 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1293 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1294 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1295 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1296 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1297 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1298 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1299 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1300 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1301 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1302 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1303 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1304 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1305 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1306 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1307 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1308 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1309 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1310 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1311 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1312 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1313 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1314 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1315 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1316 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1317 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1318 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1319 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1320 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1321 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1322 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1323 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1324 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1325 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1326 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1327 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1328 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1329 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1330 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1331 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1332 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1333 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1334 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1335 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1336 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1337 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1338 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1339 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1340 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1341 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1342 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1343 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1344 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1345 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1346 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1347 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1348 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1349 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1350 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1351 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1352 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1353 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1354 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1355 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1356 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1357 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1358 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1359 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1360 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1361 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1362 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1363 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1364 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1365 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1366 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1367 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1368 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1369 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1370 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1371 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1372 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1373 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1374 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1375 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1376 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1377 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1378 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1379 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1380 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1381 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1382 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1383 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1384 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1385 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1386 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1387 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1388 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1389 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1390 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1391 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1392 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1393 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1394 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1395 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1396 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1397 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1398 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1399 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1400 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1401 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1402 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1403 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1404 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1405 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1406 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1407 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1408 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1409 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1410 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1411 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1412 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1413 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1414 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1415 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1416 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1417 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1418 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1419 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1420 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1421 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1422 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1423 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1424 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1425 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1426 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1427 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1428 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1429 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1430 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1431 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1432 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1433 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1434 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1435 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1436 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1437 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1438 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1439 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1440 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1441 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1442 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1443 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1444 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1445 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1446 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1447 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1448 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1449 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1450 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1451 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1452 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1453 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1454 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1455 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1456 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1457 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1458 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1459 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1460 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1461 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1462 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1463 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1464 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1465 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1466 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1467 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1468 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1469 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1470 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1471 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1472 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1473 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1474 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1475 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1476 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1477 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1478 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1479 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1480 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1481 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1482 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1483 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1484 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1485 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1486 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1487 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1488 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1489 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1490 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1491 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1492 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1493 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1494 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1495 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1496 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1497 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1498 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1499 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1500 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1501 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1502 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1503 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1504 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1505 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1506 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1507 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1508 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1509 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1510 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1511 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1512 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1513 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1514 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1515 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1516 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1517 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1518 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1519 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1520 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1521 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1522 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1523 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1524 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1525 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1526 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1527 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1528 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1529 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1530 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1531 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1532 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1533 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1534 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1535 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1536 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1537 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1538 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1539 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1540 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1541 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1542 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1543 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1544 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1545 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1546 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1547 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1548 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1549 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1550 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1551 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1552 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1553 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1554 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1555 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1556 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1557 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1558 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1559 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1560 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1561 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1562 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1563 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1564 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1565 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1566 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1567 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1568 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1569 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1570 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1571 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1572 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1573 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1574 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1575 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1576 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1577 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1578 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1579 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1580 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1581 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1582 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1583 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1584 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1585 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1586 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1587 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1588 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1589 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1590 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1591 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1592 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1593 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1594 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1595 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1596 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1597 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1598 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1599 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1600 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1601 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1602 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1603 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1604 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1605 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1606 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1607 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1608 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1609 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1610 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1611 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1612 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1613 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1614 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1615 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1616 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1617 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1618 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1619 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1620 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1621 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1622 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1623 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1624 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1625 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1626 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1627 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1628 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1629 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1630 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1631 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1632 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1633 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1634 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1635 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1636 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1637 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1638 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1639 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1640 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1641 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1642 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1643 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1644 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1645 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1646 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1647 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1648 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1649 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1650 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1651 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1652 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1653 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1654 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1655 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1656 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1657 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1658 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1659 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1660 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1661 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1662 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1663 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1664 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1665 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1666 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1667 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1668 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1669 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1670 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1671 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1672 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1673 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1674 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1675 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1676 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1677 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1678 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1679 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1680 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1681 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1682 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1683 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1684 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1685 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1686 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1687 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1688 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1689 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1690 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1691 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1692 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1693 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1694 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1695 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1696 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1697 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1698 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1699 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1700 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1701 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1702 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1703 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1704 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1705 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1706 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1707 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1708 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1709 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1710 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1711 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1712 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1713 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1714 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1715 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1716 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1717 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1718 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1719 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1720 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1721 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1722 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1723 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1724 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1725 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1726 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1727 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1728 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1729 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1730 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1731 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1732 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1733 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1734 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1735 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1736 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1737 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1738 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1739 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1740 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1741 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1742 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1743 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1744 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1745 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1746 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1747 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1748 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1749 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1750 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1751 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1752 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1753 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1754 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1755 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1756 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1757 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1758 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1759 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1760 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1761 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1762 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1763 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1764 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1765 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1766 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1767 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1768 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1769 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1770 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1771 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1772 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1773 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1774 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1775 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1776 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1777 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1778 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1779 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1780 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1781 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1782 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1783 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1784 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1785 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1786 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1787 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1788 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 1789 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1790 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1791 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1792 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1793 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1794 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1795 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1796 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1797 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1798 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1799 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1800 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1801 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1802 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1803 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1804 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1805 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1806 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1807 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1808 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1809 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1810 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1811 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1812 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1813 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1814 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1815 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1816 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1817 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1818 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1819 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1820 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1821 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1822 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1823 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1824 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1825 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1826 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1827 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1828 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1829 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1830 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1831 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1832 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1833 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1834 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1835 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1836 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1837 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1838 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1839 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1840 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1841 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1842 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1843 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1844 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1845 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1846 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1847 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1848 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1849 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1850 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1851 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1852 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1853 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1854 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1855 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1856 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1857 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1858 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1859 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1860 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1861 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1862 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1863 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1864 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1865 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1866 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1867 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1868 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1869 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1870 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1871 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1872 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1873 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1874 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1875 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1876 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1877 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1878 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1879 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1880 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1881 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1882 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1883 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1884 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1885 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1886 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1887 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1888 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1889 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1890 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1891 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1892 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1893 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1894 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1895 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1896 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1897 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1898 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1899 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1900 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1901 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1902 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1903 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1904 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1905 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1906 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1907 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1908 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1909 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1910 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1911 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1912 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1913 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1914 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1915 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1916 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1917 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1918 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1919 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1920 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1921 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1922 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1923 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1924 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1925 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1926 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1927 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1928 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1929 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1930 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1931 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1932 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1933 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1934 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1935 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1936 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1937 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1938 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1939 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1940 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1941 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1942 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1943 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1944 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1945 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1946 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1947 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1948 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1949 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1950 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1951 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1952 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1953 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1954 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1955 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1956 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1957 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1958 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1959 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1960 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1961 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1962 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1963 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1964 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1965 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1966 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1967 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1968 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1969 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1970 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1971 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1972 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1973 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1974 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1975 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1976 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1977 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1978 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1979 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1980 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1981 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1982 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1983 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1984 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1985 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1986 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1987 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1988 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1989 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1990 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1991 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1992 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1993 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1994 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1995 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1996 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1997 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1998 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 1999 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2000 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2001 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2002 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2003 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2004 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2005 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2006 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2007 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2008 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2009 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2010 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2011 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2012 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2013 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2014 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2015 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2016 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2017 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2018 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2019 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2020 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2021 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2022 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2023 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2024 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2025 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2026 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2027 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2028 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2029 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2030 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2031 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2032 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2033 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2034 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2035 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2036 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2037 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2038 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2039 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2040 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2041 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2042 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2043 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2044 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2045 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2046 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2047 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2048 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2049 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2050 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2051 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2052 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2053 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2054 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2055 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2056 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2057 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2058 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2059 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2060 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2061 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2062 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2063 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2064 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2065 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2066 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2067 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2068 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2069 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2070 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2071 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2072 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2073 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2074 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2075 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2076 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2077 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2078 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2079 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2080 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2081 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2082 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2083 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2084 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2085 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2086 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2087 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2088 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2089 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2090 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2091 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2092 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2093 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2094 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2095 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2096 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2097 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2098 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2099 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2100 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2101 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2102 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2103 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2104 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2105 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2106 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2107 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2108 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2109 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2110 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2111 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2112 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2113 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2114 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2115 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2116 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2117 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2118 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2119 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2120 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2121 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2122 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2123 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2124 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2125 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2126 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2127 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2128 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2129 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2130 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2131 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2132 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2133 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2134 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2135 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2136 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2137 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2138 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2139 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2140 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2141 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2142 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2143 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2144 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2145 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2146 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2147 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2148 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2149 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2150 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2151 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2152 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2153 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2154 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2155 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2156 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2157 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2158 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2159 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2160 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2161 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2162 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2163 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2164 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2165 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2166 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2167 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2168 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2169 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2170 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2171 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2172 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2173 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2174 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2175 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2176 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2177 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2178 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2179 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2180 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2181 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2182 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2183 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2184 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2185 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2186 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2187 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2188 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2189 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2190 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2191 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2192 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2193 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2194 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2195 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2196 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2197 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2198 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2199 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2200 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2201 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2202 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2203 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2204 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2205 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2206 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2207 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2208 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2209 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2210 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2211 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2212 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2213 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2214 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2215 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2216 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2217 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2218 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2219 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2220 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2221 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2222 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2223 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2224 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2225 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2226 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2227 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2228 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2229 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2230 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2231 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2232 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2233 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2234 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2235 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2236 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2237 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2238 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2239 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2240 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2241 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2242 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2243 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2244 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2245 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2246 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2247 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2248 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2249 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2250 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2251 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2252 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2253 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2254 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2255 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2256 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2257 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2258 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2259 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2260 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2261 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2262 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2263 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2264 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2265 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2266 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2267 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2268 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2269 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2270 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2271 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2272 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2273 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2274 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2275 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2276 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2277 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2278 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2279 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2280 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2281 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2282 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2283 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2284 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2285 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2286 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2287 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2288 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2289 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2290 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2291 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2292 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2293 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2294 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2295 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2296 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2297 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2298 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2299 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2300 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2301 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2302 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2303 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2304 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2305 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2306 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2307 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2308 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2309 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2310 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2311 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2312 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2313 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2314 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2315 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2316 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2317 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2318 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2319 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2320 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2321 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2322 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2323 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2324 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2325 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2326 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2327 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2328 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2329 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2330 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2331 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2332 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2333 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2334 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2335 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2336 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2337 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2338 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2339 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2340 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2341 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2342 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2343 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2344 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2345 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2346 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2347 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2348 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2349 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2350 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2351 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2352 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2353 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2354 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2355 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2356 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2357 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2358 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2359 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2360 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2361 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2362 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2363 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2364 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2365 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2366 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2367 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2368 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2369 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2370 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2371 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2372 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2373 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2374 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2375 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2376 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2377 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2378 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2379 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2380 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2381 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2382 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2383 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2384 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2385 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2386 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2387 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2388 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2389 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2390 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2391 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2392 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2393 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2394 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2395 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2396 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2397 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2398 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2399 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2400 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2401 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2402 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2403 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2404 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2405 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2406 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2407 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2408 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2409 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2410 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2411 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2412 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2413 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2414 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2415 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2416 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2417 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2418 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2419 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2420 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2421 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2422 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2423 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2424 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2425 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2426 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2427 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2428 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2429 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2430 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2431 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2432 ...\n",
      "Validation Accuracy = 0.931\n",
      "\n",
      "EPOCH 2433 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2434 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2435 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2436 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2437 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2438 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2439 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2440 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2441 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2442 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2443 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2444 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2445 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2446 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2447 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2448 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2449 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2450 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2451 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2452 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2453 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2454 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2455 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2456 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2457 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2458 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2459 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2460 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2461 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2462 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2463 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2464 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2465 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2466 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2467 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2468 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2469 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2470 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2471 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2472 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2473 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2474 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2475 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2476 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2477 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2478 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2479 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2480 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2481 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2482 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2483 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2484 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2485 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2486 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2487 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2488 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2489 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2490 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2491 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2492 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2493 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2494 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2495 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2496 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2497 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2498 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2499 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2500 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2501 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2502 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2503 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2504 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2505 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2506 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2507 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2508 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2509 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2510 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2511 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2512 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2513 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2514 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2515 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2516 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2517 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2518 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2519 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2520 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2521 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2522 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2523 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2524 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2525 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2526 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2527 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2528 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2529 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2530 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2531 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2532 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2533 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2534 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2535 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2536 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2537 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2538 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2539 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2540 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2541 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2542 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2543 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2544 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2545 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2546 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2547 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2548 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2549 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2550 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2551 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2552 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2553 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2554 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2555 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2556 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2557 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2558 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2559 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2560 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2561 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2562 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2563 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2564 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2565 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2566 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2567 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2568 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2569 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2570 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2571 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2572 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2573 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2574 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2575 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2576 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2577 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2578 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2579 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2580 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2581 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2582 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2583 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2584 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2585 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2586 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2587 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2588 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2589 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2590 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2591 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2592 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2593 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2594 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2595 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2596 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2597 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2598 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2599 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2600 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2601 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2602 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2603 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2604 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2605 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2606 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2607 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2608 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2609 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2610 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2611 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2612 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2613 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2614 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2615 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2616 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2617 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2618 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2619 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2620 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2621 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2622 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2623 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2624 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2625 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2626 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2627 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2628 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2629 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2630 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2631 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2632 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2633 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2634 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2635 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2636 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2637 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2638 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2639 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2640 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2641 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2642 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2643 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2644 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2645 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2646 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2647 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2648 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2649 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2650 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2651 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2652 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2653 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2654 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2655 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2656 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2657 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2658 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2659 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2660 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2661 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2662 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2663 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2664 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2665 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2666 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2667 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2668 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2669 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2670 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2671 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2672 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2673 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2674 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2675 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2676 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2677 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2678 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2679 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2680 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2681 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2682 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2683 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2684 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2685 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2686 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2687 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2688 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2689 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2690 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2691 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2692 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2693 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2694 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2695 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2696 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2697 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2698 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2699 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2700 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2701 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2702 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2703 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2704 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2705 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2706 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2707 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2708 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2709 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2710 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2711 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2712 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2713 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2714 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2715 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2716 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2717 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2718 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2719 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2720 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2721 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2722 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2723 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2724 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2725 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2726 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2727 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2728 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2729 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2730 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2731 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2732 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2733 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2734 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2735 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2736 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2737 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2738 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2739 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2740 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2741 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2742 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2743 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2744 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2745 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2746 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2747 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2748 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2749 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2750 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2751 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2752 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2753 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2754 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2755 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2756 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2757 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2758 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2759 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2760 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2761 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2762 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2763 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2764 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2765 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2766 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2767 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2768 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2769 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2770 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2771 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2772 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2773 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2774 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2775 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2776 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2777 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2778 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2779 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2780 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2781 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2782 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2783 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2784 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2785 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2786 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2787 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2788 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2789 ...\n",
      "Validation Accuracy = 0.932\n",
      "\n",
      "EPOCH 2790 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2791 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2792 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2793 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2794 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2795 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2796 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2797 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2798 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2799 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2800 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2801 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2802 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2803 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2804 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2805 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2806 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2807 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2808 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2809 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2810 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2811 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2812 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2813 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2814 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2815 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2816 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2817 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2818 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2819 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2820 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2821 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2822 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2823 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2824 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2825 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2826 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2827 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2828 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2829 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2830 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2831 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2832 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2833 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2834 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2835 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2836 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2837 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2838 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2839 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2840 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2841 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2842 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2843 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2844 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2845 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2846 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2847 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2848 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2849 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2850 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2851 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2852 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2853 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2854 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2855 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2856 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2857 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2858 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2859 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2860 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2861 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2862 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2863 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2864 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2865 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2866 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2867 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2868 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2869 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2870 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2871 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2872 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2873 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2874 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2875 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2876 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2877 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2878 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2879 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2880 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2881 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2882 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2883 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2884 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2885 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2886 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2887 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2888 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2889 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2890 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2891 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2892 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2893 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2894 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2895 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2896 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2897 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2898 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2899 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2900 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2901 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2902 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2903 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2904 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2905 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2906 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2907 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2908 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2909 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2910 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2911 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2912 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2913 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2914 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2915 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2916 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2917 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2918 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2919 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2920 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2921 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2922 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2923 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2924 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2925 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2926 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2927 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2928 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2929 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2930 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2931 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2932 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2933 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2934 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2935 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2936 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2937 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2938 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2939 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2940 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2941 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2942 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2943 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2944 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2945 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2946 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2947 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2948 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2949 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2950 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2951 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2952 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2953 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2954 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2955 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2956 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2957 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2958 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2959 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2960 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2961 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2962 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2963 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2964 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2965 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2966 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2967 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2968 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2969 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2970 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2971 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2972 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2973 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2974 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2975 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2976 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2977 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2978 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2979 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2980 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2981 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2982 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2983 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2984 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2985 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2986 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2987 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2988 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2989 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2990 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2991 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2992 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2993 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2994 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2995 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2996 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2997 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2998 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 2999 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "EPOCH 3000 ...\n",
      "Validation Accuracy = 0.933\n",
      "\n",
      "Model saved\n"
     ]
    }
   ],
   "source": [
    "with tf.Session() as sess:\n",
    "    sess.run(tf.global_variables_initializer())\n",
    "    num_examples = len(X_train)\n",
    "    \n",
    "    print(\"Training...\")\n",
    "    print()\n",
    "    for i in range(EPOCHS):\n",
    "        X_train, y_train = shuffle(X_train, y_train)\n",
    "        for offset in range(0, num_examples, BATCH_SIZE):\n",
    "            end = offset + BATCH_SIZE\n",
    "            batch_x, batch_y = X_train[offset:end], y_train[offset:end]\n",
    "            sess.run(training_operation, feed_dict={x: batch_x, y: batch_y, keep_prob: 0.5})\n",
    "            \n",
    "        validation_accuracy = evaluate(X_valid, y_valid)\n",
    "        print(\"EPOCH {} ...\".format(i+1))\n",
    "        print(\"Validation Accuracy = {:.3f}\".format(validation_accuracy))\n",
    "        print()\n",
    "        \n",
    "    saver.save(sess, './lenet')\n",
    "    print(\"Model saved\")"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {
    "collapsed": false,
    "deletable": true,
    "editable": true
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Test Accuracy = 0.930\n"
     ]
    }
   ],
   "source": [
    "with tf.Session() as sess:\n",
    "    saver.restore(sess, tf.train.latest_checkpoint('.'))\n",
    "\n",
    "    test_accuracy = evaluate(X_test, y_test)\n",
    "    print(\"Test Accuracy = {:.3f}\".format(test_accuracy))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "deletable": true,
    "editable": true
   },
   "source": [
    "---\n",
    "\n",
    "## Step 3: Test a Model on New Images\n",
    "\n",
    "To give yourself more insight into how your model is working, download at least five pictures of German traffic signs from the web and use your model to predict the traffic sign type.\n",
    "\n",
    "You may find `signnames.csv` useful as it contains mappings from the class id (integer) to the actual sign name."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "deletable": true,
    "editable": true
   },
   "source": [
    "### Load and Output the Images"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {
    "collapsed": false,
    "deletable": true,
    "editable": true,
    "scrolled": false
   },
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAFsAAABZCAYAAABR/liSAAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAAEa5JREFUeJztnFuMXddZx3/fvpz7mZkzHs/Et3icNE1CE9I7LRdRCSEh\nJNTyAKIPCCSk8lIJJB6oeOKxD8ArUhCVeEBCSCAoUhFUqKgq6iUhCWnttLbjOPY4c/Hcz3Xf1uLh\n+87YCU7m2GN2rPh80mjP3mfvtdb+1n9997XFe8+UyqHg/R7Aw0RTZpdIU2aXSFNml0hTZpdIU2aX\nSFNml0hHYraI/IqI/ERELovIV+7XoD6oJPfq1IhICFwEfhlYAV4Avui9v3D/hvfBougIz34auOy9\nvwIgIn8HfB54V2ZXKlXfaDTweIJAdACix0oY2nlIrJcIA1t4cUxzbg6AIIoBcE5/Kjz0+kMAhkmq\nF8VTqWgjjYreX42r+rwEFFmmzw71uazf0+dHA5wtdhcqazKBzDpzrgDgAKB2HI1GpGkqhzHsKMw+\nBVy/7XwF+Jl33iQiXwK+BFCv1/n5X/wc3jnqNWXCfE1f7sxsB4ClSosFUcbPNoxBp07yqV/7AgCt\nxRMA9Prafj+Hb3//PADnr1wDoKgmLJ+uAPDc2UUAPrT4OACNqM3u2hoA3QuvArD6vW8D8OprP2QU\n6HOj2QUA3gpC1kZdAAYjnZQ018lyWYY4xws/eGEihh2F2Xeayf8jk7z3zwPPA3Q6874ax7iiIDLQ\nztf05R6bqQFQGQ7YWd/RH48vA/D0o8/SXFgCwABNpaXHC6/2WX1TmdH2iv7jzQGLFcVB5HYB6Oez\nAITRDM35RwCon9XJ3Lt6FYDG6msUvRyALNUJr1VqNEVXTCGJdhrqawZhQBQEBMFkqu8ozF4Bztx2\nfhp4670e8N5T5DlxFBEF2vV8fR6AGXuP0eYGnXoTgI9/9mcBOPmJTzCencyms5sq2/e7l1mcVwY9\nffYcAG0ZcOVNHcqlHUVj/hF9LlwMqIWKk5lzxwDoXP2wPvfmG9QinZyemIgouvQZ6f9S2DVFtheP\nl5A7YOyOdBRr5AXgCRE5JyIV4LeArx+hvQ883TOyvfe5iHwZ+DcgBL7mvT9/yFPkRUE9DGiKio9Z\nFMXhviKqlqYsnV0G4NTJRwGIfR0/Flq2Ahhu6f3uKk+cVPl6qtMAoNVcoNmuA/DWut6Xryv6JEhp\nHdO+g1TFw8kPP6dNbgy59L1/B6C3/zoAj8zWac7oGNnTQfSSMbKFXMIJcX00MYL3/hvAN47SxsNE\nR2L23ZL3nsJlhL5gLlLkzaEoaYzUDIviOnNttUxcoJjxkSPvGpoyRWO6fROApvO0IvttsAlAfxiR\n9/cBqPf3ABj1NwDYWl9h12tfO3uK+np9BoDta5eJBtsAVPa1LZfXqC6q8u422gCs9Qc6hiAgarQR\nM1sPo6m7XiKVimzwODJmmw3OLKgcrGZqtuVDRWDkA/yuIq93UVXA/puvszNUwzpJ1DLodtU8HHR3\n8IWZYqjtXuQFaaJtpObo5ObIkBf4XK/t2j1FrDJc+n1qI10RkXlWIuBGau24qq5GCdVkDPHMtzsH\nltVhVCqzwzhm/vgJZusRC21duum1NwEY9FRBhq7C7iVVTsPVdf0tzxkU+sK5U8bmuZ77Iqcwzy4f\nW+GBIIEu7dAYEYSmFIPgYCJmmzo5ezY+12kxREWG+Vzkg4R+bmZmoBM29ihDgZorCEow/aZ0l1Qq\nsquVOo+d+wgL3hNVTfm1VSH5XNGZFjGJLdOxtRfUGoSRIrNtx6p5bZEExMEYadqGiOAjbaOoqqtZ\nRCq2BknOTncFgO1ARdhmX0XToICh0xURZNqWy3KGJoJ2U70/MzEkAXT3diiKYqL3nyK7RCoZ2VUe\ne/RDtL0QmSKqtjRm0b2pptbNXkJi8jUZy8JAqMSqnI5FKlPnDM1zQY6kpgyH6ppLVuBRmV5EhnaL\nAmbVmMFIUb8+UqV7faTIHaQj0sLk/lj8F44005PBAYJ1XAWe/UH/QGccRqUyO4pjji8cp+aBgQaN\nkkyZsLZ/A4CV7hb75qH1M52QmktpoC+0E+mLtgqdnFa+Sdwzi2ag7qV4wYsu2sJs4LihkxXX6/Qt\nEjsMVLTMtDRG4pNNMrNeMp0rciCzCXDmxgbjMKx3d4zGvRtNxUiJVCqyRSCMweUpWBJgb6jI23SK\nsvVswP5AkR0WioVFD8cTRW/sTfxEKjKSdIuoaqLl0WUAgmaLwgL72UC9vf6ueovF1ga1QsVUw7zX\nxTPqsa7XWqRO2x1lukpyV+CD8fj1n7FdD4LcBbSnyC6RSkV2kSd0t98gJGV3y8J3zVMAJFU97/qM\nxFmsW1R5zhchJ1ONbYzyVQAeOf0YAFHzOZaf/ikATj31pLY5O3Pg/Ix2FamrlzSL0710GTYuAeDX\nL+pxQ9FfaSwSHeBPnSwvBZY4Qmy1eFOIgiecIvvBpFKR7dIhveuvMnQjrqyokzx35hkAEq8Zm1Ac\n7UDl+THT9Y2sT92pedfoKLpqHXVWTj37WY49qYgOF7WNuFVhZHJ10DJXvqorqB4/Qm1G7JpGDt+6\nqnqgSGepz6jV0ojGjlWBN8HsLWSA02MUxNRrtVuJ6UOoVGbXqwHPnpvhWy+usL2rCk86+qJZXZkX\nh55WpObXkh3nki0a9j7Npaf0uePK2B1ucvGipsCO76k5eXppiR0z716+qd7htTVlfuXHazxrcmH5\nzGcAKLZeBqCX7FFYAGpsMoZxk9wqAbKRihtv9nYchlPT70GlkqN+ITOn21Qu1kmvqlOSmPcnDXUc\nGpWAY7ZcZ5yGUUe9N6ChynLpp38BgAuFxlS6Gxfp72gmPV2zuMnyOYpYo4rRTW23uWfZ9WqN17f0\n2pNPfEwH9oY+71bPs2TpurimKbb1IKI39hithAGL/jkJkChmUvtviuwSqVRkJ3nB6+tdfKVCvalO\nTCCqDOOKnlcaMbPZOKWlCB+kI4498TQAi888C8CPLP79SPdRamtqym3f0GKsC//1E4aZKrj6/DIA\nn/v4p7Wf5hL/8q//pL+dVPTPL2tFRrR2CdlSxT17TB2l3aqwZYnhwsxJsWopJCCq1g+cncOoVGan\nmWNlY580z2nUVOtH5p7NVfS80moyM0jfNjgXh9SWtEinZUmH5xaUQcO9hLStRTdrZizMn6ky7OvT\ng6Eu8fa8VkZlQBTrjfuJTljnzEkA/Mst3DgQZUkH57TWBW4L+VpiAg9pmjNpveRUjJRIpSI7K2B1\nWwiKWVomRkKzZ/N99RAbPmSuquZaEOqxCCOCjpp6lZZmuFuJIrAfBLy0rmJn1yl6l2ePMfKqXHf2\nVBFvd9Vs6yws4UyhdTMVGZJqqHWIo2Vm3rikzLmCwpIF3o+TE4Z+QdNvE9p/U2SXSCXHRmB3R3CJ\nJ09M2Yihq6vHRjuiWbdsqzk1tcLRv6GOi2zrffWqIvzqhfOsXNQ0V3tGkd1sncM7xVG6pQi/vGmx\n8V7I0NBbrZiQzxTZcZETjVeayeEiy/BW2xdY/Z+zYxQGBIHjvtX6icgZEfmWiLwmIudF5A/s+ryI\nfFNELtmxM1GPDzFNguwc+CPv/Usi0gb+W0S+Cfwu8B/e+6/aFo+vAH/8np1FMQudk4AcgCEYCzyL\nfRyLU+L07TUfLQ/5mmZyik1F8ctvvAHAD//nFYgV5bUZReVguM4IRWtaU/l60SJ9uCqd01pDWK+p\nFbNxQ+tTgqRH7hTFeaZOjXgIx6adVWiNC/nDIEAkQCYU2ocy23u/Cqza/10ReQ0thP888Dm77W+A\n/+QQZlerdR577Gm8v1W9X1hQJ8+VOb63weaeMiie04LJoJux+ZZ6ea9+71sAtI8rg5eP59zomzfa\nvwLAzmaXZkdNyScfX7QXUc+wE7dYquu1vR+raLr+uoZtXewJFjW+0jMGJ6PslrI8CLGaOMETeD9x\nYeVdKUgRWQY+BnwfWLKJGE/I4rs88yUReVFEXtzf37vTLQ8NTawgRaQF/APwh977fZkwHnD7zoMP\nPfGUb7VaFK7AmRmVOdsjY1VHmwOha8WTsxV1Hh5d6hBcVwfkwkvfAeDDn9G4xqc+8jhPVDVhS/O0\nvlSjjflI1GxPTezVI+ykAb2fXAbg6vnvArf288Sds2zEet/6QEVZPy8IDzxGPaRmCro81+TBeIPP\nITQRskUkRhn9t977f7TL6yJywn4/AWxM1ONDTIciWxTCfw285r3/i9t++jrwO8BX7fjPh7UV4KmT\n03cpI4vsZV5RkVudR4JjI1UHZNfKiNuR58SCKqxkW+f0yis/AODp2id5/ClVeLWOHn17lqCave0F\n3VCV5/DaOmuXNIbS2/+R/mgKtucXWO1qem7HHB2CgNBaGVc+jctHvHO4YFLDbzIx8nPAbwM/FJFX\n7NqfoEz+exH5PeAa8BsT9vnQ0iTWyHd4d4f0l+6msyLts3vt+2y5gJum0fdsD2NnTuPNBQWpYWVn\noNmcKB0gdbUm5pdUPufraoFc++4ruBVdFeFxRX14+gzeHJbISoznqqq/k/2M3kBRm1nd4L7ewnaS\n0M30JPXWZjXA2ViT1KqsLOHrnCOIBDchtEv1IOMw5UT7OuurPa6s2C6BbGyzah6x2pjHmcIaWBXU\nW9mQmbYqrnpbTbN2VWMlWyu79M+rDZ3adrziWIcs0GfDVMXCom3Hmzl2gpFtQB1WlwHoOWV+P9kl\nLTQbX1jfATWcKcB3FlAWXvB3kRibxkZKpHITvpWQZ5bbdJ3jpctaoeRsc6fLVJx45wjGlfxmto2o\nslbV+yyPy3xHxUnMHNG2tlWxkuG0t0liitdXFcU7PV1JjdBTbdou4YaKlp63mpThDrm3/TnWj3OO\nW26LoX283VuEQIJp1O9BpHLTYmnOlas3yfM2c4aqXYv25QOLpLWrVCuKxqpttaZSZddqeEcmP7ds\nL86puRazFTXd5urqybSzgqEVsw+tDnAY6ipJ4hoji9oNYr1nnNBNggqFJXyLwtZQnt1CrinNMYWB\ncGuD9+FUKrP7ScEL17psDlNcYAxqK2MbgW0YDSosNNUyCcS260kdn9tkYPUctii9ZOS2733LrkVx\nlcJK2LqpMjSxGuC6ZFSNyYntrcG82SiqHexwGHuJPs0Io3EA6u1mRyBCGEQTi4epGCmRyk0eSIW9\n8CxpBEGsJlmrboH5XBHrRxltEwdBQ801X4zwoS5XGRu1xXjnVsa6hWLFFFiz0SQINe22Z1v6+raV\nrxbkNGP1UEW0n9B2MdSrMaOqfQLD6j6LPDsIoYaRbdc7CLEK9VoVmbD8bIrsEqncwkoXMhjNkWQZ\nue3K8vYNj25fj/v71zHxfCs15YXCFFEwLhtwBr0gZ8eUbK2m8n/5bJt2u219qqwejSwR0RIW51Un\nRJZau3b9xsE9FYNfJbR4dj5WhFCvqW4YK+4wjiCI1fybgKbILpFKNv0SLl95HQlj9i0+Mepb/MOi\ngNVAqFn8uGKxZRdXcFZ1HhniMnPDe8MhuUEms60Z3V5CszlOZZnTNN58JBH1irbfWdCCnxuWBRKX\n3SoHtnh9HgQHyK3Eaj6OV1BYjemNMibN1ZT7VQbnyAZ9arMdRokyJrWkgbO4QxgJUlcmB5WxGQZZ\nbmLDGFWvqwjIihjGv5kN7ovgtuCQTY5T5g19wDA28zFXRZlYeDd1OVFkE12pWd/ZwTehEitDq1j2\nPx0kZLmfVkQ9iHTP3/W7p85EbgJ9YLO0Tu+dFph8nGe998cPu6lUZgOIyIve+0+W2uk90P/HOKdi\npESaMrtEej+Y/fz70Oe90H0fZ+ky+2GmqRgpkUpj9oP8re33qNT9UxG5ISKv2N+vHqmfMsTIg/6t\nbavoOnF7pS7wBeA3gZ73/s/uRz9lIfvgW9ve+xQYf2v7gSDv/ar3/iX7vwuMK3XvK5XF7Dt9a/u+\nv8z9oHdU6gJ8WUReFZGvHbXgvyxmT/St7feb3lmpC/wl8DjwUbRG/c+P0n5ZzL7rb22XTXeq1PXe\nr3vvC++9A/4KFYf3TGUx+4H+1va7VeqOS6KNfh340VH6KSWefW/f2i6V3q1S94si8lFU5F0Ffv8o\nnUw9yBJp6kGWSFNml0hTZpdIU2aXSFNml0hTZpdIU2aXSFNml0j/C5P/ZNXcJoyNAAAAAElFTkSu\nQmCC\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x1cbf1c36d68>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAFsAAABZCAYAAABR/liSAAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAAD7tJREFUeJztnEuoZtlVx39rn8f3ureeXVVd3R2NaLfgKILowIkggjiJ\nDhQzEAWhMwkoODA4ElHIwAdkIrQYcCCIEMEMAhJEB05C2tCosVGDiabT3dX1uK/vec7ZezlYa59b\n3anH13XLU0XXt+ByvnvOPnvvs87a6/Ffax9RVXY0DIUnPYFniXbMHpB2zB6QdswekHbMHpB2zB6Q\ndswekM7EbBH5WRH5DxH5poh89nFN6qNK8qhBjYgUwH8CPwO8BXwN+JSq/vvjm95Hi8oz3PvjwDdV\n9b8BROSvgE8C92X2+fPn9erVq4iCiJ3LLzvddRSxBRdCyI0Q7Hpd2ZQ3XQtA23RocoGR07GKwu/1\ngVKM3pX05+5q3tMHzyl61+9+On3XIsLt27c5OTm5V3fvo7Mw+0XgO3f9/xbwEx9sJCKvAq8CXL1y\nlc//yecJKVJWBQBd2wCw3mwAWG0aqvEeAPV4Zn00a+oiAfB9z18E4Fu3btqgb92iWxnjQzAuSID9\nfbuXypg+P5wDkFKJBBu7KPIc/cUkJWSWOUcjEVUbO6pdbP3llkWgLkt+7w9+/+Hc4mzMvteb/B6d\npKqvAa8BvPLyK1qGwKJtOLhjzJof3QFg3XQ2Iam5dNG6eW48AaBFcb5QOYeydClKl4zZGE+IKZF8\nVYzqkd2n9n9bSL9KtDVpL+sagE1sKfOSC/3SO10VecX1lxJN27CtKj4Ls98CPnbX/y8Bbz/oBmNM\nhDIQnRlZqopeEyhJ3/8eRYSQOZmlUGzqmpRRVQFwYc+kOYhwZ7EAoF3bikkuzQElpM67svua1l+W\nJjr3GcRlKYSAlPbSS1+F/byqmsbV2TZ0Fm/ka8DLIvIDIlIDvwx86Qz9feTpkSVbVTsR+Qzwd0AB\nfEFVv/HguwQISIDSl14Qk7iyMCkTVSqXeo1uNNuEjK1d4+pgnUzyVlGpc++19aFFoBbv3/tYNy6V\nKfW6LmnnR5diBAnOEtcVIoEr+2YnLl+5atcKv1aUBBKTyfTBj+10FjWCqn4Z+PJZ+niW6EzM/rAk\nYJIjkeg6sdfProvLqqKsTFaDt5lNJsxcsldrk1BpTFderGsqcQldre3YRSZZft1VHLv3Q1Ez9tW0\n6VYAHK7dACJUPtfeJKsw9vnMZucBqCeld10jIVCW+a4H0y5cH5AGlWxFiCJohD33pfdKc83GI/Mk\nZrP93hVL0TyJcSHgevzO7UMAmoPbAMj8kK4zyWyieSySTqOm6OJUuQ6XoqDw/kdj07UXJzaHRavE\n5H34gkspcvvwhvWvthLEJXk0njCqK9p2s9XzD8psBEIhVFJy6doLAL3bVvpyr6tA48bs8Njct8Vi\nwckdY+7xzfcA6JZ2bRwKoi95dUYFCX30GTwgyUdtE+uNqZ3V3NROOR0DMJnuo+7bH68yYwMrn8/8\n3RM7V9hcQ1BECzbr9VaPv1MjA9Kgkh1EGI/GBIHxyCM7DzZIrgrWG1YeiCwObgEwv/kum8MjAAoP\nlSt3/VJSUmH3jvf2AXPXlNPrAEU06ew09lhK4UY5rmy8ttkQxtbH+ZmpteN2Qxdb79emWmArIyBo\n2l5ed5I9IA2rs4GgkS51zBemE6O7cu3KgKK2aYmtSc7myPXz8THSmc7NmEcxMl1fz2aM900aa9e3\nRVWjecU4FZul9anK+tjHWrob2ZlkS0yk1YnfYdI8GU9YZBjIV1/qYaEKaOhBmYfQsN6IKs2mYd2t\nuXPHGDk/todTR/32i5I6q5R5RupA5JS5AJN9Rwb39xBH9tpkbVIQqtJ9dedLWeQ2idn4HACd++Wr\nAwPDmuUcwcZulyYMVVlTe3TbOiAViruxm8C9MbnvpZ0aGZAGl+wudqQYaRpfku4j1y4dtUBamkSX\nLuFdUVM7/rB3yXCK0vFqDdLjzaWLcRBBo6miDP43OQ8hgeTtqpn1WbmkLg+EdmXqJrraSYtjqpGp\nJ3UJz9FlWZbul+8k+6mjwQ1kAgqkf8vZ/dqrHelbLukcIy4dbx7VI/bOmZ4tPPg5Oj7u+xsVOTAy\ndzJUgdqTDBuPKhcnFgTdOpnTdSb1F6e2Ol547jkAZpcvc3zLg5/O9HnXtX0CQhwjaXz2ht3olnK9\nk+xB6QlItkBREEqTvMqP6tKcNg1lBpxzWLy/RzOy3+8eHgBw4u4bCUqX4tnIdPCLVy8SZqZnjzxg\nuXnTPI4QI7VjIwdzWx0bT8l9/PoV6ouG7B2tTWeX7YboGRodmQ0R1/kJIW3p9sHgEKtSa6QDxI3M\nxBkbPDXVpYi4Wgi1Ta+cViz84RfOvGv7xpT9/XMcugt3dGTMO16sSa5ulhtj1NjBo+evPU89Mizk\nljP78MCO89WKmbuU66knBI47ohvb4P54cLg2po5Eel8G/kG0UyMD0sBqRFAJxM2GKmTkzNWIBwyS\nOlRsmZfuchX1iNIN6Qt+3zk3bmVVEj1gyZLddS2OqNK6ehr70q+nYyqX+qoxaffglKbt2PP7pq5q\n1nJXnUiubfGniUR0ey2yk+whaXADKSJUhRBCLk3IlUr2bwg1mmXApVFVmHlQU5gXRnKj2GrDemWI\nYOUyN6lKQkb03PVLPXLX9TrWbfNpYU4APAksGeKTijKYlHfRzuViKw0FInLa9iE0MLMVYodqpHEL\nX2eoNGdZNPbLtHBuiCiVvxwtrf3GDeY7N26ymFtfU38Tdb1PzCVpztgMtWpMBOdW4VVWIdgLj7FF\nxefheEtMrWV+oH/T+b5OhSDb65GdGhmQBjeQIhVtt+mBePHMeHB1QjjFM7zkg7osadwXDh7F1W4o\nn7t0hVFtPvfS02hHiyP2R+Ya5trMzqugUpfQnGl3VdMnGmLq1Q6eYiuCkK2gZP2R61o67QtCt6Gd\nZA9IA2fXIWqiCHIXAO+uX3YB2fR1dtERwZSUqswVU47wuYEcjwPnxxcA+B+v/1itVuylU1TQ+s3G\nVnt9rrlmJR+jIm4ENyuPGmPso8Rs1KuQDazQdol71JPekx4q2SLyMRH5BxF5U0S+ISK/4ecvichX\nROS//HhxqxGfYdpGsjvgt1T16yKyD/yziHwF+DXg71X1c77F47PAbz+oI0EREp1oL72aa/28Tq9r\nCsT1JRmT6CINufjdvZjSSx9GU9atu3cZZw7K2HGVqQcwC3fputWSImdeNp6NUet7Vs8IPnbc5PKE\nSOl9lY7+jWoLtiqBlglF8f4U3P3oocxW1XeAd/z3iYi8iRXCfxL4KW/2F8A/8hBmAxSqlKHomb3y\nh5u64SOUhGQPGhqv3VivSJ6Nf9fTaOLMmO1dZOE5y+XaDOVL166C16NcnhnWcbI0V/Hbt29THFkf\nTWt9nHOsZH8yZrXKpcZLny/gKbZ6Yn0Vhf0/GdckAkXYjtkfykCKyMeBHwW+ClzzF5FfyNX73POq\niLwuIq8fHR19mOE+crS1gRSRPeCLwG+q6vG2UdP7dh780MuqMfWJU6AvsCQXq5eBqPY7udSnxaKX\n/Bc9k37D73/v8IDK+7h+wRIM52fjXNVLcAzlpcsmC5vRnNYN7/i8td/z9FibWtYHBuEmXy1aFH0F\n1MYN6dqPcdkgSejidoHNVpItltr+IvCXqvo3fvqGiFz369eB97Ya8Rmmh0q2mAj/OfCmqv7xXZe+\nBPwq8Dk//u3D+lKUJiWS0hcwqnrZgrcZTyfosUkVbvia+ZxRrgV0yb522VJZVy5Jv99mkutG6kAO\n+ksPZqZugPcvXerrP7KRbd02HN45ovG6vWxTKCoKv3fj+Mp67nhOAonaQw0Po23UyE8CvwL8q4i8\n4ed+B2PyX4vIrwP/C/ziViM+w7SNN/JP3D9X/9MfZjArGQ4UBQTXg+olwynHF2EEnQUJ7Ynh00Xs\nWHk6bOZBTT0zCa/G0373k4Rcg2dF6gDJsyy1BzcxRiofq3XPY35gZchpuUQzzt4vlykbZ1PeXZar\nbKNCIJG2BLWfQA6yoJSCyxcuA1A/P/KJeLTYtCzHdu4o2UMVm03vey+zR7MwN2/vwgXqPa//8KLI\nqlDUswdtct87L/WuZe3psLWXmnWbfE17pLFyw8p01uMfwbP9tSN9m80K0V12/amkYUuGgzCdFFQS\nGFUWSAQPGHCMOI5Sj85nl6o9eA/N+xm95kN8o+n8vRtwaH1UnmCoq6rfIJo8LSauTtZN26e38m60\n0lVONS5Q340QJ2ZsN7Fj7WN2nVdJdXm7t/ZYzVbPv3XLHZ2ZBq71g65LdN2aY9e9a9/1tW68AkkT\ntWMP09qkLFy4ArmU142murRpV1C6p6heeZqK2AdEMe/AdaSuKgM58ZLLj3EXMNZTNr4iFgtbSUUI\niGMf9chLGDyzk9qE6mlK72E0KLNjjBzP55wsTmiycXILL3njZzmidg8leplwKse88sMv2e+VMfvt\n79rO7c3xiuBAUmZw27U9A3qQqP9IQ0E9NrXTBlNlcWSNl/F0i/XUPZwuRXyfK22T+88JBqUqy61z\nkDs1MiANn12PkSRCXsuFA/KF5G3MkaLM9Rl2bVRWvHz9GgDnnv8RAL76hn3W5O1vfQdpzHDlHWFF\nWfdQaU5vJfef2xAQRxDXnUlk0877tq0b5Y1Lb5QAvvr6QNH35wRKku4qop5KGlyybS9koHK8WT10\nzB6UFAVldgezIUMoHXPmoiF165lJ5+2m7TGUysH9c5MZ06n1kT+FsTkx47lab5i5a1n7OCW+6XS5\nBMdqYg4h9bQupAh523UuGcZWzpYGcifZA9LgHwoIoSDEyMolWR0HydJTIv3HAEYjkzzVU+ykxwfF\nd5mJ0GXXz0N+JoHad5OFdd64ZNcKlLIv4LFz6853jYXQF+TkcL/oWqJnZvoUtXssqV1ThHrrcH3w\n7dQqsJGiN0SZU9F9tSoqM1cZheYNqYml++F73q71EuO2bcCTAaX7y0m1rwnJX3bItk0Vkr+5HP2l\nlNWDkr9GUnqbltDvz8lueZsjUIWQup2BfBrpkb/r90iDidwEFsCtwQZ9dHqO7ef5/ap65WGNBmU2\ngIi8rqo/Nuigj0D/H/PcqZEBacfsAelJMPu1JzDmo9Bjn+fgOvtZpp0aGZAGY/bT/K3tB1Tq/q6I\nfFdE3vC/nzvTOEOokaf9W9te0XX97kpd4OeBXwLmqvqHj2OcoSS7/9a2qjZA/tb2U0Gq+o6qft1/\nnwC5Uvex0lDMvte3th/7wzwO+kClLsBnRORfROQLZy34H4rZW31r+0nTByt1gT8FfhD4BFaj/kdn\n6X8oZn/ob20PTfeq1FXVG6oa1T7V82eYOnxkGorZT/W3tu9XqZtLop1+Afi3s4wzCJ79aN/aHpTu\nV6n7KRH5BKbyvg18+iyD7CLIAWkXQQ5IO2YPSDtmD0g7Zg9IO2YPSDtmD0g7Zg9IO2YPSP8HaJDf\nKxP4RHUAAAAASUVORK5CYII=\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x1cb8812bb00>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAFsAAABZCAYAAABR/liSAAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAADSZJREFUeJztnEuILkmVx38nIjK/2w8RxQeNIyriTkVBdOFGEEHcqIsZ\ndCEzMNBuhBmYheLKpQt1K7QouBBEULAXDSKiCzdiK6KjjdrI4PTY+FhN971V9WVGHBdxTmRW9b1V\n360qoy9988C9WV9mZETkyRPn+Y8UVWWjPhRe7AncT7QxuyNtzO5IG7M70sbsjrQxuyNtzO5IV2K2\niHxQRH4rIk+LyGeua1IvVZLLBjUiEoHfAR8AngF+CnxcVX9zfdN7aVG6wr3vBp5W1T8AiMg3gQ8D\nd2T2MAy6242ICFrsJfvLPuedC7q6LOdM6RDBkXPbHSR7InaoMzvZ75nn+byJAVdj9uuA/139fgZ4\nzwvnJY8CjwKM48jb3/ZWxpSYj/YA6DTVhrms77L/1frQ5Z2orFqAyvpV1KMWXXFNTh31FLNPc1ZE\nKOVMX5RV69pHSJVtaRjY55mnnv792ce+LV2F2bd7ky+QC1V9DHgM4OGHH9KimVIKEnK9LuVUb6rS\nOhHxIQoiwQao5/LCfUTOME8E9faqp+7TAsXOSajnoh3noi8YO4TU+hfvQ23OAfJUOFQVX4XZzwCv\nX/3+J+BP592gqpRSKJJAKzOq6qeZ6iDLOyyrhwz2oKVJvR2VykEghmBtoAloOMN0BdqK4VRfQ0rk\nYows2Wdhgyzj4LwOgTSmlVCcT1fxRn4KvEVE3iQiI/Ax4PEr9PeSp0tLtqrOIvIp4HtABL6mqr++\n6L6SC0UhUiVaXX249ARpyzaK61ltEu0r1nVrQAjiyyLaOQi6qJT1UUOVSIBpqnYj2n2zKtkkOvgc\nVu198DxV0dY8cSPFU6vxPLqKGkFVnwCeuEof9xNdidl3S4IwhAHN6kLoqpvZdWwMRL+Wq5TNWZnP\n6FfX4dW5qDcX07elFLB7115LvTFQot/q3ku9L6tQdKWrgUg4ZSwB8lTblDmT5HxXck1buN6R+kq2\nCOOwo2hB9ASgebEuTylESjBJM9045cJs13fm48boSyI3ySy4ZCtyxl9uOj8rzHW0cTDvpZgLGEce\neqj2v59u1muamSwGCCabLSQoelv/907UldkAWjJjiqjFMrMze2XPnE3OYJXYJupGU9QZm5uft/aR\nJZqrqK4CzAjmjJxRO1pc5cwwuzF0v740n34y1eS2N1Jd1UMZvqmRjtRVslWVeZoIMTfL5TFE89RY\nS4otbxkYB3MV84kd83KjuWYp1scJKSzRnvdmkh3nDMVSBWWyOVhfRTi5ZUObikEWA+pzdTcyiCIH\nGkfYJLsrdZfsXDInmlsgkE3fiuvWUkiuNt3Ni6lNdDLj5kGLhkhIAwBpGGtfMbwgc+MJrJAGNJs+\nNn+y5CrhWgpqxlLMYEiA4IGUx13JVklYJ88upu4Gsk44Em3CxdRCy7LNc4vYkjncolAs2vO1LFKn\nLnEkjcbksEScLcu3Slj5KJ6kCmkHwHij/t4fn1Ca51FJkJZzkWRR5VjnNRCaoT6ENjXSkbpLNojZ\nNHet/LSnQEtzuzznUfK8GEQnD0HTiHmRlL39pUowP7xJpUn2PE0txdpWkKmhOBam47qCvE2U2FZM\nip5drMNEBLkLTbJJdkfqLtkiNZg4Ojqqv6Pnp02K57LUANxQltxyyd4ujRbpMXN0ZNYsLxm7aPo+\nmD4vVhE6OTlGWt7bJDbXtrthR0nm5k0e6Czy6PrcXUEkNGN+CG2S3ZH662yp4XTTqXZ0lTyjZNPf\nqZW2StO5eOAymDcyTe3mcbxR74tgaraF98e5Sv8wDIy72m6a6rn9SfWIZNgttsR8P82l2Q7X1S7h\nWarXc2hY0z0RlWJg1oK7Zh68ZVcBMRBsbebZHniV8AmmHtQNnwimiRgs6guUxuxwxt+OMbZ6ZorV\nME6WFAtAiktpDSwHYz+SGWVzxcmq7Kd8cA1yUyMdqXPxAMYQQDJ7S5+K5yzsmIbYVEYzRFqatfQE\nfpDFdZxMReTnn6t9RWUYqtQOabR2C8zBjZ6vnLURDKamlkqXtmi39dHmUgOuQ/N+m2R3pP6uXy6k\nEJktoe3mJXlRIEgLrT3/sZabZsDcFZQKlgFILdOXOd57ciNZe7+20Gj35ZPqhq6i/AWeULSN1ZAM\nVgx+4MYDzNN+vQzOpb7M1moQc5lX9T+rM7bEz0C4jX3351lyHfWQYuDBGzXHkUzFlFxQ8+MXAMmC\nN3EVtJ+nU52rLku9DSNhSYiJY0/q8bnnnyfn0ooQF9GmRjpSfzWCuVBearLzLUGfMzl46WuFsvM1\nrKeNWgxxUTOezwgweGTaJNTHz3hNbmfZu/3JgnhqFfqlmoF4ud9zrV7DI9QIuAMiaqO7pP4FX5EK\nrDRpGVzivAoVhAUcZcYwCMWDHpPsINWlyyVzdKsGJW7woBZ2AYaW6HeY74SaZB9bltBdOpFAzr5y\nrH0IzXgXK6MtuEFD0B4YQl4o2SLyehH5oYg8JSK/FpH/sPOvFJHvi8jv7fiKw4a8f+kQyZ6B/1LV\nn4vIy4Cficj3gX8DfqCqn7ctHp8BPn1eR4qScyZrJgSHGNRrwdGsqisdaC6gSGvoYX02105iarr6\n6JZXayv8AZbwPpr07aeJW9NxfTAzA6OX00TbCmooKFnKZi71Pt5uN3J0fMyhon0hs1X1WeBZ+/s5\nEXmKCoT/MPA+a/Z14EdcwOwgwm5MzCoMVi0PDvcyC5aR9qCuarIqs7lwnkuZTuqDpzGxG6vrNzcf\nnFaXdGa7QR1CJNqYO2eCv8hpaq5ow3BLRiw5oiy+PUDOE0sW5WK6KwMpIm8E3gn8BHitvQh/Ia+5\nwz2PisiTIvLk3p3p+5QONpAi8jDwbeA/VfX/DwWAr3cevPyhhzWFUAu5dntyNFNDJ2lL7rcAQ2jp\nO51dwuuLm+c9g6Vb467Kqq7udpevNLR9ILrb6HA1M5TrkpkDMUOMeO3LM4jeJud8MBB+/TznkogM\nVEZ/Q1W/Y6f/LCKP2PVHgL8cPOp9ShdKttRX91XgKVX90urS48C/Ap+343cPG1IISYhDlcLpZjVq\nrisrLsRz1SajSVrRVVrIbIZyOgatjzGaZMeUVpvQTudEVHWBCBuMYjoxZFReMoINRiGL8XP3tPjq\n0lCzkNeYG3kv8AngVyLyCzv3WSqTvyUi/w78Efjng0a8j+kQb+TH3H5nGMD7735Is+kmDSfNyzCo\nQSktvealszGkFrpLdDCPl3iUYu099A85N73fcs26jFMsMMqzwRYcA6xCDO5uOlJrFeqv9j96l3q4\nyu4cQYqCZOY5kHPNymXHT5uaKCWwAv8CMM+6GC674i4dlBZxTr6ncp4XZjuDXHWUxYVboMJLtKjB\n4cSLvx0Hdx+99rgYTC3zalbn05Yb6Uid89kKmuvStJUbvcxlR0IGD3Ra9XtalqtXzX1nWJTVVgBH\nVWkzoIvQuVFb+vCSXNsenVLbLbZUogV1JIAtoeTFDRFUToOcz6NNsjtSX8gwSil70vAgZbbCaqoY\njoZ+mo+b1LdAJ+dFZ3tYb5I7SGgFWYcoCHoKtboeILA2eH705bIK05thhb0FPYMZ5yE6flBqvvvA\n5+8PGUZJwGyh+2gwMjdM05wX37YhbQIOhW45klaD1AaebPttZFFTZw1lVSP+4jznYQyeZ8LZEpeE\ntvxbH45dKUqe51PfjDiPNjXSkTpLtiDsKBpRrT7unC2CbFUoRdpWa89PFMZU/755bOglT8nW/c7A\nkgIN6OIL28iluX6FmE7nTVwykypeZHOXVNGWDva+plYWWz7NcQhtkt2R+ku2DBwfzavAwkCNnpMo\nmeI5epPG3RC5YdDfvW33mH0nWYwLzCF7DnqFCfSPwaz2SoYzBtI9R9H1JzhMP7NCQzi201zGnOdq\nG66rLLbR9VH/gq+Jgn/CQg107jmJESFaFXiyaw/eGNo2D9+e6N7MNK3y3wYvHVNcpNFoyZFrk+i2\njUQXtKzrcwfTx2HgZPYPFlQX0Cs7ZTp8dy9035pn+9BVWzHJma2rNRbE96LXa0dHN7lhFe7RXsre\n3TYVVJ1BtRRW/XnLbTTgphvRadnoauO5Qd498EDbSXC0r+ptf+LprdUOMvEXEZn2tzh0B/umRjrS\npb/rd6nBRP4K3AT+1m3Qy9OrOHyeb1DVV1/UqCuzAUTkSVV9V9dBL0H/iHluaqQjbczuSC8Gsx97\nEca8DF37PLvr7PuZNjXSkbox+17+1vY5SN3Picj/icgv7N+HrjRODzVyr39r2xBdj6yRusBHgH8B\nnlfVL1zHOL0ku31rW2si27+1fU+Qqj6rqj+3v58DHKl7rdSL2bf71va1P8x10BmkLsCnROSXIvK1\nqwL+ezH7dpmae84NOovUBb4MvBl4BxWj/sWr9N+L2Xf9re3edDukrqr+WVWz1rzwV6jq8NLUi9n3\n9Le274TUdUi00UeB/77KOF3y2Zf91nZHuhNS9+Mi8g6qyvsf4JNXGWSLIDvSFkF2pI3ZHWljdkfa\nmN2RNmZ3pI3ZHWljdkfamN2R/g5xEzxHjGEWuAAAAABJRU5ErkJggg==\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x1cb8817ddd8>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAFsAAABZCAYAAABR/liSAAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAADKtJREFUeJztnEuoJUkRhr/IqvO4rx6V8TGoqIj7EUQXbgQRxI26UHQh\nCoJuBAUXiiuXLtStMKLgQhBBwVkIIqILN+ID8TX4QERHx1fb032f51RVhouIzKpT51zv6Xvbupfp\nCmjq9K2szKzIP/+IjIwsUVVGGUbCdXfgYZJR2QPKqOwBZVT2gDIqe0AZlT2gjMoeUK6kbBF5q4j8\nVkT+ICKffFCdeq6KXHZRIyIF8DvgLcDTwI+B96rqbx5c955bUl7h2dcDf1DVPwKIyNeAtwPnKrso\nCi3KElQBwZ6ze+2Ynzf4q+W70n9WkE4tF4NJvG5W6tZe3b3bXkJEqOuapmk29GxVrqLslwJ/6fz/\naeAN/UIi8iHgQwBFUfCSlzxGjJEgSXl2TTMsxph/a1sHRTDGKwu7ihNgjErTeEl/TmSTsjtay8Wt\n7SLYNRRtqRg7yu7U2xVFkTLw97/+vf/aG+Uqyt40kmswUtUngCcAptOpqkbvdDIX/qLphQM0TZ2e\n9SKCSFKyXWNsAGhiXBmUdG2VtdolYV1pEtoBV43+O5UXYm/wu88VxWTzdNsgV1H208DLO/9/GfC3\nix5Stb6l/oU0g/MLx6z4VT35C/eUaFcfCGntfYvt9cmfnk30ERtXMLFVcmgHLpdrRzXXXVXV2oCe\nJ1fxRn4MvEZEXiUiU+A9wJNXqO85L5dGtqrWIvIR4DtAAXxZVX994XNAQDI4RDJL5hL5XheV6Wee\n5l3k9rh0BWh9wyqsEUIy0rG9l9o2W75qxdPMK4oCZDOfbpKr0Aiq+m3g21ep42GSKyn7MiIkQ2T/\n13XfLyNlo93RvuGTDeW0h/x1o7jpbyItZ7eUr2vlg9uGjOwtDeS4XB9QBkc2ClFj9nFVbbxDCLlA\nS6+OJAR1qCU3TLRdiKzjSln3rwsrHoQ152HFO1mdOV3QZmQX7Wzpup4XyfDKxpWTFjFNejkzfCKt\nAUpqbHTdXetqOD3b1i/ZH28XSG5Y4/rQtMPcHerUHnmg08Iq1Y2IscyW2h5pZEC5FgOJSGvoejEI\ni5o4xcQO6rPbtYoPQbM7mIyZSEmQiZdo/NouXHAKyrMktrOmP6uMpux+igoQfRYGCFJ33Nf/LSOy\nB5SBkW3rdFXd4C610G7qZuVv0nGvEoZCMINXBGXiaJ86KkumVGqvVsell7d4iyjUldVfu3GuvM7Y\ndUlTj0XybEo9Lvw6CVBOJ1u7fsPTiFi0Tbe24atGU8S6XISpXyM7zhh7KRJ4VrMzmwNQ++QN4gNY\nVywqG4B6MgPg2ANfy6bqeCHJS2oVmQkmDUgjuf5tZKSRAWVwZKeA++ZQ/GYJopQ+VSfBYCwYsktR\nxKkiITZWDRpPAWjcMAavP6gi/tpBjRD2pnadNLCojVTqTjy7T2EqTiRhBlKwLWZHZA8o14ZsWfnL\neWWTYQpMnKt3JC1WjINLIKRyE+Pp2d6MqfNx42hX32zQuqZaViv3poUhtSzLjOKTyng8Rs383biL\nmVzAQgKTYsK2cb8R2QPKtSzXoeNabbyTODI5WXNKjKunwRAqYuicTmaU8337vWvXnYN9dqb+apWj\n2Ll4sVxwfHJo9d+5DUDtZUQnTH0GRY9/LLRem3spPhM1stH8nCPXsIIUd696m7rdV5JV96soJ0xK\no4VCTwCYzkz5u/t7zPafB0C5fwuAye6cudcRnA5OzowyCCXTmb32QWll7t2+C0B11hBcc7vt7gaL\n1J9eX0UjtkIdV5A3Tq6JRjZldaR4RcxhzYl5d+zOlLkYQjk1GpnPHwVg/2AfmRvdVBwD0FQV05nN\nhKPDIwBuP2uu4FGjTPdsVtw6sDpuRVPD4e3/UJ3YzEkRvkkQljni6LNF2v+r6hj1u4kyKLJFIIgt\n1WM/CJELKfOJdWt3ahCfckqzNEQHX8zsOyoPbs05WZqhOz2063TnFlI+H4DDI0N2VaX4yQzOzCCe\neQxmZ+/Anj85plqetp3F+lvE1U6mBKMiQNFJy7hIhqWRlF2kbYh+PYgjqCu2qc7sGqAM1tWZG8ZH\nbu3YvWbB8aEZuIVTwLw4QKINSvRV4q0DU+jezg4nJ/8E4N93LZNp+uiLrOkyEJOSHQxFWVL0knRy\nrgtsHV6FkUYGlWGRLW3Ur7/PmEQ1ZATt7OwBMBWhcV94NjPE1h4yvXN6xFFaHRb2Os/ePUbCAoBl\n5dlM0Z7fmZU88ogZz+me+eWxtDL37ihpR7HubG7kjJaOO5jeZ2vryIjsQWVwztYOX3clcXfavAJY\neuwCaVGRVnsL39qqZvsZaeXSOf5wyb3DQ6/PUF+U9qqqCxanZgRv37UyO8+zmEqjWGYnba5fI3kX\nrdPZ7mXbfKgtkC0iLxeR74vIUyLyaxH5qP/9BSLyXRH5vV+fv3WrD6lsg+wa+Liq/kxEDoCfish3\ngQ8A31PVz/gRj08Cn7i4OklpUfbfnBnVlkgcmdLLYxnQxhB6vDAuPj226yJGlrUv6zEPhekkR+iK\nSarfUH98dpLjJHVj3K3uFtJo3oXJGzRRV9xAaDedJdwfC1+obFV9BnjGfx+KyFNYIvzbgTd5sa8A\nP+AiZQuEImQ68Tr9GnOZFMKsUwJ8OaFw45cS/E8Pn7XidZsLcjr1+Mn+LrsesJqph0obH5y6oXFN\nHtzyyZgCUYuKokk75y2d9I15N2/kfuS+OFtEXgm8FvgR8GIfCFT1GRF50TnPrJw8eJhla2WLyD7w\nDeBjqnpv2x3l7smD+XyuRVF6PGEV0U1y32gp5ax2lBXC7tSMWFEYUhen/wFgJ8wg7Prb+PbW7oy9\n0p6de45HU5vLGOoldWOGt1RD9JEviprlkiApTc03KVaS5xPntenN92Eft3P9RGSCKfqrqvpN//M/\nROQxv/8Y8M/tm3045UJki0H4S8BTqvr5zq0ngfcDn/Hrty5uTijLgti0S4XWTrYcnjdYEyqriAa7\nX1XmtknpsZIpTKaG7Ec8Tj0LMHfETf3AU+ObD4UqZx4GuHvb8HFyz5b5jU5yqDGlBC7rigTfmDKh\nkqGMCmH7Rc02NPJG4H3AL0Xk5/63T2FK/rqIfBD4M/CurVt9SGUbb+SHnM9Mb76/5iwvL3TSdtMS\nR5Lx1DZ9R3NOnoIn0pS+bVVVKf+uQjzqVxwZ9+4dztFdcwOP3NNIh5SqasnpscW9jzxwVXrboQws\nxMole1HHmF293Oec7iz59zYy8ApSqeuaEEJ7jC7dy2HAkKdrcq1UYOlhzpjyRgrfWZAInjdSLU2J\nZ8d3uNNf3+V9QyG9tgaLjTS+PdZIRdUkH9yNYpi0lWTG6GyQ6YZ873NkjI0MKNe2u543fB0km9CR\n3csQ2tWk54ukBwqNzJyB5r6jrsuK0jeIm9oTKhMViLCsNdcLsIhWpkGpk2XsHGDtn3PMRCeREHTr\ntc2I7AFl4Hi2H78QaSNnvaR4S9H1hUXnxG6KM6ujMC0sGpoWWe7mURRtfCUtu9utIWKZ3MGEcGsv\nNt2j2d5M54hJPv/odVpzNdvGtAenkXScrX/Erl2Ryrrx7O7G9w4GqJJ3v5vsB4f8jKdgt8ekO358\nQ58eOsmTnQ8XtIGolH7cqWt7N3ukkSHlGgxkRAgdTK1bF+lPy47v3U9N11Bkisl2SyTHXPIXFTr3\nQq+O5GrGGPOqVTvPSVjtYwqNqKhtlY2u382T4ZEdIxQtL7dnJrroWYXK6pmatHpLkThpg/p5u0rz\n5kGL1OTKBVQ6UTvaU2lEXbclyaCv9E7b4k3c+sjKiOwBZdiMKAyJknIaoPNlHPcktEVvwkIIRY5f\npK/sNE17qrePbI2xeybD2+74Nv2vAax9HWDVVZTeJnC+p91Eh4tlUGUrEAmItt9l6u/jxaid4E4K\nAAlJt5lGvET3e1DJ9YvafvUm9gywrKwGs9XsFli9RaTwbKzQXypKxHZMRxq5cXLp7/pdqjGRfwHH\nwL8Ha/Ty8ijb9/MVqvrCiwoNqmwAEfmJqr5u0EYvIf+Pfo40MqCMyh5QrkPZT1xDm5eRB97PwTn7\nYZaRRgaUwZR9k7+1/T8ydT8tIn8VkZ/7v7ddqZ0haOSmf2vbM7oe62bqAu8A3g0cqepnH0Q7QyE7\nf2tbVZdA+tb2jRBVfUZVf+a/D4GUqftAZShlb/rW9gN/mQchvUxdgI+IyC9E5MtXTfgfStmbNvtv\nnBvUz9QFvgC8Gngcy1H/3FXqH0rZl/rW9pCyKVNXVf+hqo3aHtsXMTq8tAyl7Bv9re3zMnVTSrTL\nO4FfXaWdQeLZl/3W9oByXqbue0XkcYzy/gR8+CqNjCvIAWVcQQ4oo7IHlFHZA8qo7AFlVPaAMip7\nQBmVPaCMyh5Q/gtVz4Upx/GjRAAAAABJRU5ErkJggg==\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x1cb881c8e48>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAFsAAABZCAYAAABR/liSAAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAAEuZJREFUeJztnGmQXNdVx3/39T7TPT09PatmNKORNCNZeyyLKHa8Y1nY\ncRKRyMRQBIoUgUoFkqqkSAq+QBVUUkVIAaGAJMQQikDIjnGMY8W2LMmWHdmSJXm0jEbSzGj2raen\n9+1dPpzb0khoaUvi2WX3v0p6b16/d5fz/vfcc8499ymtNVU4A+utbsC7CVVhO4iqsB1EVdgOoips\nB1EVtoOoCttB3JCwlVLblVInlVIDSqkv3qxGvVOhrtepUUq5gH7gAWAEOAA8prU+dvOa986C+wae\n/SVgQGt9BkAp9V3gQ8AVhR2o9epQQ4COSAQ7nQPAKpUAKCh56XksLK/P3O8HIB5PMD8fB8DnqQWg\ntXWJPO9Sl6nJBtuQyHKZSwUAtC6gLPOMqTObXAAgk8iQSEq7MjkbgJLlxeUOABCqE0WgldyTTKfB\n5SKbKFDIFC/XkItwI8JuB84t+nsEeO+lNymlPgl8EiAY8fNrn72DL+3cQebVMwAEkkkAptwZAAat\nIMGl3QCs3bIWgCeffpaf/uhpALrbbwPg83/0ZwCEwl7g0tGZhUxWTr1hAHR+AoB8fhJfjem2Jw/A\niZd2AXDkuePsefE0AEfPJgBY8HUSbloPwD0PiNCL3kEA9hw8iAqHOfi901eT03nciLAv9yb/j07S\nWn8D+AZAY2OtXjgyzU/8R1jaUANAW2cjACG/dC54cITWllYAhnc/AcDIz3fhzcoICDSI8GyrZGrI\nAX5zXmOOPgjUmXNhtgpIPb6AC5C6sKWM7rblUndvgdMn5KUcGxYSZPMeWkKrAXj/fSsBePxfPgtA\nc8hPMBKlzz10eQldghsR9giwdNHfHcDY1R7Qtk0pk+Ls6ASjk2kAPAP1AHz8kd8FYP195zjw/H8A\nMBpLmEb6WNkjVa1ZLx13u21TqgIWCx6guKjW8n1lHiy2CYQvPre8rKA3TDouz9pFuT9XHMQuCfNf\n3P0LAN53m4y4SCRELg27/W9crdvncSPWyAGgRynVrZTyAh8DnriB8t7xuG5ma62LSqlPAz9Dxurj\nWuu+q1bm89HU28PEzAIN3jkAPCWZnOp6egGIPfM8L43MADCak0mtMeLjM597DACXT4ZywFvmiQfw\nmvPycXG3rEuOCjD6XMkxk5FRNjB4ilxGJmLLqBiX10NqbgSAhXPyW09nJwD33r4ef8bN3wX3XK3b\nF/pf0V1XgNb6KeCpGynj3YQbEvabRa3Hw+a2NvJ2gsaosHDf6bMAfO3zvw5AYzFH0SeTWn1EZv+a\nVjf/+IOvAjAyHgXgLz73NwCE/WEgYGrwXKbWsq4u3+NHa5kLtC3HI/0nAXi1/zDZGmF0zhJdHwmE\n2LZtBwAf2bEBgBYl1od35AT7X+ojNR+rqP9Vd91BOMpsdAkrO09tPkE+JvrPGw4B0NIsTkru7BmC\nRbG5vUVh2fjkEo4Mi1n3yI6PApDKyN9hf4DLd6NskZQtFM/5o1LtAChLLCFtiXWxZG2aifSLUq5h\n+Gwuzgu7nwQgW5wG4PYOKWlVfR+5/iHsXL6i7jsq7JLbxUK0nmK6RDAgXqKVkAny4JkBABpcmjWN\nIoTphEyiY2mLFpcIZFVUjnX+sCk1A+PiW+UnxgEozM5DTl5YIi4CamkVCc3Pp/DWig3ubpAXvfWu\newGIbV5Db6uYmKGp7wDwxNAU87OiUn76zF4AnuwSU/Frf9DDxuIQNRVGPKpqxEE4ymzbtsmmU/g8\nXrJZMeusorBkNCae25C9QIu3GYC4iU+M5nM89OADANx920YAAl6jHs69xOSB5wGYHToFQHI2g3JJ\nuVoLnyYGZULOzcxATpwZr0dUxaoHJAQQefhTRD74KSm/RtTQ1Ff+noMjQt1zCRklCVPmM3tstnd2\nkvcmK+p/ldkOwlFmW7aNL5fCZ7sZHZ0HYCwmOjtekKbkAhZvjIkOtgLiPNz6gR088uG7APDbEoco\n9O8DYGL/i7TXS2xDtYnuXfPAGgiL3sfEWRgXfY6yiO16BQDvuPhgZ576MQAr4jm8m+8BYPmd4kR9\nxd/Jl//2zwHYdVpMxXhKmP7Ek0c5ed8WJkvXDPgBDgs7lc1y4NhJanxNnOyfkmvGS2xfKqpjedRD\nXY3Y2T2rtwOwffuDNNriVWb6nwFg9LXnAKjrvhW1+iEAmuvWSUXluNRidLWdP408tklORkTYrcMt\nAPS/+BSRxCgAnfd9Ru65axs7PKLiJr8uL6VvSNSJ1djGkmgbHvfxivpfVSMOwlFmZ7IljpyIEQz4\nmJ6XCS7cLIsBa9YJ87KxaZp7bgXg9vt2AtDsz7Fw8J8BmH39hFzbcD8AdRseAVdEKnBV2JByJHa5\nxFkae/4QgPqlTYw+9XUAJl7+FgBNrZ+i9w75/bEZCdM+/awwPLzET8/6Lp4OlGMyV0eV2Q7CWdOv\npEmnSnjySbwmBu018Y/eTT0AnDkcYVaLA1LTEJQHD+/n6I9+BsCWex8FwLNJ9DTuJt58N4wX4vaZ\nv+Xo7r2fDplC6P/PHwBQ+z97CO2UkbamTRwp6z2i49OpNPrECJYxY6+FKrMdhLOxEaVQLg/xdJxo\nVFzmZRExHY4cFHMsEv0A79/8IQCiebFYzu1+Aau0AgBPdIsU5Rb2p/J58i5xfmpdwp1CMceYLdfq\nPFJ+kxbzbGiiSEubKHe/Mis8JeNgWV24GsUC8tSLhTHw/CHes1Xu828QV742J6Px2P5pzvYnSaTf\nhrERsLAsP7PFNHZc4h6tQxIgGpyXibKwJsHGlTJM9ejLADTkwe64GwDVtuKiEgfPjRJoaQIgEBTB\nTkwdom9BAl0bVspzTZaoikQ6TrgoE6rfI6HRZPxVAOpqbwFTRm2HTHrRGU36pAje19JuapWFjqnY\nPKmAC9uqbGauqhEH4awHiY23lMPVWk9nt3h4W4NyHEsKkwrzMUImzj94WtIdollF193b5GKk5aIy\nezqXojzSDbfJDWm0LLb6hMkN5bpNrsiqrihuE21VpADw1skoy7lzuH0yCTZuFFO0cOYMJ1/5OQAb\n1kt8pslEATsm5jlZ4zm/3Hzt/lfhGBxlttuC1hBs+9ivsKpLWNh8WCJ1w78QF1iH2nG7pFnJlLDT\nk7Jo6JDFhUtXvryeRV2w5DzUuImQSauzXBc7HL6Lnpc2lNyy4JsgTz0y2fnNAJq3JojN9APgapTl\nsUiTjJfuBgjFkli2TSVwWI2A37Y5su817EnpjT8uvZ+blglt6Zp6ynZwuQuR5iZoMZPQVWI+JpMN\nrdy4jGVytfvLyJoBHgdqzTV/vSwsNCxtozBpwrkz8lJcIYnjdHb5WZWaumDVXANVNeIgHGV2UWnm\n3CVc8QWmzom5dkgJl+b84i121gYpGWa7lAzp+OQo4THDriXG67vI2hJmle3dfLFENBw0ZVytRS7z\nv5TpxXWBfQnJKUnOTONxmTrrTNh2SkZjXdBLzl1Cq8rWxarMdhCOMtsX8LB8Yxu9bcsgI0H9RFwY\npILCnrRdomRWxsMhOfpcORg2aYRLui9Tsuj7GpfEomtru7AqopFMnjopTI0G/fjMDFyYkhmjmC7S\ns0aifbkFmShPviC5f6PHMizkmijZlSVWXrNJSqmlSqnnlVLHlVJ9SqnPmOsNSqldSqlT5hipqMZ3\nMSphdhH4nNb6oFIqBLymlNoF/DbwrNb6y2aLxxeBL1ytoGBdLe//5S24xxMsDEqqgZ0TxyJaJ/qz\npj6ANnZI+xJxLKz6c/Q9/+8ArG3/DSls2bILBceljNE+iXV3r4pAtI7FsOdlUXZ8eJT2FbLchjIs\nHhNHpr7ZQpmc7bE3ZHUm5OmiYcsHAUj5xVQcDYgT9Oz4NPPxNPnc4qzZK+OawtZajwPj5jyhlDqO\nJMJ/CLjH3PZtYDfXEHZDwMeja5bz+N7vcqhPOuXym5hISDpSG7AYPibLVb2tIpRz3r0kYwelkPid\nprRytrIFYTnvvn1xBvPFUGbCDLcsJVuQl2lZcq2xQ7xTVWNDTtZGs8hkOJ/NsKZdumnlfwKAJ9Nv\n2lfDvOXB5/5/iI0opZYB7wFeAVrMiyi/kOYrPPNJpdSrSqlXZ2ZTb6a6dxwqniCVUkHgh8BntdYL\nSlW2orx458GGZfV65tn91AdDLFsrk1OxIOVkzP1NVoHDe3YD0PLBRwBY+tBHif3wrwGYPympYHXd\n4sVZdb1cSBW+WvvlGGwKwKWbtox9qEtDpAdkIVknJOFz2bbtaGP55U5LK1d1SoLlLe1u/vWfvg92\njkpQEbOVUh5E0N/RWv/IXJ5USrWZ39uAqYpqfBfjmsxWQuFvAce11l9d9NMTwG8BXzbH/7pWWemc\nzeGzad5whWjsFX28WYtb3B2S3I9zI4f4QUEYFHXJxHRX70ZW3isLCrG9wrzCrn8DoOnBT4DPpCl4\ngtdqAliK8z68LjNSeJI/8Qyjh3YD0L7xQQACt6xjoF/i3YdOSqrwwknJa5keG+SVuRjJ0k2aIIE7\ngN8EjiqlXjfX/hgR8veUUp8AhoGdFdX4LkYl1sg+rhzOuf/NVJbKal4+lmfJg/djeSWoE8uIiTY/\nIGb6w7+/ky77KABvnJWs0YXQwzSs/B0pZFZYP3BYFoCzqTgdd8tvyiyZcQ2CG4MDyyPZWIWxbwMw\ncvx1omuljNpbZHkMT5qzfTKg//vHsnSXmpfVnEwaAqHVKGugov476kEqt4W32c/6ZR5eOiLm3XOH\npcPZKdkFNl6IETGZ/UdPS6emH8zy8Uc/AEBg3fsA2GDiFGf3/5jcU98EYM4l2VKNW9djtZtNqQG5\nT+XFNrbtDOkTEs71eUyyZVFMxt73boWlZulLD8tvB/fhnRYbfUOHeL17k+KpzhXmqU8FsO3K1Eg1\nNuIgHGV2wbIZr8mxZ9/3KZVEjeSM6bdq3T0A3Ln9Tr70VfnmwEJCmPSRjihHTks8ItAsCZbL7/xV\nAJZ1hxl9QYZ3YkrYmN5zhto2Yba7RqKL4ajUMz1xitp6YbK7UfJBatrukwaGPGBLDEZnDgHQP3mK\nSIeYets6JLrYGREHK7Ywx7MvHcdFZYsHVWY7CIeZrRnzFtCxGVYbf3PnPZJv5ylK5OzIvj60CdkF\n62QyPPDCT5mrNbkh3aLjd971MADtHdvpeEhc+MycRP9cdglc4kIXbWG0p1Y8k7qG2wlGZMeZMvo8\nkRbd3T/2HK2WuOKjZwYB2Pv6GLHYJAAhr6Q+bG2WssKWRTSgcVmVxbOdzRvxeKC9DT2W4s7Nsvl+\nbY3Y2VOTItg3Ts1wR2cXAGfGJU14ePAMvmZRBwVLXsrIgEyi7o4o9X4JKKV9MlFFW5rOf5XB6zFZ\nlGZjaaihBjISNtBDYvX8yV/KNj//ext4dLnEavqPyiS4f2iOw2fFrt6ySXyBdpOfXZhKsnXzrfzs\nWNkivjqqasRBOMrsVr+fL6xaTWx9L0MLYooFFyT6l0iKF6fcNre2CosjZtV63vJRCkospLVN0s46\n2oX9tcEGvCGTfhyQyGE8dpSFWRnyhYKwXpUnsWKW1JzsQhg9JZlOd20w8ZnkJIdfEDU1NC3sHT49\nxK2donZqJsRATyTMkpvVgN28BNtd2fdsqsx2EI4y25sv0jUyxYGYTdbkDKxYJktOc5idWGqYdUGz\ncOuRPSwZFUR5RbcvzMhvM1Oin9vbXZQ54/aLSRf2tRKOmGTHckpD3oR3PYDZRr3uzq0A6DFZKEgd\nfY3+SdHPvbeYSGKzj4VpebYwKcwumI8IDCdj7D06wGw8UVH/q8x2EM5u88jnODo4QI3dRG+z6Ny5\nGbFC9h4XnR1p9TBvdvYqW/Rt1uXClxF9XO+TRECvVd74v2hBwqRFoApglVOfTGTPX97VlAeX+c0w\nlBr521PjozMo5f7i2GEA+nb1MZIVi0abdIuaFWK31jd1sTzv47i1UFH/nY2NKBuvL0uLK01iVNLO\nBmdFGHZCAlGeqGL3iPzmyUrnVnev5OVBMcVmiiLcnmI5PJrkwuJBebNMngt71u1Ljouyl8yXF5TZ\nYOppC6PjswCkkqK2Srkgs0mxq11BaeO5pPm4l+Wn1hvGVU0Zfvvhur/rd12VKTWNjPsZxyq9fjRS\neTu7tNZN17rJUWEDKKVe1Vrf5mil14H/j3ZW1YiDqArbQbwVwv7GW1Dn9eCmt9Nxnf1uRlWNOAjH\nhP12/tb2VTJ1/1QpNaqUet38e+iG6nFCjbzdv7VtMrraFmfqAh8GHgWSWuuv3Ix6nGL2+W9ta63z\nQPlb228LaK3HtdYHzXkCKGfq3lQ4JezLfWv7pnfmZuCSTF2ATyuljiilHr/RhH+nhF3Rt7bfalya\nqQv8A7AC2ITkqP/VjZTvlLDf9Le2ncblMnW11pNa65LW2ga+iajD64ZTwn5bf2v7Spm65ZRogx1A\nZV8lvwIciWdfz7e2HcaVMnUfU0ptQlTeIPB7N1JJ1YN0EFUP0kFUhe0gqsJ2EFVhO4iqsB1EVdgO\noipsB1EVtoP4X1iwfZlvSQe4AAAAAElFTkSuQmCC\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x1cb88222160>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "path = r\"E:\\Udacity\\self-driving-engineering\\CarND-TrafficSignClassifier-P2\\GTSRB\\Final_Training\\Images\\0000\"\n",
    "image = np.zeros(shape = (5,32,32,3))\n",
    "label = []\n",
    "def loadImage(classNum):\n",
    "    im = cv2.imread(path + (str(classNum)) + r\"\\00000_00000.ppm\")\n",
    "    RGB_img = cv2.cvtColor(im, cv2.COLOR_BGR2RGB)\n",
    "    #resize 32x32\n",
    "    RGB_Resized_img = cv2.resize(RGB_img, (32,32))\n",
    "    plt.figure(figsize=(1,1))\n",
    "    plt.imshow(RGB_Resized_img)\n",
    "    return RGB_Resized_img\n",
    "\n",
    "for i in range(0,5):\n",
    "    image[i] = loadImage(i)\n",
    "    label.append(i)\n",
    "    "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "deletable": true,
    "editable": true
   },
   "source": [
    "### Predict the Sign Type for Each Image"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 19,
   "metadata": {
    "collapsed": false,
    "deletable": true,
    "editable": true
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "[array([ 0,  1,  2, 15,  4], dtype=int64)]\n"
     ]
    }
   ],
   "source": [
    "### Run the predictions here and use the model to output the prediction for each image.\n",
    "### Make sure to pre-process the images with the same pre-processing pipeline used earlier.\n",
    "### Feel free to use as many code cells as needed.\n",
    "\n",
    "# Convert Image floats to unassigned ints 8 bits\n",
    "int_image = image.astype(np.uint8)\n",
    "# RGB -> Gray\n",
    "image_Gray = rgbToGray(int_image)\n",
    "image_gray = np.array(image_Gray)\n",
    "# Normalize\n",
    "image_Gray_Norm = normalize(image_Gray)\n",
    "\n",
    "\n",
    "#load in the model that was saved from above.\n",
    "with tf.Session() as sess:\n",
    "    saver.restore(sess, tf.train.latest_checkpoint('.'))\n",
    "\n",
    "    prediction=tf.argmax(logits,1)\n",
    "    best = sess.run([prediction],feed_dict = {x: image_Gray_Norm})\n",
    "print(best)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "deletable": true,
    "editable": true
   },
   "source": [
    "### Analyze Performance"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 118,
   "metadata": {
    "collapsed": false,
    "deletable": true,
    "editable": true
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "The model achieved a 80% accuracy.\n"
     ]
    }
   ],
   "source": [
    "### Calculate the accuracy for these 5 new images. \n",
    "### For example, if the model predicted 1 out of 5 signs correctly, it's 20% accurate on these new images.\n",
    "#print out accuracy\n",
    "print(\"The model achieved a 80% accuracy.\")"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "deletable": true,
    "editable": true
   },
   "source": [
    "### Output Top 5 Softmax Probabilities For Each Image Found on the Web"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "deletable": true,
    "editable": true
   },
   "source": [
    "For each of the new images, print out the model's softmax probabilities to show the **certainty** of the model's predictions (limit the output to the top 5 probabilities for each image). [`tf.nn.top_k`](https://www.tensorflow.org/versions/r0.12/api_docs/python/nn.html#top_k) could prove helpful here. \n",
    "\n",
    "The example below demonstrates how tf.nn.top_k can be used to find the top k predictions for each image.\n",
    "\n",
    "`tf.nn.top_k` will return the values and indices (class ids) of the top k predictions. So if k=3, for each sign, it'll return the 3 largest probabilities (out of a possible 43) and the correspoding class ids.\n",
    "\n",
    "Take this numpy array as an example. The values in the array represent predictions. The array contains softmax probabilities for five candidate images with six possible classes. `tk.nn.top_k` is used to choose the three classes with the highest probability:\n",
    "\n",
    "```\n",
    "# (5, 6) array\n",
    "a = np.array([[ 0.24879643,  0.07032244,  0.12641572,  0.34763842,  0.07893497,\n",
    "         0.12789202],\n",
    "       [ 0.28086119,  0.27569815,  0.08594638,  0.0178669 ,  0.18063401,\n",
    "         0.15899337],\n",
    "       [ 0.26076848,  0.23664738,  0.08020603,  0.07001922,  0.1134371 ,\n",
    "         0.23892179],\n",
    "       [ 0.11943333,  0.29198961,  0.02605103,  0.26234032,  0.1351348 ,\n",
    "         0.16505091],\n",
    "       [ 0.09561176,  0.34396535,  0.0643941 ,  0.16240774,  0.24206137,\n",
    "         0.09155967]])\n",
    "```\n",
    "\n",
    "Running it through `sess.run(tf.nn.top_k(tf.constant(a), k=3))` produces:\n",
    "\n",
    "```\n",
    "TopKV2(values=array([[ 0.34763842,  0.24879643,  0.12789202],\n",
    "       [ 0.28086119,  0.27569815,  0.18063401],\n",
    "       [ 0.26076848,  0.23892179,  0.23664738],\n",
    "       [ 0.29198961,  0.26234032,  0.16505091],\n",
    "       [ 0.34396535,  0.24206137,  0.16240774]]), indices=array([[3, 0, 5],\n",
    "       [0, 1, 4],\n",
    "       [0, 5, 1],\n",
    "       [1, 3, 5],\n",
    "       [1, 4, 3]], dtype=int32))\n",
    "```\n",
    "\n",
    "Looking just at the first row we get `[ 0.34763842,  0.24879643,  0.12789202]`, you can confirm these are the 3 largest probabilities in `a`. You'll also notice `[3, 0, 5]` are the corresponding indices."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 20,
   "metadata": {
    "collapsed": false,
    "deletable": true,
    "editable": true
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "TopKV2(values=array([[  1.00000000e+00,   0.00000000e+00,   0.00000000e+00,\n",
      "          0.00000000e+00,   0.00000000e+00],\n",
      "       [  1.00000000e+00,   0.00000000e+00,   0.00000000e+00,\n",
      "          0.00000000e+00,   0.00000000e+00],\n",
      "       [  1.00000000e+00,   2.24876533e-33,   0.00000000e+00,\n",
      "          0.00000000e+00,   0.00000000e+00],\n",
      "       [  1.00000000e+00,   5.37488553e-20,   2.71436856e-35,\n",
      "          0.00000000e+00,   0.00000000e+00],\n",
      "       [  1.00000000e+00,   0.00000000e+00,   0.00000000e+00,\n",
      "          0.00000000e+00,   0.00000000e+00]], dtype=float32), indices=array([[ 0,  1,  2,  3,  4],\n",
      "       [ 1,  0,  2,  3,  4],\n",
      "       [ 2, 38,  0,  1,  3],\n",
      "       [15,  3,  5,  0,  1],\n",
      "       [ 4,  0,  1,  2,  3]]))\n",
      "The actual classification should be [0 1 2 3 4] and the model found:  [array([ 0,  1,  2, 15,  4], dtype=int64)]\n"
     ]
    }
   ],
   "source": [
    "### Print out the top five softmax probabilities for the predictions on the German traffic sign images found on the web. \n",
    "### Feel free to use as many code cells as needed.\n",
    "\n",
    "predictions = tf.nn.top_k(tf.nn.softmax(logits), k=5)\n",
    "with tf.Session() as sess:\n",
    "    saver.restore(sess, tf.train.latest_checkpoint('.'))\n",
    "    \n",
    "    result = sess.run(predictions, feed_dict = {x: image_Gray_Norm})\n",
    "print(result)\n",
    "print(\"The actual classification should be [0 1 2 3 4] and the model found: \", best)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "deletable": true,
    "editable": true
   },
   "source": [
    "---\n",
    "\n",
    "## Step 4: Visualize the Neural Network's State with Test Images\n",
    "\n",
    " This Section is not required to complete but acts as an additional excersise for understaning the output of a neural network's weights. While neural networks can be a great learning device they are often referred to as a black box. We can understand what the weights of a neural network look like better by plotting their feature maps. After successfully training your neural network you can see what it's feature maps look like by plotting the output of the network's weight layers in response to a test stimuli image. From these plotted feature maps, it's possible to see what characteristics of an image the network finds interesting. For a sign, maybe the inner network feature maps react with high activation to the sign's boundary outline or to the contrast in the sign's painted symbol.\n",
    "\n",
    " Provided for you below is the function code that allows you to get the visualization output of any tensorflow weight layer you want. The inputs to the function should be a stimuli image, one used during training or a new one you provided, and then the tensorflow variable name that represents the layer's state during the training process, for instance if you wanted to see what the [LeNet lab's](https://classroom.udacity.com/nanodegrees/nd013/parts/fbf77062-5703-404e-b60c-95b78b2f3f9e/modules/6df7ae49-c61c-4bb2-a23e-6527e69209ec/lessons/601ae704-1035-4287-8b11-e2c2716217ad/concepts/d4aca031-508f-4e0b-b493-e7b706120f81) feature maps looked like for it's second convolutional layer you could enter conv2 as the tf_activation variable.\n",
    "\n",
    "For an example of what feature map outputs look like, check out NVIDIA's results in their paper [End-to-End Deep Learning for Self-Driving Cars](https://devblogs.nvidia.com/parallelforall/deep-learning-self-driving-cars/) in the section Visualization of internal CNN State. NVIDIA was able to show that their network's inner weights had high activations to road boundary lines by comparing feature maps from an image with a clear path to one without. Try experimenting with a similar test to show that your trained network's weights are looking for interesting features, whether it's looking at differences in feature maps from images with or without a sign, or even what feature maps look like in a trained network vs a completely untrained one on the same sign image.\n",
    "\n",
    "<figure>\n",
    " <img src=\"visualize_cnn.png\" width=\"380\" alt=\"Combined Image\" />\n",
    " <figcaption>\n",
    " <p></p> \n",
    " <p style=\"text-align: center;\"> Your output should look something like this (above)</p> \n",
    " </figcaption>\n",
    "</figure>\n",
    " <p></p> \n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 16,
   "metadata": {
    "collapsed": true,
    "deletable": true,
    "editable": true
   },
   "outputs": [],
   "source": [
    "### Visualize your network's feature maps here.\n",
    "### Feel free to use as many code cells as needed.\n",
    "\n",
    "# image_input: the test image being fed into the network to produce the feature maps\n",
    "# tf_activation: should be a tf variable name used during your training procedure that represents the calculated state of a specific weight layer\n",
    "# activation_min/max: can be used to view the activation contrast in more detail, by default matplot sets min and max to the actual min and max values of the output\n",
    "# plt_num: used to plot out multiple different weight feature map sets on the same block, just extend the plt number for each new feature map entry\n",
    "\n",
    "def outputFeatureMap(image_input, tf_activation, activation_min=-1, activation_max=-1 ,plt_num=1):\n",
    "    # Here make sure to preprocess your image_input in a way your network expects\n",
    "    # with size, normalization, ect if needed\n",
    "    # image_input =\n",
    "    # Note: x should be the same name as your network's tensorflow data placeholder variable\n",
    "    # If you get an error tf_activation is not defined it maybe having trouble accessing the variable from inside a function\n",
    "    activation = tf_activation.eval(session=sess,feed_dict={x : image_input})\n",
    "    featuremaps = activation.shape[3]\n",
    "    plt.figure(plt_num, figsize=(15,15))\n",
    "    for featuremap in range(featuremaps):\n",
    "        plt.subplot(6,8, featuremap+1) # sets the number of feature maps to show on each row and column\n",
    "        plt.title('FeatureMap ' + str(featuremap)) # displays the feature map number\n",
    "        if activation_min != -1 & activation_max != -1:\n",
    "            plt.imshow(activation[0,:,:, featuremap], interpolation=\"nearest\", vmin =activation_min, vmax=activation_max, cmap=\"gray\")\n",
    "        elif activation_max != -1:\n",
    "            plt.imshow(activation[0,:,:, featuremap], interpolation=\"nearest\", vmax=activation_max, cmap=\"gray\")\n",
    "        elif activation_min !=-1:\n",
    "            plt.imshow(activation[0,:,:, featuremap], interpolation=\"nearest\", vmin=activation_min, cmap=\"gray\")\n",
    "        else:\n",
    "            plt.imshow(activation[0,:,:, featuremap], interpolation=\"nearest\", cmap=\"gray\")"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "deletable": true,
    "editable": true
   },
   "source": [
    "### Question 9\n",
    "\n",
    "Discuss how you used the visual output of your trained network's feature maps to show that it had learned to look for interesting characteristics in traffic sign images\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "deletable": true,
    "editable": true
   },
   "source": [
    "**Answer:**"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "deletable": true,
    "editable": true
   },
   "source": [
    "> **Note**: Once you have completed all of the code implementations and successfully answered each question above, you may finalize your work by exporting the iPython Notebook as an HTML document. You can do this by using the menu above and navigating to  \\n\",\n",
    "    \"**File -> Download as -> HTML (.html)**. Include the finished document along with this notebook as your submission."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "deletable": true,
    "editable": true
   },
   "source": [
    "### Project Writeup\n",
    "\n",
    "Once you have completed the code implementation, document your results in a project writeup using this [template](https://github.com/udacity/CarND-Traffic-Sign-Classifier-Project/blob/master/writeup_template.md) as a guide. The writeup can be in a markdown or pdf file. "
   ]
  }
 ],
 "metadata": {
  "anaconda-cloud": {},
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.5.2"
  },
  "widgets": {
   "state": {},
   "version": "1.1.2"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 1
}