Celsius_to_Fahrenheit.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "HnKx50tv5aZD"
   },
   "source": [
    "# Tutorial on the basics: trainning your first model\n",
    "\n",
    "### Tutor: Julio C. da Silva (Néel Institute CNRS, Grenoble, France) /  email: julio-cesar.da-silva@neel.cnrs.fr\n",
    "#### Personal webpage: https://sites.google.com/view/jcesardasilva\n",
    "\n",
    "##### Disclaimer: This notebook is intended from educational reasons only and should not be use for professional data analysis. For the latter, there are other more efficient and complete codes available. It is important to mention that the Python codes were inspired by the \"Tutorial TensorFlow\" provided by TensorFlow Core by TensorFlow authors.  Modifications have been made on the original code for educational reasons and Python compatibility. Further information and other tutorials are available at: https://www.tensorflow.org/tutorials\n",
    "\n",
    "This code run in **Python3** and requires certain python packages, which are: **Numpy, IPython, Matplotlib, Tensorflow, Keras**\n",
    "\n",
    "If you do not have those packages, I suggest their installation via pip install: \n",
    "\n",
    "    pip3 install numpy, ipython, matplotlib, tensorflow, keras"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {
    "cellView": "form",
    "colab": {},
    "colab_type": "code",
    "id": "IwtS_OXU5cWG"
   },
   "outputs": [],
   "source": [
    "#@title Licensed under the Apache License, Version 2.0 (the \"License\");\n",
    "# you may not use this file except in compliance with the License.\n",
    "# You may obtain a copy of the License at\n",
    "#\n",
    "# https://www.apache.org/licenses/LICENSE-2.0\n",
    "#\n",
    "# Unless required by applicable law or agreed to in writing, software\n",
    "# distributed under the License is distributed on an \"AS IS\" BASIS,\n",
    "# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.\n",
    "# See the License for the specific language governing permissions and\n",
    "# limitations under the License."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "F8YVA_634OFk"
   },
   "source": [
    "You will train your first Machine Learning model! We'll try to keep things simple here, and only introduce basic concepts. The problem we will solve is to convert from Celsius to Fahrenheit, where the approximate formula is:\n",
    "\n",
    "$$ f = c \\times 1.8 + 32 $$\n",
    "\n",
    "Of course, it would be simple enough to create a conventional Python function that directly performs this calculation, but that wouldn't be machine learning. Instead, we will give TensorFlow some sample Celsius values (0, 8, 15, 22, 38) and their corresponding Fahrenheit values (32, 46, 59, 72, 100).\n",
    "\n",
    "Then, we will train a model that figures out the above formula through the training process."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "fA93WUy1zzWf"
   },
   "source": [
    "## Import dependencies\n",
    "\n",
    "First, import TensorFlow. Here, we're calling it `tf` for ease of use. We also tell it to only display errors.\n",
    "\n",
    "Next, import [NumPy](http://www.numpy.org/) as `np`. Numpy helps us to represent our data as highly performant lists. Finaly, we will use [Matploblib] (https://matplotlib.org) to vizualize the data. So,`import matplotlib.pyplot plt`"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "X9uIpOS2zx7k"
   },
   "outputs": [],
   "source": [
    "import tensorflow as tf\n",
    "import numpy as np\n",
    "import matplotlib.pyplot as plt"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "AC3EQFi20buB"
   },
   "source": [
    "## Set up training data\n",
    "\n",
    "As we saw before, supervised Machine Learning is all about figuring out an algorithm given a set of inputs and outputs. Since the task is to create a model that can give the temperature in Fahrenhet when given the degrees in Celsius, we create two lists `celsius_q` and `fahrenheit_a` that we can use to train our model."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "gg4pn6aI1vms"
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "-40.0 degrees Celsius = -40.0 degrees Fahrenhet\n",
      "-10.0 degrees Celsius = 14.0 degrees Fahrenhet\n",
      "0.0 degrees Celsius = 32.0 degrees Fahrenhet\n",
      "8.0 degrees Celsius = 46.0 degrees Fahrenhet\n",
      "15.0 degrees Celsius = 59.0 degrees Fahrenhet\n",
      "22.0 degrees Celsius = 72.0 degrees Fahrenhet\n",
      "38.0 degrees Celsius = 100.0 degrees Fahrenhet\n"
     ]
    }
   ],
   "source": [
    "celsius_q    = np.array([-40, -10,  0,  8, 15, 22,  38],  dtype=float)\n",
    "fahrenheit_a = np.array([-40,  14, 32, 46, 59, 72, 100],  dtype=float)\n",
    "\n",
    "for i,c in enumerate(celsius_q):\n",
    "  print(\"{} degrees Celsius = {} degrees Fahrenhet\".format(c, fahrenheit_a[i]))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "wwJGmDrQ0EoB"
   },
   "source": [
    "### Some Machine Learning terminology\n",
    "\n",
    " - **Feature** — The input(s) to our model. In this case, a single value — the degrees in Celsius.\n",
    "\n",
    " - **Labels** — The output our model predicts. In this case, a single value — the degrees in Fahrenhet.\n",
    " \n",
    " - **Example** — A pair of inputs/outputs used during training. In our case a pair of values from `celsius_q` and `fahrenhet_a` at a specific index, such as `(22,72)`.\n",
    "\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "VM7_9Klvq7MO"
   },
   "source": [
    "## Create the model\n",
    "\n",
    "Next create the model. We will use simplest possible model we can, a Dense network. Since the problem is straightforward, this network will require only a single layer, with a single neuron. \n",
    "\n",
    "### Build a layer\n",
    "\n",
    "We'll call the layer `l0` and create it by instantiating `tf.keras.layers.Dense` with the following configuration:\n",
    "\n",
    "*   `input_shape=[1]` — This specifies that the input to this layer is a single value. That is, the shape is a one-dimensional array with one member. Since this is the first (and only) layer, that input shape is the input shape of the entire model. The single value is a floating point number, representing degrees Celcius.\n",
    "\n",
    "*   `units=1` — This specifies the number of neurons in the layer. The number of neurons defines how many internal variables the layer has to try to learn how to solve the problem (more later). Since this is the final layer, it is also the size of the model's output — a single float value representing degrees Fahrenheit. (In a multi-layered network, the size and shape of the later would need to match the `input_shape` of the next layer.)\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "pRllo2HLfXiu"
   },
   "outputs": [],
   "source": [
    "l0 = tf.keras.layers.Dense(units=1, input_shape=[1])  "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "_F00_J9duLBD"
   },
   "source": [
    "### Assemble layers into the model\n",
    "\n",
    "Once layers are defined, they need to be assembled into a model. The Sequential model definition takes a list of layers as argument, specifying the calculation order from the input to the output.\n",
    "\n",
    "This model has just a single layer, l0."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "cSp-GpLSuMRq"
   },
   "outputs": [],
   "source": [
    "model = tf.keras.Sequential([l0])"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "t7pfHfWxust0"
   },
   "source": [
    "**Note**\n",
    "\n",
    "You will often see the layers defined inside the model definition, rather than beforehand:\n",
    "\n",
    "```python\n",
    "model = tf.keras.Sequential([\n",
    "  tf.keras.layers.Dense(units=1, input_shape=[1])\n",
    "])\n",
    "```"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "kiZG7uhm8qCF"
   },
   "source": [
    "## Compile the model, with loss and optimizer functions\n",
    "\n",
    "Before training, the model has to be compiled. When compiled for training, the model is given:\n",
    "\n",
    "- **Loss function** — A way of measuring how far off predictions are from the desired outcome. (The measured difference is called the \"loss\".\n",
    "\n",
    "- **Optimizer function** — A way of adjusting internal values in order to reduce the loss.\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "m8YQN1H41L-Y"
   },
   "outputs": [],
   "source": [
    "model.compile(loss='mean_squared_error',\n",
    "              optimizer=tf.keras.optimizers.Adam(0.1))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "17M3Pqv4P52R"
   },
   "source": [
    "These are used during training (`model.fit()`, below) to first calculate the loss at each point, and then improve it. In fact, the act of calculating the current loss of a model and then improving it is precisely what training is.\n",
    "\n",
    "During training, the optimizer function is used to calculate adjustments to the model's internal variables. The goal is to adjust the internal variables until the model (which is really a math function) mirrors the actual equation for converting Celsius to Fahrenheit.\n",
    "\n",
    "TensorFlow uses numerical analysis to perform this tuning, and all this complexity is hidden from you so we will not go into the details here. What is useful to know about these parameters are:\n",
    "\n",
    "The loss function ([mean squared error](https://en.wikipedia.org/wiki/Mean_squared_error)) and the optimizer ([Adam](https://machinelearningmastery.com/adam-optimization-algorithm-for-deep-learning/)) used here are standard for simple models like this one, but many others are available. It is not important to know how these specific functions work at this point.\n",
    "\n",
    "One part of the Optimizer you may need to think about when building your own models is the learnign rate (`0.1` in the code above). This is the step size taken when adjusting values in the model. If the value is too small, it will take too many iterations to train the model. Too large, and accuracy goes down. Finding a good value often involves some trial and error, but the range is usually within 0.001 (default), and 0.1"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "c-Jk4dG91dvD"
   },
   "source": [
    "## Train the model\n",
    "\n",
    "Train the model by calling the `fit` method. \n",
    "\n",
    "During training, the model takes in Celsius values, performs a calculation using the current internal variables (called \"weights\") and outputs values which are meant to be the Fahrenheit equivalent. Since the weights are intially set randomly, the output will not be close to the correct value. The difference between the actual output and the desired output is calculated using the loss function, and the optimizer function directs how the weights should be adjusted. \n",
    "\n",
    "This cycle of calculate, compare, adjust is controlled by the `fit` method. The first argument is the inputs, the second argument is the desired outputs. The `epochs` argument specifies how many times this cycle should be run, and the `verbose` argument controls how much output the method produces."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "lpRrl7WK10Pq"
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Finished training the model\n"
     ]
    }
   ],
   "source": [
    "history = model.fit(celsius_q, fahrenheit_a, epochs=500, verbose=False)\n",
    "print(\"Finished training the model\")"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "0-QsNCLD4MJZ"
   },
   "source": [
    "## Display training statistics\n",
    "\n",
    "The `fit` method returns a history object. We can use this object to plot how the loss of our model goes down after each training epoch. A high loss means that the Fahrenheit degrees the model predicts is far from the corresponding value in `fahrenheit_a`. \n",
    "\n",
    "By plotting this informat, you can see that our model improves very quickly at first, and then has a steady, slow improvement until it is very near \"perfect\" towards the end."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "IeK6BzfbdO6_"
   },
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAYsAAAEICAYAAACuxNj9AAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADh0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uMy4yLjIsIGh0dHA6Ly9tYXRwbG90bGliLm9yZy+WH4yJAAAgAElEQVR4nO3de5heZX3v//dnzueZZDIJkwMkQMCEWgKMnHRXpYKIVmxrFWor9ce16W5xF3vayu7+bQ8te6u/KpVW2eKWiq0F2VYusikeIqBUUSCRcEgCJEAgCTlMzpkc5vj9/bHumTwZ5kQyzzwz83xe1/Vcz1r3On3XMMw3677vdd+KCMzMzEZSUugAzMxs8nOyMDOzUTlZmJnZqJwszMxsVE4WZmY2KicLMzMbVd6ThaRSSU9Iui+tL5L0qKQNkr4tqSKVV6b1DWn7wpxz3JjKn5P0znzHbGZmxyqbgGvcAKwDGtL654CbI+IuSf8LuBa4NX3viYjTJV2V9vugpKXAVcBZwFzgR5LOiIje4S44a9asWLhwYd5uyMxsOlq1atXOiGgZaltek4Wk+cC7gZuAP5Mk4BLgd9MudwCfIksWV6ZlgO8A/5D2vxK4KyI6gZckbQDOB34+3HUXLlzIypUrx/1+zMymM0kvD7ct39VQfwf8F6AvrTcDeyOiJ61vBual5XnAJoC0fV/af6B8iGPMzGwC5C1ZSHoPsCMiVuXrGoOud52klZJWtre3T8QlzcyKRj6fLN4MvFfSRuAusuqnLwFNkvqrv+YDW9LyFmABQNreCOzKLR/imAERcVtEtEVEW0vLkFVuZmZ2nPKWLCLixoiYHxELyRqoH4yIDwEPAe9Pu10D3JuWl6d10vYHIxvlcDlwVeottQhYDDyWr7jNzOy1JqI31GAfB+6S9DfAE8DXU/nXgX9KDdi7yRIMEbFG0t3AWqAHuH6knlBmZjb+NB2HKG9rawv3hjIze30krYqItqG2+Q1uMzMblZNFjgNHuvniiud54pU9hQ7FzGxScbLI0dMb3PLAep54ZW+hQzEzm1ScLHLUVmbt/Ye6ekbZ08ysuDhZ5KgoK6G8VBzscmcrM7NcThaD1FaWcbDTTxZmZrmcLAaprSjjYKefLMzMcjlZDFJbWeonCzOzQZwsBqmpKOOgG7jNzI7hZDGInyzMzF7LyWKQ2ooyDrk3lJnZMZwsBqmtdDWUmdlgThaDZNVQfrIwM8vlZDFI1nXWTxZmZrmcLAaprSyjs6ePnt6+0Xc2MysSThaD1FSUAnjIDzOzHE4Wg3gwQTOz18pbspBUJekxSU9KWiPp06n8G5JekrQ6fZalckm6RdIGSU9JOjfnXNdIWp8+1wx3zfHQnyzcbmFmdlQ+5+DuBC6JiA5J5cBPJX0vbfvLiPjOoP3fBSxOnwuAW4ELJM0EPgm0AQGskrQ8IvIyQ1FtfzWUe0SZmQ3I25NFZDrSann6jDTh95XAN9NxvwCaJLUC7wRWRMTulCBWAJfnK24/WZiZvVZe2ywklUpaDewg+4P/aNp0U6pqullSZSqbB2zKOXxzKhuuPC9qK1KycAO3mdmAvCaLiOiNiGXAfOB8Sb8C3Ai8AXgTMBP4+HhcS9J1klZKWtne3n7c56mtzKqh3MBtZnbUhPSGioi9wEPA5RGxNVU1dQL/CJyfdtsCLMg5bH4qG6588DVui4i2iGhraWk57lj7q6E6XA1lZjYgn72hWiQ1peVq4FLg2dQOgSQB7wOeSYcsBz6cekVdCOyLiK3AD4DLJM2QNAO4LJXlRf97FofcwG1mNiCfvaFagTsklZIlpbsj4j5JD0pqAQSsBv5T2v9+4ApgA3AI+AhAROyW9NfA42m/z0TE7nwFXVPhJwszs8Hyliwi4ingnCHKLxlm/wCuH2bb7cDt4xrgMEpLRHV5qdsszMxy+A3uIdRWltHhaigzswFOFkOorfSThZlZLieLIWTDlPvJwsysn5PFEDwPt5nZsZwshlBbWeZqKDOzHE4WQ6itKHPXWTOzHE4WQ6ipKOWQx4YyMxvgZDGE2krPw21mlsvJYgi1laUc7Oole0/QzMycLIZQW1lGb1/Q2dNX6FDMzCYFJ4shDMxp4aooMzPAyWJI/cOUu5HbzCzjZDGEgXm4/a6FmRngZDGkGs/DbWZ2DCeLIdSlZHHgiJOFmRk4WQypocoTIJmZ5XKyGEJdlZ8szMxy5XMO7ipJj0l6UtIaSZ9O5YskPSppg6RvS6pI5ZVpfUPavjDnXDem8uckvTNfMferryoH4MCR7nxfysxsSsjnk0UncElEnA0sAy6XdCHwOeDmiDgd2ANcm/a/FtiTym9O+yFpKXAVcBZwOfCVNK933tSUlyJBh58szMyAPCaLyHSk1fL0CeAS4Dup/A7gfWn5yrRO2v7rkpTK74qIzoh4CdgAnJ+vuAFKSkRdZRn7nSzMzIA8t1lIKpW0GtgBrABeAPZGRP9f4c3AvLQ8D9gEkLbvA5pzy4c4Jvda10laKWlle3v7CcdeX+lhys3M+uU1WUREb0QsA+aTPQ28IY/Xui0i2iKiraWl5YTPV19V7jYLM7NkQnpDRcRe4CHgIqBJUlnaNB/Ykpa3AAsA0vZGYFdu+RDH5E19VZl7Q5mZJfnsDdUiqSktVwOXAuvIksb7027XAPem5eVpnbT9wcjGCF8OXJV6Sy0CFgOP5SvufnVVroYyM+tXNvoux60VuCP1XCoB7o6I+yStBe6S9DfAE8DX0/5fB/5J0gZgN1kPKCJijaS7gbVAD3B9ROR9hL/6qnJe3nUo35cxM5sS8pYsIuIp4Jwhyl9kiN5MEXEE+J1hznUTcNN4xziSukpXQ5mZ9fMb3MNoqCpzA7eZWeJkMYy6yjI6e/ro8mx5ZmZOFsOp92CCZmYDnCyG4fGhzMyOcrIYhkeeNTM7ysliGPVOFmZmA5wshlFf6WooM7N+ThbDcAO3mdlRThbDcJuFmdlRThbD8JOFmdlRThbDqCwrpaKshP1uszAzc7IYSb3HhzIzA8aQLJT5PUn/Pa2fLCmv05pOFvVVZZ6H28yMsT1ZfIVs0qKr0/oB4Mt5i2gSqfNggmZmwNiGKL8gIs6V9ARAROyRVJHnuCaF+spyV0OZmTG2J4vuNIFRQDYDHlAUQ7F6tjwzs8xYksUtwD3AbEk3AT8F/sdoB0laIOkhSWslrZF0Qyr/lKQtklanzxU5x9woaYOk5yS9M6f88lS2QdInXvddHifPw21mlhm1GioiviVpFfDrgID3RcS6MZy7B/jziPilpHpglaQVadvNEfG3uTtLWko2lepZwFzgR5LOSJu/TDaH92bgcUnLI2LtGGI4IQ1V5W6zMDNjhGQhaWbO6g7gztxtEbF7pBNHxFZga1o+IGkdMG+EQ64E7oqITuClNBd3f6+rDWk6ViTdlfbNe7Koq8yqoSICSfm+nJnZpDVSNdQqYGX6bgeeB9an5VWv5yKSFpLNx/1oKvqopKck3S5pRiqbB2zKOWxzKhuuPO/qq8roCzjY1TsRlzMzm7SGTRYRsSgiTgV+BPxGRMyKiGbgPcAPx3oBSXXAvwIfi4j9wK3AacAysiePL5xA/LnXuU7SSkkr29vbx+OUAxMg7T/sqigzK25jaeC+MCLu71+JiO8BF4/l5JLKyRLFtyLiu+n47RHRGxF9wNc4WtW0BViQc/j8VDZc+TEi4raIaIuItpaWlrGEN6rG6ixZ7HOyMLMiN5Zk8aqk/yZpYfr8FfDqaAcpq+T/OrAuIr6YU96as9tvAs+k5eXAVZIqJS0CFgOPAY8DiyUtSu93XJX2zTsnCzOzzFheyrsa+CRZ91mAhzn6NvdI3gz8PvC0pNWp7L8CV0taRvbexkbgDwEiYo2ku8karnuA6yOiF0DSR4EfAKXA7RGxZgzXP2FNNU4WZmYwtq6zu4EbXu+JI+KnZF1tB7t/iLL+Y24Cbhqi/P6RjssXP1mYmWVGTRaSHiK9vZ0rIi7JS0STSEO1G7jNzGBs1VB/kbNcBfw2WTXRtFdfWYbkJwszs7FUQw1+p+Jnkh7LUzyTSkmJaKgqd7Iws6I3lmqo3De5S4DzgMa8RTTJNFY7WZiZjaUaahVZm4XIqp9eAq7NZ1CTiZOFmdnYksWSiDiSWyCpMk/xTDpNNeXsPeRkYWbFbSwv5T0yRNnPxzuQyaqhuty9ocys6I006uxJZAP2VUs6h6PvTDQANRMQ26Tgaigzs5Grod4J/AHZWExfzCk/QPYmdlHoTxYeptzMitmwySIi7gDukPTbEfGvExjTpNJYXU5PX3Coq5fayrE08ZiZTT8jVUP9XkT8M7BQ0p8N3p47OOB0ljvkh5OFmRWrkf761abvuokIZLLKTRZzm6oLHI2ZWWGMVA311fT96YkLZ/Jp8mCCZmZjeoO7BfiPwMLc/SPi/8lfWJNHYxqmfO+hrgJHYmZWOGOphL8X+Hey6VWLbjLqGTUVAOzxi3lmVsTGkixqIuLjeY9kkjqaLPxkYWbFayxvcN8n6Yq8RzJJVVeUUl1eyp6DThZmVrzGkixuIEsYhyXtl3RA0v7RDpK0QNJDktZKWiPphlQ+U9IKSevT94xULkm3SNog6SlJ5+ac65q0/3pJ1xzvzR6vmbUV7D7oaigzK16jJouIqI+IkoiojoiGtN4whnP3AH8eEUuBC4HrJS0FPgE8EBGLgQfSOsC7gMXpcx1wKwwMkf5J4ALgfOCT/QlmosyoLXc1lJkVtbH0hjp3iOJ9wMsRMeyMeRGxFdialg9IWkc21tSVwNvSbncAPwY+nsq/GREB/EJSk6TWtO+KNBc4klYAlwN3juH+xsWMmgp2uxrKzIrYWBq4vwKcCzyd1t8IPAM0SvqjiPjhaCeQtBA4B3gUmJMSCcA2YE5angdsyjlscyobrnzCzKip4JXdhybykmZmk8pY2ixeBc6JiPMi4jxgGfAicCnw+dEOllQH/CvwsYg4pq0jPUXE64566OtcJ2mlpJXt7e3jccoBM2sr3MBtZkVtLMnijIhY078SEWuBN0TEi6MdKKmcLFF8KyK+m4q3p+ol0veOVL4FWJBz+PxUNlz5MSLitohoi4i2lpaWMdzW2M2oqWD/kR66e/vG9bxmZlPFWJLFGkm3Snpr+nwFWJtmyxu2i5Cy8by/DqwbNOjgcqC/R9M1ZC/99Zd/OPWKuhDYl6qrfgBcJmlGati+LJVNmJm1/W9xu0eUmRWnsbRZ/AHwx8DH0vrPgL8gSxRvH+G4NwO/DzwtaXUq+6/AZ4G7JV0LvAx8IG27H7gC2AAcAj4CEBG7Jf018Hja7zP9jd0TpSnnxbyW+qKZUdbMbMCoySIiDgNfSJ/BOkY47qccnV1vsF8fYv8Arh/mXLcDt48Wa77MrM2ShXtEmVmxGkvX2cXA/wSWAlX95RFxah7jmlQGhvxwsjCzIjWWNot/JHtBroes2umbwD/nM6jJZuDJwi/mmVmRGkuyqI6IBwBFxMsR8Sng3fkNa3JpSsOU+8nCzIrVWBq4OyWVAOslfZSs22pRzZ5XVV5KXWUZu5wszKxIjXUgwRrgT4DzyHo4TfhgfoU2q66C9gOdhQ7DzKwgxtIbqr/LagepO2sxaqmvZGeHk4WZFadhk4Wk5SMdGBHvHf9wJq+W+kqe23ag0GGYmRXESE8WF5EN4Hcn2QCAw70zURRm1VXys45dhQ7DzKwgRkoWJ5ENFng18LvAvwF35o4TVUxa6irZd7ibzp5eKstKCx2OmdmEGraBOyJ6I+L7EXEN2eRFG4Afpx5RRWdWGuZjV4d7RJlZ8RmxgTsNFvhusqeLhcAtwD35D2vyaanLkkX7gU7mNlUXOBozs4k1UgP3N4FfIRvg79MR8cyERTUJ9T9ZuPusmRWjkZ4sfg84SPaexZ9kI44DWUN3jHEe7mmjf7RZd581s2I0bLKIiLG8sFc0mtP4UH6yMLNi5IQwRlXlpTRUlfnJwsyKkpPF69BSX0m7k4WZFSEni9ehpb6SHfudLMys+IyaLCTVplFnkXSGpPdKKh/DcbdL2iHpmZyyT0naIml1+lyRs+1GSRskPSfpnTnll6eyDZI+8fpvcfy0Nlazdd+RQoZgZlYQY3myeBiokjQP+CHZqLPfGMNx3wAuH6L85ohYlj73A0haClwFnJWO+YqkUkmlwJeBd5HN1Hd12rcgWhur2L7/CL19UagQzMwKYizJQhFxCPgt4CsR8Ttkf9RHFBEPA7vHGMeVwF0R0RkRL5G9LX5++myIiBcjogu4K+1bEK1N1fT0hRu5zazojClZSLoI+BDZ+FAAJzI40kclPZWqqWaksnlkgxb225zKhisfKsjrJK2UtLK9vf0Ewhtea0M2Bbmrosys2IwlWXwMuBG4JyLWSDoVeOg4r3crcBqwDNgKfOE4z/MaEXFbRLRFRFtLS8t4nfYYrU0pWew9nJfzm5lNVmOZ/OgnwE8AUkP3zoj4k+O5WERs71+W9DXgvrS6BViQs+v8VMYI5ROutTEbE8pPFmZWbMbSG+pfJDVIqgWeAdZK+svjuZik1pzV30znA1gOXCWpUtIiYDHwGPA4sFjSIkkVZI3gI07KlE8zasqpLCth6z4/WZhZcRn1yQJYGhH7JX0I+B7wCWAV8P+NdJCkO4G3AbMkbQY+CbxN0jIggI3AHwKk6q27gbVAD3B9RPSm83wU+AFZO8nthZxPQxJzm6p51U8WZlZkxpIsytN7Fe8D/iEiuiWN2nc0Iq4eovjrI+x/E3DTEOX3k418Oymc1FDFNicLMysyY2ng/irZU0At8LCkU4D9+QxqMmttqnIDt5kVnVGTRUTcEhHzIuKKyLwMvH0CYpuU5jVVs23/Ebp6+godipnZhBlLA3ejpC/2v8Mg6QtkTxlF6ZTmWvoCtvjpwsyKyFiqoW4HDgAfSJ/9wD/mM6jJbGFzDQAbdx0scCRmZhNnLA3cp0XEb+esf1rS6nwFNNmd0pw9VL2y61CBIzEzmzhjebI4LOkt/SuS3gwUbR3MrLoKaipK/WRhZkVlLE8W/wn4pqTGtL4HuCZ/IU1ukjiluZaX/WRhZkVkLMN9PAmcLakhre+X9DHgqXwHN1ktbK7hue0HCh2GmdmEGfNMeRGxPyL636/4szzFMyWc0lzLpt2HPK+FmRWN451WVeMaxRSzsLmG7t7gVXefNbMicbzJoqj/SX3a7DoA1u9wVZSZFYdhk4WkA5L2D/E5AMydwBgnnTNPqgdg3VYnCzMrDsM2cEdE/UQGMpU0VJUzf0Y167YW7RBZZlZkjrcaqugtaW1wsjCzouFkcZyWtDbw0s6DHOnuLXQoZmZ552RxnJacVE9fwPN+38LMikDekoWk2yXtkPRMTtlMSSskrU/fM1K5JN0iaYOkpySdm3PMNWn/9ZImzZvjS1obAHhmi6uizGz6y+eTxTeAyweVfQJ4ICIWAw+kdYB3kc27vRi4DrgVsuRCNh3rBcD5wCf7E0yhndJcw6y6Ch7fuLvQoZiZ5V3ekkVEPAwM/kt6JXBHWr6DbKrW/vJvpsmVfgE0SWoF3gmsiIjdEbEHWMFrE1BBSOKCRc08+uIuIor6tRMzKwIT3WYxJyK2puVtwJy0PA/YlLPf5lQ2XPmkcMGpM3l13xE27/Gb3GY2vRWsgTuyf46P2z/JJV3XP5tfe3v7eJ12RBcsagbgFy/umpDrmZkVykQni+2peon0vSOVbwEW5Ow3P5UNV/4aEXFbRLRFRFtLS8u4Bz6UxbPraK6t4N/X75yQ65mZFcpEJ4vlHJ0L4xrg3pzyD6deURcC+1J11Q+AyyTNSA3bl6WySaGkRFx21kn8aN12DnX1FDocM7O8yWfX2TuBnwNnStos6Vrgs8ClktYD70jrAPcDLwIbgK8BfwwQEbuBvwYeT5/PpLJJ433L5nKoq5cVa7cXOhQzs7wZy0x5xyUirh5m068PsW8A1w9zntuB28cxtHH1poUzmdtYxXd/uYUrl02atnczs3HlN7hPUEmJ+MCbFvCT59tZ+6pf0DOz6cnJYhx85OJFNFaX86n/u4Y+z55nZtOQk8U4aKwp56/evYTHXtrNZ+5b6+lWzWzayVubRbH5nfPm8+zWA9z+s5d45IWd/OY587OutXUVzKqrpLmugpoK/7jNbGryX69xIon/9z1LOO+UGfz9g+v53Peffc0+M2sr+A+LZ/HBtgVcdFozUlFPZW5mU4iTxTiSxLt/tZV3/2oruw92sWn3IXYd7GRXRxe7Dnbx/PYDPPTsDu5d/SpvOKmeG69YwlvPmJgXCM3MToSTRZ7MrK1gZm3Fa8qPdPey/MlX+fJDG7jm9sd4+5kt/Lf3LOW0lroCRGlmNjZu4J5gVeWlfKBtAT/801/jr65YwsqNe7j87x7mf96/jo5OvwVuZpOTk0WBVJaV8h9/7VQe+su38ZvnzOOrD7/IJX/7Y+55YrOHPDezScfJosBm1VXy+fefzT1/fDGtjVX86bef5H1f/hk/WrvdScPMJg1Nxz9IbW1tsXLlykKH8br19QXf+eVmbnlgPZv3HGZJawMfvugUfuPsudRVunnJzPJL0qqIaBtym5PF5NPd28e9q1/law+/yHPbD1BbUcp7l83lt86dz3knz6CkxF1uzWz8OVlMURHBL1/Zy12PvcJ9T23lcHcv85qq+Y2z53LlsrksaW0odIhmNo04WUwDBzt7WLF2O/eu3sLD63fS2xecOaee9y6by3vPnsuCmTWFDtHMpjgni2lmV0cn9z+zjeWrt/D4xj0AnHfKDK5cNpcr3tjKrLrKAkdoZlORk8U0tnnPIf7vk1u5d/UWnt12gNIS8ZbTZ3HlsrlcunQO9VXlhQ7RzKYIJ4si8dy2A9y7egv3rn6VLXsPU1Fawq+dMYsr3tjKO5bOocGJw8xGMOmShaSNwAGgF+iJiDZJM4FvAwuBjcAHImKPstH2vgRcARwC/iAifjnS+Ys1WfTLGsb38G9PbeN7z2xl674jlJeK/7C4hSve2MqlS+fQWO3EYWbHmqzJoi0iduaUfR7YHRGflfQJYEZEfFzSFcB/JksWFwBfiogLRjp/sSeLXH19werNe/ne01u5/+ltbNl7mPJScdFps7h06RzesWQ2rY3VhQ7TzCaBqZIsngPeFhFbJbUCP46IMyV9NS3fOXi/4c7vZDG0iODJzfu4/+mt/HDNNjbuOgTAr8xr4NIlJ/GOpbNZ2trgodPNitRkTBYvAXuAAL4aEbdJ2hsRTWm7gD0R0STpPuCzEfHTtO0B4OMRMWw2cLIYXUTwQvtBVqzdzo/WbeeXr+whAuY2VvGOpXN4x5I5XHhqMxVlHhHGrFiMlCwKNYbEWyJii6TZwApJx8wUFBEh6XVlMUnXAdcBnHzyyeMX6TQlidNn13H67Dr+6G2nsbOjkwef3cGP1m7n/6zczDd//jJ1lWW85fRZvPXMFt56Rgtzm1xdZVasCpIsImJL+t4h6R7gfGC7pNacaqgdafctwIKcw+enssHnvA24DbIni3zGPx3NqqvkA20L+EDbAo509/LICztZsXY7P3mune+v2QbA4tl1vPWMFt56ZgtvWjiTqvLSAkdtZhNlwpOFpFqgJCIOpOXLgM8Ay4FrgM+m73vTIcuBj0q6i6yBe99I7RV24qrKS7nkDXO45A1ziAg27OjgJ8+385Pn2/nmz1/mf//0JarKS7jo1GbeekYLb1ncwmkttW7rMJvGJrzNQtKpwD1ptQz4l4i4SVIzcDdwMvAyWdfZ3an94h+Ay8m6zn5kpPYKcJtFPh3q6uHRF3cPJI+Xdh4EYHZ9JRef1szFp83iotOaPfyI2RQ06Rq4883JYuK8vOsgj7ywi0de2MXPX9jJzo4uABbMrObiU2dx8enNXHRqM7MbqgocqZmNxsnCJkREsH5HB49s2MkjL+ziFy/uYv+RbKrY01pqOX9RM29aOIM3LZzJ/BnVrrYym2ScLKwgevuCdVv388gLWfJYtXEPB9I843MaKmlbOJM3nTKDtoUzWdLaQKnn6TArKCcLmxR6+4Lntx9g5cbdPL5xD49v3M3WfUcAqKss45yTm2g7ZSbLTm7i7PmNNNVUFDhis+LiZGGT1pa9h1Py2M3KjXt4bvsB+n8lF82q5ez5jZy9oImzFzSxtLXB3XXN8sjJwqaM/Ue6eWbzPlZv3svqV/ayetNedhzoBKCsRCxpbeDsBY2cPb+JN85v5LSWOspL/Za52XhwsrApbdu+I6zetJcnN+/lyU17eWrzPjpS20dFWQlnzqnnrLkNLJ3bwFlzG3jDSQ3UVhZqcAKzqcvJwqaVvr7ghfYO1ry6n7Vb97Pm1X2seXU/ew91AyDBouZalqTksaS1gTPm1DO3sco9sMxGMBnHhjI7biUlYvGcehbPqed958wDsm67W/cdYe2r+1MS2cdTm/fyb08dfdm/rrKM02fXccacOs6YUz/wmdNQ6SRiNgonC5sWJDG3qZq5TdW8Y+mcgfJ9h7t5btsBnt9+gPXbD/D89g4eWLeDu1duHtinvqosJY46Tp9dz6mzalk0q5b5M6opc3uIGeBkYdNcY3U55y+ayfmLZh5Tvqujk+e3d7B+R5ZInt/ewfef2caeQ5sG9ikvFQtm1gwkj0Wz6lg0q5ZTW2qZXe+nESsuThZWlJrrKrmorpKLTmseKIsIdh/sYuOug7zYfpCXdh79/Pv6nXT29A3sW1NRysLmWk5prmHBzBoWzKhm/swaFsyoYf6ManfxtWnHycIskURzXSXNdZWcd8qxTyJ9fcHW/Ud4qf0gL+3s4MWURJ7bfoAHnt1BV04iAWipr2TBjOqUSGpYMLOa+TNqaG2sorWxmuoKJxObWpwszMagpETMa6pmXlM1b1k865htfX3Bzo5ONu05xKbdh9m0+9DA8qqX93DfU1vp7Tu212FTTTknNVQxt6makxqrmNtYxUmN1SmZOKHY5ONkYXaCSkrE7IYqZjdUcd4pr93e09vH1n1H2LTnENv2HWHrviPp+zBb0zskuw92vea4xupyZtdX0tL/qcu+ZzdU0lJXNVDeVF1OicfVsjxzsjDLs7LSkqw6aoQ5Po509x5NJPsP8+reLKG0H+ikvaOTJ17Zy44DR535nHoAAAoMSURBVDjS3feaY8tKxKy6o0mlubaCmbUVzKitYGZN+q4tZ0ZNVt5Q5eRir5+ThdkkUFVeysJZtSycVTvsPhHBwa5eduw/mkTaD+R8OjrZlt412X2wi67e1yYWgBLBjJrcZFLOzNoKGqsraKguo6GqnMbqchqqy2moKkvf5TRUl1FZ5qqxYuVkYTZFSKKusoy6ljpObakbcd+I4FBXL7sPdrHnUFfOdzd7j1nvYuPOQ6x6eS/7DnfR3TvyiA6VZSVDJpL6qjLqKsuorSyjpqJ0YLm2spTaimy5rrKMmspsW3V5qbseTzFTJllIuhz4ElAK/O+I+GyBQzKbtCSlP9ZlY57iNiLo7Olj/+Fu9h3uZv+RbvYf7knf3ew/0pOV52zbfbCLl3Ye5MCRHjo6e17TK2z4+EhJpPRoIqkopaq8lOr0qUzfVeUlWVnFa8uqyo8eU1VeQnVFKVVlWVlFWYnnSBlHUyJZSCoFvgxcCmwGHpe0PCLWFjYys+lD0sAf3+OdBre7t49Dnb10dPVwqDNLIAc7e+no7OFQVw8HO3vo6OzlUFf/th4OdvVm35097Oro4kh3L4e7eznS3TewPLg32ViVlojyUlFRWkJFWSmVZSVUlJWk9ZJsW1m2raK0ZGD7QHlpadqebSstEWUlory0ZODcpSUl6VuUlZRQViLKStNyqdJ6bnm2rTSdZ/A+pSWiVJp07UpTIlkA5wMbIuJFAEl3AVcCThZmk0h5aQmNNSU01pSP63m7e/tSAunlSFcfR3p6OdzVO2RiOZLWu3r66Ortpaunj+7e7KkpK+ujq+doeVdPH/sOd2fbenrp6u2juyfSfkePKYSjiYOBBJKbTEqVreduP2tuI39/9TnjHstUSRbzgE0565uBC3J3kHQdcB3AySefPHGRmVnelZeWUF5aQkPV+CahsYrIkkdvX9DdG/T2BT29ffT0BT29QU/fCMtp/+7+/Qcd29vXN3DO7r4+enuD3gj6+rLv3j7oi2x7b18MLB8ty9kewckzq/PyM5gqyWJUEXEbcBtkQ5QXOBwzm0YkFX1PsKkypOYWYEHO+vxUZmZmE2CqJIvHgcWSFkmqAK4Clhc4JjOzojElqqEiokfSR4EfkHWdvT0i1hQ4LDOzojElkgVARNwP3F/oOMzMitFUqYYyM7MCcrIwM7NROVmYmdmonCzMzGxUiph+769JagdePoFTzAJ2jlM4U4XvuTj4novD8d7zKRHRMtSGaZksTpSklRHRVug4JpLvuTj4notDPu7Z1VBmZjYqJwszMxuVk8XQbit0AAXgey4OvufiMO737DYLMzMblZ8szMxsVE4WOSRdLuk5SRskfaLQ8YwXSbdL2iHpmZyymZJWSFqfvmekckm6Jf0MnpJ0buEiP36SFkh6SNJaSWsk3ZDKp+19S6qS9JikJ9M9fzqVL5L0aLq3b6eRm5FUmdY3pO0LCxn/iZBUKukJSfel9Wl9z5I2Snpa0mpJK1NZXn+3nSySnHm+3wUsBa6WtLSwUY2bbwCXDyr7BPBARCwGHkjrkN3/4vS5Drh1gmIcbz3An0fEUuBC4Pr033M633cncElEnA0sAy6XdCHwOeDmiDgd2ANcm/a/FtiTym9O+01VNwDrctaL4Z7fHhHLcrrI5vd3OyL8ydptLgJ+kLN+I3BjoeMax/tbCDyTs/4c0JqWW4Hn0vJXgauH2m8qf4B7gUuL5b6BGuCXZNMP7wTKUvnA7znZkP8XpeWytJ8KHftx3Ov89MfxEuA+QEVwzxuBWYPK8vq77SeLo4aa53tegWKZCHMiYmta3gbMScvT7ueQqhrOAR5lmt93qo5ZDewAVgAvAHsjoiftkntfA/ectu8Dmic24nHxd8B/AfrSejPT/54D+KGkVZKuS2V5/d2eMvNZWP5EREialt3iJNUB/wp8LCL2SxrYNh3vOyJ6gWWSmoB7gDcUOKS8kvQeYEdErJL0tkLHM4HeEhFbJM0GVkh6NndjPn63/WRxVLHN871dUitA+t6RyqfNz0FSOVmi+FZEfDcVT/v7BoiIvcBDZFUwTZL6/2GYe18D95y2NwK7JjjUE/Vm4L2SNgJ3kVVFfYnpfc9ExJb0vYPsHwXnk+ffbSeLo4ptnu/lwDVp+RqyOv3+8g+nHhQXAvtyHm2nDGWPEF8H1kXEF3M2Tdv7ltSSniiQVE3WRrOOLGm8P+02+J77fxbvBx6MVKk9VUTEjRExPyIWkv0/+2BEfIhpfM+SaiXV9y8DlwHPkO/f7UI31EymD3AF8DxZPe9fFTqecbyvO4GtQDdZfeW1ZPW0DwDrgR8BM9O+IusV9gLwNNBW6PiP857fQlav+xSwOn2umM73Dfwq8ES652eA/57KTwUeAzYA/weoTOVVaX1D2n5qoe/hBO//bcB90/2e0709mT5r+v9W5ft3229wm5nZqFwNZWZmo3KyMDOzUTlZmJnZqJwszMxsVE4WZmY2KicLm/Yk9abROfs/4zaisKSFyhnNd4T9PiXpUHrjtr+sYyJjMDsRHu7DisHhiFhW6CDIBq37c+DjhQ4kl6SyODqOktmQ/GRhRSvNCfD5NC/AY5JOT+ULJT2Yxv5/QNLJqXyOpHvSfBFPSro4napU0teUzSHxw/T29FBuBz4oaeagOI55MpD0F5I+lZZ/LOlmSSslrZP0JknfTXMW/E3OacokfSvt8x1JNen48yT9JA0494Oc4SB+LOnvlM2FcMOJ/zRtunOysGJQPaga6oM52/ZFxBuBfyAbvRTg74E7IuJXgW8Bt6TyW4CfRDZfxLlkb89CNk/AlyPiLGAv8NvDxNFBljBe7x/nrsjmLPhfZEM4XA/8CvAHkvpHTD0T+EpELAH2A3+cxsb6e+D9EXFeuvZNOeetiIi2iPjC64zHipCroawYjFQNdWfO981p+SLgt9LyPwGfT8uXAB+GgdFd9ymbjeyliFid9llFNnfIcG4BVkv629cRf/8YZU8DayKN6yPpRbIB4vYCmyLiZ2m/fwb+BPg+WVJZkUbbLSUb9qXft19HDFbknCys2MUwy69HZ85yLzBcNRQRsVfSv5A9HfTr4din/Kphzt836Fp9HP1/eHDsQTYm0JqIuGiYcA4OF6fZYK6GsmL3wZzvn6flR8hGMAX4EPDvafkB4I9gYJKhxuO85heBP+ToH/rtwGxJzZIqgfccxzlPltSfFH4X+CnZjGgt/eWSyiWddZwxW5FzsrBiMLjN4rM522ZIeoqsHeFPU9l/Bj6Syn+fo20MNwBvl/Q0WXXTcc3RHhE7yeYgqEzr3cBnyEZBXQE8O/zRw3qObJ7xdcAM4NaI6CIbhvtzkp4kG3n34hHOYTYsjzprRStNmNOW/nib2Qj8ZGFmZqPyk4WZmY3KTxZmZjYqJwszMxuVk4WZmY3KycLMzEblZGFmZqNysjAzs1H9/7AVmU0wuf8wAAAAAElFTkSuQmCC\n",
      "text/plain": [
       "<Figure size 432x288 with 1 Axes>"
      ]
     },
     "metadata": {
      "needs_background": "light"
     },
     "output_type": "display_data"
    }
   ],
   "source": [
    "plt.figure()\n",
    "plt.xlabel('Epoch Number')\n",
    "plt.ylabel(\"Loss Magnitude\")\n",
    "plt.plot(history.history['loss'])\n",
    "plt.show(block=False)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "LtQGDMob5LOD"
   },
   "source": [
    "## Use the model to predict values\n",
    "\n",
    "Now you have a model that has been trained to learn the relationshop between `celsius_q` and `fahrenheit_a`. You can use the predict method to have it calculate the Fahrenheit degrees for a previously unknown Celsius degrees. \n",
    "\n",
    "So, for example, if the Celsius value is 200, what do you think the Fahrenheit result will be? Take a guess before you run this code."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "oxNzL4lS2Gui"
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "[[211.31358]]\n"
     ]
    }
   ],
   "source": [
    "print(model.predict([100.0]))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "jApk6tZ1fBg1"
   },
   "source": [
    "The correct answer is $100 \\times 1.8 + 32 = 212$, so our model is doing really well.\n",
    "\n",
    "### To review\n",
    "\n",
    "\n",
    "*   We created a model with a Dense layer\n",
    "*   We trained it with 3500 examples (7 pairs, over 500 epochs).\n",
    "\n",
    "Our model tuned the variables (weights) in the Dense layer until it was able to return the correct Fahrenheit value for any Celsius value. (Remember, 100 Celsius was not part of our training data.)\n",
    "\n",
    "\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "zRrOky5gm20Z"
   },
   "source": [
    "## Looking at the layer weights\n",
    "\n",
    "Finally, let's print the internal variables of the Dense layer. "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "kmIkVdkbnZJI"
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "These are the layer variables: [array([[1.8238542]], dtype=float32), array([28.928156], dtype=float32)]\n"
     ]
    }
   ],
   "source": [
    "print(\"These are the layer variables: {}\".format(l0.get_weights()))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "RSplSnMvnWC-"
   },
   "source": [
    "The first variable is close to ~1.8 and the second to ~32. These values (1.8 and 32) are the actual variables in the real conversion formula.\n",
    "\n",
    "This is really close to the values in the conversion formula. We'll explain this in an upcoming video where we show how a Dense layer works, but for a single neuron with a single input and a single output, the internal math looks the same as [the equation for a line](https://en.wikipedia.org/wiki/Linear_equation#Slope%E2%80%93intercept_form), $y = mx + b$, which has the same form as the conversion equation, $f = 1.8c + 32$.\n",
    "\n",
    "Since the form is the same, the variables should converge on the standard values of 1.8 and 32, which is exactly what happened.\n",
    "\n",
    "With additional neurons, additional inputs, and additional outputs, the formula becomes much more complex, but the idea is the same. \n",
    "\n",
    "### A little experiment\n",
    "\n",
    "Just for fun, what if we created more Dense layers with different units, which therefore also has more variables?"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "Y2zTA-rDS5Xk"
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Finished training the model\n",
      "[[211.74744]]\n",
      "Model predicts that 100 degrees Celsius is: [[211.74744]] degrees Fahrenheit\n",
      "These are the l0 variables: [array([[-0.24177635, -0.17992781,  0.07462218,  0.52198225]],\n",
      "      dtype=float32), array([-3.590713  , -3.6288092 ,  0.37870088,  3.6405184 ], dtype=float32)]\n",
      "These are the l1 variables: [array([[ 1.2101437 ,  0.0318702 ,  0.79859513, -0.40426564],\n",
      "       [ 1.0919857 , -1.1234739 ,  0.56094855, -0.18574677],\n",
      "       [ 0.09046844, -0.1286703 ,  0.14074093, -0.25564998],\n",
      "       [-0.815729  ,  0.3451887 , -0.7021038 ,  1.0301372 ]],\n",
      "      dtype=float32), array([-3.881077  , -0.11812885, -2.4918718 ,  2.6530437 ], dtype=float32)]\n",
      "These are the l2 variables: [array([[-1.2943397 ],\n",
      "       [-0.00361204],\n",
      "       [-0.4929169 ],\n",
      "       [ 0.46702754]], dtype=float32), array([3.577924], dtype=float32)]\n"
     ]
    }
   ],
   "source": [
    "l0 = tf.keras.layers.Dense(units=4, input_shape=[1])  \n",
    "l1 = tf.keras.layers.Dense(units=4)  \n",
    "l2 = tf.keras.layers.Dense(units=1)  \n",
    "model = tf.keras.Sequential([l0, l1, l2])\n",
    "model.compile(loss='mean_squared_error', optimizer=tf.keras.optimizers.Adam(0.1))\n",
    "model.fit(celsius_q, fahrenheit_a, epochs=500, verbose=False)\n",
    "print(\"Finished training the model\")\n",
    "print(model.predict([100.0]))\n",
    "print(\"Model predicts that 100 degrees Celsius is: {} degrees Fahrenheit\".format(model.predict([100.0])))\n",
    "print(\"These are the l0 variables: {}\".format(l0.get_weights()))\n",
    "print(\"These are the l1 variables: {}\".format(l1.get_weights()))\n",
    "print(\"These are the l2 variables: {}\".format(l2.get_weights()))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "xrpFFlgYhCty"
   },
   "source": [
    "As you can see, this model is also able to predict the corresponding Fahrenheit value really well. But when you look at the variables (weights) in the `l0` and `l1` layers, they are nothing even close to ~1.8 and ~32. The added complexity hides the \"simple\" form of the conversion equation.\n",
    "\n",
    "Stay tuned for the upcoming video on how Dense layers work for the explanation."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": []
  }
 ],
 "metadata": {
  "accelerator": "GPU",
  "colab": {
   "collapsed_sections": [],
   "name": "Copy of Celsius to Fahrenheit.ipynb",
   "private_outputs": true,
   "provenance": [],
   "toc_visible": true
  },
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.8.3"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 1
}