added notebook for simple gradient descent for 1D and 2D case

ovysotska · Feb 2, 2020 · 543e685 · 543e685
1 parent b8173fb
commit 543e685
Show file tree

Hide file tree

Showing 10 changed files with 1,008 additions and 16 deletions.
diff --git a/Interpolation.ipynb b/Interpolation.ipynb
@@ -570,7 +570,7 @@
    "name": "python",
    "nbconvert_exporter": "python",
    "pygments_lexer": "ipython3",
-   "version": "3.6.7"
+   "version": "3.6.8"
   }
  },
  "nbformat": 4,

diff --git a/Kullback_Leibler.ipynb b/Kullback_Leibler.ipynb
@@ -260,21 +260,21 @@
  ],
  "metadata": {
   "kernelspec": {
-   "display_name": "Python 2",
+   "display_name": "Python 3",
    "language": "python",
-   "name": "python2"
+   "name": "python3"
   },
   "language_info": {
    "codemirror_mode": {
     "name": "ipython",
-    "version": 2
+    "version": 3
    },
    "file_extension": ".py",
    "mimetype": "text/x-python",
    "name": "python",
    "nbconvert_exporter": "python",
-   "pygments_lexer": "ipython2",
-   "version": "2.7.14"
+   "pygments_lexer": "ipython3",
+   "version": "3.6.8"
   }
  },
  "nbformat": 4,

diff --git a/data/Convolution.pdf b/data/Convolution.pdf
diff --git a/gradient_descent.ipynb b/gradient_descent.ipynb
diff --git a/homogeneous_coords.ipynb b/homogeneous_coords.ipynb
@@ -201,7 +201,7 @@
    "name": "python",
    "nbconvert_exporter": "python",
    "pygments_lexer": "ipython3",
-   "version": "3.6.7"
+   "version": "3.6.8"
   }
  },
  "nbformat": 4,

diff --git a/Hidden_markov_model.ipynb → in_progress/Hidden_markov_model.ipynb b/Hidden_markov_model.ipynb → in_progress/Hidden_markov_model.ipynb
diff --git a/icp_cov_estimation.ipynb → in_progress/icp_cov_estimation.ipynb b/icp_cov_estimation.ipynb → in_progress/icp_cov_estimation.ipynb
diff --git a/local_image_operators.ipynb b/local_image_operators.ipynb
@@ -568,7 +568,7 @@
    "name": "python",
    "nbconvert_exporter": "python",
    "pygments_lexer": "ipython3",
-   "version": "3.6.7"
+   "version": "3.6.8"
   }
  },
  "nbformat": 4,

diff --git a/ml_regression.ipynb b/ml_regression.ipynb
@@ -38,7 +38,8 @@
     "$$\\frac{\\partial L}{\\partial a} = \\sum(y_i - ax_i -b)(-x_i)$$\n",
     "$$\\frac{\\partial L}{\\partial b} = \\sum(y_i - ax_i -b)(-1)$$\n",
     "\n",
-    "After some manipulations we can get the system of linear equation.\n\n",
+    "After some manipulations we can get the system of linear equation.\n",
+    "\n",
     "$$\n",
     "\\begin{pmatrix}\n",
     "    \\sum x_i^2 & \\sum x_i\\\\\n",
@@ -54,7 +55,8 @@
     "    \\sum y_i\n",
     "\\end{pmatrix}\n",
     "$$\n",
-    "\n\n",
+    "\n",
+    "\n",
     "** Elegant solution **\n",
     "\n",
     "Consider $y = (y_1, .., y_n)$ be a vector and $x = [[x_1, 1], [x_2, 1], ..., [x_n, 1]]$ $nx2$ a matrix and $\\theta = (a,b)^T$ line parameters. Then given the fact that we fit a line, we minimize the following likelihood $ L = || y - x\\theta ||_{\\sum_i} $. Taken into account gaussian noise assumption\n",
@@ -176,21 +178,21 @@
  ],
  "metadata": {
   "kernelspec": {
-   "display_name": "Python 2",
+   "display_name": "Python 3",
    "language": "python",
-   "name": "python2"
+   "name": "python3"
   },
   "language_info": {
    "codemirror_mode": {
     "name": "ipython",
-    "version": 2
+    "version": 3
    },
    "file_extension": ".py",
    "mimetype": "text/x-python",
    "name": "python",
    "nbconvert_exporter": "python",
-   "pygments_lexer": "ipython2",
-   "version": "2.7.14"
+   "pygments_lexer": "ipython3",
+   "version": "3.6.8"
   }
  },
  "nbformat": 4,

diff --git a/topological_sorting.ipynb b/topological_sorting.ipynb
@@ -250,7 +250,7 @@
    "name": "python",
    "nbconvert_exporter": "python",
    "pygments_lexer": "ipython3",
-   "version": "3.6.5"
+   "version": "3.6.8"
   }
  },
  "nbformat": 4,