Optimize Using Gradient Descent

In this post, we are going to talk about mathematical optimization. This term is not to be confused with the word ‘optimization’ that we use in our everyday lives, for instance, improving the efficiency of a workflow. This kind of optimization means to find an optimal solution from a set of possible candidate solutions. An optimization problem is generally given in the following way: one, there is a set of variables we can play with, and two, there is an objective function that we wish to minimize or maximize.

Let’s build a better understanding of this concept through an example. For instance, let’s imagine that we have to cook a meal for our friends from a given set of ingredients. The question is, how much salt, vegetables, and meat goes into the pan. These are the variables that we can adjust, and the goal is to choose the optimal amount of these ingredients to maximize the tastiness of the meal. Tastiness will be our objective function, and for a moment, we shall pretend that tastiness is an objective measure of a meal.

Continue Reading

Site Footer

Sliding Sidebar

About Me

About Me

I am a Data Scientist. I love to share what I do and I am always keen on opportunities to develop my skills and work with people I can learn from. Hope you like my blog!


  • Pranav Suri RT @bhogleharsha: This is a vicious opening burst by India's bowlers, just telling us again why this is an extraordinary fast bowling unit.…
  • Pranav Suri RT @BecomingDataSci: What's your data science holiday wish list? Your wish for something to help your own data science learning, your wish…
  • Pranav Suri RT @AcademicsSay: I'll do it on the plane.
Insert math as
Additional settings
Formula color
Text color
Type math using LaTeX
Nothing to preview