Overfitting Problem in Machine Learning and Regularization in Linear and Logistic Regression
Well, In Researchgate and few other platforms, the topic of the overfitting problem and its reduction process in Linear Regression and Logistic Regression is ubiquitous. To the best of my knowledge, I am trying to write about this topic here... Before writing anything about the reduction process, it is a must to know what is overfitting. Okay, let's come to the point with an example first, If you, unfortunately, buy jeans pant for you which is larger in size than yours and the shop from where you have bought the pant, they have no changing and returning options. So, finding no other options available, you have to wear that pant and try to fit yourself in that oversized jeans pant. This thing can be considered as Overfitting. Now I would like to describe Overfitting in Machine Learning, and here it is....... When we train a statistical model with a huge amount of data, then overfitting occurs in the model or, in other words, the model is considered overfitted model. Let's Co...