Tag: statmetry
-
K-Nearest Neighbors(KNN) Algorithm
Table of Contents Definition KNN(K-nearest neighbors algorithm is a non-parametric supervised learning for classification and regression. Types of KNN(K-nearest neighbors) Formulation Feature of KNN KNN Steps Decision Boundary Voronoi Diagram With large number of examples and possible noise in the labels, the decision boundary can become nasty. Effect of K Larger k produces smoother boundary…
-
Random Forest Algorithm
Table of Contents Definition Random forests or random decision forests is an ensemble learning method for classification, regression and other tasks that operates by constructing a multitude of decision trees at training time. For classification tasks, the output of the random forest is the class selected by most trees. For regression tasks, the mean or average prediction of the individual trees is returned.…
-
Decision Tree
Table of Contents Definition A decision tree is a decision support hierarchical model that uses a tree-like model of decisions and their possible consequences, including chance event outcomes, resource costs, and utility. It is one way to display an algorithm that only contains conditional control statements. A decision tree is a flowchart-like structure in which each internal…