Understanding Kmeans Clustering with Examples
Recommended by 118 users
A Hospital Care chain wants to open a series of EmergencyCare wards within a region. We assume that the hospital knows the location of all the maximum accident prone areas in the region. They have to decide the number of the Emergency Units to be opened and the location of these Emergency Units, so that all the accident prone areas are covered in the vicinity of these Emergency Units.
The challenge is to decide the location of these Emergency Units so that the whole region is covered. Here is when Kmeans Clustering comes to rescue!
Before getting to Kmeans Clustering, let us first understand what Clustering is.
A cluster refers to a small group of objects. Clustering is grouping those objects into clusters. In order to learn clustering, it is important to understand the scenarios that leads to cluster different objects. Let us identify few of them.
What is Clustering?
Clustering is dividing data points into homogeneous classes or clusters:
 Points in the same group are as similar as possible
 Points in different group are as dissimilar as possible
When a collection of objects is given, we put objects into group based on similarity.
Application of Clustering:
Clustering is used in almost all the fields. You can infer some ideas from Example 1 to come up with lot of clustering applications that you would have come across.
Listed here are few more applications, which would add to what you have learnt.
 Clustering helps marketers improve their customer base and work on the target areas. It helps group people (according to different criteria’s such as willingness, purchasing power etc.) based on their similarity in many ways related to the product under consideration.
 Clustering helps in identification of groups of houses on the basis of their value, type and geographical locations.
 Clustering is used to study earthquake. Based on the areas hit by an earthquake in a region, clustering can help analyse the next probable location where earthquake can occur.
Clustering Algorithms:
A Clustering Algorithm tries to analyse natural groups of data on the basis of some similarity. It locates the centroid of the group of data points. To carry out effective clustering, the algorithm evaluates the distance between each point from the centroid of the cluster.
The goal of clustering is to determine the intrinsic grouping in a set of unlabelled data.
What is Kmeans Clustering?
Kmeans (Macqueen, 1967) is one of the simplest unsupervised learning algorithms that solve the wellknown clustering problem. Kmeans clustering is a method of vector quantization, originally from signal processing, that is popular for cluster analysis in data mining.
Kmeans Clustering – Example 1:
A pizza chain wants to open its delivery centres across a city. What do you think would be the possible challenges?
 They need to analyse the areas from where the pizza is being ordered frequently.
 They need to understand as to how many pizza stores has to be opened to cover delivery in the area.
 They need to figure out the locations for the pizza stores within all these areas in order to keep the distance between the store and delivery points minimum.
Resolving these challenges includes a lot of analysis and mathematics. We would now learn about how clustering can provide a meaningful and easy method of sorting out such real life challenges. Before that let’s see what clustering is.
Kmeans Clustering Method:
If k is given, the Kmeans algorithm can be executed in the following steps:
 Partition of objects into k nonempty subsets
 Identifying the cluster centroids (mean point) of the current partition.
 Assigning each point to a specific cluster
 Compute the distances from each point and allot points to the cluster where the distance from the centroid is minimum.
 After reallotting the points, find the centroid of the new cluster formed.
The step by step process:
Now, let’s consider the problem in Example 1 and see how we can help the pizza chain to come up with centres based on Kmeans algorithm.
Similarly, for opening Hospital Care Wards:
Kmeans Clustering will group these locations of maximum prone areas into clusters and define a cluster center for each cluster, which will be the locations where the Emergency Units will open. These Clusters centers are the centroids of each cluster and are at a minimum distance from all the points of a particular cluster, henceforth, the Emergency Units will be at minimum distance from all the accident prone areas within a cluster.
Here is another example for you, try and come up with the solution based on your understanding of Kmeans clustering.
Kmeans Clustering – Example 2:
Let’s consider the data on drugrelated crimes in Canada. The data consists of crimes due to various drugs that include, Heroin, Cocaine to prescription drugs, especially by underage people. The crimes resulted due to these substance abuse can be brought down by starting deaddiction centres in areas most afflicted by this kind of crime. With the available data, different objectives can be set. They are:
 Classify the crimes based on the abuse substance to detect prominent cause.
 Classify the crimes based on age groups.
 Analyze the data to determine what kinds of deaddiction centre is required.
 Find out how many deaddiction centres need to be setup to reduce drug related crime rate.
The Kmeans algorithm can be used to determine any of the above scenarios by analyzing the available data.
Following the Kmeans Clustering method used in the previous example, we can start off with a given k, following by the execution of the Kmeans algorithm.
Mathematical Formulation for Kmeans Algorithm:
D= {x_{1},x_{2},…,x_{i},…,x_{m}} à data set of m records
x_{i}= (x_{i1},x_{i2},…,x_{in}) à each record is an ndimensional vector
Finding Cluster Centers that Minimize Distortion:
Solution can be found by setting the partial derivative of Distortion w.r.t. each cluster center to zero.
For any k clusters, the value of k should be such that even if we increase the value of k from after several levels of clustering the distortion remains constant. The achieved point is called the “Elbow”.
This is the ideal value of k, for the clusters created.
Related Post:
Application of Clustering in Data Science Using realtime examples.

krupa jain

bob ama

yogesh indani


rahul

EdurekaSupport


sumit