What does dimensionality reduction mean exactly?

I searched for its meaning, I just found that it means the transformation of raw data into a more useful form.
How can I use it in a practical life (application)?
Mar 3, 2022 383 views

1 answer to this question.

Dimensionality reduction is used in Machine Learning to get better features for either a classification or a regression task. It can be understood as reducing feature space from high dimension to low dimension in such a way that lower dimensions provide more information.
Consider the following scenario: You have a list of 100 TV shows  and 10000 people, and you know whether each person enjoys or dislikes each of the 100 TV shows. So you have a binary vector of length 100 [position I is 0 if that individual dislikes the i'th TV show, 1 for like] for each occurrence
You could perform your machine learning task directly on these vectors, or you could choose 5 TV shows genres and, using the data you already have, determine whether the person likes or dislikes the entire genre, reducing your data from a vector of size 100 to a vector of size 5 [position i is 1 if the person likes genre i]
Because most people may only like TV shows in their particular genres, the vector of length 5 can be regarded as a good example of the vector of length 100.
However, it will not be an exact representation because some people may dislike all TV shows in a genre except one.

The argument is that the smaller vector carries the majority of the information in the larger one while taking up far less space and being much faster to compute.
answered Mar 3, 2022 by
• 5,480 points

What does backbone mean in a neural network?

According to my understanding, the "backbone" refers ...READ MORE

What is Unsupervised Learning?

Unsupervised Learning is the training of machine ...READ MORE

What is semi-supervised machine learning?

Hi@Ganesh, Semi-supervised machine learning is a combination of ...READ MORE

What is Reinforcement learning?

Alright, let me not get into the ...READ MORE

Epoch vs Iteration when training neural networks

Epoch can be understood as the number ...READ MORE

Will robots take over surgeons?

Yes we will definitely need a surgeon ...READ MORE

How is machine learning used to detect objects?

To understand the surrounding environment in real ...READ MORE

How do neural networks used in AI and deep learning learn?

A neural network is a hardware or ...READ MORE