at model fit I m getting an error as ValueError Input contains NaN infinity or a value too large for dtype float32

Question

import pandas as pd
import numpy as np
import matplotlib.pyplot as plt

company= pd.read_csv("C:\\Users\\Mahesh\\Desktop\\Sravanthi\\company_Data.csv")
colnames=list(company.columns)

x=pd.get_dummies(company.iloc[:,1:11]).astype('bool')
X=pd.DataFrame(x)
y=company.iloc[:,0]
y.isnull().sum()
y=pd.get_dummies(company.iloc[:,0]).astype('bool')
Y=pd.DataFrame(y)
help(pd.DataFrame)
y = y.dropna()
y.isnull().sum()
from sklearn.model_selection import train_test_split
train,test=train_test_split(company,test_size=0.3)
x=x.drop([399],inplace=True,axis=0)

from sklearn.tree import DecisionTreeClassifier
model=DecisionTreeClassifier(criterion='entropy')

model.fit(train[X],train[Y])

Answer 1

Hi,

I think your X parameter contains null value, that's why you got this error. You can avoid this error by feature engineering concept. In this you can avoid NAN in two ways. One way is to remove the null value and another way is replacing missing values with suitable value(Imputation concept). 

To remove NAN values, you can use dropna(). But it will remove the total row or column. So you can create your own customize function that is called Imputation.

Hope this will help you.