Decision Trees and Random Forests classifier in Python

Welcome everyone, Today we will see Decision Trees and Random Forests classifier-and Types in Python so let’s start:

Import Libraries


import pandas as pd


import numpy as np


import matplotlib.pyplot as plt


import seaborn as sns


%matplotlib inline

Get the Data

df = pd.read_csv('Decision Trees.csv')

df.head()

Decision  Age Number Start


0 present 34 3 9


1 absent 58 4 15


2 absent 28 5 8


3 present 72 3 4


4 absent 81 4 15

Split data into x/y_training and x/y_test data.

Let’s start to split up the data into a training and test set.

from sklearn.model_selection import train_test_split


x = df.drop('Decision Trees',axis=1)


y = df['Decision Trees']


x_train, x_test, y_train, y_test = train_test_split(x, y, test_size=0.20)

check out Decision Trees

We will start just by training a single decision trees in this section.

from sklearn.tree import DecisionTreeClassifier


dtree = DecisionTreeClassifier()


dtree.fit(x_train,y_train)

DecisionTreeClassifier(class_weight=None, criterion='gini', max_depth=None,


            max_features=None, max_leaf_nodes=None, min_samples_leaf=1,


            min_samples_split=2, min_weight_fraction_leaf=0.0,


            presort=False, random_state=None, splitter='best')

How to Prediction and Evaluation the data
Let’s start to evaluate our decision tree.

predictions = dtree.predict(x_test)


from sklearn.metrics import classification_report,confusion_matrix


print(classification_report(y_test,predictions))

         precisionx    recallx  f1-scorex   supportx


    present       0.80      0.80      0.80        15


    absent       0.45      0.45      0.45         10


avg / total       0.75      0.75      0.75        25

print(confusion_matrix(y_test,predictions))


[[18  4]


 [ 2  3]

Tree Visualization

from IPython.display import Image  


from sklearn.externals.six import StringIO  


from sklearn.tree import export_graphviz


import pydot 

features = list(df.columns[1:])


features


['Ages', 'Numbers', 'Starts']


dot_data = StringIO()  


export_graphviz(dtree, out_file=dot_data,feature_names=features,filled=True,rounded=True)


graph = pydot.graph_from_dot_data(dot_data.getvalue())  


Image(graph[0].create_png())  

Decision Trees and Random Forests classifier-Types in Python

(more…)