利用K近邻(回归)KNeighborsRegressor进行回归预测(复习9)

本文是个人学习笔记，内容主要基于K近邻(回归)KNeighborsRegressor对boston数据集学习回归模型和利用模型预测。
K近邻(回归)模型同样是无参数模型，只是借助K个最近训练样本的目标数值，对待测样本的回归值进行决策。即根据样本的相似度预测回归值。
衡量样本待测样本回归值的不同方式：（1）对K个近邻目标数值使用普通的算术平均算法（2）对K个近邻目标数值考虑距离的差异进行加权平均。

from sklearn.datasets import load_boston
boston=load_boston()
print(boston.DESCR)   #打印数据描述

from sklearn.cross_validation import train_test_split
import numpy as np
X=boston.data
y=boston.target
X_train,X_test,y_train,y_test=train_test_split(X,y,random_state=33,test_size=0.25)

print('The max target value is',np.max(boston.target))
print('The min target value is',np.min(boston.target))
print('The average target value is',np.mean(boston.target))

from sklearn.preprocessing import StandardScaler
ss_X=StandardScaler()
ss_y=StandardScaler()

X_train=ss_X.fit_transform(X_train)
X_test=ss_X.transform(X_test)
y_train=ss_y.fit_transform(y_train.reshape(-1, 1))
y_test=ss_y.transform(y_test.reshape(-1, 1))

from sklearn.neighbors import KNeighborsRegressor

uni_knr=KNeighborsRegressor(weights='uniform')   #初始化平均回归的KNN回归器
uni_knr.fit(X_train,y_train)
uni_knr_y_predict=uni_knr.predict(X_test)

dis_knr=KNeighborsRegressor(weights='distance')   #初始化距离加权回归的KNN回归器
dis_knr.fit(X_train,y_train)
dis_knr_y_predict=dis_knr.predict(X_test)

from sklearn.metrics import r2_score,mean_absolute_error,mean_squared_error

print('R-squared value of uniform-weighted KNeighborsRegression:',uni_knr.score(X_test,y_test))
print('The mean squared error of uniform-weighted KNeighborsRegression:',mean_squared_error(ss_y.inverse_transform(y_test),
                                                                                            ss_y.inverse_transform(uni_knr_y_predict)))
print('The mean absolute error of uniform-weighted KNeighborsRegression:',mean_absolute_error(ss_y.inverse_transform(y_test),
                                                                                              ss_y.inverse_transform(uni_knr_y_predict)))
print(' ')
print('R-squared value of distance-weighted KNeighborsRegression:',dis_knr.score(X_test,y_test))
print('The mean squared error of distance-weighted KNeighborsRegression:',mean_squared_error(ss_y.inverse_transform(y_test),
                                                                                             ss_y.inverse_transform(dis_knr_y_predict)))
print('The mean absolute error of distance-weighted KNeighborsRegression:',mean_absolute_error(ss_y.inverse_transform(y_test),
                                                                                               ss_y.inverse_transform(dis_knr_y_predict)))

从评测结果可见，采用K近邻加权平均的回归策略可以获得较高的模型性能。