使用LightGBM和GridSearchCV预测Titanic数据集

2023-12-16 02:08

本文主要是介绍使用LightGBM和GridSearchCV预测Titanic数据集,希望对大家解决编程问题提供一定的参考价值,需要的开发者们随着小编来一起学习吧!

对于Titanic数据集预测的初次尝试,主要使用的是LightGBM和GridSearchCV。这两个参数都很多,对应的文档在https://lightgbm.readthedocs.io/en/latest/Experiments.html 和 https://lightgbm.cn/docs/6/#io以及https://scikit-learn.org/stable/modules/generated/sklearn.model_selection.GridSearchCV.html
常看常新吧,毕竟官方文档是最好的指导老师。

未来改进:可变学习速率;训练信息提取储存;Cabin信息充分利用;算法调参

import pandas as pd
import numpy as np
from xgboost import plot_importance
from matplotlib import pyplot as plt
from sklearn.model_selection import train_test_split
from sklearn.model_selection import StratifiedKFold
from sklearn.feature_extraction.text import TfidfVectorizer
from sklearn.metrics import roc_auc_score
from sklearn.preprocessing import LabelEncoder
from sklearn.preprocessing import OneHotEncoder
from sklearn.impute import SimpleImputer
import lightgbm as lgb
from sklearn.pipeline import Pipeline
from sklearn.compose import ColumnTransformer
from sklearn.model_selection import GridSearchCV
from sklearn.preprocessing import StandardScaler
from sklearn.metrics import roc_auc_scoredir=r'C:\Users\43480\Documents\python_work\Titanic'#写路径的时候,raw字符串可以用\,否则就需要用//。
train = pd.read_csv(dir+'//train.csv')
test = pd.read_csv(dir+'//test.csv')cate_cols = ['Sex', 'Embarked']
no_feas = ['PassengerId','Survived','Ticket','Name','Cabin']#理论上说,Cabin还是有利用价值的,这里是第一次用,就没管。
num_cols=train.columns.drop(no_feas).drop(cate_cols)#.drop()可以在不改变原对象内容的情况下生成新的对象。
y_train=train['Survived']#.astype(int)#这里很迷,理论上应该完全不影响的,但是有的时候需要,有的时候就不需要。

两个imputer的strategy都是最频繁,数字属性这里确实可以考虑换成中位数

num_pipeline=Pipeline([('imputer',SimpleImputer(missing_values=np.nan, strategy = 'most_frequent')),('std_scaler',StandardScaler()),
])
cate_pipeline=Pipeline([('imputer',SimpleImputer(missing_values=np.nan, strategy = 'most_frequent')),('onehotencoder',OneHotEncoder()),
])full_pipeline=ColumnTransformer([('num', num_pipeline,num_cols),('cate',cate_pipeline,cate_cols)
])
train_tr=full_pipeline.fit_transform(train)#train_tr即train_transformed
test_tr=full_pipeline.fit_transform(test)

查阅说明文档得知,bagging_fraction与subsample是同一个变量的不同名称,剩下三个的情况与此相同,之所以用一个不用另一个是因为用了就会不停地挑warning,原因不明。貌似就算数据集不平衡,开了is_unbalance也会导致预测结果变差,原因不明。

gsearch = GridSearchCV(gbm, params_grid, scoring=‘roc_auc’, cv=5,verbose=4,return_train_score=True)其中verbose>3才能够有详细的训练细节输出,return_train_score=True才能看到训练过程的得分,从而判断是否过拟合。
split0_train_score和split1_train_score是什么东西还没有搞懂。

从给出的score判断,现阶段模型处于过拟合状态(提交之后的得分也证实了这一点),解决过拟合需要调参,调参的基础是对于算法的深入理解,这也正是下一步的努力方向。

另外,未来很可能需要将 GridSearchCV的训练信息提取保存分析,出现需求的时候再说吧。

params = {"objective": "binary","is_unbalance": True,"num_leaves": 50,"max_depth": -1,"learning_rate": 0.05,"subsample":0.8,#"bagging_fraction": 0.8,"colsample_bytree": 0.8,#"feature_fraction": 0.8,"subsample_freq":5,#"bagging_freq": 5,"bagging_seed": 42,"verbosity": -1,"min_child_samples":30,#"min_data_in_leaf":30,#"silent":False,#显示训练过程#"num_threads": 4  # 进程数 根据机器资源调整n_jobs#"n_jobs":-1#使用所有资源
}
params_grid={'learning_rate':[0.1,0.05],"num_leaves": [30,35],"subsample":[0.78,0.8,0.82],"colsample_bytree":[0.87,0.91,0.93],"min_child_samples":[10,20]
}gbm = lgb.LGBMClassifier(**params)
gsearch = GridSearchCV(gbm, params_grid, scoring='roc_auc', cv=5,verbose=4,return_train_score=True)
gsearch.fit(train_tr, y_train)#print("split0_train_score",gsearch.cv_results_['split0_train_score'])
#print("split1_train_score",gsearch.cv_results_['split1_train_score'])
for i in range(len(gsearch.cv_results_['params'])):print(gsearch.cv_results_['params'][i])print('\t')print('模型平均训练得分:{0}'.format(gsearch.cv_results_['mean_train_score'][i]))print('\t')print('模型平均测试得分:{0}'.format(gsearch.cv_results_['mean_test_score'][i]))print('\n')
print('参数的最佳取值:{0}'.format(gsearch.best_params_))
print('最佳模型得分:{0}'.format(gsearch.best_score_))
Fitting 5 folds for each of 72 candidates, totalling 360 fits
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.78, score=(train=0.995, test=0.843), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.78, score=(train=0.997, test=0.809), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.78, score=(train=0.994, test=0.887), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.78 [Parallel(n_jobs=1)]: Using backend SequentialBackend with 1 concurrent workers.
[Parallel(n_jobs=1)]: Done   1 out of   1 | elapsed:    0.0s remaining:    0.0s
[Parallel(n_jobs=1)]: Done   2 out of   2 | elapsed:    0.0s remaining:    0.0s
[Parallel(n_jobs=1)]: Done   3 out of   3 | elapsed:    0.1s remaining:    0.0s[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.78, score=(train=0.994, test=0.863), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.78, score=(train=0.995, test=0.903), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.8, score=(train=0.996, test=0.840), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.8, score=(train=0.997, test=0.809), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.8, score=(train=0.994, test=0.888), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.8, score=(train=0.995, test=0.856), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.8, score=(train=0.994, test=0.901), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.82, score=(train=0.996, test=0.848), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.82, score=(train=0.997, test=0.806), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.82, score=(train=0.994, test=0.895), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.82, score=(train=0.996, test=0.856), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.82, score=(train=0.995, test=0.914), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.78, score=(train=0.996, test=0.849), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.78, score=(train=0.997, test=0.806), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.78, score=(train=0.995, test=0.890), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.78, score=(train=0.996, test=0.857), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.78, score=(train=0.996, test=0.901), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.8, score=(train=0.996, test=0.843), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.8, score=(train=0.997, test=0.810), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.8, score=(train=0.996, test=0.893), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.8, score=(train=0.996, test=0.853), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.8, score=(train=0.996, test=0.901), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.82, score=(train=0.997, test=0.850), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.82, score=(train=0.997, test=0.807), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.82, score=(train=0.996, test=0.887), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.82, score=(train=0.996, test=0.851), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.82, score=(train=0.996, test=0.912), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.78, score=(train=0.981, test=0.863), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.78, score=(train=0.985, test=0.828), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.78, score=(train=0.976, test=0.892), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.78, score=(train=0.980, test=0.881), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.78, score=(train=0.979, test=0.913), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.8, score=(train=0.982, test=0.863), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.8, score=(train=0.984, test=0.822), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.8, score=(train=0.978, test=0.903), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.8, score=(train=0.983, test=0.882), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.8, score=(train=0.978, test=0.912), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.82, score=(train=0.982, test=0.862), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.82, score=(train=0.985, test=0.828), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.82, score=(train=0.978, test=0.893), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.82, score=(train=0.983, test=0.879), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.82, score=(train=0.980, test=0.906), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.78, score=(train=0.981, test=0.863), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.78, score=(train=0.985, test=0.828), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.78, score=(train=0.976, test=0.892), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.78, score=(train=0.980, test=0.881), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.78, score=(train=0.979, test=0.913), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.8, score=(train=0.982, test=0.863), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.8, score=(train=0.984, test=0.822), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.8, score=(train=0.978, test=0.903), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.8, score=(train=0.983, test=0.882), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.8, score=(train=0.978, test=0.912), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.82, score=(train=0.982, test=0.862), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.82, score=(train=0.985, test=0.828), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.82, score=(train=0.978, test=0.893), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.82, score=(train=0.983, test=0.879), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.87, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.82, score=(train=0.980, test=0.906), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.78, score=(train=0.982, test=0.853), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.78, score=(train=0.986, test=0.812), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.78, score=(train=0.980, test=0.898), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.78, score=(train=0.984, test=0.876), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.78, score=(train=0.982, test=0.899), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.8, score=(train=0.984, test=0.845), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.8, score=(train=0.987, test=0.809), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.8, score=(train=0.981, test=0.899), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.8, score=(train=0.984, test=0.868), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.8, score=(train=0.981, test=0.909), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.82, score=(train=0.983, test=0.842), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.82, score=(train=0.987, test=0.810), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.82, score=(train=0.980, test=0.893), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.82, score=(train=0.985, test=0.864), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.82, score=(train=0.983, test=0.902), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.78, score=(train=0.985, test=0.852), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.78, score=(train=0.988, test=0.819), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.78, score=(train=0.983, test=0.897), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.78, score=(train=0.986, test=0.871), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.78, score=(train=0.984, test=0.906), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.8, score=(train=0.986, test=0.841), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.8, score=(train=0.989, test=0.811), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.8, score=(train=0.984, test=0.903), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.8, score=(train=0.987, test=0.870), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.8, score=(train=0.984, test=0.908), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.82, score=(train=0.987, test=0.845), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.82, score=(train=0.989, test=0.814), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.82, score=(train=0.984, test=0.893), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.82, score=(train=0.987, test=0.870), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.82, score=(train=0.984, test=0.907), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.78, score=(train=0.960, test=0.863), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.78, score=(train=0.966, test=0.828), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.78, score=(train=0.957, test=0.892), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.78, score=(train=0.962, test=0.875), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.78, score=(train=0.957, test=0.916), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.8, score=(train=0.963, test=0.862), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.8, score=(train=0.966, test=0.826), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.8, score=(train=0.956, test=0.894), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.8, score=(train=0.963, test=0.875), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.8, score=(train=0.957, test=0.912), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.82, score=(train=0.962, test=0.858), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.82, score=(train=0.968, test=0.826), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.82, score=(train=0.957, test=0.897), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.82, score=(train=0.961, test=0.879), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.82, score=(train=0.959, test=0.910), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.78, score=(train=0.960, test=0.863), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.78, score=(train=0.966, test=0.828), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.78, score=(train=0.957, test=0.892), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.78, score=(train=0.962, test=0.875), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.78, score=(train=0.957, test=0.916), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.8, score=(train=0.963, test=0.862), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.8, score=(train=0.966, test=0.826), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.8, score=(train=0.956, test=0.894), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.8, score=(train=0.963, test=0.875), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.8, score=(train=0.957, test=0.912), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.82, score=(train=0.962, test=0.858), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.82, score=(train=0.968, test=0.826), total=   0.1s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.82, score=(train=0.957, test=0.897), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.82, score=(train=0.961, test=0.879), total=   0.0s
[CV] colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.87, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.82, score=(train=0.959, test=0.910), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.78, score=(train=0.995, test=0.843), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.78, score=(train=0.997, test=0.809), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.78, score=(train=0.994, test=0.887), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.78, score=(train=0.994, test=0.863), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.78, score=(train=0.995, test=0.903), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.8, score=(train=0.996, test=0.840), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.8, score=(train=0.997, test=0.809), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.8, score=(train=0.994, test=0.888), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.8, score=(train=0.995, test=0.856), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.8, score=(train=0.994, test=0.901), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.82, score=(train=0.996, test=0.848), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.82, score=(train=0.997, test=0.806), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.82, score=(train=0.994, test=0.895), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.82, score=(train=0.996, test=0.856), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.82, score=(train=0.995, test=0.914), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.78, score=(train=0.996, test=0.849), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.78, score=(train=0.997, test=0.806), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.78, score=(train=0.995, test=0.890), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.78, score=(train=0.996, test=0.857), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.78, score=(train=0.996, test=0.901), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.8, score=(train=0.996, test=0.843), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.8, score=(train=0.997, test=0.810), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.8, score=(train=0.996, test=0.893), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.8, score=(train=0.996, test=0.853), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.8, score=(train=0.996, test=0.901), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.82, score=(train=0.997, test=0.850), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.82, score=(train=0.997, test=0.807), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.82, score=(train=0.996, test=0.887), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.82, score=(train=0.996, test=0.851), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.82, score=(train=0.996, test=0.912), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.78, score=(train=0.981, test=0.863), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.78, score=(train=0.985, test=0.828), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.78, score=(train=0.976, test=0.892), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.78, score=(train=0.980, test=0.881), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.78, score=(train=0.979, test=0.913), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.8, score=(train=0.982, test=0.863), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.8, score=(train=0.984, test=0.822), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.8, score=(train=0.978, test=0.903), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.8, score=(train=0.983, test=0.882), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.8, score=(train=0.978, test=0.912), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.82, score=(train=0.982, test=0.862), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.82, score=(train=0.985, test=0.828), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.82, score=(train=0.978, test=0.893), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.82, score=(train=0.983, test=0.879), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.82, score=(train=0.980, test=0.906), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.78, score=(train=0.981, test=0.863), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.78, score=(train=0.985, test=0.828), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.78, score=(train=0.976, test=0.892), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.78, score=(train=0.980, test=0.881), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.78, score=(train=0.979, test=0.913), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.8, score=(train=0.982, test=0.863), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.8, score=(train=0.984, test=0.822), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.8, score=(train=0.978, test=0.903), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.8, score=(train=0.983, test=0.882), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.8, score=(train=0.978, test=0.912), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.82, score=(train=0.982, test=0.862), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.82, score=(train=0.985, test=0.828), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.82, score=(train=0.978, test=0.893), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.82, score=(train=0.983, test=0.879), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.91, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.82, score=(train=0.980, test=0.906), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.78, score=(train=0.982, test=0.853), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.78, score=(train=0.986, test=0.812), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.78, score=(train=0.980, test=0.898), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.78, score=(train=0.984, test=0.876), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.78, score=(train=0.982, test=0.899), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.8, score=(train=0.984, test=0.845), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.8, score=(train=0.987, test=0.809), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.8, score=(train=0.981, test=0.899), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.8, score=(train=0.984, test=0.868), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.8, score=(train=0.981, test=0.909), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.82, score=(train=0.983, test=0.842), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.82, score=(train=0.987, test=0.810), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.82, score=(train=0.980, test=0.893), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.82, score=(train=0.985, test=0.864), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.82, score=(train=0.983, test=0.902), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.78, score=(train=0.985, test=0.852), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.78, score=(train=0.988, test=0.819), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.78, score=(train=0.983, test=0.897), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.78, score=(train=0.986, test=0.871), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.78, score=(train=0.984, test=0.906), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.8, score=(train=0.986, test=0.841), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.8, score=(train=0.989, test=0.811), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.8, score=(train=0.984, test=0.903), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.8, score=(train=0.987, test=0.870), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.8, score=(train=0.984, test=0.908), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.82, score=(train=0.987, test=0.845), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.82, score=(train=0.989, test=0.814), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.82, score=(train=0.984, test=0.893), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.82, score=(train=0.987, test=0.870), total=   0.1s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.82, score=(train=0.984, test=0.907), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.78, score=(train=0.960, test=0.863), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.78, score=(train=0.966, test=0.828), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.78, score=(train=0.957, test=0.892), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.78, score=(train=0.962, test=0.875), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.78, score=(train=0.957, test=0.916), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.8, score=(train=0.963, test=0.862), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.8, score=(train=0.966, test=0.826), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.8, score=(train=0.956, test=0.894), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.8, score=(train=0.963, test=0.875), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.8, score=(train=0.957, test=0.912), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.82, score=(train=0.962, test=0.858), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.82, score=(train=0.968, test=0.826), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.82, score=(train=0.957, test=0.897), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.82, score=(train=0.961, test=0.879), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.82, score=(train=0.959, test=0.910), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.78, score=(train=0.960, test=0.863), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.78, score=(train=0.966, test=0.828), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.78, score=(train=0.957, test=0.892), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.78, score=(train=0.962, test=0.875), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.78, score=(train=0.957, test=0.916), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.8, score=(train=0.963, test=0.862), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.8, score=(train=0.966, test=0.826), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.8, score=(train=0.956, test=0.894), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.8, score=(train=0.963, test=0.875), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.8, score=(train=0.957, test=0.912), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.82, score=(train=0.962, test=0.858), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.82, score=(train=0.968, test=0.826), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.82, score=(train=0.957, test=0.897), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.82, score=(train=0.961, test=0.879), total=   0.0s
[CV] colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.91, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.82, score=(train=0.959, test=0.910), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.78, score=(train=0.995, test=0.843), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.78, score=(train=0.997, test=0.809), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.78, score=(train=0.994, test=0.887), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.78, score=(train=0.994, test=0.863), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.78, score=(train=0.995, test=0.903), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.8, score=(train=0.996, test=0.840), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.8, score=(train=0.997, test=0.809), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.8, score=(train=0.994, test=0.888), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.8, score=(train=0.995, test=0.856), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.8, score=(train=0.994, test=0.901), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.82, score=(train=0.996, test=0.848), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.82, score=(train=0.997, test=0.806), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.82, score=(train=0.994, test=0.895), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.82, score=(train=0.996, test=0.856), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=30, subsample=0.82, score=(train=0.995, test=0.914), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.78, score=(train=0.996, test=0.849), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.78, score=(train=0.997, test=0.806), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.78, score=(train=0.995, test=0.890), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.78, score=(train=0.996, test=0.857), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.78, score=(train=0.996, test=0.901), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.8, score=(train=0.996, test=0.843), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.8, score=(train=0.997, test=0.810), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.8, score=(train=0.996, test=0.893), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.8, score=(train=0.996, test=0.853), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.8, score=(train=0.996, test=0.901), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.82, score=(train=0.997, test=0.850), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.82, score=(train=0.997, test=0.807), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.82, score=(train=0.996, test=0.887), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.82, score=(train=0.996, test=0.851), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=10, num_leaves=35, subsample=0.82, score=(train=0.996, test=0.912), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.78, score=(train=0.981, test=0.863), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.78, score=(train=0.985, test=0.828), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.78, score=(train=0.976, test=0.892), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.78, score=(train=0.980, test=0.881), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.78, score=(train=0.979, test=0.913), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.8, score=(train=0.982, test=0.863), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.8, score=(train=0.984, test=0.822), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.8, score=(train=0.978, test=0.903), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.8, score=(train=0.983, test=0.882), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.8, score=(train=0.978, test=0.912), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.82, score=(train=0.982, test=0.862), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.82, score=(train=0.985, test=0.828), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.82, score=(train=0.978, test=0.893), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.82, score=(train=0.983, test=0.879), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=30, subsample=0.82, score=(train=0.980, test=0.906), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.78, score=(train=0.981, test=0.863), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.78, score=(train=0.985, test=0.828), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.78, score=(train=0.976, test=0.892), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.78, score=(train=0.980, test=0.881), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.78, score=(train=0.979, test=0.913), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.8, score=(train=0.982, test=0.863), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.8, score=(train=0.984, test=0.822), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.8, score=(train=0.978, test=0.903), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.8, score=(train=0.983, test=0.882), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.8, score=(train=0.978, test=0.912), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.82, score=(train=0.982, test=0.862), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.82, score=(train=0.985, test=0.828), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.82, score=(train=0.978, test=0.893), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.82, score=(train=0.983, test=0.879), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.93, learning_rate=0.1, min_child_samples=20, num_leaves=35, subsample=0.82, score=(train=0.980, test=0.906), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.78, score=(train=0.982, test=0.853), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.78, score=(train=0.986, test=0.812), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.78, score=(train=0.980, test=0.898), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.78, score=(train=0.984, test=0.876), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.78, score=(train=0.982, test=0.899), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.8, score=(train=0.984, test=0.845), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.8, score=(train=0.987, test=0.809), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.8, score=(train=0.981, test=0.899), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.8, score=(train=0.984, test=0.868), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.8, score=(train=0.981, test=0.909), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.82, score=(train=0.983, test=0.842), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.82, score=(train=0.987, test=0.810), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.82, score=(train=0.980, test=0.893), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.82, score=(train=0.985, test=0.864), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=30, subsample=0.82, score=(train=0.983, test=0.902), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.78, score=(train=0.985, test=0.852), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.78, score=(train=0.988, test=0.819), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.78, score=(train=0.983, test=0.897), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.78, score=(train=0.986, test=0.871), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.78, score=(train=0.984, test=0.906), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.8, score=(train=0.986, test=0.841), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.8, score=(train=0.989, test=0.811), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.8, score=(train=0.984, test=0.903), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.8, score=(train=0.987, test=0.870), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.8, score=(train=0.984, test=0.908), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.82, score=(train=0.987, test=0.845), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.82, score=(train=0.989, test=0.814), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.82, score=(train=0.984, test=0.893), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.82, score=(train=0.987, test=0.870), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=10, num_leaves=35, subsample=0.82, score=(train=0.984, test=0.907), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.78, score=(train=0.960, test=0.863), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.78, score=(train=0.966, test=0.828), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.78, score=(train=0.957, test=0.892), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.78, score=(train=0.962, test=0.875), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.78 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.78, score=(train=0.957, test=0.916), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.8, score=(train=0.963, test=0.862), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.8, score=(train=0.966, test=0.826), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.8, score=(train=0.956, test=0.894), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.8, score=(train=0.963, test=0.875), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.8 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.8, score=(train=0.957, test=0.912), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.82, score=(train=0.962, test=0.858), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.82, score=(train=0.968, test=0.826), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.82, score=(train=0.957, test=0.897), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.82, score=(train=0.961, test=0.879), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.82 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=30, subsample=0.82, score=(train=0.959, test=0.910), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.78, score=(train=0.960, test=0.863), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.78, score=(train=0.966, test=0.828), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.78, score=(train=0.957, test=0.892), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.78, score=(train=0.962, test=0.875), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.78 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.78, score=(train=0.957, test=0.916), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.8, score=(train=0.963, test=0.862), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.8, score=(train=0.966, test=0.826), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.8, score=(train=0.956, test=0.894), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.8, score=(train=0.963, test=0.875), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.8 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.8, score=(train=0.957, test=0.912), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.82, score=(train=0.962, test=0.858), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.82, score=(train=0.968, test=0.826), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.82, score=(train=0.957, test=0.897), total=   0.0s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.82, score=(train=0.961, test=0.879), total=   0.1s
[CV] colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.82 
[CV]  colsample_bytree=0.93, learning_rate=0.05, min_child_samples=20, num_leaves=35, subsample=0.82, score=(train=0.959, test=0.910), total=   0.0s
{'colsample_bytree': 0.87, 'learning_rate': 0.1, 'min_child_samples': 10, 'num_leaves': 30, 'subsample': 0.78}模型平均训练得分:0.9948913668289157模型平均测试得分:0.8608351091098221{'colsample_bytree': 0.87, 'learning_rate': 0.1, 'min_child_samples': 10, 'num_leaves': 30, 'subsample': 0.8}模型平均训练得分:0.9952100757707395模型平均测试得分:0.8586537943313092{'colsample_bytree': 0.87, 'learning_rate': 0.1, 'min_child_samples': 10, 'num_leaves': 30, 'subsample': 0.82}模型平均训练得分:0.995492319063807模型平均测试得分:0.8636974901647936{'colsample_bytree': 0.87, 'learning_rate': 0.1, 'min_child_samples': 10, 'num_leaves': 35, 'subsample': 0.78}模型平均训练得分:0.9961760304607352模型平均测试得分:0.8604601571926592{'colsample_bytree': 0.87, 'learning_rate': 0.1, 'min_child_samples': 10, 'num_leaves': 35, 'subsample': 0.8}模型平均训练得分:0.9962742557034495模型平均测试得分:0.8601277225906501{'colsample_bytree': 0.87, 'learning_rate': 0.1, 'min_child_samples': 10, 'num_leaves': 35, 'subsample': 0.82}模型平均训练得分:0.99633271486064模型平均测试得分:0.86168599578933{'colsample_bytree': 0.87, 'learning_rate': 0.1, 'min_child_samples': 20, 'num_leaves': 30, 'subsample': 0.78}模型平均训练得分:0.9800659666555948模型平均测试得分:0.8752995445195519{'colsample_bytree': 0.87, 'learning_rate': 0.1, 'min_child_samples': 20, 'num_leaves': 30, 'subsample': 0.8}模型平均训练得分:0.9810037812865241模型平均测试得分:0.8763429083059412{'colsample_bytree': 0.87, 'learning_rate': 0.1, 'min_child_samples': 20, 'num_leaves': 30, 'subsample': 0.82}模型平均训练得分:0.9816219899017564模型平均测试得分:0.8734101325557602{'colsample_bytree': 0.87, 'learning_rate': 0.1, 'min_child_samples': 20, 'num_leaves': 35, 'subsample': 0.78}模型平均训练得分:0.9800659666555948模型平均测试得分:0.8752995445195519{'colsample_bytree': 0.87, 'learning_rate': 0.1, 'min_child_samples': 20, 'num_leaves': 35, 'subsample': 0.8}模型平均训练得分:0.9810037812865241模型平均测试得分:0.8763429083059412{'colsample_bytree': 0.87, 'learning_rate': 0.1, 'min_child_samples': 20, 'num_leaves': 35, 'subsample': 0.82}模型平均训练得分:0.9816219899017564模型平均测试得分:0.8734101325557602{'colsample_bytree': 0.87, 'learning_rate': 0.05, 'min_child_samples': 10, 'num_leaves': 30, 'subsample': 0.78}模型平均训练得分:0.9828878353715409模型平均测试得分:0.8674828999301066{'colsample_bytree': 0.87, 'learning_rate': 0.05, 'min_child_samples': 10, 'num_leaves': 30, 'subsample': 0.8}模型平均训练得分:0.9834158405982226模型平均测试得分:0.8659434954675926{'colsample_bytree': 0.87, 'learning_rate': 0.05, 'min_child_samples': 10, 'num_leaves': 30, 'subsample': 0.82}模型平均训练得分:0.983594604576265模型平均测试得分:0.8620285393411816{'colsample_bytree': 0.87, 'learning_rate': 0.05, 'min_child_samples': 10, 'num_leaves': 35, 'subsample': 0.78}模型平均训练得分:0.985396181530478模型平均测试得分:0.8690272850990489{'colsample_bytree': 0.87, 'learning_rate': 0.05, 'min_child_samples': 10, 'num_leaves': 35, 'subsample': 0.8}模型平均训练得分:0.9860977803932928模型平均测试得分:0.8665975606981379{'colsample_bytree': 0.87, 'learning_rate': 0.05, 'min_child_samples': 10, 'num_leaves': 35, 'subsample': 0.82}模型平均训练得分:0.9861863090215518模型平均测试得分:0.8657844292665029{'colsample_bytree': 0.87, 'learning_rate': 0.05, 'min_child_samples': 20, 'num_leaves': 30, 'subsample': 0.78}模型平均训练得分:0.9603291739546999模型平均测试得分:0.8749722825998079{'colsample_bytree': 0.87, 'learning_rate': 0.05, 'min_child_samples': 20, 'num_leaves': 30, 'subsample': 0.8}模型平均训练得分:0.960894823796824模型平均测试得分:0.8738037221270639{'colsample_bytree': 0.87, 'learning_rate': 0.05, 'min_child_samples': 20, 'num_leaves': 30, 'subsample': 0.82}模型平均训练得分:0.9615460090403143模型平均测试得分:0.8739911847539901{'colsample_bytree': 0.87, 'learning_rate': 0.05, 'min_child_samples': 20, 'num_leaves': 35, 'subsample': 0.78}模型平均训练得分:0.9603291739546999模型平均测试得分:0.8749722825998079{'colsample_bytree': 0.87, 'learning_rate': 0.05, 'min_child_samples': 20, 'num_leaves': 35, 'subsample': 0.8}模型平均训练得分:0.960894823796824模型平均测试得分:0.8738037221270639{'colsample_bytree': 0.87, 'learning_rate': 0.05, 'min_child_samples': 20, 'num_leaves': 35, 'subsample': 0.82}模型平均训练得分:0.9615460090403143模型平均测试得分:0.8739911847539901{'colsample_bytree': 0.91, 'learning_rate': 0.1, 'min_child_samples': 10, 'num_leaves': 30, 'subsample': 0.78}模型平均训练得分:0.9948913668289157模型平均测试得分:0.8608351091098221{'colsample_bytree': 0.91, 'learning_rate': 0.1, 'min_child_samples': 10, 'num_leaves': 30, 'subsample': 0.8}模型平均训练得分:0.9952100757707395模型平均测试得分:0.8586537943313092{'colsample_bytree': 0.91, 'learning_rate': 0.1, 'min_child_samples': 10, 'num_leaves': 30, 'subsample': 0.82}模型平均训练得分:0.995492319063807模型平均测试得分:0.8636974901647936{'colsample_bytree': 0.91, 'learning_rate': 0.1, 'min_child_samples': 10, 'num_leaves': 35, 'subsample': 0.78}模型平均训练得分:0.9961760304607352模型平均测试得分:0.8604601571926592{'colsample_bytree': 0.91, 'learning_rate': 0.1, 'min_child_samples': 10, 'num_leaves': 35, 'subsample': 0.8}模型平均训练得分:0.9962742557034495模型平均测试得分:0.8601277225906501{'colsample_bytree': 0.91, 'learning_rate': 0.1, 'min_child_samples': 10, 'num_leaves': 35, 'subsample': 0.82}模型平均训练得分:0.99633271486064模型平均测试得分:0.86168599578933{'colsample_bytree': 0.91, 'learning_rate': 0.1, 'min_child_samples': 20, 'num_leaves': 30, 'subsample': 0.78}模型平均训练得分:0.9800659666555948模型平均测试得分:0.8752995445195519{'colsample_bytree': 0.91, 'learning_rate': 0.1, 'min_child_samples': 20, 'num_leaves': 30, 'subsample': 0.8}模型平均训练得分:0.9810037812865241模型平均测试得分:0.8763429083059412{'colsample_bytree': 0.91, 'learning_rate': 0.1, 'min_child_samples': 20, 'num_leaves': 30, 'subsample': 0.82}模型平均训练得分:0.9816219899017564模型平均测试得分:0.8734101325557602{'colsample_bytree': 0.91, 'learning_rate': 0.1, 'min_child_samples': 20, 'num_leaves': 35, 'subsample': 0.78}模型平均训练得分:0.9800659666555948模型平均测试得分:0.8752995445195519{'colsample_bytree': 0.91, 'learning_rate': 0.1, 'min_child_samples': 20, 'num_leaves': 35, 'subsample': 0.8}模型平均训练得分:0.9810037812865241模型平均测试得分:0.8763429083059412{'colsample_bytree': 0.91, 'learning_rate': 0.1, 'min_child_samples': 20, 'num_leaves': 35, 'subsample': 0.82}模型平均训练得分:0.9816219899017564模型平均测试得分:0.8734101325557602{'colsample_bytree': 0.91, 'learning_rate': 0.05, 'min_child_samples': 10, 'num_leaves': 30, 'subsample': 0.78}模型平均训练得分:0.9828878353715409模型平均测试得分:0.8674828999301066{'colsample_bytree': 0.91, 'learning_rate': 0.05, 'min_child_samples': 10, 'num_leaves': 30, 'subsample': 0.8}模型平均训练得分:0.9834158405982226模型平均测试得分:0.8659434954675926{'colsample_bytree': 0.91, 'learning_rate': 0.05, 'min_child_samples': 10, 'num_leaves': 30, 'subsample': 0.82}模型平均训练得分:0.983594604576265模型平均测试得分:0.8620285393411816{'colsample_bytree': 0.91, 'learning_rate': 0.05, 'min_child_samples': 10, 'num_leaves': 35, 'subsample': 0.78}模型平均训练得分:0.985396181530478模型平均测试得分:0.8690272850990489{'colsample_bytree': 0.91, 'learning_rate': 0.05, 'min_child_samples': 10, 'num_leaves': 35, 'subsample': 0.8}模型平均训练得分:0.9860977803932928模型平均测试得分:0.8665975606981379{'colsample_bytree': 0.91, 'learning_rate': 0.05, 'min_child_samples': 10, 'num_leaves': 35, 'subsample': 0.82}模型平均训练得分:0.9861863090215518模型平均测试得分:0.8657844292665029{'colsample_bytree': 0.91, 'learning_rate': 0.05, 'min_child_samples': 20, 'num_leaves': 30, 'subsample': 0.78}模型平均训练得分:0.9603291739546999模型平均测试得分:0.8749722825998079{'colsample_bytree': 0.91, 'learning_rate': 0.05, 'min_child_samples': 20, 'num_leaves': 30, 'subsample': 0.8}模型平均训练得分:0.960894823796824模型平均测试得分:0.8738037221270639{'colsample_bytree': 0.91, 'learning_rate': 0.05, 'min_child_samples': 20, 'num_leaves': 30, 'subsample': 0.82}模型平均训练得分:0.9615460090403143模型平均测试得分:0.8739911847539901{'colsample_bytree': 0.91, 'learning_rate': 0.05, 'min_child_samples': 20, 'num_leaves': 35, 'subsample': 0.78}模型平均训练得分:0.9603291739546999模型平均测试得分:0.8749722825998079{'colsample_bytree': 0.91, 'learning_rate': 0.05, 'min_child_samples': 20, 'num_leaves': 35, 'subsample': 0.8}模型平均训练得分:0.960894823796824模型平均测试得分:0.8738037221270639{'colsample_bytree': 0.91, 'learning_rate': 0.05, 'min_child_samples': 20, 'num_leaves': 35, 'subsample': 0.82}模型平均训练得分:0.9615460090403143模型平均测试得分:0.8739911847539901{'colsample_bytree': 0.93, 'learning_rate': 0.1, 'min_child_samples': 10, 'num_leaves': 30, 'subsample': 0.78}模型平均训练得分:0.9948913668289157模型平均测试得分:0.8608351091098221{'colsample_bytree': 0.93, 'learning_rate': 0.1, 'min_child_samples': 10, 'num_leaves': 30, 'subsample': 0.8}模型平均训练得分:0.9952100757707395模型平均测试得分:0.8586537943313092{'colsample_bytree': 0.93, 'learning_rate': 0.1, 'min_child_samples': 10, 'num_leaves': 30, 'subsample': 0.82}模型平均训练得分:0.995492319063807模型平均测试得分:0.8636974901647936{'colsample_bytree': 0.93, 'learning_rate': 0.1, 'min_child_samples': 10, 'num_leaves': 35, 'subsample': 0.78}模型平均训练得分:0.9961760304607352模型平均测试得分:0.8604601571926592{'colsample_bytree': 0.93, 'learning_rate': 0.1, 'min_child_samples': 10, 'num_leaves': 35, 'subsample': 0.8}模型平均训练得分:0.9962742557034495模型平均测试得分:0.8601277225906501{'colsample_bytree': 0.93, 'learning_rate': 0.1, 'min_child_samples': 10, 'num_leaves': 35, 'subsample': 0.82}模型平均训练得分:0.99633271486064模型平均测试得分:0.86168599578933{'colsample_bytree': 0.93, 'learning_rate': 0.1, 'min_child_samples': 20, 'num_leaves': 30, 'subsample': 0.78}模型平均训练得分:0.9800659666555948模型平均测试得分:0.8752995445195519{'colsample_bytree': 0.93, 'learning_rate': 0.1, 'min_child_samples': 20, 'num_leaves': 30, 'subsample': 0.8}模型平均训练得分:0.9810037812865241模型平均测试得分:0.8763429083059412{'colsample_bytree': 0.93, 'learning_rate': 0.1, 'min_child_samples': 20, 'num_leaves': 30, 'subsample': 0.82}模型平均训练得分:0.9816219899017564模型平均测试得分:0.8734101325557602{'colsample_bytree': 0.93, 'learning_rate': 0.1, 'min_child_samples': 20, 'num_leaves': 35, 'subsample': 0.78}模型平均训练得分:0.9800659666555948模型平均测试得分:0.8752995445195519{'colsample_bytree': 0.93, 'learning_rate': 0.1, 'min_child_samples': 20, 'num_leaves': 35, 'subsample': 0.8}模型平均训练得分:0.9810037812865241模型平均测试得分:0.8763429083059412{'colsample_bytree': 0.93, 'learning_rate': 0.1, 'min_child_samples': 20, 'num_leaves': 35, 'subsample': 0.82}模型平均训练得分:0.9816219899017564模型平均测试得分:0.8734101325557602{'colsample_bytree': 0.93, 'learning_rate': 0.05, 'min_child_samples': 10, 'num_leaves': 30, 'subsample': 0.78}模型平均训练得分:0.9828878353715409模型平均测试得分:0.8674828999301066{'colsample_bytree': 0.93, 'learning_rate': 0.05, 'min_child_samples': 10, 'num_leaves': 30, 'subsample': 0.8}模型平均训练得分:0.9834158405982226模型平均测试得分:0.8659434954675926{'colsample_bytree': 0.93, 'learning_rate': 0.05, 'min_child_samples': 10, 'num_leaves': 30, 'subsample': 0.82}模型平均训练得分:0.983594604576265模型平均测试得分:0.8620285393411816{'colsample_bytree': 0.93, 'learning_rate': 0.05, 'min_child_samples': 10, 'num_leaves': 35, 'subsample': 0.78}模型平均训练得分:0.985396181530478模型平均测试得分:0.8690272850990489{'colsample_bytree': 0.93, 'learning_rate': 0.05, 'min_child_samples': 10, 'num_leaves': 35, 'subsample': 0.8}模型平均训练得分:0.9860977803932928模型平均测试得分:0.8665975606981379{'colsample_bytree': 0.93, 'learning_rate': 0.05, 'min_child_samples': 10, 'num_leaves': 35, 'subsample': 0.82}模型平均训练得分:0.9861863090215518模型平均测试得分:0.8657844292665029{'colsample_bytree': 0.93, 'learning_rate': 0.05, 'min_child_samples': 20, 'num_leaves': 30, 'subsample': 0.78}模型平均训练得分:0.9603291739546999模型平均测试得分:0.8749722825998079{'colsample_bytree': 0.93, 'learning_rate': 0.05, 'min_child_samples': 20, 'num_leaves': 30, 'subsample': 0.8}模型平均训练得分:0.960894823796824模型平均测试得分:0.8738037221270639{'colsample_bytree': 0.93, 'learning_rate': 0.05, 'min_child_samples': 20, 'num_leaves': 30, 'subsample': 0.82}模型平均训练得分:0.9615460090403143模型平均测试得分:0.8739911847539901{'colsample_bytree': 0.93, 'learning_rate': 0.05, 'min_child_samples': 20, 'num_leaves': 35, 'subsample': 0.78}模型平均训练得分:0.9603291739546999模型平均测试得分:0.8749722825998079{'colsample_bytree': 0.93, 'learning_rate': 0.05, 'min_child_samples': 20, 'num_leaves': 35, 'subsample': 0.8}模型平均训练得分:0.960894823796824模型平均测试得分:0.8738037221270639{'colsample_bytree': 0.93, 'learning_rate': 0.05, 'min_child_samples': 20, 'num_leaves': 35, 'subsample': 0.82}模型平均训练得分:0.9615460090403143模型平均测试得分:0.8739911847539901参数的最佳取值:{'colsample_bytree': 0.87, 'learning_rate': 0.1, 'min_child_samples': 20, 'num_leaves': 30, 'subsample': 0.8}
最佳模型得分:0.8763429083059412[Parallel(n_jobs=1)]: Done 360 out of 360 | elapsed:   17.8s finished
res = gsearch.predict(train_tr)#这里的res就是布尔值
percent=[0 if res[i]!=y_train[i] else 1 for i in range(len(res))]error_rate=1-np.array(percent,dtype=int).sum()/len(res)#个人偏好,二分类看error_rate。虽然这样肯定是不全面的。
print(error_rate)
roc_auc_score(y_train,res)
0.068462401795735150.9284584411849295

生成提交的测试集预测结果文件。

result = gsearch.predict(test_tr)
dataframe = pd.DataFrame({'PassengerId':test["PassengerId"],'Survived':result})
dataframe.to_csv("submission.csv",index=False,sep=',')

这篇关于使用LightGBM和GridSearchCV预测Titanic数据集的文章就介绍到这儿,希望我们推荐的文章对编程师们有所帮助!



http://www.chinasem.cn/article/498712

相关文章

大模型研发全揭秘:客服工单数据标注的完整攻略

在人工智能(AI)领域,数据标注是模型训练过程中至关重要的一步。无论你是新手还是有经验的从业者,掌握数据标注的技术细节和常见问题的解决方案都能为你的AI项目增添不少价值。在电信运营商的客服系统中,工单数据是客户问题和解决方案的重要记录。通过对这些工单数据进行有效标注,不仅能够帮助提升客服自动化系统的智能化水平,还能优化客户服务流程,提高客户满意度。本文将详细介绍如何在电信运营商客服工单的背景下进行

基于MySQL Binlog的Elasticsearch数据同步实践

一、为什么要做 随着马蜂窝的逐渐发展,我们的业务数据越来越多,单纯使用 MySQL 已经不能满足我们的数据查询需求,例如对于商品、订单等数据的多维度检索。 使用 Elasticsearch 存储业务数据可以很好的解决我们业务中的搜索需求。而数据进行异构存储后,随之而来的就是数据同步的问题。 二、现有方法及问题 对于数据同步,我们目前的解决方案是建立数据中间表。把需要检索的业务数据,统一放到一张M

关于数据埋点,你需要了解这些基本知识

产品汪每天都在和数据打交道,你知道数据来自哪里吗? 移动app端内的用户行为数据大多来自埋点,了解一些埋点知识,能和数据分析师、技术侃大山,参与到前期的数据采集,更重要是让最终的埋点数据能为我所用,否则可怜巴巴等上几个月是常有的事。   埋点类型 根据埋点方式,可以区分为: 手动埋点半自动埋点全自动埋点 秉承“任何事物都有两面性”的道理:自动程度高的,能解决通用统计,便于统一化管理,但个性化定

中文分词jieba库的使用与实景应用(一)

知识星球:https://articles.zsxq.com/id_fxvgc803qmr2.html 目录 一.定义: 精确模式(默认模式): 全模式: 搜索引擎模式: paddle 模式(基于深度学习的分词模式): 二 自定义词典 三.文本解析   调整词出现的频率 四. 关键词提取 A. 基于TF-IDF算法的关键词提取 B. 基于TextRank算法的关键词提取

使用SecondaryNameNode恢复NameNode的数据

1)需求: NameNode进程挂了并且存储的数据也丢失了,如何恢复NameNode 此种方式恢复的数据可能存在小部分数据的丢失。 2)故障模拟 (1)kill -9 NameNode进程 [lytfly@hadoop102 current]$ kill -9 19886 (2)删除NameNode存储的数据(/opt/module/hadoop-3.1.4/data/tmp/dfs/na

异构存储(冷热数据分离)

异构存储主要解决不同的数据,存储在不同类型的硬盘中,达到最佳性能的问题。 异构存储Shell操作 (1)查看当前有哪些存储策略可以用 [lytfly@hadoop102 hadoop-3.1.4]$ hdfs storagepolicies -listPolicies (2)为指定路径(数据存储目录)设置指定的存储策略 hdfs storagepolicies -setStoragePo

Hadoop集群数据均衡之磁盘间数据均衡

生产环境,由于硬盘空间不足,往往需要增加一块硬盘。刚加载的硬盘没有数据时,可以执行磁盘数据均衡命令。(Hadoop3.x新特性) plan后面带的节点的名字必须是已经存在的,并且是需要均衡的节点。 如果节点不存在,会报如下错误: 如果节点只有一个硬盘的话,不会创建均衡计划: (1)生成均衡计划 hdfs diskbalancer -plan hadoop102 (2)执行均衡计划 hd

Hadoop数据压缩使用介绍

一、压缩原则 (1)运算密集型的Job,少用压缩 (2)IO密集型的Job,多用压缩 二、压缩算法比较 三、压缩位置选择 四、压缩参数配置 1)为了支持多种压缩/解压缩算法,Hadoop引入了编码/解码器 2)要在Hadoop中启用压缩,可以配置如下参数

Makefile简明使用教程

文章目录 规则makefile文件的基本语法:加在命令前的特殊符号:.PHONY伪目标: Makefilev1 直观写法v2 加上中间过程v3 伪目标v4 变量 make 选项-f-n-C Make 是一种流行的构建工具,常用于将源代码转换成可执行文件或者其他形式的输出文件(如库文件、文档等)。Make 可以自动化地执行编译、链接等一系列操作。 规则 makefile文件

使用opencv优化图片(画面变清晰)

文章目录 需求影响照片清晰度的因素 实现降噪测试代码 锐化空间锐化Unsharp Masking频率域锐化对比测试 对比度增强常用算法对比测试 需求 对图像进行优化,使其看起来更清晰,同时保持尺寸不变,通常涉及到图像处理技术如锐化、降噪、对比度增强等 影响照片清晰度的因素 影响照片清晰度的因素有很多,主要可以从以下几个方面来分析 1. 拍摄设备 相机传感器:相机传