Grid Search Example - Xgboost Typing CST Test
Loading…
Grid Search Example — Xgboost Code
Performs hyperparameter tuning with GridSearchCV.
import xgboost as xgb
from sklearn.datasets import load_iris
from sklearn.model_selection import GridSearchCV
data = load_iris()
param_grid = {'max_depth':[2,3],'n_estimators':[50,100]}
model = xgb.XGBClassifier(eval_metric='mlogloss')
grid = GridSearchCV(model,param_grid,cv=3)
grid.fit(data.data,data.target)
print('Best Params:',grid.best_params_)Xgboost Language Guide
XGBoost (Extreme Gradient Boosting) is an optimized, scalable, and high-performance gradient boosting framework based on decision trees, widely used for supervised learning tasks including classification, regression, and ranking.
Primary Use Cases
- ▸Binary and multiclass classification
- ▸Regression tasks
- ▸Learning-to-rank applications
- ▸Feature importance analysis
- ▸Integration in ML pipelines for structured/tabular data
Notable Features
- ▸Gradient boosting with L1/L2 regularization
- ▸Parallelized tree construction
- ▸Supports missing value handling natively
- ▸Tree pruning via depth-wise or loss-guided strategies
- ▸Supports GPU acceleration and distributed training
Origin & Creator
XGBoost was developed by Tianqi Chen and collaborators in 2014 to provide an efficient and scalable gradient boosting library, optimized for performance and accuracy.
Industrial Note
XGBoost is heavily used in Kaggle competitions, finance, healthcare analytics, adtech, recommendation systems, and any scenario needing fast and accurate tree-based predictions.