Programming 2 - Tree and Forests

Goal
- Learn to implement tree-based algorithms: random forest, Adaboost, XGBoost.
- Improve performance by out-of-bag error, important features, imbalanced classes, and tree size.
Readings
- Chapter 14 Trees and Forests, Machine Learning with Python Cookbook 2nd, Free O'Reilly Learning by FJU ID
Instructions
- Read the reading and practice all the Python codes with the IRIS dataset example.
- Exercise: Change the data to another Scikit-Learn toy dataset. Modify the Python codes to perform more analysis. Analyze the results of output, explain the results, and improve the results.
Report: a separate and single web page that you
- - Write the goal of this assignment
  - Explain those tree-based algorithms. Explain the Scikit-Learn functions of those tree-based algorithms.
  - Paste the Python codes you write. Clearly explain modified code segments written by you.
  - Upload code output results into your report web page. Explain the results of the output results
  - Give references to this assignment (teacher's readings, your readings)
Submit the web address of your web page to Microsoft Teams.

Goal