https://towardsdatascience.com/xgboost-order-does-matter-60d8d0d5aa71?gi=d051128bfa6b
XGBoost: Order Does Matter
What impact does the order of the features have on XGBoost models, and how can you use feature importance to identify related features in your data?
Bitya Neuhof
Aug 10
“However, what happens if two features have the same score at a given level in the model training process? Which one will be preferred by the algorithm? It turns out that in some XGBoost implementations, the preferred feature will be the first one (related to the insertion order of the features); however, in other implementations, one of the two features is selected randomly.”