https://www.kdnuggets.com/2023/08/gpt4-8-models-one-secret.html
GPT-4: 8 Models in One; The Secret is Out
By Dr. Mandar Karhade, MD. PhD., Sr. Director Data Strategy and Advanced Analytics at Avalere Health
August 24, 2023
“The Mixture of Experts is an ensemble learning technique…. a task is divided into subtasks, and experts for each subtask are used to solve the models.”