TLDR: "old" ml techniques like XGBoost can beat LLMs and neural networks for some tasks.