Apple's DynaMiCS fine-tunes LLMs with dynamic domain constraints

Apple ML Research proposes DynaMiCS, a method that uses dynamic data mixtures to fine-tune LLMs while preserving performance on constrained domains like general knowledge and safety. It outperforms fixed heuristics and adaptive baselines.