>Overall, our findings position LoRA as the complementary axis of memory alongside RAG and ICL, offering distinct advantages.