[Distributed] [CustomDevices] Adapt SP on lora && polish MC2 APIs#8303

wawltor merged 2 commits intoPaddlePaddle:developPaddlePaddle/PaddleNLP:developfrom

SylarTiaNII:cp_lora_spSylarTiaNII/PaddleNLP:cp_lora_spCopy head branch name to clipboard