Skip to content

Commit 7a1c439

Browse files
authored
[AutoParallel] update loss for global clip (#8750)
* update loss for global clip * skip ci
1 parent 10d058d commit 7a1c439

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

scripts/distribute/ci_case_auto.sh

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -42,7 +42,7 @@ function llama_case_list_auto() {
4242
llama_dygraph_auto_bs8_fp32_DP2
4343
llama_dygraph_auto_bs8_fp32_DP2-MP2
4444
llama_dygraph_auto_bs8_fp32_DP2-MP2-PP2
45-
llama_dygraph_auto_bs8_fp16_DP2-MP2-PP2
45+
# llama_dygraph_auto_bs8_fp16_DP2-MP2-PP2 TODO: REOPEN this PR when global clip merge in paddle dev.
4646
llama_dy2st_auto_bs4_bf16_DP1-MP1-PP4-SD2-VPP3_split_bw
4747
llama_dy2st_auto_bs4_bf16_DP1-MP1-PP4-SD2
4848

@@ -760,7 +760,7 @@ function llama_dygraph_auto_bs8_fp16_DP2-MP2-PP2() {
760760
ips=-1
761761
mem=-1
762762
echo "result: loss=$loss ips=$ips mem=$mem"
763-
loss_base=9.41604424
763+
loss_base=9.41603851
764764
if [ $IS_A100 -ne 0 ];then
765765
loss_base=9.46169376
766766
fi

0 commit comments

Comments
 (0)