Skip to content

Commit 69f7d22

Browse files
committed
Update code
1 parent 568507b commit 69f7d22

File tree

1 file changed

+3
-5
lines changed

1 file changed

+3
-5
lines changed

paddlenlp/trainer/training_args.py

Lines changed: 3 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -1093,11 +1093,9 @@ def __post_init__(self):
10931093
"enable_mp_fused_linear_param_grad_add only works with enable_mp_async_allreduce. It will not work."
10941094
)
10951095

1096-
sync_param = sync_grad = sync_moment = True # For CI test
1097-
1098-
# sync_param = "sync_param" in mp_config
1099-
# sync_grad = "sync_grad" in mp_config
1100-
# sync_moment = "sync_moment" in mp_config
1096+
sync_param = "sync_param" in mp_config
1097+
sync_grad = "sync_grad" in mp_config
1098+
sync_moment = "sync_moment" in mp_config
11011099

11021100
# sync_param_name = [""] matches any parameter name.
11031101
# If sync_param, sync_grad and sync_moment are not set, the default value in Paddle is :

0 commit comments

Comments
 (0)