Skip to content

Commit 5623c4e

Browse files
committed
fix yaml file"
1 parent ee70617 commit 5623c4e

File tree

2 files changed

+4
-4
lines changed

2 files changed

+4
-4
lines changed

model_zoo/gpt-3/ppfleetx/configs/nlp/gpt/auto/pretrain_gpt_6.7B_dp2_mp2_pp2_sharding2.yaml

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -20,6 +20,10 @@ Model:
2020
fuse_attn_qkv: True
2121
use_recompute: True
2222
recompute_granularity:
23+
sr: 0
24+
refined_ops_patterns:
25+
- {main_ops: [matmul_v2, elementwise_add], num: 0, pre_ops: [], suf_ops: []}
26+
- {main_ops: [flash_attn], num: 0, pre_ops: [], suf_ops: []}
2327
no_recompute_layers:
2428

2529

model_zoo/gpt-3/ppfleetx/configs/nlp/gpt/auto/pretrain_gpt_6.7B_sharding16.yaml

Lines changed: 0 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -20,10 +20,6 @@ Model:
2020
fuse_attn_qkv: True
2121
use_recompute: True
2222
recompute_granularity:
23-
sr: 0
24-
refined_ops_patterns:
25-
- {main_ops: [matmul_v2, elementwise_add], num: 0, pre_ops: [], suf_ops: []}
26-
- {main_ops: [flash_attn], num: 0, pre_ops: [], suf_ops: []}
2723
no_recompute_layers:
2824

2925

0 commit comments

Comments
 (0)