Skip to content

[DOC]: Update the documentation of ShardConfig for 1D, 2D, 2.5D, 3D tensor parallelism #6197

Open
@giriprasad51

Description

@giriprasad51

📚 The doc issue

Hi @FrankLeeeee , @ver217 please update the https://github.com/hpcaitech/ColossalAI/blob/main/colossalai/shardformer/README.md file

# tensor_parallel_mode: Literal['1d', '2d', '2.5d', '3d'] this line is commented in ShardConfig but documentation is not updated Its hard to use 2D,2.5D, 3D tensor parallelism

Metadata

Metadata

Assignees

No one assigned

    Labels

    documentationImprovements or additions to documentation

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions