Skip to content
This repository has been archived by the owner on Oct 16, 2023. It is now read-only.

How to setup the master address and hostname #2

Open
jind11 opened this issue Jan 6, 2023 · 2 comments
Open

How to setup the master address and hostname #2

jind11 opened this issue Jan 6, 2023 · 2 comments

Comments

@jind11
Copy link

jind11 commented Jan 6, 2023

We plan to use multiple aws ec2 instances for multi-node training, in this case, how to setup the master address and hostname:
--master_addr
--master_port
--hosts

It would be great to have more concrete demo examples. Thanks!

@kurisusnowdeng
Copy link
Member

Hi @jind11 , It is supposed to be the same as how to use distributed pytorch.

@lhray
Copy link

lhray commented Feb 23, 2023

the document can't find how to start the distributed job. just write colossalai run. Could give one example

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants