U 0-ee(@sddlZddlZddlmZmZddlmZmZddlm Z ddl m Z ddl m Z mZmZmZmZmZmZe rzddlZd d Zd d Zd dZdS)N) SAGEMAKER_PARALLEL_EC2_INSTANCESTORCH_DYNAMO_MODES)ComputeEnvironmentSageMakerDistributedType)is_boto3_available)SageMakerConfig)DYNAMO_BACKENDS _ask_field _ask_options_convert_dynamo_backend_convert_mixed_precision#_convert_sagemaker_distributed_mode_convert_yes_no_to_boolcCstd}ddddiddgd}zv|j|tj|d d d ddd d dddddddddddddddddgdd gd}|j||d!tj|d d d"Wn(|jjk rtd#|d$YnXdS)%Niamz 2012-10-17ZAllowZServicezsagemaker.amazonaws.comzsts:AssumeRole)EffectZ PrincipalAction)VersionZ Statement)indent)RoleNameZAssumeRolePolicyDocumentz sagemaker:*zecr:GetDownloadUrlForLayerzecr:BatchGetImagezecr:BatchCheckLayerAvailabilityzecr:GetAuthorizationTokenzcloudwatch:PutMetricDatazcloudwatch:GetMetricDatazcloudwatch:GetMetricStatisticszcloudwatch:ListMetricszlogs:CreateLogGroupzlogs:CreateLogStreamzlogs:DescribeLogStreamszlogs:PutLogEventszlogs:GetLogEventszs3:CreateBucketz s3:ListBucketzs3:GetBucketLocationz s3:GetObjectz s3:PutObject*)rrResourceZ_policy_permission)rZ PolicyNameZPolicyDocumentzrole z# already exists. Using existing one) boto3clientZ create_rolejsondumpsZput_role_policy exceptionsZEntityAlreadyExistsExceptionprint) role_name iam_clientZsagemaker_trust_policyZpolicy_documentr"e/var/www/html/Darija-Ai-Train/env/lib/python3.8/site-packages/accelerate/commands/config/sagemaker.py_create_iam_role_for_sagemaker&sV   r$cCstd}|j|dddS)Nr)rZRoleZArn)rrZget_role)r r!r"r"r#_get_iam_role_arn\s r%cCstdddgt}d}|dkr4tddd}|tjd<n,td td }|tjd <td }|tjd <tddd}|tjd<tdddgt}|dkrtd}nd}td|dt|tdtddd}d}|rtddd}tdtddd} d} | rtd d!d} td"tddd} d} | r*td#d$d} td%d&d'gt} i}td(tddd}|rd)}td*d+d,t Dt d-d||d.<td/tddd}|rtd0t d1ddd||d2<td3tddd||d4<td5tddd||d6<d7}| t j krt|td8d}n|d97}t|d:dd;d}d}| t j kr8tdtd=d}td?d@dAdBdCgt}|r|d@krtdDt|tj| d|||||||| | |dES)FNzHow do you want to authorize?z AWS Profilez7Credentials (AWS_ACCESS_KEY_ID, AWS_SECRET_ACCESS_KEY) rz'Enter your AWS Profile name: [default] default)r&Z AWS_PROFILEzNote you will need to provide AWS_ACCESS_KEY_ID and AWS_SECRET_ACCESS_KEY when you launch you training script with,`accelerate launch --aws_access_key_id XXX --aws_secret_access_key YYY`zAWS Access Key ID: ZAWS_ACCESS_KEY_IDzAWS Secret Access Key: ZAWS_SECRET_ACCESS_KEYz"Enter your AWS Region: [us-east-1]z us-east-1ZAWS_DEFAULT_REGIONzMDo you already have an IAM Role for executing Amazon SageMaker Training Jobs?zProvide IAM Role namez%Create new IAM role using credentialszEnter your IAM role name: Z#accelerate_sagemaker_execution_rolez$Accelerate will create an iam role "z " using the provided credentialsz2Do you want to use custom Docker image? [yes/NO]: FzPlease enter yes or no.)r& error_messagezEnter your Docker image: cSs t|SNstrlowerxr"r"r#z%get_sagemaker_input..zODo you want to provide SageMaker input channels with data locations? [yes/NO]: z\Enter the path to the SageMaker inputs TSV file with columns (channel_name, data_location): cSs t|Sr(r)r,r"r"r#r.r/z3Do you want to enable SageMaker metrics? [yes/NO]: z[Enter the path to the SageMaker metrics TSV file with columns (metric_name, metric_regex): cSs t|Sr(r)r,r"r"r#r.r/zWhat is the distributed mode?zNo distributed trainingzData parallelismz?Do you wish to optimize your script with torch dynamo?[yes/NO]:Zdynamo_z+Which dynamo backend would you like to use?cSsg|] }|qSr")r+).0r-r"r"r# sz'get_sagemaker_input..rbackendzGDo you want to customize the defaults sent to torch.compile? [yes/NO]: zWhich mode do you want to use?cSs tt|Sr()rintr,r"r"r#r.r/modez\Do you want the fullgraph mode or it is ok to break model into several subgraphs? [yes/NO]: Z use_fullgraphz7Do you want to enable dynamic shape tracing? [yes/NO]: Z use_dynamicz:Which EC2 instance type you want to use for your training?cSs tt|Sr()rr3r,r"r"r#r.r/z? [ml.p3.2xlarge]:cSs t|Sr(r)r,r"r"r#r.r/z ml.p3.2xlargezShould distributed operations be checked while running for errors? This can avoid timeout issues but will be slower. [yes/NO]: rz(How many machines do you want use? [1]: z2Do you wish to use FP16 or BF16 (mixed precision)?noZfp16Zbf16Zfp8zTorch dynamo used without mixed precision requires TF32 to be efficient. Accelerate will enable it by default when launching your scripts.)Z image_uriZcompute_environmentdistributed_typeZuse_cpu dynamo_configec2_instance_typeZprofileregion iam_role_namemixed_precision num_machinessagemaker_inputs_filesagemaker_metrics_filedebug)r r3r osenvironrr$rrr r rrNOrZ DATA_PARALLELZMODEL_PARALLELrr rZAMAZON_SAGEMAKER)Zcredentials_configurationZ aws_profileZaws_access_key_idZaws_secret_access_keyZ aws_regionZrole_managementr:Zis_custom_docker_imageZ docker_imageZis_sagemaker_inputs_enabledr=Zis_sagemaker_metrics_enabledr>r6r7Z use_dynamoprefixZuse_custom_optionsZec2_instance_queryr8r?r<r;r"r"r#get_sagemaker_inputas6           rD)rr@Zutils.constantsrrZutils.dataclassesrrZ utils.importsrZ config_argsr Z config_utilsr r r r rrrrr$r%rDr"r"r"r#s  $ 6