U 9%e\@sTdZddlmZddlmZddlmZmZee Z ddiZ GdddeeZ d S) z BiT model configuration)PretrainedConfig)logging)BackboneConfigMixin*get_aligned_output_features_output_indicesz google/bit-50z=https://huggingface.co/google/bit-50/resolve/main/config.jsoncsbeZdZdZdZddgZddgZddd d d d gdd ddgddddddddddffdd ZZS) BitConfiga This is the configuration class to store the configuration of a [`BitModel`]. It is used to instantiate an BiT model according to the specified arguments, defining the model architecture. Instantiating a configuration with the defaults will yield a similar configuration to that of the BiT [google/bit-50](https://huggingface.co/google/bit-50) architecture. Configuration objects inherit from [`PretrainedConfig`] and can be used to control the model outputs. Read the documentation from [`PretrainedConfig`] for more information. Args: num_channels (`int`, *optional*, defaults to 3): The number of input channels. embedding_size (`int`, *optional*, defaults to 64): Dimensionality (hidden size) for the embedding layer. hidden_sizes (`List[int]`, *optional*, defaults to `[256, 512, 1024, 2048]`): Dimensionality (hidden size) at each stage. depths (`List[int]`, *optional*, defaults to `[3, 4, 6, 3]`): Depth (number of layers) for each stage. layer_type (`str`, *optional*, defaults to `"preactivation"`): The layer to use, it can be either `"preactivation"` or `"bottleneck"`. hidden_act (`str`, *optional*, defaults to `"relu"`): The non-linear activation function in each block. If string, `"gelu"`, `"relu"`, `"selu"` and `"gelu_new"` are supported. global_padding (`str`, *optional*): Padding strategy to use for the convolutional layers. Can be either `"valid"`, `"same"`, or `None`. num_groups (`int`, *optional*, defaults to `32`): Number of groups used for the `BitGroupNormActivation` layers. drop_path_rate (`float`, *optional*, defaults to 0.0): The drop path rate for the stochastic depth. embedding_dynamic_padding (`bool`, *optional*, defaults to `False`): Whether or not to make use of dynamic padding for the embedding layer. output_stride (`int`, *optional*, defaults to 32): The output stride of the model. width_factor (`int`, *optional*, defaults to 1): The width factor for the model. out_features (`List[str]`, *optional*): If used as backbone, list of features to output. Can be any of `"stem"`, `"stage1"`, `"stage2"`, etc. (depending on how many stages the model has). If unset and `out_indices` is set, will default to the corresponding stages. If unset and `out_indices` is unset, will default to the last stage. out_indices (`List[int]`, *optional*): If used as backbone, list of indices of features to output. Can be any of 0, 1, 2, etc. (depending on how many stages the model has). If unset and `out_features` is set, will default to the corresponding stages. If unset and `out_features` is unset, will default to the last stage. Example: ```python >>> from transformers import BitConfig, BitModel >>> # Initializing a BiT bit-50 style configuration >>> configuration = BitConfig() >>> # Initializing a model (with random weights) from the bit-50 style configuration >>> model = BitModel(configuration) >>> # Accessing the model configuration >>> configuration = model.config ``` bitZ preactivationZ bottleneckZSAMEZVALIDr@iiiZreluN gFc stjf|||jkr4td|dd|j|dk rd||jkrT|}ntd|d||_||_||_ ||_ ||_ ||_ ||_ ||_| |_| |_| |_| |_dgddtd t|d D|_t| ||jd \|_|_dS) Nz layer_type=z is not one of ,zPadding strategy z not supportedstemcSsg|]}d|qS)Zstage).0idxrrh/var/www/html/Darija-Ai-API/env/lib/python3.8/site-packages/transformers/models/bit/configuration_bit.py sz&BitConfig.__init__..r ) out_features out_indices stage_names)super__init__ layer_types ValueErrorjoinuppersupported_padding num_channelsembedding_size hidden_sizesdepths layer_type hidden_actglobal_padding num_groupsdrop_path_rateembedding_dynamic_padding output_stride width_factorrangelenrrZ _out_featuresZ _out_indices)selfrr r!r"r#r$r%r&r'r(r)r*rrkwargs __class__rrr\s2  $zBitConfig.__init__) __name__ __module__ __qualname____doc__Z model_typerrr __classcell__rrr/rrs&:  rN) r4Zconfiguration_utilsrutilsrZutils.backbone_utilsrrZ get_loggerr1loggerZ!BIT_PRETRAINED_CONFIG_ARCHIVE_MAPrrrrrs