U 9%eC@sddlZddlmZddlZddlmZmZmZddl m Z ddl m Z m Z mZmZddlmZddlmZmZmZmZmZd d lmZGd d d eeZdS) N)Integral) BaseEstimatorTransformerMixin _fit_context)_safe_indexing)HiddenIntervalOptions StrOptions_weighted_percentile)_check_feature_names_in_check_sample_weight check_arraycheck_is_fittedcheck_random_state) OneHotEncoderc @seZdZUdZeedddddgeddd hged d d hgeee j e j hdgeed dddde edhgdgdZ eed<d"dd ddddddZeddd#ddZddZddZddZd$d d!ZdS)%KBinsDiscretizera Bin continuous data into intervals. Read more in the :ref:`User Guide `. .. versionadded:: 0.20 Parameters ---------- n_bins : int or array-like of shape (n_features,), default=5 The number of bins to produce. Raises ValueError if ``n_bins < 2``. encode : {'onehot', 'onehot-dense', 'ordinal'}, default='onehot' Method used to encode the transformed result. - 'onehot': Encode the transformed result with one-hot encoding and return a sparse matrix. Ignored features are always stacked to the right. - 'onehot-dense': Encode the transformed result with one-hot encoding and return a dense array. Ignored features are always stacked to the right. - 'ordinal': Return the bin identifier encoded as an integer value. strategy : {'uniform', 'quantile', 'kmeans'}, default='quantile' Strategy used to define the widths of the bins. - 'uniform': All bins in each feature have identical widths. - 'quantile': All bins in each feature have the same number of points. - 'kmeans': Values in each bin have the same nearest center of a 1D k-means cluster. For an example of the different strategies see: :ref:`sphx_glr_auto_examples_preprocessing_plot_discretization_strategies.py`. dtype : {np.float32, np.float64}, default=None The desired data-type for the output. If None, output dtype is consistent with input dtype. Only np.float32 and np.float64 are supported. .. versionadded:: 0.24 subsample : int or None, default='warn' Maximum number of samples, used to fit the model, for computational efficiency. Defaults to 200_000 when `strategy='quantile'` and to `None` when `strategy='uniform'` or `strategy='kmeans'`. `subsample=None` means that all the training samples are used when computing the quantiles that determine the binning thresholds. Since quantile computation relies on sorting each column of `X` and that sorting has an `n log(n)` time complexity, it is recommended to use subsampling on datasets with a very large number of samples. .. versionchanged:: 1.3 The default value of `subsample` changed from `None` to `200_000` when `strategy="quantile"`. .. versionchanged:: 1.5 The default value of `subsample` changed from `None` to `200_000` when `strategy="uniform"` or `strategy="kmeans"`. random_state : int, RandomState instance or None, default=None Determines random number generation for subsampling. Pass an int for reproducible results across multiple function calls. See the `subsample` parameter for more details. See :term:`Glossary `. .. versionadded:: 1.1 Attributes ---------- bin_edges_ : ndarray of ndarray of shape (n_features,) The edges of each bin. Contain arrays of varying shapes ``(n_bins_, )`` Ignored features will have empty arrays. n_bins_ : ndarray of shape (n_features,), dtype=np.int_ Number of bins per feature. Bins whose width are too small (i.e., <= 1e-8) are removed with a warning. n_features_in_ : int Number of features seen during :term:`fit`. .. versionadded:: 0.24 feature_names_in_ : ndarray of shape (`n_features_in_`,) Names of features seen during :term:`fit`. Defined only when `X` has feature names that are all strings. .. versionadded:: 1.0 See Also -------- Binarizer : Class used to bin values as ``0`` or ``1`` based on a parameter ``threshold``. Notes ----- For a visualization of discretization on different datasets refer to :ref:`sphx_glr_auto_examples_preprocessing_plot_discretization_classification.py`. On the effect of discretization on linear models see: :ref:`sphx_glr_auto_examples_preprocessing_plot_discretization.py`. In bin edges for feature ``i``, the first and last values are used only for ``inverse_transform``. During transform, bin edges are extended to:: np.concatenate([-np.inf, bin_edges_[i][1:-1], np.inf]) You can combine ``KBinsDiscretizer`` with :class:`~sklearn.compose.ColumnTransformer` if you only want to preprocess part of the features. ``KBinsDiscretizer`` might produce constant features (e.g., when ``encode = 'onehot'`` and certain bins do not contain any data). These features can be removed with feature selection algorithms (e.g., :class:`~sklearn.feature_selection.VarianceThreshold`). Examples -------- >>> from sklearn.preprocessing import KBinsDiscretizer >>> X = [[-2, 1, -4, -1], ... [-1, 2, -3, -0.5], ... [ 0, 3, -2, 0.5], ... [ 1, 4, -1, 2]] >>> est = KBinsDiscretizer( ... n_bins=3, encode='ordinal', strategy='uniform', subsample=None ... ) >>> est.fit(X) KBinsDiscretizer(...) >>> Xt = est.transform(X) >>> Xt # doctest: +SKIP array([[ 0., 0., 0., 0.], [ 1., 1., 1., 0.], [ 2., 2., 2., 1.], [ 2., 2., 2., 2.]]) Sometimes it may be useful to convert the data back into the original feature space. The ``inverse_transform`` function converts the binned data into the original feature space. Each value will be equal to the mean of the two bin edges. >>> est.bin_edges_[0] array([-2., -1., 0., 1.]) >>> est.inverse_transform(Xt) array([[-1.5, 1.5, -3.5, -0.5], [-0.5, 2.5, -2.5, -0.5], [ 0.5, 3.5, -1.5, 0.5], [ 0.5, 3.5, -1.5, 1.5]]) rNleft)closedz array-likeonehotz onehot-denseordinaluniformquantilekmeansrwarn random_staten_binsencodestrategydtype subsampler_parameter_constraints)r!r"r#r$rcCs(||_||_||_||_||_||_dSNr)selfr r!r"r#r$rr)d/var/www/html/Darija-Ai-API/env/lib/python3.8/site-packages/sklearn/preprocessing/_discretization.py__init__s zKBinsDiscretizer.__init__T)Zprefer_skip_nested_validationcs|j|dd}|jtjtjfkr(|j}n|j}|j\}}dk r\|jdkr\td|jd|jdkr||jdkr|t d t |j}|dkr|jd krd nd}|dk r||krt |j }|j||d d } t|| }|jd}||} dk rt||jdtj|td} t|D]8} |dd| f} }| |krvt d| d| | <ttj tjg| | <q|jdkrt| || | d| | <n:|jd kr tdd| | d}dkrtt|| | <n$tjfdd|Dtjd| | <n|jdkrddlm}t| || | d}|dd|dddddfd}|| | |dd}|jdddfdjdddf}| |dd|ddd| | <tj!| | | |f| | <|jdkrtj"| | tjddk}| | || | <t#| | d| | krt d| t#| | d| | <q| |_$| |_%d|j&krt'd d|j%D|j&dk|d!|_(|j(tdt#|j%f|S)"as Fit the estimator. Parameters ---------- X : array-like of shape (n_samples, n_features) Data to be discretized. y : None Ignored. This parameter exists only for compatibility with :class:`~sklearn.pipeline.Pipeline`. sample_weight : ndarray of shape (n_samples,) Contains weight values to be associated with each sample. Only possible when `strategy` is set to `"quantile"`. .. versionadded:: 1.3 Returns ------- self : object Returns the instance itself. numericr#NrzY`sample_weight` was provided but it cannot be used with strategy='uniform'. Got strategy=z instead.)rrrzIn version 1.5 onwards, subsample=200_000 will be used by default. Set subsample explicitly to silence this warning in the mean time. Set subsample=None to disable subsampling explicitly.ri@ F)sizereplacerz3Feature %d is constant and will be replaced with 0.rdcsg|]}t|qSr)r ).0qcolumn sample_weightr)r* &sz(KBinsDiscretizer.fit..rr)KMeans?)Z n_clustersinitZn_init)r5)rr)Zto_beging:0yE>zqBins whose width are too small (i.e., <= 1e-8) in feature %d are removed. Consider decreasing the number of bins.rcSsg|]}t|qSr))npZaranger1ir)r)r*r6Ns) categoriesZ sparse_outputr#))_validate_datar#r;float64float32shaper" ValueErrorr$warningsr FutureWarningrrchoicer_validate_n_binsrZzerosobjectrangeminmaxarrayinfZlinspaceZasarrayZ percentileZclusterr7fitZcluster_centers_sortZr_Zediff1dlen bin_edges_n_bins_r!r_encoder)r(Xyr5Z output_dtypeZ n_samples n_featuresr$rngZ subsample_idxr bin_edgesjjZcol_minZcol_maxZ quantilesr7Z uniform_edgesr:kmZcentersmaskr)r3r*rNs               (    zKBinsDiscretizer.fitcCs|j}t|tr tj||tdSt|tddd}|jdksH|jd|krPt d|dk||kB}t |d}|jddkrd d d |D}t d t j||S) z0Returns n_bins_, the number of bins per feature.r-TF)r#copyZ ensure_2drrz8n_bins must be a scalar or array of shape (n_features,).rz, css|]}t|VqdSr')strr<r)r)r* gsz4KBinsDiscretizer._validate_n_bins..zk{} received an invalid number of bins at indices {}. Number of bins must be at least 2, and must be an int.)r isinstancerr;fullintrndimrBrCwherejoinformatr__name__)r(rVZ orig_binsr Zbad_nbins_valueZviolating_indicesindicesr)r)r*rGXs" z!KBinsDiscretizer._validate_n_binscCst||jdkrtjtjfn|j}|j|d|dd}|j}t|jdD]8}tj ||dd|dd|fdd|dd|f<qJ|j d kr|Sd}d |j kr|j j}|j|j _z|j |}W5||j _X|S) a Discretize the data. Parameters ---------- X : array-like of shape (n_samples, n_features) Data to be discretized. Returns ------- Xt : {ndarray, sparse matrix}, dtype={np.float32, np.float64} Data in the binned space. Will be a sparse matrix if `self.encode='onehot'` and ndarray otherwise. NTF)r\r#resetrr8right)Zsiderr) rr#r;r@rAr?rQrIrBZ searchsortedr!rS transform)r(rTr#XtrXrYZ dtype_initZXt_encr)r)r*rjqs 6    zKBinsDiscretizer.transformcCst|d|jkr|j|}t|dtjtjfd}|jj d}|j d|krdt d ||j dt |D]P}|j |}|dd|ddd }|t|dd|f|dd|f<ql|S) a Transform discretized data back to original feature space. Note that this function does not regenerate the original data due to discretization rounding. Parameters ---------- Xt : array-like of shape (n_samples, n_features) Transformed data in the binned space. Returns ------- Xinv : ndarray, dtype={np.float32, np.float64} Data in the original feature space. rT)r\r#rrz8Incorrect number of features. Expecting {}, received {}.Nr8r9)rr!rSinverse_transformrr;r@rArRrBrCrerIrQint_)r(rkZXinvrVrYrXZ bin_centersr)r)r*rls"     (z"KBinsDiscretizer.inverse_transformcCs.t|dt||}t|dr*|j|S|S)aGet output feature names. Parameters ---------- input_features : array-like of str or None, default=None Input features. - If `input_features` is `None`, then `feature_names_in_` is used as feature names in. If `feature_names_in_` is not defined, then the following input feature names are generated: `["x0", "x1", ..., "x(n_features_in_ - 1)"]`. - If `input_features` is an array-like, then `input_features` must match `feature_names_in_` if `feature_names_in_` is defined. Returns ------- feature_names_out : ndarray of str objects Transformed feature names. Zn_features_in_rS)rrhasattrrSget_feature_names_out)r(Zinput_featuresr)r)r*ros     z&KBinsDiscretizer.get_feature_names_out)r&)NN)N)rf __module__ __qualname____doc__r rr r typer;r@rArr%dict__annotations__r+rrNrGrjrlror)r)r)r*rs6     '&r)rDnumbersrnumpyr;baserrrutilsrZutils._param_validationrr r r Z utils.statsr Zutils.validationrrrrrZ _encodersrrr)r)r)r*s