a h+@sddlZddlmZmZddlZddlZddlmZm Z m Z m Z m Z ddl mZmZe rfddlmZe eZeeejdd d Zeed d Gd ddeZdS)N)AnyUnion)add_end_docstringsis_torch_availableis_torchaudio_availableis_torchcodec_availablelogging)Pipelinebuild_pipeline_init_args),MODEL_FOR_AUDIO_CLASSIFICATION_MAPPING_NAMES)bpayload sampling_ratereturnc Cs|}d}d}dddd|d|d|d d d d g }ztj|tjtjd }Wnty^tdYn0||}|d}t|tj} | j ddkrtd| S)z? Helper function to read an audio file through ffmpeg. 1Zf32leZffmpegz-izpipe:0z-acz-arz-fz -hide_bannerz -loglevelquietzpipe:1)stdinstdoutzFffmpeg was not found but is required to load audio files from filenamerzMalformed soundfile) subprocessPopenPIPEFileNotFoundError ValueError communicatenpZ frombufferZfloat32shape) rraracZformat_for_conversionZffmpeg_commandZffmpeg_processZ output_streamZ out_bytesZaudiorg/var/www/html/assistant/venv/lib/python3.9/site-packages/transformers/pipelines/audio_classification.py ffmpeg_reads6  r!T)Zhas_feature_extractorcseZdZdZdZdZdZdZfddZe e j e e efeeee efdfdd Zdd d Zd d ZddZdddZZS)AudioClassificationPipelinea Audio classification pipeline using any `AutoModelForAudioClassification`. This pipeline predicts the class of a raw waveform or an audio file. In case of an audio file, ffmpeg should be installed to support multiple audio formats. Example: ```python >>> from transformers import pipeline >>> classifier = pipeline(model="superb/wav2vec2-base-superb-ks") >>> classifier("https://huggingface.co/datasets/Narsil/asr_dummy/resolve/main/1.flac") [{'score': 0.997, 'label': '_unknown_'}, {'score': 0.002, 'label': 'left'}, {'score': 0.0, 'label': 'yes'}, {'score': 0.0, 'label': 'down'}, {'score': 0.0, 'label': 'stop'}] ``` Learn more about the basics of using a pipeline in the [pipeline tutorial](../pipeline_tutorial) This pipeline can currently be loaded from [`pipeline`] using the following task identifier: `"audio-classification"`. See the list of available models on [huggingface.co/models](https://huggingface.co/models?filter=audio-classification). FTcsjd|vr|ddurd|d<nd|vr.d|d<tj|i||jdkr\td|jd|tdS)Ntop_kptzThe z is only available in PyTorch.)super__init__Z frameworkr __class__Zcheck_model_typer )selfargskwargsr(rr r'bs  z$AudioClassificationPipeline.__init__)inputsr+rc stj|fi|S)a Classify the sequence(s) given as inputs. See the [`AutomaticSpeechRecognitionPipeline`] documentation for more information. Args: inputs (`np.ndarray` or `bytes` or `str` or `dict`): The inputs is either : - `str` that is the filename of the audio file, the file will be read at the correct sampling rate to get the waveform using *ffmpeg*. This requires *ffmpeg* to be installed on the system. - `bytes` it is supposed to be the content of an audio file and is interpreted by *ffmpeg* in the same way. - (`np.ndarray` of shape (n, ) of type `np.float32` or `np.float64`) Raw audio at the correct sampling rate (no further check will be done) - `dict` form can be used to pass raw audio sampled at arbitrary `sampling_rate` and let this pipeline do the resampling. The dict must be either be in the format `{"sampling_rate": int, "raw": np.array}`, or `{"sampling_rate": int, "array": np.array}`, where the key `"raw"` or `"array"` is used to denote the raw audio waveform. top_k (`int`, *optional*, defaults to None): The number of top labels that will be returned by the pipeline. If the provided number is `None` or higher than the number of labels available in the model configuration, it will default to the number of labels. function_to_apply(`str`, *optional*, defaults to "softmax"): The function to apply to the model output. By default, the pipeline will apply the softmax function to the output of the model. Valid options: ["softmax", "sigmoid", "none"]. Note that passing Python's built-in `None` will default to "softmax", so you need to pass the string "none" to disable any post-processing. Return: A list of `dict` with the following keys: - **label** (`str`) -- The label predicted. - **score** (`float`) -- The corresponding probability. )r&__call__)r)r-r+r,rr r.os"z$AudioClassificationPipeline.__call__NcKsxi}|dur|jjj|d<n ||jjjkr4|jjj}||d<|durf|dvr\td|d||d<nd|d<ii|fS)Nr#)softmaxsigmoidnonez'Invalid value for `function_to_apply`: z2. Valid options are ['softmax', 'sigmoid', 'none']function_to_applyr/)modelconfigZ num_labelsr)r)r#r2r+Zpostprocess_paramsrrr _sanitize_parameterss   z0AudioClassificationPipeline._sanitize_parametersc Cst|tr^|ds|dr,t|j}n2t|d}|}Wdn1sT0Yt|trvt ||j j }t rddl }t||jr|}trddl }ddl}t||jjr|}|j}||jd}t|tr|}d|vr d|vsd|vstd |dd}|durB|d d|dd}|d}|}||j j krddl }tr|dd lm} ntd | t|t!j"r|#|n|||j j }t|t!j"st$d t%|j&dkrtd|j ||j j dd} |j'dur| j(|j'd} | S)Nzhttp://zhttps://rbr)arrayrrrawr7zWhen passing a dictionary to AudioClassificationPipeline, the dict needs to contain a "raw" key containing the numpy array or torch tensor representing the audio and a "sampling_rate" key, containing the sampling_rate associated with that arraypath) functionalztorchaudio is required to resample audio samples in AudioClassificationPipeline. The torchaudio package can be installed through: `pip install torchaudio`.z2We expect a numpy ndarray or torch tensor as inputr zFWe expect a single channel audio input for AudioClassificationPipeliner%)rZreturn_tensors)dtype)) isinstancestr startswithrequestsgetcontentopenreadbytesr!Zfeature_extractorrrtorchZTensorcpunumpyr torchcodecZdecodersZ AudioDecoderZget_all_samplesdataZ sample_ratedictcopyrpoprZ torchaudior: ImportErrorZresamplerndarrayZ from_numpy TypeErrorlenrr;to) r)r-frErHZ_audio_samplesZ_arrayZ_inputsZin_sampling_rateF processedrrr preprocesssh  &            z&AudioClassificationPipeline.preprocesscCs|jfi|}|S)N)r3)r)Z model_inputs model_outputsrrr _forwardsz$AudioClassificationPipeline._forwardr$r/csv|dkr|jdd}n"|dkr2|jd}n |jd}||\}}|}|}fddt||D}|S)Nr/rr0cs$g|]\}}|jjj|dqS))scorelabel)r3r4Zid2label).0rYZ_idr)rr z;AudioClassificationPipeline.postprocess..)Zlogitsr/r0Ztopktolistzip)r)rVr#r2ZprobsZscoresZidslabelsrr\r postprocesss z'AudioClassificationPipeline.postprocess)NN)r$r/)__name__ __module__ __qualname____doc__Z_load_processorZ_load_image_processorZ_load_feature_extractorZ_load_tokenizerr'rrrNrDr=rJrlistr.r5rUrWrb __classcell__rrr,r r"Bs 0$ Kr")rtypingrrrGrr?utilsrrrrr baser r Zmodels.auto.modeling_autor Z get_loggerrcloggerrDintrNr!r"rrrr s  $