a hJ @sddlmZddlZddlZddlmZddlZddlmZm Z ddl m Z Gddde Z dd d d d d d d ddZ dd dd d d d d d dddZdd d d d d d d dddZd d ddddZdS)) annotationsN)Path)hf_hub_downloadsnapshot_download)tqdmcs4eZdZdZfddZdddfdd ZZS) disabled_tqdmz Class to override `disable` argument in case progress bars are globally disabled. Taken from https://github.com/tqdm/tqdm/issues/619#issuecomment-619639324. csd|d<tj|i|dS)NTdisable)super__init__)selfargskwargs __class__^/var/www/html/assistant/venv/lib/python3.9/site-packages/sentence_transformers/util/file_io.pyr szdisabled_tqdm.__init__strNone)attrreturncs2zt|Wnty,|dkr(Yn0dS)zBFix for https://github.com/huggingface/huggingface_hub/issues/1603_lockN)r __delattr__AttributeError)r rrrrrs  zdisabled_tqdm.__delattr__)__name__ __module__ __qualname____doc__r r __classcell__rrrrr s rFrzbool | str | Nonez str | Nonebool)model_name_or_pathtoken cache_folderrevisionlocal_files_onlyrc Cstt|d||||dS)a} Checks if the given model name or path corresponds to a SentenceTransformer model. Args: model_name_or_path (str): The name or path of the model. token (Optional[Union[bool, str]]): The token to be used for authentication. Defaults to None. cache_folder (Optional[str]): The folder to cache the model files. Defaults to None. revision (Optional[str]): The revision of the model. Defaults to None. local_files_only (bool): Whether to only use local files for the model. Defaults to False. Returns: bool: True if the model is a SentenceTransformer model, False otherwise. z modules.json)r r!r"r#)rload_file_path)rr r!r"r#rrris_sentence_transformer_model sr%z str | Path)rfilename subfolderr r!r"r#rc Csbt|||}|rt|St||}z"t||j|j|d|||dWSty\YdS0dS)a Loads a file from a local or remote location. Args: model_name_or_path (str): The model name or path. filename (str): The name of the file to load. subfolder (str): The subfolder within the model subfolder (if applicable). token (Optional[Union[bool, str]]): The token to access the remote file (if applicable). cache_folder (Optional[str]): The folder to cache the downloaded file (if applicable). revision (Optional[str], optional): The revision of the file (if applicable). Defaults to None. local_files_only (bool, optional): Whether to only consider local files. Defaults to False. Returns: Optional[str]: The path to the loaded file, or None if the file could not be found or loaded. sentence-transformers)r'r(r" library_namer cache_dirr#N)rexistsrrnameparentas_posix Exception)rr'r(r r!r"r# file_pathrrrr$@s"   r$)rr(r r!r"r#rc Cst|tr|}t||}|r,t|S|||dvrB|dndd|||td}ztfi|}Wn(tyd|d<tfi|}Yn0t||S)af Loads the subfolder path for a given model name or path. Args: model_name_or_path (str): The name or path of the model. subfolder (str): The subfolder to load. token (Optional[Union[bool, str]]): The token for authentication. cache_folder (Optional[str]): The folder to cache the downloaded files. revision (Optional[str], optional): The revision of the model. Defaults to None. local_files_only (bool, optional): Whether to only use local files. Defaults to False. Returns: Optional[str]: The subfolder path if it exists, otherwise None. )r&.z/**Nr))Zrepo_idr"Zallow_patternsr*r r+r#Z tqdm_classTr#) isinstancerr/r,rrrr0) rr(r r!r"r#Zdir_pathZdownload_kwargs repo_pathrrr load_dir_pathns(    r5r)urlpathrc Cs tj|dkr&tjtj|ddtj|dd}|jdkrftd|d|jtj d| d S|d }t |d l}|j d }|d urt |nd }td |dd}|jddD] }|r|t|||qWd n1s0Yt|||d S)a Downloads a URL to a given path on disk. Args: url (str): The URL to download. path (str): The path to save the downloaded file. Raises: requests.HTTPError: If the HTTP request returns a non-200 status code. Returns: None r&T)exist_ok)streamz"Exception when trying to download z . Response )fileNZ_partwbzContent-LengthB)unittotalZ unit_scalei) chunk_size)osr7dirnamemakedirsrequestsget status_codeprintsysstderrraise_for_statusopenheadersintr iter_contentupdatelenwriterenameclose) r6r7reqZdownload_filepathZ file_binarycontent_lengthr?progresschunkrrrhttp_gets$   * rX)NNNF)r&NNNF)NNNF) __future__rrArHpathlibrrDZhuggingface_hubrrZtqdm.autonotebookrrr%r$r5rXrrrrs0   #12