a h@sUddlmZmZmZmZddlmZmZddlm Z ddl m Z m Z ddl mZe rpddlmZdd lmZeed efZeed <ed eed ZedeeedZeeeedddZGdddeZdS))AnySequence TypedDictUnion) TypeAliasoverload) is_pil_image)is_vision_availablerequires_backends)Pipeline)Image load_imagez Image.Image ImagePairKeypointxyMatchZkeypoint_image_0Zkeypoint_image_1score)imagesreturncsdd}ddt|trXt|dkr>tfdd|Dr>|gStfdd|DrX|St|dS)N)z-Input images must be a one of the following :z - A pair of images.z - A list of pairs of images.cSst|pt|tS)z"images is a PIL Image or a string.)r isinstancestr)imagerd/var/www/html/assistant/venv/lib/python3.9/site-packages/transformers/pipelines/keypoint_matching.py_is_valid_image+sz-validate_image_pairs.._is_valid_imagerc3s|]}|VqdSNr.0rr rr 0z'validate_image_pairs..c3s:|]2}t|to0t|dko0tfdd|DVqdS)rc3s|]}|VqdSr!rr"r$rrr%5r&z1validate_image_pairs...N)rrlenall)r#Z image_pairr$rrr%2s   )rrr'r( ValueError)r error_messagerr$rvalidate_image_pairs$s " r+c seZdZdZdZdZdZdZfddZdddZ e de e e eed d d Ze dee e e eeed d d Zdeee e fe e eeeeeefd fdd ZdddZddZdeedddZZS)KeypointMatchingPipelinez Keypoint matching pipeline using any `AutoModelForKeypointMatching`. This pipeline matches keypoints between two images. FTcs2tj|i|t|d|jdkr.tddS)NZvisionptzBKeypoint matching pipeline only supports PyTorch (framework='pt').)super__init__r frameworkr))selfargskwargs __class__rrr/Fs  z!KeypointMatchingPipeline.__init__NcCs2i}|dur||d<i}|dur(||d<|i|fS)Ntimeout thresholdr)r1r7r6Zpreprocess_paramsZpostprocess_paramsrrr_sanitize_parametersLsz-KeypointMatchingPipeline._sanitize_parameters)inputsr7r3rcKsdSr!rr1r:r7r3rrr__call__Usz!KeypointMatchingPipeline.__call__cKsdSr!rr;rrrr<Xsc sH|durtdt|}tj|fd|i|}t|dkrD|dS|S)a Find matches between keypoints in two images. Args: inputs (`str`, `list[str]`, `PIL.Image` or `list[PIL.Image]`): The pipeline handles three types of images: - A string containing a http link pointing to an image - A string containing a local path to an image - An image loaded in PIL directly The pipeline accepts either a single pair of images or a batch of image pairs, which must then be passed as a string. Images in a batch must all be in the same format: all as http links, all as local paths, or all as PIL images. threshold (`float`, *optional*, defaults to 0.0): The threshold to use for keypoint matching. Keypoints matched with a lower matching score will be filtered out. A value of 0 means that all matched keypoints will be returned. kwargs: `timeout (`float`, *optional*, defaults to None)` The maximum time in seconds to wait for fetching images from the web. If None, no timeout is set and the call may block forever. Return: Union[list[Match], list[list[Match]]]: A list of matches or a list if a single image pair is provided, or of lists of matches if a batch of image pairs is provided. Each match is a dictionary containing the following keys: - **keypoint_image_0** (`Keypoint`): The keypoint in the first image (x, y coordinates). - **keypoint_image_1** (`Keypoint`): The keypoint in the second image (x, y coordinates). - **score** (`float`): The matching score between the two keypoints. NzFCannot call the keypoint-matching pipeline without an inputs argument!r7r r)r)r+r.r<r')r1r:r7r3Zformatted_inputsoutputsr4rrr<[s' csJfdd|D}|j||jd}||j}dd|D}||d}|S)Ncsg|]}t|dqS)r6rr"r>rr r&z7KeypointMatchingPipeline.preprocess..)rZreturn_tensorscSsg|] }|jqSr)sizer"rrrr?r&) model_inputs target_sizes)image_processorr0toZ torch_dtype)r1rr6rArBpreprocess_outputsrr>r preprocesss   z#KeypointMatchingPipeline.preprocesscCs,|d}|jfi|}||dgd}|S)NrArB) model_outputsrB)model)r1rErArGforward_outputsrrr_forwardsz!KeypointMatchingPipeline._forward)rc Cs|d}|d}|jj|||d}|d}g}t|d|d|dD]Z\}}} t|d|dd }t|d|dd }|t||| d qFt|d d d d}|S)NrGrB)rBr7rZ keypoints0Z keypoints1Zmatching_scoresr rrcSs|dS)Nrr)rrrrr&z6KeypointMatchingPipeline.postprocess..T)keyreverse)rCZpost_process_keypoint_matchingzipritemappendrsorted) r1rIr7rGrBZpostprocess_outputsZ pair_resultZkp_0Zkp_1rrrr postprocesss"z$KeypointMatchingPipeline.postprocess)NN)r9)r9)r9)N)r9)__name__ __module__ __qualname____doc__Z_load_processorZ_load_image_processorZ_load_feature_extractorZ_load_tokenizerr/r8rrfloatrlistrr<rrFrJrR __classcell__rrr4rr,<s*  $/ r,N)typingrrrrZtyping_extensionsrrZ image_utilsr utilsr r baser ZPILrrrr__annotations__rWrrr+r,rrrrs