a ¾ ÀhÑã@s ddlmZdd„Zdd„ZdS)é)ÚceilcsÎttd|ƒƒ‰dd„t| ¡ƒDƒ‰g}ˆD]$}ˆ |¡dkr,||vr,| |¡q,‡fdd„ˆDƒ}‡fdd„ˆDƒ}t|ƒdkr’tdt|ƒƒ‚t|ƒdkr®tdt|ƒƒ‚t|ƒdkrÊtd t|ƒƒ‚dS) NrcSsg|]}|D]}|‘q qS©r)Ú.0ZsublistÚitemrrúc/var/www/html/assistant/venv/lib/python3.9/site-packages/transformers/utils/model_parallel_utils.pyÚ óz%assert_device_map..écsg|]}|ˆvr|‘qSrr©rÚi)Údevice_map_blocksrrrrcsg|]}|ˆvr|‘qSrrr )ÚblocksrrrrzœDuplicate attention blocks specified in device_map. Attention blocks must be specified to one device. These attention blocks were specified more than once: zŽThere are attention blocks for this model that are not specified in the device_map. Add these attention blocks to a device on the device_map: zdThe device_map contains more attention blocks than this model has. Remove these from the device_map:)ÚlistÚrangeÚvaluesÚcountÚappendÚlenÚ ValueErrorÚstr)Z device_mapZ num_blocksZduplicate_blocksr Zmissing_blocksZ extra_blocksr)r r rÚassert_device_maps4  ÿÿ ÿÿ ÿÿrcsJtt|ƒƒ‰tt|t|ƒƒƒ‰‡‡fdd„td|ˆƒDƒ}tt||ƒƒS)zEReturns a dictionary of layers distributed evenly across all devices.csg|]}ˆ||ˆ…‘qSrrr ©ZlayersZn_blocksrrr5rz"get_device_map..r)rrÚintrrÚdictÚzip)Zn_layersZdevicesZ layers_listrrrÚget_device_map1s rN)ÚmathrrrrrrrÚs