.hXdZddlmZddlZddlZddlZddlmZddlm Z ddl Z ddl Z ddl Z ddlmZmZddlmZddlmZdd lmZdd lmZmZmZmZmZmZmZdd lm Z m!Z!dd l"m#Z#dd l$m%Z%m&Z&m'Z'dZ(GddZ)y)ar Run prediction on images, videos, directories, globs, YouTube, webcam, streams, etc. Usage - sources: $ yolo mode=predict model=yolo11n.pt source=0 # webcam img.jpg # image vid.mp4 # video screen # screenshot path/ # directory list.txt # list of images list.streams # list of streams 'path/*.jpg' # glob 'https://youtu.be/LNwODJXcvt4' # YouTube 'rtsp://example.com/media.mp4' # RTSP, RTMP, HTTP, TCP stream Usage - formats: $ yolo mode=predict model=yolo11n.pt # PyTorch yolo11n.torchscript # TorchScript yolo11n.onnx # ONNX Runtime or OpenCV DNN with dnn=True yolo11n_openvino_model # OpenVINO yolo11n.engine # TensorRT yolo11n.mlpackage # CoreML (macOS-only) yolo11n_saved_model # TensorFlow SavedModel yolo11n.pb # TensorFlow GraphDef yolo11n.tflite # TensorFlow Lite yolo11n_edgetpu.tflite # TensorFlow Edge TPU yolo11n_paddle_model # PaddlePaddle yolo11n.mnn # MNN yolo11n_ncnn_model # NCNN yolo11n_imx_model # Sony IMX yolo11n_rknn_model # Rockchip RKNN ) annotationsN)Path)Any)get_cfg get_save_dir)load_inference_source) LetterBox) AutoBackend) DEFAULT_CFGLOGGERMACOSWINDOWS callbackscolorstrops) check_imgsz check_imshow)increment_path)attempt_compile select_devicesmart_inference_modea inference results will accumulate in RAM unless `stream=True` is passed, causing potential out-of-memory errors for large sources or long-running streams and videos. See https://docs.ultralytics.com/modes/predict/ for help. Example: results = model(source=..., stream=True) # generator of Results objects for r in results: boxes = r.boxes # Boxes object for bbox outputs masks = r.masks # Masks object for segment masks outputs probs = r.probs # Class probabilities for classification outputs ceZdZdZeddf ddZddZddZddZdZ dddZ dd Z d Z e dd Zddd Zdd ZdddZdddZd dZd!dZy)" BasePredictora  A base class for creating predictors. This class provides the foundation for prediction functionality, handling model setup, inference, and result processing across various input sources. Attributes: args (SimpleNamespace): Configuration for the predictor. save_dir (Path): Directory to save results. done_warmup (bool): Whether the predictor has finished setup. model (torch.nn.Module): Model used for prediction. data (dict): Data configuration. device (torch.device): Device used for prediction. dataset (Dataset): Dataset used for prediction. vid_writer (dict[str, cv2.VideoWriter]): Dictionary of {save_path: video_writer} for saving video output. plotted_img (np.ndarray): Last plotted image. source_type (SimpleNamespace): Type of input source. seen (int): Number of images processed. windows (list[str]): List of window names for visualization. batch (tuple): Current batch data. results (list[Any]): Current batch results. transforms (callable): Image transforms for classification. callbacks (dict[str, list[callable]]): Callback functions for different events. txt_path (Path): Path to save text results. _lock (threading.Lock): Lock for thread-safe inference. Methods: preprocess: Prepare input image before inference. inference: Run inference on a given image. postprocess: Process raw predictions into structured results. predict_cli: Run prediction for command line interface. setup_source: Set up input source and inference mode. stream_inference: Stream inference on input source. setup_model: Initialize and configure the model. write_results: Write inference results to files. save_predicted_images: Save prediction visualizations. show: Display results in a window. run_callbacks: Execute registered callbacks for an event. add_callback: Register a new callback function. Nct|||_t|j|_|jjd|j_d|_|jj rtd|j_d|_|jj|_ d|_ d|_ d|_ i|_ d|_d|_d|_g|_d|_d|_d|_|xst+j,|_d|_t1j2|_t+j6|y)a* Initialize the BasePredictor class. Args: cfg (str | dict): Path to a configuration file or a configuration dictionary. overrides (dict, optional): Configuration overrides. _callbacks (dict, optional): Dictionary of callback functions. Ng?FT)warnr)rargsrsave_dirconf done_warmupshowrmodeldataimgszdevicedataset vid_writer plotted_img source_typeseenwindowsbatchresults transformsrget_default_callbackstxt_path threadingLock_lockadd_integration_callbacks)selfcfg overrides _callbackss Z/var/www/html/ai-service/venv/lib/python3.12/site-packages/ultralytics/engine/predictor.py__init__zBasePredictor.__init__osC+ $TYY/ 99>> !!DIIN  99>>)t4DIIN IINN        #Hy'F'F'H ^^% ++D1ct|tj }|r{tj|j |}|j ddk(r |ddddf}|jd}tj|}tj|}|j|j}|jjr|jn|j}|r|dz}|S)a Prepare input image before inference. Args: im (torch.Tensor | list[np.ndarray]): Images of shape (N, 3, H, W) for tensor, [(H, W, 3) x N] for list. Returns: (torch.Tensor): Preprocessed image tensor of shape (N, 3, H, W). .N)rr=) isinstancetorchTensornpstack pre_transformshape transposeascontiguousarray from_numpytor$r!fp16halffloat)r4im not_tensors r8 preprocesszBasePredictor.preprocesss$B 55 $,,R01Bxx|q TrT ]l+B%%b)B!!"%B UU4;; **//RWWYrxxz  #IB r:c\|jjrS|jjs=t |j t |jddjz dnd}|j|g||jj||jjd|S)zGRun inference on a given image using the specified model and arguments.rT)mkdirF)augment visualizeembed) rrUr(tensorrrrr+stemr!rTrV)r4rOrkwargsrUs r8 inferencezBasePredictor.inferencesyy""D,<,<,C,C 4==4 1 a0@+A+F+FFd S  tzz"ufjudii&7&79TXT]T]TcTcuntuur:ct|Dchc]}|jc}dk(}t|j|xr`|jj xrH|j jxs0t|j ddxr|j j |j j}|Dcgc] }|| c}Scc}wcc}w)z Pre-transform input image before inference. Args: im (list[np.ndarray]): List of images with shape [(H, W, 3) x N]. Returns: (list[np.ndarray]): List of transformed images. r>dynamicF)autostride)image) lenrGr r#rrectr!ptgetattrimxr^)r4rOx same_shapes letterboxs r8rFzBasePredictor.pre_transformsB/q177/0A5  JJb b`74::y%#H#_QUQ[Q[Q_Q_M_::$$  -//q "//00s C 9Cc|S)z6Post-process predictions for an image and return them.)r4predsimg orig_imgss r8 postprocesszBasePredictor.postprocesss r:c||_|r|j||g|i|St|j||g|i|S)a Perform inference on an image or stream. Args: source (str | Path | list[str] | list[Path] | list[np.ndarray] | np.ndarray | torch.Tensor, optional): Source for inference. model (str | Path | torch.nn.Module, optional): Model for inference. stream (bool): Whether to stream the inference results. If True, returns a generator. *args (Any): Additional arguments for the inference method. **kwargs (Any): Additional keyword arguments for the inference method. Returns: (list[ultralytics.engine.results.Results] | generator): Results objects or generator of Results objects. )streamstream_inferencelist)r4sourcer!rorrYs r8__call__zBasePredictor.__call__sR (4((HHH H---feMdMfMN Nr:c6|j||}|D]}y)aD Method used for Command Line Interface (CLI) prediction. This function is designed to run predictions using the CLI. It sets up the source and model, then processes the inputs in a streaming manner. This method ensures that no outputs accumulate in memory by consuming the generator without storing results. Args: source (str | Path | list[str] | list[Path] | list[np.ndarray] | np.ndarray | torch.Tensor, optional): Source for inference. model (str | Path | torch.nn.Module, optional): Model for inference. Note: Do not modify this function or remove the generator. The generator ensures that no outputs are accumulated in memory, which is critical for preventing memory issues during long-running predictions. N)rp)r4rrr!gen_s r8 predict_clizBasePredictor.predict_clis("##FE2 A  r:c t|jj|jjd|_t ||jj |jj|jjt|jdd|_ |jj|_ |jjxsS|jjxs;t|jdkDxs!tt|jddg}|r*d d l}t|d d st#j$t&i|_y ) z Set up source and inference mode. Args: source (str | Path | list[str] | list[Path] | list[np.ndarray] | np.ndarray | torch.Tensor): Source for inference. r?)r^min_dimchr=)rrr+ vid_stridebufferchannelsi video_flagFrNroT)rrr#r!r^rr+r{ stream_bufferrcr%r(ro screenshotr`any torchvisionr warningSTREAM_WARNINGr&)r4rr long_sequencers r8 setup_sourcezBasePredictor.setup_sources!9J9JTUV ,))//yy++99**TZZq1    <<33    # # A** A4<< 4' A74<<w?@   440~.r:c /r Kjjrtjdjsj |j 5j||njjjjsjjrBjjrjdz n jjddjsjjjjsjj rdnj"j$jj&gj(d_ dgdc___t1j2j4 t1j2j4 t1j2j4 f}j7d j"D]Q_j7d j.\}}}|d5j9|} ddd|d5j: g|i|} jj<r1t?| t@jBr| gn| Ed{ ddd ddd|d 5jE  |_#dddj7d tI|} tK| D]} xj*dz c_|djLdz| z |djLdz| z |d jLdz| z djF| _'jjsCjjs-jjsjjPs|| xxjS| tU||  |z cc< jjr$tjdjY|j7djFEd{TdddjZj]D]-} t?| t^j`s| jc/jjPrt_jdjjrj*r~tgfdD}tjdtijj.j*tkjddg jld d|zjjs,jjsjjnrtItqjjsd}jjrd|dd|dkDzdjdz nd}tjdtudj|j7dy#1swYxYw7#1swYxYw#1swYxYw#tV$rY8wxYw7D#1swYAxYww)a= Stream real-time inference on camera feed and save results to file. Args: source (str | Path | list[str] | list[Path] | list[np.ndarray] | np.ndarray | torch.Tensor, optional): Source for inference. model (str | Path | torch.nn.Module, optional): Model for inference. *args (Any): Additional arguments for the inference method. **kwargs (Any): Additional keyword arguments for the inference method. Yields: (ultralytics.engine.results.Results): Results objects. NlabelsTparentsexist_okr>)r#r)r$on_predict_starton_predict_batch_startr?on_predict_postprocess_end@@)rQrZrm on_predict_batch_endc3VK|] }|jjz dz"yw)rN)tr)).0rer4s r8 z1BasePredictor.stream_inference..zs"?accDIIo+?s&)zRSpeed: %.1fms preprocess, %.1fms inference, %.1fms postprocess per image at shape rzr=z labels/*.txtz labelsz saved to zResults saved to boldon_predict_end);rverboser infor! setup_modelr2rrrsavesave_txtrrSrwarmuprbtritonr%bsrzr#r)r*r+rProfiler$ run_callbacksrQrZrVrArBrCrmr,r`rangedtspeedr write_resultsr StopIterationjoinr&valuescv2 VideoWriterreleasedestroyAllWindowstupleminrcrG save_croprqglobr)r4rrr!rrY profilerspathsim0srrOrjnivrnls` r8rpzBasePredictor.stream_inferences^ 99   KKOzz   U # ZZ> (   (:f @P@P Qyy~~!3!3-1YY-?-?)T]]YYbfquYv## !! $ 1B1B1 Y]YcYcYfYftimisist"$( 23R /DIt|TZ 4;;/ 4;;/ 4;;/I   1 2"ll( ( ""#;)B+4Q (B'') A!S__-   99>>  ! ! # 99  ?Y??A KKd 3WTZZq5QaTVT\T\]^]_T`abdfgh  99>>TYY//4993F3FT$--,,^<=>BW[W`W`WiWi"RDsb1f~.j9Q8RSoqA KK+HVT]],K+LQCP Q +,q//Y!!EE %(}> (> (sAZ7G-Z*Y, Z*$AY<3Y9 4Y<9 Z* Z*Z )$Z*C Z-ZAZ*#Z'$Z*+?Z7+GZ7,Y6 1Z*9Y<<Z Z* Z Z* Z$Z*#Z$$Z**Z4/Z7c t|xs|jjt|jj||jj |jj |jjd||_|jj|_|jj|j_t|jdr|j(j@r4|jA|jdz |jj|j(j,r|j-tC||j(j*r)|jE|j|jFz ||S)aq Write inference results to a file or directory. Args: i (int): Index of the current image in the batch. p (Path): Path to the current image. im (torch.Tensor): Preprocessed image tensor. s (list[str]): List of result strings. Returns: (str): String with result information. rr=Nz: z frame (\d+)/r>rr_rvz {:g}x{:g} r?rZz.1fms) line_widthboxesrrim_gpuz.txt) save_confcrops)r file_name)$r`rGr(rofrom_imgrWr%countresearchintrrXrr/formatr,__str__rrrrr plotr show_boxes show_conf show_labels retina_masksr'rrrstrsave_predicted_imagesname) r4rprOrstringframematchresults r8rzBasePredictor.write_resultss^ rxx=A DB    " "d&6&6&?&?4CSCSCZCZ 2h FLL&&EIIoqt4E%*CaME 0AFFDLLDUDUY`D`bhijoipfq4rs %,%%rxx|44a--//1V^^%&v||K'@&ERHH 99>>TYY^^%{{99//ii**YY((yy,,#yy55t2a5 + D  99   OOt}}oT2dii>Q>QO R 99     dmmg&=I[I[  \ 99>> IIc!f  99>>  & &t}}qvv'=u E r:c|j}|jjdvrt|jjdk(r|jjnd}|j|j dz }||j vr|jjrt|jddtrdn trdnd \}}tjtt|j!|tj"|||j$d |j$d f |j |<|j |j'||jjr*tj(|d |j d|d|yytj(t|j!d|y)z Save video predictions as mp4 or images as jpg at specified path. Args: save_path (Path): Path to save the results. frame (int): Frame number for video mode. >videoror_framesTr)z.mp4avc1).aviWMV2)rMJPGr>r)filenamefourccfps frameSize/rvz.jpgN)r'r%rrrrXr&r save_framesrrSr rrrr with_suffixVideoWriter_fourccrGwriteimwrite)r4 save_pathrrOr frames_pathsuffixrs r8rz#BasePredictor.save_predicted_imagessn   <<   3 3&*ll&7&77&B$,,""C--Y^^,rr_i,r@qN)r'platformsystemr*appendr namedWindow WINDOW_NORMALWINDOW_KEEPRATIO resizeWindowrGimshowwaitKeyr%rordr)r4rrOs r8r zBasePredictor.shows    ??  'AT\\,A LL   " OOAs0033G3GG H   Q RXXa[ 9 1b ;;dll//7:s BT ISQTX U  Vr:cV|jj|gD] }|| y)z2Run all registered callbacks for a specific event.N)rget)r4eventcallbacks r8rzBasePredictor.run_callbackss)**5"5 H TN r:c@|j|j|y)z-Add a callback function for a specific event.N)rr)r4rfuncs r8 add_callbackzBasePredictor.add_callbacks u$$T*r:)r6zdict[str, Any] | Noner7z dict[str, list[callable]] | None)rOztorch.Tensor | list[np.ndarray]return torch.Tensor)rOr)rOlist[np.ndarray]rr)NNF)robool)NN)T)rr ) rrrrrOrrz list[str]rr)r)rrrr)r)rr)rr)rrrcallable)__name__ __module__ __qualname____doc__r r9rQrZrFrmrsrwrrrprrrr rrrir:r8rrEs'V +/7; '2)'25 '2R2v0(O**<h-h-T]21f @D   +r:r)*r __future__rrrr0pathlibrtypingrrnumpyrDrBultralytics.cfgrrultralytics.datarultralytics.data.augmentr ultralytics.nn.autobackendr ultralytics.utilsr r r rrrrultralytics.utils.checksrrultralytics.utils.filesrultralytics.utils.torch_utilsrrrrrrir:r8rs\B#   12.2[[[>2^^ @+@+r: