SK-AM62A-LP: Query on Recognized class.

Hi Qutaiba,

Qutaiba Saleh said:

classification you can insert your code at this line: https://github.com/TexasInstruments/edgeai-gst-apps/blob/main/apps_python/post_process.py#L111 or the method called there. 

I tried to modify this line. As an initial step before adding the logic needed, added a sample string.

sample = "Hello"
img = self.overlay_topN_classnames(img, sample)
#added a string to sample variable and an integer to test 

But it doesn't work for me. I tried it in my custom model and its config.yaml.
Found that variable class_name is associated with it, changed and reflected in display. Below is the code snippet from post_process.py

for idx in topN_classes:
            idx = idx + self.model.label_offset
            if idx in self.model.dataset_info:
                class_name = self.model.dataset_info[idx].name
                if not class_name:
                    class_name = "UNDEFINED"
                if self.model.dataset_info[idx].supercategory:
                    class_name = (
                        self.model.dataset_info[idx].supercategory + "/" + class_name
                    )
            else:
                class_name = "UNDEFINED"

            text_size, _ = cv2.getTextSize(class_name, font, font_size, 2)

Best Regards,
Sajan

Hi Sajan,

Sajan Saji said:

I tried to modify this line. As an initial step before adding the logic needed, added a sample string.

The method overlay_topN_classnames expects an image and results array coming out of a classification model. It does not accept a text and overlay it on the image. 

I would like to make sure that your custom model works on the edgeai-gst-apps before doing any modification. After that, we can modify the code. As you indicated the variable calss_name can be used to track the class identified in the current frame. 

You can insert some logic here: https://github.com/TexasInstruments/edgeai-gst-apps/blob/main/apps_python/post_process.py#L168 to increase the counter in the dictionary you suggested to use earlier in your query. After that you can insert the logic to decide whether enough number of reference to a certain class happened. Of course, as you already know, that dictionary has be defined out of the function in the class level. 

Please, let me know if this is helpful.

Best regards,

Qutaiba