• State Resolved
  • Locked Locked
  • Replies 8 replies
  • Answers 2 answers
  • Subscribers 30 subscribers
  • Views 583 views
  • Users 0 members are here
Support feedback
Options
Options
Similar topics

This thread has been locked.

If you have a related question, please click the "Ask a related question" button in the top right corner. The newly created question will be automatically linked to this question.

TIDEP-01013: What are the recognized gestures ?

Ali Mouizina
Prodigy 50 points
Part Number: TIDEP-01013
Other Parts Discussed in Thread: AWR1642BOOST-ODS

Hello, 

I would like to know what are the gesture which are recognized in the software you provide ? I see in the documentation left/right/up/down swipe gestures are recognized. Are there others ? 

Thanks

  • 0
    TI__Mastermind 30405 points

    Hi Ali,

    This design demonstrates Swipe Left and Swipe Down gestures and is maintained as part of the TI Processor-SDK Linux and all the files come included in Processor-SDK Linux. 

    If you want to run this demo just using the mmWave Sensor EVM, without Beaglebone and the Linux based GUI, please refer to the following link. This will show the presence and gesture indication using character output on Tera Term as described in the user guide on this page.

    68xx AoP_ODS - Multiple Gesture and Motion Detection

    Please note that the Gesture demo is provided as-is to demonstrate proof of concept. We do provide support for custom modifications including addition of new gestures and/or modification of existing ones at this time.

    Refer to the following thread for more details: https://e2e.ti.com/support/sensors/f/1023/t/820557

    Regards

    -Nitin 

  • 0 in reply to Nitin Sakhuja
    Prodigy 50 points

    Nitin,

    Thanks for your answer. I was not aware of the software you mentionned. 

    I was more referring to the SW you show in this documentation (section 3.2.2). Could you confirm that on the latter, only two gestures are implemented ? 

    ----------------------------------------------------------------------------------------------------------------------------------------------------

    Also you said: We do provide support for custom modifications including addition of new gestures and/or modification of existing ones at this time. 

    ==> What kind of support do you provide for companies which would like to integrate your products with added gestures ? Beside the support related to gesture, there will be questions about mechnical, electronic integration etc. 

    Finally, in another thread you mentionned this article. Is it applicable also to 60-64 GHz radar ? 

    Thanks again for your support

  • 0 in reply to Ali Mouizina
    TI__Mastermind 30405 points

    Hi Ali,

    Please find my responses inline:

    I was more referring to the SW you show in this documentation (section 3.2.2). Could you confirm that on the latter, only two gestures are implemented ? 

    [NS]: The above link does not resolve to a valid page. But the xWR68xx Presence and Gesture detection demo implements the above mentioned two gestures only as it uses the same firmware binary (for the xWR68xx ODS / AOP EVM) that I pointed to in my earlier response i.e.

    68xx AoP_ODS - Multiple Gesture and Motion Detection

    There is also another multi-gesture demo available in our Automotive Toolbox which demonstrates 6 gestures, but it is implemented on the AWR1642BOOST-ODS EVM which works in the 77GHz frequency range. Again, this is also provided as an as-is software for demonstration purpose.

    AWR16xx Multi Gesture Demo

    ----------------------------------------------------------------------------------------------------------------------------------------------------

    Also you said: We do not provide support for custom modifications including addition of new gestures and/or modification of existing ones at this time. 

    ==> What kind of support do you provide for companies which would like to integrate your products with added gestures ? Beside the support related to gesture, there will be questions about mechnical, electronic integration etc. 

    [NS]: This particular demo is meant as a proof of concept of gesture recognition capability using ANN running on the device. But we do not have more documentation and/or collateral to retrain the ANN for adding more gestures. Customers are expected to use this software as a proof of concept and develop their own training software and add new gestures if they wish to.

    All demo software in the Industrial and Automotive Toolboxes is provided free of cost as reference for evaluation purposes. Users of these demos are required to do their own evaluation and development. You can also refer to the Third Party Network Search Tool given below and engage with the vendors directly:

    https://www.ti.com/sensors/mmwave-radar/industrial/design-development.html#third-party-network

    Finally, in another thread you mentionned this article. Is it applicable also to 60-64 GHz radar ? 

    [NS]: Yes, the same principles apply to 60-64GHz radar as well.

    Thanks

    -Nitin

  • 0 in reply to Nitin Sakhuja
    Prodigy 50 points

    Nitin, 

    The information you are giving are very valuable thanks. After checking your links I have a few more questions:

    • What are the criteria to consider when choosing between a 60-64 Ghz & 77 Ghz radar ? 
    • In the documentation of the gesture control for both solutions you mentionned before, the range of gesture detection is about 1 feet (30 cm), is it a limitation related to the hardware itself ? Or can we train a new model to detect gesture further ? at 50 cm for example ? 
    • Can we translate the code from the one available for  AWR1642BOOST-ODS EVM to 68xx AoP_ODS to be able to detect 6 gestures ? 

    BR

  • 0 in reply to Ali Mouizina
    TI__Mastermind 30405 points

    Hi Ali,

    1. Please refer to the following thread for a similar discussion. There are several similar threads which you can search on this topic.

    IWR6843: Choosing from multiple mmwave chipsets - IWR68XX, IWR16XX, IWR18XX

    2. This is not a hardware limitation but how we trained the ANN and do the software processing. The sensor itself can be used up to a much longer range and while we demonstrate other applications such as people counting (up to 10m), long range people detection (up to 100m), etc at much larger distances, we have not evaluated gesture recognition beyond 0.4m range. But this should be doable with appropriately designed software.

    3. Yes, this can be done. But you will need to re-train the ANN because of the difference in antenna pattern between the two EVMs.

    Regards

    -Nitin

  • 0 in reply to Nitin Sakhuja
    Prodigy 50 points

    Nitin,

    I didn't ask before but are the source codes provided  for all the applications available in the Out of the box lab for Industrial&Automotive toolbox ? (gesture, people counting, vital signs etc). 

    Are there some parts of the application that are provided only as binary or precompiled parts ? 

    Thanks

  • 0 in reply to Ali Mouizina
    TI__Mastermind 30405 points

    Ali,

    The source code for all labs (e.g. people counting, vital signs, long range people detection etc), except OOB demo labs, is included in the toolbox directories. The OOB demo labs in toolbox refer to the OOB demo source files directly from the SDK. These labs and are meant only to provide CCS projects and detailed instructions for these demos (since SDK includes only makefiles).

    Hope that clarifies.

    Thanks

    -Nitin

  • 0 in reply to Nitin Sakhuja
    Prodigy 50 points

    Yes it does thanks