This thread has been locked.

If you have a related question, please click the "Ask a related question" button in the top right corner. The newly created question will be automatically linked to this question.

CC2642R: Power Saving with enabled Standby Policy: After 1 minute working we observe stopped data collection form the Sensor Controller and stopped timer(clock) - related activities

Part Number: CC2642R
Other Parts Discussed in Thread: SYSBIOS, CC2640, , ENERGYTRACE, CC2640R2F, SYSCONFIG

Tool/software:

We use SimpleLink SDK CC13xx CC26xx version 6.10.0.29, and the TI tool CCS12:

We use POWER_SAVING in the Compiler predefined symbols, and we enabled Standby policy in the same way as it is enabled in the TI FW app simple_peripheral in the same SDK 6.10.0.29: parameter comparison attached in a screenshot:

When we start our Firmware in this Power saving mode, it works well for approx. 1 minute, after that the data collection from sensor controller stops, and some timer(clock) related activities stop working as well.

Details:

1) We use Sensor Controller RTC-driven Alert interrupts to the main processor in the MCU. These interrupts/events invoke ADC read operations.

2) For LED on/off scheduling we are using timer (clock) APIs from file utils.c.

Util_constructClock: it calls ti_sysbios_knl_Clock_construct

Util_startClock: it calls Clock_start(handle) that calls ti_sysbios_knl_Clock_start

Question 1 for TI: Is it possible that the failures in these 2 above areas 1) and 2) are caused by a problem in the communication between drivers and the Power manager?

According to: SimpleLink SDK Power Management: MSP432, MSP432E4, CC13xx/CC26xx, and CC32xx    User’s Guide (2019)

“1.3 Power Manager API

Driver development: A device driver communicates with the Power Manager to enable/disable access to its peripherals. “

The above spec is a bit old, Question 2 for TI: What is the best Power management TI spec to follow for our SDK CC13xx CC26xx version 6.10.0.29? We also used a TI spec (link below), but it is for a higher SDK version 6.40:

software-dl.ti.com/.../power.html

According to our battery usage measurements: our previous TI MCU CC2640 saved battery 2 times better compared to our new current prototype using 6.10.0.29: We also had POWER_SAVING there as a predefined symbol. We did not have .syscfg file with power policy options. We had the standby policy defined in a .cfg file, no longer used in the new SDK.

  • For our new MCU cc2642 I found a good sources of info:
    file:///C:/ti/simplelink_cc13xx_cc26xx_sdk_6_10_00_29/docs/drivers/doxygen/html/_power_8h.html#ti_drivers_Power_Examples_enable
    and file PowerCC26X2.h: they show several settings and the following steps to enable Power Policy:

    // Import Power Driver definitions
    // One-time initialization of Power manager
    // Enable power policy

    We have in our code the first two: #include for the drivers above, and the Power_init(). Looking at our FW app .cfg file: when I select the box: "Enable Policy", Power_enablePolicy() will be called, correct? I could not find other setup suggested in the TI docs.

    I tested and measured the initial period when all works OK on our device in Power saving mode: This period is: the first 3 min 35 secs during an established Bluetooth 5 connection. After this period the connection works OK for at least 1 hour and longer, and our I2C bus chip in the device works OK communicating with a mobile app, but our device RGB LED and events from the sensor controller get lost, i.e stop working at the end of this period.

    The CC2642R datasheet says:
    "SCLK_MF is an internal 2 MHz clock that is used by the Sensor Controller in low-power mode and also for internal power management circuitry. The SCLK_MF clock is always driven by the internal 2 MHz RC Oscillator (RCOSC_MF)."

    Will it help if I enable this symbol: USE_RCOSC  ? We inherited this code from TI examples:
    #ifdef USE_RCOSC
    // Set device's Sleep Clock Accuracy
    #if ( HOST_CONFIG & ( CENTRAL_CFG | PERIPHERAL_CFG ) )
    HCI_EXT_SetSCACmd(500);
    #endif // (CENTRAL_CFG | PERIPHERAL_CFG)
    RCOSC_enableCalibration();
    #endif // USE_RCOSC

    I tried but had RCOSC_enableCalibration rejected as unresolved symbol. It does not exist in the TI src code as part of the 6.10 SDK, that we are using.
    I should probably use the TI doc on link:
    Measuring CC13xx and CC26xx current consumption (Rev. D)
  • Hello Ludmil,

    Thanks for reaching out. Please help me with the following questions to assist you further:

    1. From what I understand, you have been using the CC2640 device and now migrating your code to CC2642 correct? or is this a new SW development for CC2642 based on an out of the box example? Have you checked this migration guide: https://software-dl.ti.com/simplelink/esd/simplelink_cc13xx_cc26xx_sdk/7.40.00.77/exports/docs/ble5stack/ble_user_guide/html/ble-stack-5.x-guide/porting-guides/cc2640r2_to_cc26x2.html
    2. Could you confirm if the entire sensor controller functionality also stops working after > 1 hour or the LEDs are the only ones failing here (previously I understood the ADC and comms (?) were also not working correctly)?
    3. If the standby policy is not enabled, will the issue reproduce?
    4. Regarding the RCOSC: The RCOSC build configuration no longer exists. To use RCOSC, add the following define in the project predefined symbols: USE_RCOSC.
    5. Do you know where is the extra power consumption (x2 more than 2640) coming from? Measuring CC13xx and CC26xx current consumption (Rev. D) can me help for for this. You can also leverage Energy Trace, especially EnergyTrace++ Instructions.

    BR,

    David

  • Hi David, Thanks very much for your reply.
    RE 1: Yes: we have an old CC2640 device, and we migrated most of our code to CC2642R. We used the TI migration guide and re-used bits from Simple Peripheral TI app.

    RE 2: 
    The cc2642R datasheet says on p49: "In Standby mode, only the always-on (AON) domain is active. An external wake-up event, RTC event, or Sensor Controller event is required to bring the device back to active mode. …. All GPIOs are latched in standby mode."

    When the periodic RTC event comes, our SC code task runs and enables power to a voltage sensor and all LEDs by driving a digital output:

    gpioClearOutput(AUXIO_O_SG_POWER);

    After this our SC code reads the ADC to provide voltage sensor data to the MCU, and schedules its own execution:
    // Schedule the next execution <in ticks>  (1 sample period on the SC: default 100 ms)

    fwScheduleTask(1);

    All this works well in the following modes:
    - Standard “No Power policy enabled” mode,
    - In WFI Power Management mode,
    - In the first 1 to 3 mins in standby mode.

    After this variable period 1 to 3 mins in Power standby policy mode, we observe the following:
    1) My debug shows all LEDs turned off (red, blue, green), so the above SC gpio call has not been made by our SC code, or it has not enabled the power for the LEDs.
    2) No voltage sensor values are reported by the MCU over Bluetooth. I added debug code to the alert callback function: scTaskAlertCallback() to confirm that the alert interrupts from the SC to our MCU Firmware app have stopped. Also: If interrupts were available, our MCU code would read and report some ADC values: random or 0, but we see last value frozen (no more values present) in the mobile app still connected OK to our device.
    3) The Bluetooth connection is still in place and a separate IMU chip on our PCBA controlled only by the MCU (not the SC), is sending correct data to our mobile app.
    As a next debugging step, I can modify our SC task to remove the suspected dig output operation: gpioClearOutput(AUXIO_O_SG_POWER);


    RE your 3: 
    If the standby policy is not enabled, will the issue reproduce?  Reply : No.

    RE your 4: Thanks for the info. As I indicated in my previous message: I tried the predefined this symbol: USE_RCOSC, but had RCOSC_enableCalibration rejected as unresolved symbol. It does not exist in the TI src code as part of the 6.10 SDK, that we are using:
    #ifdef USE_RCOSC
    // Set device's Sleep Clock Accuracy
    #if ( HOST_CONFIG & ( CENTRAL_CFG | PERIPHERAL_CFG ) )
    HCI_EXT_SetSCACmd(500);
    #endif // (CENTRAL_CFG | PERIPHERAL_CFG)
    RCOSC_enableCalibration();
    #endif // USE_RCOSC

    RE your 5: "Do you know where is the extra power consumption (x2 more than 2640) coming from? " Reply: No, not measured yet, we will try. I looked at the doc you mentioned. We do not have such Power measurement equipment. Will check if it is possible to hire.

  • Hi David, I ran another test on the Sensor Controller: No digital outputs driven by our SC code, no ADC read, empty SC task code apart from only periodic RTC events (alert interrupts) generated from SC to the main MCU FW application core + our FW rescheduling itself. This setup generated successfully periodic alert interrupts for over 1 hour in MCU standby mode. This shows that these events can survive the standby mode alone, but they probably get stopped when all our SC code runs, because of a crash or a deadlock related to gpio calls to power up or down sensors, or an ADC-related FW call. 

    Further debugging showed that the suspected Digital output operations:
    Enable then disable sensor power supply:
    gpioClearOutput(AUXIO_O_SG_POWER);
    gpioSetOutput(AUXIO_O_SG_POWER);

    stop the SC alert interrupts to the MCU, when added to the beginning of our empty (reduced) SC FW app that runs every sample period in Power standby mode (using external crystals, indicated via X in the .syscfg file).
    Our empty (reduced) FW app contains only: generate a periodic alert interrupt + reschedule our SC FW task by calling fwScheduleTask(1).


    I suspected a race condition between our gpio calls and the TI power manager operation: "enable digital io" during wakeup, so I added 2ms delay before our first dig out operation => the RTC alert interrupts were recovered and received by our MCU FW app.

    Next step: I kept this 2ms delay and restored all our FW code to run in Power policy mode => after 2 mins the alert interrupts disappeared similar to our first configuration in Standby mode.
    The .syscfg file setup used, is shown below:



    SC power setup shown below:

  • Hello Ludmil,

    Thanks for the extra information.

    Would it be possible to ask you to try to reproduce this issue using one of our out of the box examples considering the modifications you have done (utilizing drivers and sensor controller)? Also, are you using a custom board or an evaluation board from TI?

    BR,

    David.

  • Hi Dave, My experiments use configuration that is close to the standard TI environment:
    I use a custom board, but as I said in my first message: We use POWER_SAVING in the Compiler predefined symbols, and we enabled Standby policy in the same way as it is enabled in the TI FW app simple_peripheral in the same SDK 6.10.0.29: parameter comparison attached in a screenshot:

    During my experiments when the SC alert interrupts stop, I cannot reduce our SC FW app any further, I removed the main code. As I said above it only has:
    - 2x digio API calls
    - generate a periodic alert interrupt
    - reschedule our SC FW task by calling fwScheduleTask(1).

    Looking at the results, I think the issue is related to the 2x digio API calls in our SC code: they somehow cause the alert interrupt to stop in Standby mode.
    I may need to check the effect of the logic: We power up sensors and L
    EDs by setting the dig. output to 0: gpioClearOutput(AUXIO_O_SG_POWER);

    These APIs work reliably when Power Saving is not enabled, and when it is enabled in WFI mode. I will think again, but at present I cannot see how changing our main FW and custom board will resolve the problem. 

  • Hello Ludmil,

    I see, please allow me until tomorrow to go through these findings and be able to take a more detailed look at it while also requesting help from the team experts in sensor controller because it seems it will be difficult to reproduce the issue on our side at the moment.

    BR,

    David.

  • Hi David, thanks a lot. I checked the usage of XOSC boxes in the syscfg power settings in the simple peripheral example TI app and our FW app:
    The settings are the same: We use and tick the same XOSC LF and HF options/boxes: i.e. external crystal oscillators are used on our PCBA, and on the simple peripheral Hardware:



     

  • Hello Ludmil,

    Thanks. I have discuss this further with the team and it does not seem like a known issue. Please help me with the following:

    1. If you use the simple_peripheral out of the box example with the minimal SC functionalities and same power saving setups, does this issue reproduces in your board?
    2. Are you running this test in debug mode?
    3. Have you had your custom board review by TI?
    4. Can you dump register data after the devices crashes to analyze some of the flags by connecting to the target in debug mode?
      1. AON_RTC register (SEC / SUBSEC / CH2CMP) - Page 1385 of TRM. This is done with the objective of checking if the RTC has been modified (if CH2CMP value is more than SEC and SUBSEC then that will evidence this scenario that will potentially cause issues.
      2. AUX_SCE --> CTL Register to see if CLK_EN is enabled - Page 1811 of TRM.
      3. AUX_SCE --> FETCHSTAT - Page 1812 of TRM.
      4. AUX_SCE --> CPUSTAT  - Page 1813 of TRM.
    5. Could you please try setting Default Power Mode to "Low Power"?                                                 

    BR,

    David.

  • Hi David, thanks a lot for the advice. RE your 5. Could you please try setting Default Power Mode to "Low Power"?    I will try today. I wanted to do this, but noticed in the SC Power help table that Low-power mode is not available for ADC (screenshot below), is this correct? We use ADC enable and select API calls in our SC FW code.

    RE your 1. If you use the simple_peripheral out of the box example with the minimal SC functionalities:
    I wanted to do this but I only have a simple peripheral project file that has no SC files and does not use the sensor controller:
    simple_peripheral_CC26X2R1_LAUNCHXL_tirtos_ccs

    If you know a link for a simple peripheral variant using SC code and provides the SC project, it will be useful.
    I will have to search for such project to see the SC source code.

  • Hi Daved, RE your 5. Try Default power mode set to "Low Power" for SC: I tried 2 variants with "Low Power" for SC: With this config shown below, I cannot connect over Bluetooth to our mobile app, or rarely connect, but the LEDs and main voltage sensor are not working:

    With this second possible variant I cannot connect over Bluetooth:

    RE: Your questions:
    2. Are you running this test in debug mode? LK: I am running in Release mode. WFI Power mode runs OK in Release mode and saves 32% more power compared to Release mode with no Power policy.

    3. Have you had your custom board review by TI? LK: The updated board with CC2642R has not been reviewed by TI. I cannot say this now for the original board with cc2640: it was designed 8 years ago. 

  • Hi David, RE your 4.: dump register data:
    I found some TI code that reads these registers, so I think I can read them in our code after my detection of the missing alert interrupt from SC:

    // Read the current RTC value
    key = scifOsalEnterCriticalSection();
    sec = HWREG(AON_RTC_BASE + AON_RTC_O_SEC);
    subsec = HWREG(AON_RTC_BASE + AON_RTC_O_SUBSEC);

    ch2Cmp= HWREG(AON_RTC_BASE + AON_RTC_O_CH2CMP);

    RE your 2.: Are you running this test in debug mode?
    As I said I was running in Release mode, I switched to Debug mode now, I am trying to reproduce the issue and use the serial port to dump the RTC registers.

  • Hi David, please find attached an RTC log showing the loss of the SC alert interrupt event on the main MCU application code. The RTC registers are dumped every sample instant around the loss event, marked with "ERROR" in the log (sample period 100 ms). Time to the loss event is different on different runs: range 1-6 minutes, one run of 11 mins did not have the problem. 

    Our FW app runs in debug mode, I am using the serial port for the debug messages. The app is in standby Power management mode. SC is in active mode, 'cos the low power mode did not work.

    I did a quick sanity check and could not find an apparent issue in the AON, but a specialist is needed to check.
    In case RTC is OK, I think one scenario to explain the events, could be: RTC ticks are OK. Our SC task crashes probably on digio 0 output attempt (this stops voltage from SC and PCBA LEDs, we see and know the dependency). Our SC task cannot re-schedule itself on the next RTC interrupt, and never runs again, so it never generates again the SC Alert interrupt to the main core. Our main FW finds no Alert. This matches the attached log.

    AON_RTC_O_SEC log 4 ERROR.txt
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    44   335675392   2894531
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    44   765460480   2901084
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    44   1195507712   2907637
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    44   1625292800   2914190
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    44   2055340032   2920743
    
    voltage: 3587
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    44   2485125120   2927296
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    44   2915172352   2933849
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    44   3344957440   2940402
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    44   3775004672   2946955
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    44   4204789760   2953508
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    45   339476480   2960061
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    45   769523712   2966614
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    45   1199308800   2973167
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    45   1629224960   2979720
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    45   2059272192   2986273
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    45   2489188352   2992826
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    45   2919104512   2999379
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    45   3349020672   3005932
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    45   3778805760   3012485
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    45   4208852992   3019038
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    46   343670784   3025591
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    46   773586944   3032144
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    46   1203372032   3038697
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    46   1633288192   3045250
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    46   2063204352   3051803
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    46   2493120512   3058356
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    46   2923036672   3064909
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    46   3352952832   3071462
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    46   3782868992   3078015
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    46   4212785152   3084568
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    47   347734016   3091121
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    47   777650176   3097674
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    47   1207435264   3104227
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    47   1637351424   3110780
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    47   2067136512   3117333
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    47   2497052672   3123886
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    47   2926968832   3130439
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    47   3356884992   3136992
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    47   3786801152   3143545
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    47   4216717312   3150098
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    48   351666176   3156651
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    48   781582336   3163204
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    48   1211498496   3169757
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    48   1641414656   3176310
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    48   2071199744   3182863
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    48   2500984832   3189416
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    48   2930900992   3195969
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    48   3360817152   3202522
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    48   3790733312   3209075
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    48   4220649472   3215628
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    49   355598336   3222181
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    49   785514496   3228734
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    49   1215430656   3235287
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    49   1645346816   3241840
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    49   2075131904   3248393
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    49   2505179136   3254946
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    49   2934964224   3261499
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    49   3364618240   3268052
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    49   3794534400   3274605
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    49   4224450560   3281158
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    50   359530496   3287711
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    50   789446656   3294264
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    50   1219362816   3300817
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    50   1649278976   3307370
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    50   2079195136   3313923
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    50   2509111296   3320476
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    50   2938896384   3327029
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    50   3368812544   3333582
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    50   3798597632   3340135
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    50   4228513792   3346688
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    51   363462656   3353241
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    51   793378816   3359794
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    51   1223294976   3366347
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    51   1653211136   3372900
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    51   2083127296   3379453
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    51   2513043456   3386006
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    51   2942959616   3392559
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    51   3372875776   3399112
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    51   3802791936   3405665
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    51   4232577024   3412218
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    52   367263744   3418771
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    52   797179904   3425324
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    52   1227227136   3431877
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    52   1657012224   3438430
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    52   2087059456   3444983
    
    voltage: 3588
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    52   2516975616   3451536
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    52   2946891776   3458089
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    52   3376676864   3464642
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    52   3806593024   3471195
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    52   4236509184   3477748
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    53   371458048   3484301
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    53   801243136   3490854
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    53   1231159296   3497407
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    53   1661075456   3503960
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    53   2090991616   3510513
    
    voltage: 3588
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    53   2520907776   3517066
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    53   2950823936   3523619
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    53   3380740096   3530172
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    53   3810656256   3536725
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    53   4240572416   3543278
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    54   375521280   3549831
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    54   805437440   3556384
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    54   1235222528   3562937
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    54   1665007616   3569490
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    54   2094792704   3576043
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    54   2524708864   3582596
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    54   2954625024   3589149
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    54   3384672256   3595702
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    54   3814457344   3602255
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    54   4244504576   3608808
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    55   379322368   3615361
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    55   809369600   3621914
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    55   1239285760   3628467
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    55   1669070848   3635020
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    55   2098855936   3641573
    
    voltage: 3589
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    55   2528772096   3648126
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    55   2958688256   3654679
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    55   3388735488   3661232
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    55   3818651648   3667785
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    55   4248567808   3674338
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    56   383516672   3680891
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    56   813301760   3687444
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    56   1243348992   3693997
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    56   1673265152   3700550
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    56   2103181312   3707103
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    56   2533097472   3713656
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    56   2962751488   3720209
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    56   3392536576   3726762
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    56   3822583808   3733315
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    56   4252499968   3739868
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    57   387448832   3746421
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    57   817233920   3752974
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    57   1247150080   3759527
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    57   1677197312   3766080
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    57   2107113472   3772633
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    57   2537029632   3779186
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    57   2966814720   3785739
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    57   3396599808   3792292
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    57   3826515968   3798845
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    57   4256301056   3805398
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    58   391380992   3811951
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    58   821166080   3818504
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    58   1251213312   3825057
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    58   1681129472   3831610
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    58   2111045632   3838163
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    58   2540961792   3844716
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    58   2970746880   3851269
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    58   3400663040   3857822
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    58   3830579200   3864375
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    58   4260495360   3870928
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    59   395313152   3877481
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    59   825229312   3884034
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    59   1255145472   3890587
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    59   1685061632   3897140
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    59   2114977792   3903693
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    59   2544762880   3910246
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    59   2974810112   3916799
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    59   3404595200   3923352
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    59   3834511360   3929905
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    59   4264558592   3936458
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    60   399376384   3943011
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    60   829161472   3949564
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    60   1259077632   3956117
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    60   1688993792   3962670
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    60   2119041024   3969223
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    60   2548826112   3975776
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    60   2978873344   3982329
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    60   3408789504   3988882
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    60   3838705664   3995435
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    60   4268621824   4001988
    
    App Message received (BATTERY_MONITOR_EVENT)
    voltage: 3587
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    61   403570688   4008541
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    61   833486848   4015094
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    61   1263403008   4021647
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    61   1693057024   4028200
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    61   2122973184   4034753
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    61   2552889344   4041306
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    61   2982805504   4047859
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    61   3412590592   4054412
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    61   3842637824   4060965
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    61   4272553984   4067518
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    62   407502848   4074071
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    62   837287936   4080624
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    62   1267335168   4087177
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    62   1697251328   4093730
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    62   2127036416   4100283
    
    voltage: 3588
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    62   2556821504   4106836
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    62   2986606592   4113389
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    62   3416653824   4119942
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    62   3846569984   4126495
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    62   4276486144   4133048
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    63   411435008   4139601
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    63   841351168   4146154
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    63   1271267328   4152707
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    63   1701183488   4159260
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    63   2131099648   4165813
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    63   2561015808   4172366
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    63   2990800896   4178919
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    63   3420585984   4185472
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    63   3850502144   4192025
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    63   4280418304   4198578
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    64   415367168   4205131
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    64   845283328   4211684
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    64   1275068416   4218237
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    64   1705115648   4224790
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    64   2135031808   4231343
    
    voltage: 3589
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    64   2564947968   4237896
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    64   2994864128   4244449
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    64   3424649216   4251002
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    64   3854303232   4257555
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    64   4284350464   4264108
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    65   419299328   4270661
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    65   849215488   4277214
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    65   1279131648   4283767
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    65   1709047808   4290320
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    65   2138963968   4296873
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    65   2568880128   4303426
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    65   2998796288   4309979
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    65   3428581376   4316532
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    65   3858628608   4323085
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    65   4288413696   4329638
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    66   423231488   4336191
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    66   853147648   4342744
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    66   1283063808   4349297
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    66   1712979968   4355850
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    66   2142896128   4362403
    
    voltage: 3588
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    66   2572812288   4368956
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    66   3002728448   4375509
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    66   3432644608   4382062
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    66   3862560768   4388615
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    66   4292476928   4395168
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    67   427294720   4401721
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    67   857079808   4408274
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    67   1286864896   4414827
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    67   1717436416   4421380
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    67   2147221504   4427933
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    67   2577137664   4434486
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    67   3007053824   4441039
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    67   3436969984   4447592
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    67   3866886144   4454145
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    68   1835008   4460698
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    68   431751168   4467251
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    68   861667328   4473804
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    68   1291583488   4480357
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    68   1721499648   4486910
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    68   2151284736   4493463
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    68   2581069824   4500016
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    68   3010985984   4506569
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    68   3440902144   4513122
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    68   3870818304   4519675
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    69   5767168   4526228
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    69   435683328   4532781
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    69   865599488   4539334
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    69   1295515648   4545887
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    69   1725431808   4552440
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    69   2155347968   4558993
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    69   2585264128   4565546
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    69   3015049216   4572099
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    69   3444834304   4578652
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    69   3874619392   4585205
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    70   12976128   4591758
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    70   442892288   4598311
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    70   872808448   4604864
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    70   1302724608   4611417
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    70   1732771840   4617970
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    70   2162688000   4624523
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    70   2592473088   4631076
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    70   3022389248   4637629
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    70   3452174336   4644182
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    70   3881959424   4650735
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    71   16908288   4657288
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    71   446824448   4663841
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    71   876740608   4670394
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    71   1306656768   4676947
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    71   1736572928   4683500
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    71   2166620160   4690053
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    71   2596536320   4696606
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    71   3026452480   4703159
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    71   3456237568   4709712
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    71   3886153728   4716265
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    72   20971520   4722818
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    72   450756608   4729371
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    72   880672768   4735924
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    72   1310588928   4742477
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    72   1740505088   4749030
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    72   2170421248   4755583
    
    voltage: 3588
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    72   2600337408   4762136
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    72   3030384640   4768689
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    72   3460300800   4775242
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    72   3890085888   4781795
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    73   25034752   4788348
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    73   454819840   4794901
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    73   884604928   4801454
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    73   1314521088   4808007
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    73   1744437248   4814560
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    73   2174353408   4821113
    
    voltage: 0
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    73   2604400640   4827666
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    73   3034316800   4834219
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    73   3464232960   4840772
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    73   3894280192   4847325
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    74   29229056   4853878
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    74   459145216   4860431
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    74   888930304   4866984
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    74   1318715392   4873537
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    74   1748500480   4880090
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    74   2178416640   4886643
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    74   2608332800   4893196
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    74   3038248960   4899749
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    74   3468165120   4906302
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    74   3898081280   4912855
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    75   33161216   4919408
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    75   463077376   4925961
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    75   892993536   4932514
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    75   1322778624   4939067
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    75   1752694784   4945620
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    75   2182479872   4952173
    
    voltage: 0
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    75   2612264960   4958726
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    75   3042181120   4965279
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    75   3472228352   4971832
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    75   3902144512   4978385
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    76   37093376   4984938
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    76   467009536   4991491
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    76   896925696   4998044
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    76   1326972928   5004597
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    76   1756889088   5011150
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    76   2186674176   5017703
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    76   2616590336   5024256
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    76   3046375424   5030809
    
    Stack Message received (GAP_MSG_EVENT), status: 0
    Gap Message received (GAP_LINK_TERMINATED_EVENT), status: 0, opcode: 6
    
    

  • syscfg and SC Power settings used when collecting RTC logs:
      

  • Another log attached: includes SC registers as well (decimal numbers are shown):
    Point of Error:

    SC Alert OK AON_RTC_O_SEC AON_RTC_O_SUBSEC AON_RTC_O_CH2CMP:
    23 2295857152 1543048

    AUX_SCE_O_CTL AUX_SCE_O_CPUSTAT:
    1 1281

    ERROR: LOST SC Alert AON_RTC_O_SEC AON_RTC_O_SUBSEC AON_RTC_O_CH2CMP:
    23 2729050112 1549601

    AUX_SCE_O_CTL AUX_SCE_O_CPUSTAT:
    1 774
    ------------------------------------------------------------------

    AON_RTC_O_SEC+SCreg-s log 7 ERROR 23 seconds from start.txt
    17   982515712   1130209
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   1281
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    17   1412300800   1136762
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   1281
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    17   1842085888   1143315
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   1281
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    17   2272002048   1149868
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   1281
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    17   2701918208   1156421
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   1281
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    17   3131834368   1162974
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   1281
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    17   3561750528   1169527
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   1281
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    17   3991666688   1176080
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   1281
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    18   126615552   1182633
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   1281
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    18   556531712   1189186
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   1281
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    18   986447872   1195739
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   1281
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    18   1416364032   1202292
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   1281
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    18   1846280192   1208845
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   1281
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    18   2276065280   1215398
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   1281
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    18   2705850368   1221951
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   1281
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    18   3135766528   1228504
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   1281
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    18   3565682688   1235057
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   1281
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    18   3995598848   1241610
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   1281
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    19   130547712   1248163
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   1281
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    19   560463872   1254716
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   1281
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    19   990380032   1261269
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   1281
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    19   1420296192   1267822
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   1281
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    19   1850212352   1274375
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   1281
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    19   2280128512   1280928
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   1281
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    19   2709913600   1287481
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   1281
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    19   3139698688   1294034
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   1281
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    19   3569614848   1300587
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   1281
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    19   3999531008   1307140
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   1281
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    20   134479872   1313693
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   1281
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    20   564396032   1320246
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   1281
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    20   994312192   1326799
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   1281
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    20   1424228352   1333352
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   1281
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    20   1854144512   1339905
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   1281
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    20   2284060672   1346458
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   1281
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    20   2713976832   1353011
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   1281
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    20   3143892992   1359564
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   1281
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    20   3573678080   1366117
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   1281
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    20   4003463168   1372670
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   1281
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    21   138412032   1379223
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   1281
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    21   568328192   1385776
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   1281
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    21   998244352   1392329
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   1281
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    21   1428160512   1398882
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   1281
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    21   1858076672   1405435
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   1281
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    21   2287992832   1411988
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   1281
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    21   2717908992   1418541
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   1281
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    21   3147825152   1425094
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   1281
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    21   3577741312   1431647
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   1281
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    21   4007526400   1438200
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   1281
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    22   142344192   1444753
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   1281
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    22   572260352   1451306
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   1281
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    22   1002176512   1457859
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   1281
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    22   1432092672   1464412
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   1281
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    22   1862008832   1470965
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   1281
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    22   2291924992   1477518
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   1281
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    22   2721841152   1484071
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   1281
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    22   3151757312   1490624
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   1281
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    22   3581673472   1497177
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   1281
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    22   4011589632   1503730
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    23   146538496   1510283
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   1281
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    23   576323584   1516836
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   1281
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    23   1006108672   1523389
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   1281
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    23   1436024832   1529942
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   1281
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    23   1865940992   1536495
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   1281
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    23   2295857152   1543048
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   1281
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    23   2729050112   1549601
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    23   3159097344   1556154
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    23   3589013504   1562707
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    23   4019060736   1569260
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    24   154009600   1575813
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    24   583794688   1582366
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    24   1013710848   1588919
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    24   1443495936   1595472
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    24   1873412096   1602025
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    24   2303328256   1608578
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    24   2733244416   1615131
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    24   3163291648   1621684
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    24   3593207808   1628237
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    24   4023123968   1634790
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    25   158072832   1641343
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    25   588120064   1647896
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    25   1018036224   1654449
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    25   1447952384   1661002
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    25   1877999616   1667555
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    25   2307784704   1674108
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    25   2737700864   1680661
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    25   3167617024   1687214
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    25   3597402112   1693767
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    25   4027318272   1700320
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    26   162267136   1706873
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    26   592314368   1713426
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    26   1022230528   1719979
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    26   1452146688   1726532
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    26   1882062848   1733085
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    26   2312110080   1739638
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    26   2742026240   1746191
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    26   3171942400   1752744
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    26   3601727488   1759297
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    26   4031643648   1765850
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    27   166461440   1772403
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    27   596377600   1778956
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    27   1026293760   1785509
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    27   1456340992   1792062
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    27   1886257152   1798615
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    27   2316173312   1805168
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    27   2746089472   1811721
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    27   3176005632   1818274
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    27   3606052864   1824827
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    27   4036100096   1831380
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    28   171180032   1837933
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    28   601096192   1844486
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    28   1031143424   1851039
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    28   1460928512   1857592
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    28   1890713600   1864145
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    28   2320629760   1870698
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    28   2750414848   1877251
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    28   3180462080   1883804
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    28   3610378240   1890357
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    28   4041080832   1896910
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    29   175505408   1903463
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    29   605552640   1910016
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    29   1035862016   1916569
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    29   1465516032   1923122
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    29   1895563264   1929675
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    29   2325479424   1936228
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    29   2755395584   1942781
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    29   3185442816   1949334
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    29   3615358976   1955887
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    29   4048027648   1962440
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    30   182845440   1968993
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    30   612106240   1975546
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    30   1041629184   1982099
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    30   1471152128   1988652
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    30   1900675072   1995205
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    30   2330198016   2001758
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    30   2759720960   2008311
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    30   3189506048   2014864
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    30   3619553280   2021417
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    30   4049731584   2027970
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    31   184811520   2034523
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    31   614465536   2041076
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    31   1044119552   2047629
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    31   1474297856   2054182
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    31   1904214016   2060735
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    31   2333736960   2067288
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    31   2763784192   2073841
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    31   3193700352   2080394
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    31   3623485440   2086947
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    31   4053401600   2093500
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    32   188350464   2100053
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    32   621019136   2113159
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    32   1050935296   2119712
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    32   1480327168   2126265
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    32   1909850112   2132818
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    32   2339504128   2139371
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    32   2769027072   2145924
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    32   3200122880   2152477
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    32   3630170112   2159030
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    32   4059430912   2165583
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    33   194248704   2172136
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    33   623509504   2178689
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    33   1053032448   2185242
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    33   1482555392   2191795
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    33   1912471552   2198348
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    33   2342256640   2204901
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    33   2772041728   2211454
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    33   3201957888   2218007
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    Stack Message received (GAP_MSG_EVENT), status: 0
    Gap Message received (GAP_LINK_TERMINATED_EVENT), status: 0, opcode: 6
    ForceSensor disabled!
    IMU disabled!
    Advertising Timer for 60 seconds started; device is advertising connection!
    Device Disconnected!
    !!! IMU Timer not enabled !!!
    
    

    Looks like the moment of Lost SC alert is random: can be even 23x100ms = 2.3 seconds after the Bluetooth connection established with our Mobile app. The app just displays data on the screen.

  • Hi,

    I read this post and what you are experiencing is a code hang or an implementation issue. Also, I do not think the power management is causing your issue. By default if you use simple peripheral is set to low power, it will go to standby mode if there is no event.

    I did this project using CC2640R2F integrated sensor controller to simple peripheral. If you do the integration of sensor controller to the simple peripheral correctly, then there will be no problem.

    Soil Moisture Sensor Controller Project.

    -kel

  • H David,
    RE: your a: Here is my decoding of the RTC registers': From log 7 above: AON_RTC Seconds numbers seem to be  always correct, including and after the error. A new log entry comes every 100 ms.  Around the error we have all 10 RTC second indications: 23, then number 24 repeated 10 times correctly as well. I see no loss of RTC ticks. We have a battery measurement task 

    RE: your b: Decoding of the log for 
    AUX_SCE --> CTL Register to see if CLK_EN is enabled - Page 1811 of TRM.
    CTL is 1 in all cases before and after the error: hence CLK_EN bit is set, clock always enabled.

    RE: your d: Here is my decoding of the SC CPUSTAT register, at the transition point:" all good" => "SC Alert to main core lost":
    Value 1281 decimal in SC CPUSTAT in all good cases "SC Alert OK" before the error:
    0101 0000 0001 => 2 bits set: HALTED and SLEEP

    Value 774 decimal in SC CPUSTAT in all bad cases: ERROR: ALERT to main LOST
    0011 0000 0110 => 2 bits set: HALTED and WEV

    RE: WEV: Is this some kind of "Write Event" to a register that gets frozen - did not complete? My log indicates that 774 remained in all subsequent samples, is this an SC crash for all tasks? I found that 3 secs after the ERROR: Alert interrupt missing, our other SC battery monitor task starts reporting 0 for battery voltage, previous value: almost full battery.

  • H David,
    RE: your a: Here is my decoding of the RTC registers': From log 7 above: AON_RTC Seconds numbers seem to be  always correct, including and after the error. A new log entry comes every 100 ms.  Around the error we have all 10 RTC second indications: 23, then number 24 repeated 10 times correctly as well. I see no loss of RTC ticks. 

    RE: your b: Decoding of the log for 
    AUX_SCE --> CTL Register to see if CLK_EN is enabled - Page 1811 of TRM.
    CTL is 1 in all cases before and after the error: hence CLK_EN bit is set, clock always enabled.

    RE: your d: Here is my decoding of the SC CPUSTAT register, at the transition point:" all good" => "SC Alert to main core lost":
    Value 1281 decimal in SC CPUSTAT in all good cases "SC Alert OK" before the error:
    0101 0000 0001 => 2 bits set: HALTED and SLEEP

    Value 774 decimal in SC CPUSTAT in all bad cases: ERROR: ALERT to main LOST
    0011 0000 0110 => 2 bits set: HALTED and WEV

    I removed different parts of our SC task source code to debug and try to remove the failure, but in all experiments, I reproduced the loss of SC Alert interrupts at random moments in time after startup (ie. clicking play button in CCS debugger). The transitions to the error had the same CPUSTAT change: 1281 => 774.

    RE: WEV CPUSTAT bit: Is this some kind of "Write Event" to an SC register that gets frozen when the error occurs ? Write did not complete?
    My log indicates that 774 remained in all subsequent sample periods after the error occurred. Is this an SC crash for all tasks? I found that 3 secs after the ERROR: Alert interrupt missing, our other SC battery monitor task started reporting 0 for battery voltage, all previous values: almost full battery.

  • Hello Ludmil,

    Thank you for providing this information! I will review these findings today with the expert and come back at you as soon as possible.

    BR,

    David

  • Hello Ludmil,

    The WEV refers to the "Wait for EVent" instructions. These instructions are not used by the run-time framework. Could you please confirm if you are using any of procedure that waits for some event, which might not occur at all or has occurred in the past? I would suggest to take a look at the documentation of Sensor Controller Studio.

    Do you have a Texas Instruments point of contact that could help you share the sensor controller studio project file with us to take a quick look at?

    BR,

    David.

  • Hi David, Thanks a lot for the info. In the SC task code that fails: we have a 5ms timer call to delay our SC task code: fwDelayUs(5000);. I removed this timer call as an experiment yesterday, but I still had WEV bit set: log attached. We used to have a TI contact years ago, but in 2022 were asked to use the forum. We are based in San Diego, CA.

    AON_RTC_O_SEC+log12a -5msDelay+MoreDebug ERR 500 secs from start.txt
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   1281
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    41   405405696   2699484
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   1281
    
    SC Alert OK AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    41   837156864   2706037
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   1281
    
    . . ..
    
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    500   1256718336   32787849
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    500   1686503424   32794402
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    500   2116419584   32800955
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    500   2546335744   32807508
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    500   2976251904   32814061
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    500   3406168064   32820614
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    voltage: 0
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    500   3836084224   32827167
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    500   4266131456   32833720
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    501   401080320   32840273
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    501   830996480   32846826
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    501   1260781568   32853379
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    501   1690697728   32859932
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    501   2120482816   32866485
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    501   2550267904   32873038
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    501   2980184064   32879591
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    501   3410100224   32886144
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    501   3840016384   32892697
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    501   4269932544   32899250
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    502   404881408   32905803
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    502   834928640   32912356
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    502   1264844800   32918909
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    502   1694760960   32925462
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    502   2124546048   32932015
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    502   2554331136   32938568
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    502   2984116224   32945121
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    502   3414032384   32951674
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    voltage: 0
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    502   3843948544   32958227
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    502   4273864704   32964780
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    503   408813568   32971333
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    503   838729728   32977886
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    503   1268776960   32984439
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    503   1698693120   32990992
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    503   2128609280   32997545
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    503   2558394368   33004098
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    503   2988310528   33010651
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    503   3418095616   33017204
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    503   3847880704   33023757
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    503   4277796864   33030310
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    504   412745728   33036863
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    504   842661888   33043416
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    504   1272578048   33049969
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    504   1702494208   33056522
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    504   2132541440   33063075
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    504   2562457600   33069628
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    504   2992373760   33076181
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    504   3422158848   33082734
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    voltage: 0
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    504   3852206080   33089287
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    504   4281860096   33095840
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    505   416677888   33102393
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    505   846594048   33108946
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    505   1276510208   33115499
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    505   1706426368   33122052
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    505   2136473600   33128605
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    505   2566389760   33135158
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    505   2996305920   33141711
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    505   3426222080   33148264
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    505   3856007168   33154817
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    505   4285923328   33161370
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    506   420741120   33167923
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    506   850526208   33174476
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    506   1280573440   33181029
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    506   1710489600   33187582
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    506   2140405760   33194135
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    506   2570321920   33200688
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    506   3000238080   33207241
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    506   3430154240   33213794
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    voltage: 0
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    506   3860201472   33220347
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    506   4290117632   33226900
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    507   424935424   33233453
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    507   854851584   33240006
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    507   1284636672   33246559
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    507   1714421760   33253112
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    507   2144337920   33259665
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    507   2574254080   33266218
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    507   3004170240   33272771
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    507   3434086400   33279324
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    voltage: 0
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    507   3864133632   33285877
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    507   4294049792   33292430
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    508   428998656   33298983
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    508   858914816   33305536
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    508   1288699904   33312089
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    508   1718616064   33318642
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    508   2148401152   33325195
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    508   2578186240   33331748
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    508   3008102400   33338301
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    508   3438018560   33344854
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    508   3867934720   33351407
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    509   2883584   33357960
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    509   432799744   33364513
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    509   862846976   33371066
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    509   1292763136   33377619
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    509   1722679296   33384172
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    509   2152464384   33390725
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    509   2582249472   33397278
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    509   3012034560   33403831
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    509   3441950720   33410384
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    voltage: 0
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    509   3871866880   33416937
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    510   6815744   33423490
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    510   436731904   33430043
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    510   866648064   33436596
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    510   1296695296   33443149
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    510   1726611456   33456255
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    510   2156527616   33462808
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    510   2586312704   33469361
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    510   3016228864   33475914
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    510   3446013952   33482467
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    510   3875799040   33489020
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    511   10747904   33495573
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    511   440664064   33502126
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    511   870580224   33508679
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    511   1300496384   33515232
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    511   1730412544   33521785
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    511   2160459776   33528338
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    511   2590375936   33534891
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    511   3020292096   33541444
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    511   3450077184   33547997
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    voltage: 0
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    511   3879993344   33554550
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    512   14811136   33561103
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    512   444596224   33567656
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    512   874512384   33574209
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    512   1304428544   33580762
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    512   1734344704   33587315
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    512   2164260864   33593868
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    512   2594177024   33600421
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    512   3024224256   33606974
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    512   3454140416   33613527
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    512   3883925504   33620080
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    513   18874368   33626633
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    513   448659456   33633186
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    513   878444544   33639739
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    513   1308360704   33646292
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    513   1738276864   33652845
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    513   2168193024   33659398
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    513   2598109184   33665951
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    513   3028025344   33672504
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    513   3458072576   33679057
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    voltage: 0
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    513   3888119808   33685610
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    514   22937600   33692163
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    514   452722688   33698716
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    514   882638848   33705269
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    514   1312423936   33711822
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    514   1742340096   33718375
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    514   2172256256   33724928
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    514   2602172416   33731481
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    514   3032088576   33738034
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    514   3462004736   33744587
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    514   3891920896   33751140
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    515   27000832   33757693
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    515   456916992   33764246
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    515   886833152   33770799
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    515   1316618240   33777352
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    515   1746534400   33783905
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    515   2176450560   33790458
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    515   2606235648   33797011
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    515   3036282880   33803564
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    515   3466199040   33810117
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    515   3895984128   33816670
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    516   30932992   33823223
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    516   460980224   33829776
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    516   890765312   33836329
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    516   1320812544   33842882
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    516   1750728704   33849435
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    516   2180513792   33855988
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    ERROR: LOST SC Alert AON_RTC_O_SEC  AON_RTC_O_SUBSEC  AON_RTC_O_CH2CMP:
    516   2610429952   33862541
    
    AUX_SCE_O_CTL  AUX_SCE_O_CPUSTAT:
    1   774
    
    
    
    

  • Hi Markel, thanks for the information. Our MCU is CC2642R. We ran successfully the same SC code for many months with no Power policy selected in the .syscfg file. The problem occurred when we selected Power Policy Standby in the .syscfg file. Can you provide a link to the simple peripheral source code including SC project and task that runs in standby mode?

    RE low-power mode:
    SC Power help table indicates that Low-power mode is not available for ADC (screenshot below), is this correct? We use ADC enable and select API calls in our SC FW code.


    As I indicated above in this post: 

    I tried 2 variants with "Low Power" for SC: With this config shown below, I cannot connect over Bluetooth to our mobile app, or rarely connect, but the LEDs and main voltage sensor are not working:

    With this second possible variant I cannot connect over Bluetooth:



    Regards

    Ludmil

  • I replaced the fwDelay() with a hard delay in the code and still observed the same error as before: frozen SC.

    //fwDelayUs(5000); //LK: removed

    for (U16 n = 0; n < 5000; n++) {

    sampleCounter = 0;

    }

    I found in a TI SC doc that this delay API is independent of power modes:

    fwDelayUs

    Prototype: fwDelayUs(delay)

    Delays execution of the next line by the specified number of microseconds.

    To avoid busy waiting, the delay is implemented using the microsecond delay timer.

    The delay is independent of power modes (active and low-power) and switching between power modes.

    Parameter value(s)

    • delay : Delay value in microseconds (1-65534)


    I tried custom / dynamically switched on/off low-power mode on SC: same bad result.
    I tried no Power policy in CCS, .syscfg file: all good: Alerts coming well in Release FW mode on the main core.
    Is it possible that WEV is set because SC is waiting for an ACK from the main core, and this ACK does not come in standby mode ? I made an experiment that shows this:
    I left only Alert interrupt and self-reschedule in our SC code, tried longer and had the loss of the Alert on the main core with this very reduced SC code, which makes me think that the problem is no ACK from the main MCU core. SC waits on this event, main waits on Alert, so we have a deadlock. Our main core FW calls the API for Ack to SC, it works well in no power Manag. mode and in WFI Power Manag. mode. Maybe I can switch to custom Power mode on the main core and use this option.

    Regards

    Ludmil

  • Hello Ludmil,

    It would seem you still have a procedure that waits for an event (WEV). Could you please help me with the following:

    1. Get the value after the devices crashes from AUX_SCE --> FETCHSTAT - Page 1812 of TRM.
    2. Look for that value (program address) inside the "sce.lst" listing file, which should be able to tell you which instruction is causing the WEV.

    3. Could you please confirm you are using the ADC only from the sensor controller and not MCU?
    4. Could you please share how you are reading the ADC buffer (code-snipped) would be helpful. There could be a risk of incorrect reading that generates the program to get stuck waiting for data that does not exists.

    BR,

    David.

  • Hi David, thanks a lot, I will work on 1. and 2. today.

    RE: 3 and 4:
    3. Could you please confirm you are using the ADC only from the sensor controller and not MCU?
    After the alert interrupt showing "data ready: on the main MCU core we only call: AUXADCAdjustValueForGainAndOffset(. . .) to read  .output and adjust value. 

    4. Could you please share how you are reading the ADC buffer (code-snipped) would be helpful
    LK: We use standard APIs that exist in TI manual:
    ADC — Sensor Controller Studio v2.9.0 CC13x2 CC26x2 documentation

    From the manual: 
    // Select ADC input
    adcSelectGpioInput(AUXIO_A_SENSOR_OUTPUT);
    
    // Enable the ADC (fixed reference, 2.7 us sample time, manual trigger)
    adcEnableSync(ADC_REF_FIXED, ADC_SAMPLE_TIME_2P7_US, ADC_TRIGGER_MANUAL);
    
    // Sample the sensor and store the ADC value
    adcGenManualTrigger();
    adcReadFifo(output.adcValue);
    
    // Disable the ADC
    adcDisable();

    --------------------------------------------------------------------------

    Our code sequence used successfully on the previous MCU CC2640 for more than 5 years:
    adcEnableSync(. . . )

    for (U16 n = 0; n < ADC_INPUT_COUNT; n++) {
    // Sample the sensor
    adcSelectGpioInput(Input[n]);

    . . . .

    . . . . 
    U16 sample;
    adcGenManualTrigger();
    adcReadFifo(sample);

    . . . .;
    }

    . . . . 
    // Disable the ADC
    adcDisable();

  • I added more info in the following message

  • Hi David RE your 1. and 2:

    1. Get the value after the devices crashes from AUX_SCE --> FETCHSTAT - Page 1812 of TRM.
    2. Look for that value (program address) inside the "sce.lst" listing file, which should be able to tell you which instruction is causing the WEV

    I ran a variant of our full SC code with dynamic power control (start/stop low-power mode). I decoded FETCHSTAT and found: The blocked place in the code is an ADC read at address 00e0. Instruction code 9990: input/read ADC. Looks like it is actually blocked by the preceding wev1 instruction. It shows the Program Counter at the next ADC input instruction:
                       ;? adcReadFifo(sample);
    00df ---- edb1 wev1         #WEVSEL_ADC_FIFO_NOT_EMPTY
    00e0 ---- 9990 in R1,       [#IOP_ANAIF_ADCFIFO]

    See attached below for all info:


    One possible root cause explanation: we are waiting for ADC input that does not happen because the previous dig output instruction did not supply power to our voltage sensor and also affected an OP-AMP circuit (low voltage impact confirmed by our HW engineer):
    Dig output not succeeded:
    ;? // Enable power supply
    ;? gpioClearOutput(AUXIO_O_SG_POWER);
    00d0 ---- 54bc iobclr #(20 & 0x7), [#(IOP_AIODIO0_GPIODOUT + (20 >> 3))]

    Another impact from the above dig output: The same power supply route supplies our LEDs, which are down every time when the error occurs. 
    We can try to also confirm with an oscilloscope tomorrow.

    We defined this digio power pin only in our SC configuration, not in main MCU .syscfg file. The error however only occurs when Standpy policy is selected in the main FW syscfg file. All works OK in standard non-Power saving mode on the main MCU, and in WFI mode on the main MCU. CC2642 datasheet: I found this text on page 49: All GPIOs are latched in standby mode.

    This dig output is declared in our SC code section, for which I explicitly request active mode according to TI SC docs:
    // Enter active power mode
    pwrRequestAndWaitForActiveMode();

    The error also occurs if I remove this dynamic power control config in SC and the above API.

    Configs screenshots attached as well: .syscfg and SC: Power and Clock Settings.

  • I started using adcGetFifoStatus() and adcPopFifo() as a workaround. Will check a HW test point on the PCBA to confirm the above results.

  • Hello Ludmil,

    Is this workaround avoiding the issue of the SC stopping? Could you confirm you are not using the DAC module from sysconfig?

    Is there a way for you to share with us the scp file and the relevant code for the application?

    Best Regards,

    David.

  • Hi David,
    The workaround worked fine for 65 mins yesterday in Debug mode: no SC crashes. I am testing it in Release mode today and will let you know. I am using the attached .syscfg and SC power setups:

       

    I confirm that I am not using the DAC module from sysconfig: screenshot attached below:

  • Hello Ludmil,

    Understood. Let us know how it goes.

    BR,

    David.

  • Hi Dave, We hooked an oscilloscope and confirmed that my findings are correct for the dig output on SC: it stops working at the random time moment of freeze/deadlock of the SC:
    gpioClearOutput(AUXIO_O_SG_POWER);

    To remind you: Thiis output stops power to the voltage sensor and the LEDs. I reported at the time: We deadlock at WEV when we read the ADC, so I tried first: a more robust FIFO read: replaced adcReadFifo() with FIFO status read and check for status, retry the above Dig output...etc, all this helped a bit but the dig output problem was still there. 

    Further changes and 2nd SC freeze:
    The TI SC help table is saying that ADC is not supported in low power mode, so I started calling in our SC code: 
    pwrRequestAndWaitForActiveMode();   
    then apply the dig output and do all operations, after which I switch to Low-power mode. On the main MCU code I also disable standby mode before any SC operations start, and re-enable it after all SC, BLE and other operations complete. I resolved my freeze on the dig output, but I got another 2nd type of freeze, see summary below in screenshots:



    Further change and 3rd freeze: very similar to the 2nd type:
    I replaced the above API pwrRequestAndWaitForActiveMode(); with the following menu selection that seems equivalent:

    This is a change in settings: Set "wake up active" option in the SC power settings. I also removed SCOSC calibration from .syscfg: This probably has no effect 'cos we use XOSC. I observed an SC crash after 33 mins:
    ERROR: LOST SC Alert  SEC  SUBSEC CH2CMP:
    2040  2230190080  0

    CTL  CPUSTAT  FETCHSTAT: 
    1 1281 1879769235 

    FETCHSTAT 1879769235 => Hex: 700B 0093
    lst file shows:

    PwrRequestAndWaitForActiveMode:
    ; Update Reference DAC clock divider before entering active mode
    0093 ---- 700b Id R7, #((ACTIVE_MODE_SCE_CLK_FREQ_MHZ / 2) - 1)
    0094 ---- fb96 out R7, [#IOP_ANAIF_DACSMPLCFG0]

    I think in freeze case 2 and 3 we have an output operation related to DAC (similar to my case1: dig output to control power).
    I think I resolved my old case 1, but I hit other "output" cases 2 and 3 in a different switching TI code area: how can I work in Active mode on SC 100% of the time without switching Active <=> Low-power mode ?  
    I tried 4th case: no switch to low-power mode in our SC code, no dynamic Power control in SC settings: but had the same freeze as case 3, because I still have "wake up active" option in the SC power settings and it causes a switch in TI code in the same above PC=0093, op code 0093. 5th case using "init only" option in SC power settings also ends up freezing SC in this place:

    FETCHSTAT: 700B 0092

    PwrRequestAndWaitForActiveMode:
    ; Update Reference DAC clock divider before entering active mode
    0092 ---- 700b ld R7, #((ACTIVE_MODE_SCE_CLK_FREQ_MHZ / 2) - 1)
    0093 ---- fb96 out R7, [#IOP_ANAIF_DACSMPLCFG0]

    I tried power settings on SC: "Active" set for each task code block, with either option for default power mode: at every wake up / on init only: same result: frozen SC
    at the same point in the .lst file, shown below:
     
    PwrRequestAndWaitForActiveMode:
    ; Update Reference DAC clock divider before entering active mode
    0093 ---- 700b ld R7, #((ACTIVE_MODE_SCE_CLK_FREQ_MHZ / 2) - 1)
    0094 ---- fb96 out R7, [#IOP_ANAIF_DACSMPLCFG0]

    I tried setting the frequencies for low-power and active mode the same at 2MHz (SC setting), but had the same problem in the TI code: frozen SC at the same address, opCode slightly different:
    PwrRequestAndWaitForActiveMode:
    ; Update Reference DAC clock divider before entering active mode
    0093 ---- 7000 ld R7, #((ACTIVE_MODE_SCE_CLK_FREQ_MHZ / 2) - 1)
    0094 ---- fb96 out R7, [#IOP_ANAIF_DACSMPLCFG0]

    Maybe I need custom power mode in .syscfg? Or use constraints?

  • Hello Ludmil,

    To further be able to help you with this, would it be possible for you to try the following?

    1. Could you please confirm the issue occurs with default simple_peripheral and/or SCS ADC examples (either separately or together)?
    2. Do you have a TI CC2652XR1 LaunchPad you can use to reproduce the issue?
    3. Try with the latest F2 SDK (7.10.00.98 which has last update for SCS) and SCS (that has all patches applied).

    All this so that we can try to reproduce the issue on a TI environment that we can use a base reference.

    BR,

    David.

  • Hi David, Thanks for the advice and the doc link, I can try the SCS ADC examples with SDK 7.10, but this will take some time to port code / migrate from our current SDK 6.10. I checked the SC examples. I see that they are using RTC. I switched to Util_restartClock() before some recent code updates, so it will be faster to go back to RTC in my code first, test, and then look at SDK 7.10.

  • Hi David, I ran the RTC-driven test variant on our app but it ended up with a frozen SC and "wait for event" SC instruction when reading the ADC (same as the first issue).

    I had some compilation errors with SDK 7.10.00.98 and the TI Simple Peripheral app, I am trying to resolve them.

    I managed to run one successful test with our reduced, almost empty SC task that used to freeze when using dig Output, ADC channels, and delay:
    Using our current TI SimpleLink SDK CC13xx CC26xx version 6.10.0.29, I passed successfully an approx. 2 hours run of our reduced SC task that performs the same actions as described in the TI doc: Ultra-Low Power Sensing Applications With CC13x2/CC26x2, A.3 Wake Up and Sleep – Sensor Controller, plus 1 additional action:

    - Periodic SC task that reschedules itself in the Init block and the Execution block by calling: fwScheduleTask(1).
    - In the Execution block calls only:
    fwGenAlertInterrupt(); // Alert interrupt to Main MCU app - SC task's additional action compared to the above A.3
    fwScheduleTask(1); // Schedule the next execution <in ticks>, one tick 100 ms

    The main MCU app performed the same initialisation and start of the SC task as describe in section 6. of the TI doc: Ultra-Low Power Sensing Applications With CC13x2/CC26x2, A.3 Wake Up and Sleep – Sensor Controller, plus 4 additional actions:

    1) Ignore each Alert interrupt. This main MCU core app only does the standard acknowledge of this Alert interrupt:
    scifClearAlertIntSource();
    scifAckAlertEvents();
    2) Have the Power Management Policy enabled as "Standby" in .syscfg
    3) Connect to a mobile app running on a phone during the run
    4) Drive a periodic green device LED to indicate successful runs.

    Attached .syscfg Power section used during the successful test:

  • Hello Ludmil,

    Glad to hear the test with this reduced SC task works fine. Therefore can we say the issue is happening when enabling the ADC and using delays? Have you tried to add more of these features to see which one is generating the issue and narrow it even more? This is still being test in your custom board correct (no TI launchpad)?

    BR,

    David.

  • Hi David, Yes I did the testing described in my last post, with our custom board: no TI launchpad used.
    The SC power settings used were:

    RE: adding new features: I added the 2 digiIO operations: outputs that we had in the code previously to provide power to our voltage sensor. I am running the tests. Will let you know the results on Mon around lunch time.

  • Hi David, As agreed: I started adding lines of code to the SC main task to see when the errors will appear:
    1) PASSED a test after running in a 2 hr period OK: This is after adding 2 ON/OFF power operations via digital outputs: gpioClearOutput() and gpioSetOutput(), NO ADC operations used. Periodic Alerts OK gen-d by RTC clock. Our 2nd SC task to monitor battery voltage on the SC was commented out and not used. I did not call any APIs on the SC to explicitly change active <=>low power mode.
    Config:
    Power standby policy enabled on MCU main FW in Release mode (Debug mode also ran OK for around 34 mins and I stopped it, reg-s below).
    SC config: Default pwr mode Active, applied at every SC wake up. Debug trace repeatedly showed:

    SC Alert OK SEC SUBSEC CH2CMP:
    2497 62259200 163647064

    CTL CPUSTAT FETCHSTAT:
    1 1281  1879769235

    1281 in Dec is: 0101 0000 0001  => bits set: HALTED  SLEEP (this is OK)

    2) 2nd test failed when I added ADC operations adcReadFifo(sample): read 4 voltages in total, to the 2 digital outputs: gpioClearOutput() and gpioSetOutput(),
    FAILED after 40 secs with device LEDs OFF and no voltage obtained, SC Periodic Alerts driven/gen-d by RTC clock. Our Battery code commented in SC. SC Periodic alerts stopped after 40 secs. Power standby policy again enabled on MCU main FW in Release mode. SC config: Default pwr mode Active, applied at every SC wake up.

    3) 3rd run same as 2nd run: Failed as above but in 25 mins. FW still in Release mode.

    4) Failed run: Same config as above in Debug mode with log trace: SC alerts lost after about 1 min, error log collected, debug info:
    ERROR: LOST SC Alert SEC SUBSEC CH2CMP:
    91 2197946368 6000080
    CTL CPUSTAT FETCHSTAT:
    1  774  2576351456

    774 decimal in SC CPUSTAT register, this is binary: 0011 0000 0110 => bits set: HALTED WEV
    FETCHSTAT has decimal 2576351456 => hex value: 999000E0       

    SC code in the sce.lst file:
    ;? while(sampleCounter < ADC_MAXIMUM_SAMPLES) {
    /id0149:
    00dc ---- ea10 cmp R6, #16
    00dd ---- a606 bgeu /id0150
    ;? U16 sample;
    ;? adcGenManualTrigger();
    00de ---- 6491 iobset #0, [#IOP_ANAIF_ADCTRIG]
    ;? adcReadFifo(sample);
    00df ---- edb1 wev1 #WEVSEL_ADC_FIFO_NOT_EMPTY
    00e0 ---- 9990 in R1, [#IOP_ANAIF_ADCFIFO]

    I had this error weeks ago and reported it already in this post: CPUSTAT still shows WEV, so it seems to me that is a false "NON_EMPTY" event received by the SC code, that causes a read of an empty buffer and a deadlock/frozen SC state.

    5) Successful run: PASSED: I added my workaround to our SC code: polls via adcGetFifoStatus() and reads via adcPopFifo(sample). I made this according to the TI docs: manual ADCFIFO status check. I re-ran with this workaround and had a good run for 1hr 30 mins, main FW in DEBUG mode. Same config as the prev. run, only changed the read FIFO APIs. 

    I will do more runs and will carry on adding our battery monitor.

  • Hi David, Thanks for your support.
    We ran more tests, and we think we have a stable Power standby mode on CC2642: no loss of periodic SC alert interrupts. The solution to a stopped and frozen SC because of a blocked TI API adcReadFifo(), seemed to be: instead of adcReadFifo(), poll via adcGetFifoStatus() and read via adcPopFifo(). Such scenario is discussed in the TI SC API documentation.

    As shown above, SC was frozen in the code:
    00df ---- edb1 wev1 #WEVSEL_ADC_FIFO_NOT_EMPTY
    00e0 ---- 9990 in R1, [#IOP_ANAIF_ADCFIFO]

    With our latest configurations, no other scenarios of frozen SC were observed.