-
Notifications
You must be signed in to change notification settings - Fork 2.1k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
TC-IDM-4.2 Use the min/max correctly and account for network delay #33299
TC-IDM-4.2 Use the min/max correctly and account for network delay #33299
Conversation
…z-csa/connectedhomeip into idm-4.2-troubleshoot
…z-csa/connectedhomeip into idm-4.2-troubleshoot
PR #33299: Size comparison from 0afc132 to 4de5c2c Decreases (2 builds for efr32)
Full report (71 builds for bl602, bl702, bl702l, cc13x4_26x4, cc32xx, cyw30739, efr32, esp32, linux, mbed, nrfconnect, nxp, psoc6, qpg, stm32, telink)
|
PR #33299: Size comparison from 3c5b92c to 180d696 Decreases (2 builds for efr32)
Full report (71 builds for bl602, bl702, bl702l, cc13x4_26x4, cc32xx, cyw30739, efr32, esp32, linux, mbed, nrfconnect, nxp, psoc6, qpg, stm32, telink)
|
PR #33299: Size comparison from 7ea2832 to 3de310e Decreases (2 builds for efr32)
Full report (80 builds for bl602, bl702, bl702l, cc13x4_26x4, cc32xx, cyw30739, efr32, esp32, linux, mbed, nrfconnect, nxp, psoc6, qpg, stm32, telink)
|
PR #33299: Size comparison from 7ea2832 to b7a4a9a Increases above 0.2%:
Increases (21 builds for bl602, bl702, bl702l, cc13x4_26x4, linux, nrfconnect, nxp, stm32)
Decreases (46 builds for bl602, bl702, bl702l, cc13x4_26x4, cc32xx, cyw30739, linux, mbed, nrfconnect, nxp, psoc6, qpg)
Full report (47 builds for bl602, bl702, bl702l, cc13x4_26x4, cc32xx, cyw30739, linux, mbed, nrfconnect, nxp, psoc6, qpg, stm32)
|
PR #33299: Size comparison from fb0394d to aded6de Full report (81 builds for bl602, bl702, bl702l, cc13x4_26x4, cc32xx, cyw30739, efr32, esp32, linux, mbed, nrfconnect, nxp, psoc6, qpg, stm32, telink)
|
PR #33299: Size comparison from fb0394d to 362267d Increases above 0.2%:
Increases (81 builds for bl602, bl702, bl702l, cc13x4_26x4, cc32xx, cyw30739, efr32, esp32, linux, mbed, nrfconnect, nxp, psoc6, qpg, stm32, telink)
Decreases (4 builds for psoc6)
Full report (81 builds for bl602, bl702, bl702l, cc13x4_26x4, cc32xx, cyw30739, efr32, esp32, linux, mbed, nrfconnect, nxp, psoc6, qpg, stm32, telink)
|
PR #33299: Size comparison from ca57b59 to 3390b29 Full report (71 builds for bl602, bl702, bl702l, cc13x4_26x4, cc32xx, cyw30739, efr32, esp32, linux, mbed, nrfconnect, nxp, psoc6, qpg, stm32, telink, tizen)
|
PR #33299: Size comparison from aa4250b to 408d229 Full report (8 builds for cc32xx, mbed, qpg, stm32, tizen)
|
PR #33299: Size comparison from aa4250b to 65f443f Full report (85 builds for bl602, bl702, bl702l, cc13x4_26x4, cc32xx, cyw30739, efr32, esp32, linux, mbed, nrfconnect, nxp, psoc6, qpg, stm32, telink, tizen)
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
General comment - not going to ask you to change it in this PR, but you may want to reconsider naming the variables after the step numbers - if the test plan ever gets steps added, you'll end up having to change a lot or the code will get confusing.
PR #33299: Size comparison from aa4250b to 657771c Increases above 0.2%:
Full report (85 builds for bl602, bl702, bl702l, cc13x4_26x4, cc32xx, cyw30739, efr32, esp32, linux, mbed, nrfconnect, nxp, psoc6, qpg, stm32, telink, tizen)
|
PR #33299: Size comparison from 5e37260 to edb9c5f Full report (85 builds for bl602, bl702, bl702l, cc13x4_26x4, cc32xx, cyw30739, efr32, esp32, linux, mbed, nrfconnect, nxp, psoc6, qpg, stm32, telink, tizen)
|
PR #33299: Size comparison from 35eba86 to 4618c3c Full report (85 builds for bl602, bl702, bl702l, cc13x4_26x4, cc32xx, cyw30739, efr32, esp32, linux, mbed, nrfconnect, nxp, psoc6, qpg, stm32, telink, tizen)
|
PR #33299: Size comparison from e26859c to 42085e9 Full report (82 builds for bl602, bl702, bl702l, cc13x4_26x4, cc32xx, cyw30739, esp32, linux, mbed, nrfconnect, nxp, psoc6, qpg, stm32, telink, tizen)
|
PR #33299: Size comparison from 8786012 to cc231d0 Full report (4 builds for cc32xx, mbed, stm32)
|
PR #33299: Size comparison from 8786012 to be9b682 Full report (85 builds for bl602, bl702, bl702l, cc13x4_26x4, cc32xx, cyw30739, efr32, esp32, linux, mbed, nrfconnect, nxp, psoc6, qpg, stm32, telink, tizen)
|
…roject-chip#33299) * test * Adds 1/2 second to delay in step 8 * Adds loop in 0.1s cheks for 10s for reading updated attribute * draft commit * progress * ready for review * review comments * review comments * review comments * Updates tests.yaml * Fix lint * Fix restyle * Fix restyle * Fix restyle * Fix restyle * pr review comments * Removes get_attribute_value_wait function * Step 10 wrapped in exception * Removed unused imports * Removes except Exception from step 10 * AttributeChangeCallback refactor * Removes unnecessary variable * Update endpoint assignment in step 5 * Moves steps into step array for TH * Stardardizes reportInterval values for most steps * Fix restyle * Fix restyle * Step 2 update (max_interval_ceiling_sec, min_interval_floor_sec) * Removes print statement * Fix restyle * Updates AttributeChangeCallback * Fix restyle * Removes comment * Removes comment * Removes redundant acl restore lines * Adds idm 4.2 to tests.yaml * Adds idm 4.2 to tests.yaml * Fix restyle * Update tests.yaml * Updates tests.yaml * Adds comments for execution * Updates AttributePath to AttributePath.from_attribute due to class changes * Downgrades logging.info to logging.debug * Removes setting min interval
…roject-chip#33299) * test * Adds 1/2 second to delay in step 8 * Adds loop in 0.1s cheks for 10s for reading updated attribute * draft commit * progress * ready for review * review comments * review comments * review comments * Updates tests.yaml * Fix lint * Fix restyle * Fix restyle * Fix restyle * Fix restyle * pr review comments * Removes get_attribute_value_wait function * Step 10 wrapped in exception * Removed unused imports * Removes except Exception from step 10 * AttributeChangeCallback refactor * Removes unnecessary variable * Update endpoint assignment in step 5 * Moves steps into step array for TH * Stardardizes reportInterval values for most steps * Fix restyle * Fix restyle * Step 2 update (max_interval_ceiling_sec, min_interval_floor_sec) * Removes print statement * Fix restyle * Updates AttributeChangeCallback * Fix restyle * Removes comment * Removes comment * Removes redundant acl restore lines * Adds idm 4.2 to tests.yaml * Adds idm 4.2 to tests.yaml * Fix restyle * Update tests.yaml * Updates tests.yaml * Adds comments for execution * Updates AttributePath to AttributePath.from_attribute due to class changes * Downgrades logging.info to logging.debug * Removes setting min interval
Updates TC-IDM-4.2 as per test plan changes
Category:
Functional
Description:
Validates Interaction Data Model (IDM), specifically subscription responses. Some example of tests run:
InvalidAction
results when subscribing to clusters and attributes without access rightsFull test plan link for details:
[TC-IDM-4.2] Subscription Response Messages from DUT Test Cases.