Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Generating separate binaries for each unit test for EFR32 #35028

Merged

Conversation

feasel0
Copy link
Contributor

@feasel0 feasel0 commented Aug 16, 2024

Pursuant to Issue 33360, this PR splits up the tests for EFR32 into separate flashable binaries for each test source file.

  • The binaries, along with all their related files, are output to $root_output_dir/tests with a filename like "matter-silabs-device_tests_TestSomething.s37".
  • Updated test driver so that if it's given a directory instead of an individual binary, it will flash and run all the s37 files in that directory.
  • Updated the python wheels to contain the Pigweed version of the test runner instead of the NL version.
  • Removed the NL version of the test runner.
  • Removed chip_test.gni since it is no longer used after the transition to pw unit test.
  • Removed the unused/deprecated feature of having chip_test_suite accept the variable tests, which adds both a test source and a corresponding custom test driver.

Building silabs_executable for each test source:

  • Rather than defining a silabs_executable target in src/test_driver/efr32/BUILD.gn, we set pw_unit_test_EXECUTABLE_TARGET_TYPE to "silabs_executable" and we let pw_test generate the executable target.
  • src/test_driver/efr32/BUILD.gn defines a source_set for the test driver, which is dep'd by each pw_test.
  • In addition to our matter tests, this also turns all the internal pigweed tests into silabs_executables. Since these do not define output_name, we set a default value for output_name.
  • silabs_executable.gni and flashable_executable.gni are modified to output to invoker.output_dir instead of root_out_dir so that it's possible to specify a directory besides the root. If output_dir is not defined it will default to root_out_dir.
  • Because the efr32 test binaries are now output to the "tests" sub-directory (like what's done in the main build), silabs_executable needed modification to fix some conflicts that occurred if multiple silabs_executables are built to the same directory:
  • silabs_firmware_utils.py and firmware_utils.py can't be copied via GN's copy() any more since multiple tests will need to copy these files into the same output directory ("tests"), and GN won't allow that. So the copying is now done in silabs_firmware_utils.py when make_wrapper is called during the creation of {target}.flash.py.
  • The {target}.flashbundle.txt file can no longer be generated via write_runtime_deps since the copy() target is gone (and would have the wrong output name even if it wasn't). So the creation of {target}.flashbundle.txt is now done in silabs_firmware_utils.py when make_wrapper is called during the creation of {target}.flash.py.

Changes to efr32 builder py:

  • Updated the builder script to correctly build the "unit-test" example via build_examples.py. This generates a flashbundle that includes all of the s37 and flash.py files (one for each unit test) and the two firmware utils scripts that support it.
  • Modified the builder script so that it doesn't copy the s37 and flash.py files into the artifacts directory unless the --enable-flashbundle argument is given. Previously it had been copying those files to the artifacts directory even if that argument wasn't given (the argument was not being read).

test_sources are no longer included as sources in the suite-wide common lib (except when chip_link_tests = false):

  • When chip_link_tests is true we create a pw_test target for each test source, which includes only that one test source and then deps the suite-wide common lib (which contains the common sources). Previously the common lib had also contained all of the test_sources (in addition to the common sources), but that's unnecessary.
  • The one exception is the Darwin build, which seems to require all the test_sources be included as sources in the common lib. So we add a condition that forces the inclusion when it's Darwin.

Copy link

semanticdiff-com bot commented Aug 16, 2024

Review changes with SemanticDiff.

Analyzed 6 of 17 files.

Overall, the semantic diff is 7% smaller than the GitHub diff.

Filename Status
third_party/silabs/silabs_executable.gni Unsupported file format
src/test_driver/efr32/BUILD.gn Unsupported file format
src/test_driver/efr32/README.md Unsupported file format
src/test_driver/efr32/args.gni Unsupported file format
src/test_driver/efr32/py/BUILD.gn Unsupported file format
src/test_driver/efr32/py/setup.cfg Unsupported file format
src/test_driver/efr32/py/pw_test_runner/__init__.py Unsupported file format
✔️ src/test_driver/efr32/py/pw_test_runner/pw_test_runner.py 26.84% smaller
✔️ src/test_driver/efr32/py/nl_test_runner/nl_test_runner.py Analyzed
✔️ scripts/flashing/firmware_utils.py 14.23% smaller
✔️ scripts/flashing/silabs_firmware_utils.py Analyzed
✔️ scripts/build/builders/efr32.py 13.89% smaller
✔️ scripts/build/builders/host.py Analyzed
build/toolchain/flashable_executable.gni Unsupported file format
build/chip/chip_test.gni Unsupported file format
build/chip/chip_test_suite.gni Unsupported file format
.github/.wordlist.txt Unsupported file format

@github-actions github-actions bot added the gn label Aug 16, 2024
@feasel0 feasel0 added the changing-submodules-on-purpose Marker that this PR is changing submodules (and it is not a "commit all" typo/mistake) label Aug 16, 2024
Copy link

github-actions bot commented Aug 16, 2024

PR #35028: Size comparison from e8e9fc5 to 9786dd9

Full report (74 builds for bl602, bl702, bl702l, cyw30739, esp32, linux, nrfconnect, nxp, psoc6, qpg, stm32, telink, tizen)
platform target config section e8e9fc5 9786dd9 change % change
bl602 lighting-app bl602 FLASH 1278128 1278128 0 0.0
RAM 95928 95928 0 0.0
bl602+mfd FLASH 1292238 1292238 0 0.0
RAM 96072 96072 0 0.0
bl602+rpc FLASH 1317092 1317092 0 0.0
RAM 104352 104352 0 0.0
bl702 lighting-app bl702 FLASH 943988 943988 0 0.0
RAM 15209 15209 0 0.0
bl702+mfd FLASH 946388 946388 0 0.0
RAM 15353 15353 0 0.0
bl702+rpc FLASH 1039044 1039044 0 0.0
RAM 24221 24221 0 0.0
bl706-eth FLASH 646706 646706 0 0.0
RAM 25305 25305 0 0.0
bl706-wifi FLASH 894312 894312 0 0.0
RAM 14525 14525 0 0.0
bl702l lighting-app bl702l FLASH 960392 960392 0 0.0
RAM 16868 16868 0 0.0
bl702l+mfd FLASH 963270 963270 0 0.0
RAM 17012 17012 0 0.0
cyw30739 light CYW30739B2-P5-EVK-01 unknown 2040 2040 0 0.0
FLASH 672289 672289 0 0.0
RAM 78348 78348 0 0.0
CYW30739B2-P5-EVK-02 unknown 2040 2040 0 0.0
FLASH 692149 692149 0 0.0
RAM 80980 80980 0 0.0
CYW30739B2-P5-EVK-03 unknown 2040 2040 0 0.0
FLASH 692149 692149 0 0.0
RAM 80980 80980 0 0.0
CYW930739M2EVB-02 unknown 2040 2040 0 0.0
FLASH 649077 649077 0 0.0
RAM 73416 73416 0 0.0
light-switch CYW30739B2-P5-EVK-01 unknown 2040 2040 0 0.0
FLASH 610721 610721 0 0.0
RAM 71340 71340 0 0.0
CYW30739B2-P5-EVK-02 unknown 2040 2040 0 0.0
FLASH 630349 630349 0 0.0
RAM 73892 73892 0 0.0
CYW30739B2-P5-EVK-03 unknown 2040 2040 0 0.0
FLASH 630349 630349 0 0.0
RAM 73892 73892 0 0.0
lock CYW30739B2-P5-EVK-01 unknown 2040 2040 0 0.0
FLASH 628769 628769 0 0.0
RAM 74356 74356 0 0.0
CYW30739B2-P5-EVK-02 unknown 2040 2040 0 0.0
FLASH 648477 648477 0 0.0
RAM 76908 76908 0 0.0
CYW30739B2-P5-EVK-03 unknown 2040 2040 0 0.0
FLASH 648477 648477 0 0.0
RAM 76908 76908 0 0.0
thermostat CYW30739B2-P5-EVK-01 unknown 2040 2040 0 0.0
FLASH 601717 601717 0 0.0
RAM 68388 68388 0 0.0
CYW30739B2-P5-EVK-02 unknown 2040 2040 0 0.0
FLASH 621577 621577 0 0.0
RAM 71020 71020 0 0.0
CYW30739B2-P5-EVK-03 unknown 2040 2040 0 0.0
FLASH 621577 621577 0 0.0
RAM 71020 71020 0 0.0
esp32 all-clusters-app c3devkit DRAM 94176 94176 0 0.0
FLASH 1533510 1533510 0 0.0
IRAM 82538 82538 0 0.0
m5stack DRAM 115104 115104 0 0.0
FLASH 1543238 1543238 0 0.0
IRAM 117039 117039 0 0.0
linux air-purifier-app debug unknown 4624 4624 0 0.0
FLASH 2754557 2754557 0 0.0
RAM 128408 128408 0 0.0
all-clusters-app debug unknown 5408 5408 0 0.0
FLASH 6036614 6036614 0 0.0
RAM 509704 509704 0 0.0
all-clusters-minimal-app debug unknown 5304 5304 0 0.0
FLASH 5376114 5376114 0 0.0
RAM 240072 240072 0 0.0
bridge-app debug unknown 5288 5288 0 0.0
FLASH 4728354 4728354 0 0.0
RAM 216952 216952 0 0.0
chip-tool debug unknown 5832 5832 0 0.0
FLASH 12488030 12488030 0 0.0
RAM 557202 557202 0 0.0
chip-tool-ipv6only arm64 unknown 20312 20312 0 0.0
FLASH 11163548 11163548 0 0.0
RAM 607272 607272 0 0.0
fabric-admin debug unknown 5672 5672 0 0.0
FLASH 11220897 11220897 0 0.0
RAM 555306 555306 0 0.0
fabric-bridge-app debug unknown 4520 4520 0 0.0
FLASH 4539296 4539296 0 0.0
RAM 203456 203456 0 0.0
lighting-app debug+rpc+ui unknown 5936 5936 0 0.0
FLASH 5662913 5662913 0 0.0
RAM 228008 228008 0 0.0
lock-app debug unknown 5224 5224 0 0.0
FLASH 4783920 4783920 0 0.0
RAM 203736 203736 0 0.0
ota-provider-app debug unknown 4600 4600 0 0.0
FLASH 4423174 4423174 0 0.0
RAM 197720 197720 0 0.0
ota-requestor-app debug unknown 4536 4536 0 0.0
FLASH 4561792 4561792 0 0.0
RAM 202256 202256 0 0.0
shell debug unknown 4176 4176 0 0.0
FLASH 3076093 3076093 0 0.0
RAM 159200 159200 0 0.0
thermostat-no-ble arm64 unknown 9352 9352 0 0.0
FLASH 4363444 4363444 0 0.0
RAM 242416 242416 0 0.0
tv-app debug unknown 5496 5496 0 0.0
FLASH 6006453 6006453 0 0.0
RAM 582968 582968 0 0.0
tv-casting-app debug unknown 5168 5168 0 0.0
FLASH 10691933 10691933 0 0.0
RAM 644280 644280 0 0.0
nrfconnect all-clusters-app nrf52840dk_nrf52840 FLASH 909012 909012 0 0.0
RAM 142255 142255 0 0.0
nrf7002dk_nrf5340_cpuapp FLASH 880932 880932 0 0.0
RAM 140394 140394 0 0.0
all-clusters-minimal-app nrf52840dk_nrf52840 FLASH 840848 840848 0 0.0
RAM 141074 141074 0 0.0
nxp contact k32w0+release FLASH 577372 577372 0 0.0
RAM 70468 70468 0 0.0
k32w1+release FLASH 590000 590000 0 0.0
RAM 62512 62512 0 0.0
light k32w0+release FLASH 612816 612816 0 0.0
RAM 69940 69940 0 0.0
k32w1+release FLASH 674672 674672 0 0.0
RAM 71496 71496 0 0.0
psoc6 all-clusters cy8ckit_062s2_43012 FLASH 1639108 1639108 0 0.0
RAM 210952 210952 0 0.0
all-clusters-minimal cy8ckit_062s2_43012 FLASH 1543892 1543892 0 0.0
RAM 207672 207672 0 0.0
light cy8ckit_062s2_43012 FLASH 1463796 1463796 0 0.0
RAM 200776 200776 0 0.0
lock cy8ckit_062s2_43012 FLASH 1463020 1463020 0 0.0
RAM 225112 225112 0 0.0
qpg lighting-app qpg6105+debug FLASH 655908 655908 0 0.0
RAM 105152 105152 0 0.0
lock-app qpg6105+debug FLASH 613784 613784 0 0.0
RAM 99636 99636 0 0.0
stm32 light STM32WB5MM-DK FLASH 478304 478304 0 0.0
RAM 144764 144764 0 0.0
telink air-quality-sensor-app tlsr9528a_retention FLASH 620118 620118 0 0.0
RAM 50940 50940 0 0.0
all-clusters-app tlsr9118bdk40d FLASH 680630 680630 0 0.0
RAM 149592 149592 0 0.0
all-clusters-minimal-app tlsr9528a FLASH 773898 773898 0 0.0
RAM 110752 110752 0 0.0
bridge-app tlsr9258a FLASH 678806 678806 0 0.0
RAM 91636 91636 0 0.0
contact-sensor-app tlsr9528a_retention FLASH 621714 621714 0 0.0
RAM 50980 50980 0 0.0
light-switch-app-ota-shell-factory-data tlsr9528a FLASH 707596 707596 0 0.0
RAM 74320 74320 0 0.0
lighting-app-ota-factory-data tlsr9118bdk40d FLASH 620640 620640 0 0.0
RAM 145580 145580 0 0.0
lighting-app-ota-rpc-factory-data-4mb tlsr9518adk80d FLASH 806726 806726 0 0.0
RAM 99504 99504 0 0.0
lock-app-dfu tlsr9528a FLASH 654686 654686 0 0.0
RAM 67016 67016 0 0.0
ota-requestor-app tlsr9258a FLASH 696822 696822 0 0.0
RAM 91320 91320 0 0.0
pump-app-usb tlsr9518adk80d FLASH 631102 631102 0 0.0
RAM 55760 55760 0 0.0
pump-controller-app tlsr9518adk80d FLASH 608612 608612 0 0.0
RAM 53004 53004 0 0.0
shell tlsr9518adk80d FLASH 466810 466810 0 0.0
RAM 68660 68660 0 0.0
smoke_co_alarm-app tlsr9528a_retention FLASH 628502 628502 0 0.0
RAM 52700 52700 0 0.0
temperature-measurement-app-mars-ota tlsr9518adk80d FLASH 652482 652482 0 0.0
RAM 56640 56640 0 0.0
thermostat tlsr9518adk80d FLASH 633666 633666 0 0.0
RAM 53400 53400 0 0.0
window-covering tlsr9118bdk40d FLASH 522646 522646 0 0.0
RAM 98540 98540 0 0.0
tizen all-clusters-app arm unknown 4808 4808 0 0.0
FLASH 1700832 1700832 0 0.0
RAM 89348 89348 0 0.0
chip-tool-ubsan arm unknown 10236 10236 0 0.0
FLASH 17306958 17306958 0 0.0
RAM 7560464 7560464 0 0.0

Copy link

github-actions bot commented Aug 16, 2024

PR #35028: Size comparison from e8e9fc5 to b8c957e

Full report (74 builds for bl602, bl702, bl702l, cyw30739, esp32, linux, nrfconnect, nxp, psoc6, qpg, stm32, telink, tizen)
platform target config section e8e9fc5 b8c957e change % change
bl602 lighting-app bl602 FLASH 1278128 1278128 0 0.0
RAM 95928 95928 0 0.0
bl602+mfd FLASH 1292238 1292238 0 0.0
RAM 96072 96072 0 0.0
bl602+rpc FLASH 1317092 1317092 0 0.0
RAM 104352 104352 0 0.0
bl702 lighting-app bl702 FLASH 943988 943988 0 0.0
RAM 15209 15209 0 0.0
bl702+mfd FLASH 946388 946388 0 0.0
RAM 15353 15353 0 0.0
bl702+rpc FLASH 1039044 1039044 0 0.0
RAM 24221 24221 0 0.0
bl706-eth FLASH 646706 646706 0 0.0
RAM 25305 25305 0 0.0
bl706-wifi FLASH 894312 894312 0 0.0
RAM 14525 14525 0 0.0
bl702l lighting-app bl702l FLASH 960392 960392 0 0.0
RAM 16868 16868 0 0.0
bl702l+mfd FLASH 963270 963270 0 0.0
RAM 17012 17012 0 0.0
cyw30739 light CYW30739B2-P5-EVK-01 unknown 2040 2040 0 0.0
FLASH 672289 672289 0 0.0
RAM 78348 78348 0 0.0
CYW30739B2-P5-EVK-02 unknown 2040 2040 0 0.0
FLASH 692149 692149 0 0.0
RAM 80980 80980 0 0.0
CYW30739B2-P5-EVK-03 unknown 2040 2040 0 0.0
FLASH 692149 692149 0 0.0
RAM 80980 80980 0 0.0
CYW930739M2EVB-02 unknown 2040 2040 0 0.0
FLASH 649077 649077 0 0.0
RAM 73416 73416 0 0.0
light-switch CYW30739B2-P5-EVK-01 unknown 2040 2040 0 0.0
FLASH 610721 610721 0 0.0
RAM 71340 71340 0 0.0
CYW30739B2-P5-EVK-02 unknown 2040 2040 0 0.0
FLASH 630349 630349 0 0.0
RAM 73892 73892 0 0.0
CYW30739B2-P5-EVK-03 unknown 2040 2040 0 0.0
FLASH 630349 630349 0 0.0
RAM 73892 73892 0 0.0
lock CYW30739B2-P5-EVK-01 unknown 2040 2040 0 0.0
FLASH 628769 628769 0 0.0
RAM 74356 74356 0 0.0
CYW30739B2-P5-EVK-02 unknown 2040 2040 0 0.0
FLASH 648477 648477 0 0.0
RAM 76908 76908 0 0.0
CYW30739B2-P5-EVK-03 unknown 2040 2040 0 0.0
FLASH 648477 648477 0 0.0
RAM 76908 76908 0 0.0
thermostat CYW30739B2-P5-EVK-01 unknown 2040 2040 0 0.0
FLASH 601717 601717 0 0.0
RAM 68388 68388 0 0.0
CYW30739B2-P5-EVK-02 unknown 2040 2040 0 0.0
FLASH 621577 621577 0 0.0
RAM 71020 71020 0 0.0
CYW30739B2-P5-EVK-03 unknown 2040 2040 0 0.0
FLASH 621577 621577 0 0.0
RAM 71020 71020 0 0.0
esp32 all-clusters-app c3devkit DRAM 94176 94176 0 0.0
FLASH 1533510 1533510 0 0.0
IRAM 82538 82538 0 0.0
m5stack DRAM 115104 115104 0 0.0
FLASH 1543238 1543238 0 0.0
IRAM 117039 117039 0 0.0
linux air-purifier-app debug unknown 4624 4624 0 0.0
FLASH 2754557 2754557 0 0.0
RAM 128408 128408 0 0.0
all-clusters-app debug unknown 5408 5408 0 0.0
FLASH 6036614 6036614 0 0.0
RAM 509704 509704 0 0.0
all-clusters-minimal-app debug unknown 5304 5304 0 0.0
FLASH 5376114 5376114 0 0.0
RAM 240072 240072 0 0.0
bridge-app debug unknown 5288 5288 0 0.0
FLASH 4728354 4728354 0 0.0
RAM 216952 216952 0 0.0
chip-tool debug unknown 5832 5832 0 0.0
FLASH 12488030 12488030 0 0.0
RAM 557202 557202 0 0.0
chip-tool-ipv6only arm64 unknown 20312 20312 0 0.0
FLASH 11163548 11163548 0 0.0
RAM 607272 607272 0 0.0
fabric-admin debug unknown 5672 5672 0 0.0
FLASH 11220897 11220897 0 0.0
RAM 555306 555306 0 0.0
fabric-bridge-app debug unknown 4520 4520 0 0.0
FLASH 4539296 4539296 0 0.0
RAM 203456 203456 0 0.0
lighting-app debug+rpc+ui unknown 5936 5936 0 0.0
FLASH 5662913 5662913 0 0.0
RAM 228008 228008 0 0.0
lock-app debug unknown 5224 5224 0 0.0
FLASH 4783920 4783920 0 0.0
RAM 203736 203736 0 0.0
ota-provider-app debug unknown 4600 4600 0 0.0
FLASH 4423174 4423174 0 0.0
RAM 197720 197720 0 0.0
ota-requestor-app debug unknown 4536 4536 0 0.0
FLASH 4561792 4561792 0 0.0
RAM 202256 202256 0 0.0
shell debug unknown 4176 4176 0 0.0
FLASH 3076093 3076093 0 0.0
RAM 159200 159200 0 0.0
thermostat-no-ble arm64 unknown 9352 9352 0 0.0
FLASH 4363444 4363444 0 0.0
RAM 242416 242416 0 0.0
tv-app debug unknown 5496 5496 0 0.0
FLASH 6006453 6006453 0 0.0
RAM 582968 582968 0 0.0
tv-casting-app debug unknown 5168 5168 0 0.0
FLASH 10691933 10691933 0 0.0
RAM 644280 644280 0 0.0
nrfconnect all-clusters-app nrf52840dk_nrf52840 FLASH 909012 909012 0 0.0
RAM 142255 142255 0 0.0
nrf7002dk_nrf5340_cpuapp FLASH 880932 880932 0 0.0
RAM 140394 140394 0 0.0
all-clusters-minimal-app nrf52840dk_nrf52840 FLASH 840848 840848 0 0.0
RAM 141074 141074 0 0.0
nxp contact k32w0+release FLASH 577372 577372 0 0.0
RAM 70468 70468 0 0.0
k32w1+release FLASH 590000 590000 0 0.0
RAM 62512 62512 0 0.0
light k32w0+release FLASH 612816 612816 0 0.0
RAM 69940 69940 0 0.0
k32w1+release FLASH 674672 674672 0 0.0
RAM 71496 71496 0 0.0
psoc6 all-clusters cy8ckit_062s2_43012 FLASH 1639108 1639108 0 0.0
RAM 210952 210952 0 0.0
all-clusters-minimal cy8ckit_062s2_43012 FLASH 1543892 1543892 0 0.0
RAM 207672 207672 0 0.0
light cy8ckit_062s2_43012 FLASH 1463796 1463796 0 0.0
RAM 200776 200776 0 0.0
lock cy8ckit_062s2_43012 FLASH 1463020 1463020 0 0.0
RAM 225112 225112 0 0.0
qpg lighting-app qpg6105+debug FLASH 655908 655908 0 0.0
RAM 105152 105152 0 0.0
lock-app qpg6105+debug FLASH 613784 613784 0 0.0
RAM 99636 99636 0 0.0
stm32 light STM32WB5MM-DK FLASH 478304 478304 0 0.0
RAM 144764 144764 0 0.0
telink air-quality-sensor-app tlsr9528a_retention FLASH 620118 620118 0 0.0
RAM 50940 50940 0 0.0
all-clusters-app tlsr9118bdk40d FLASH 680630 680630 0 0.0
RAM 149592 149592 0 0.0
all-clusters-minimal-app tlsr9528a FLASH 773898 773898 0 0.0
RAM 110752 110752 0 0.0
bridge-app tlsr9258a FLASH 678806 678806 0 0.0
RAM 91636 91636 0 0.0
contact-sensor-app tlsr9528a_retention FLASH 621714 621714 0 0.0
RAM 50980 50980 0 0.0
light-switch-app-ota-shell-factory-data tlsr9528a FLASH 707596 707596 0 0.0
RAM 74320 74320 0 0.0
lighting-app-ota-factory-data tlsr9118bdk40d FLASH 620640 620640 0 0.0
RAM 145580 145580 0 0.0
lighting-app-ota-rpc-factory-data-4mb tlsr9518adk80d FLASH 806726 806726 0 0.0
RAM 99504 99504 0 0.0
lock-app-dfu tlsr9528a FLASH 654686 654686 0 0.0
RAM 67016 67016 0 0.0
ota-requestor-app tlsr9258a FLASH 696822 696822 0 0.0
RAM 91320 91320 0 0.0
pump-app-usb tlsr9518adk80d FLASH 631102 631102 0 0.0
RAM 55760 55760 0 0.0
pump-controller-app tlsr9518adk80d FLASH 608612 608612 0 0.0
RAM 53004 53004 0 0.0
shell tlsr9518adk80d FLASH 466810 466810 0 0.0
RAM 68660 68660 0 0.0
smoke_co_alarm-app tlsr9528a_retention FLASH 628502 628502 0 0.0
RAM 52700 52700 0 0.0
temperature-measurement-app-mars-ota tlsr9518adk80d FLASH 652482 652482 0 0.0
RAM 56640 56640 0 0.0
thermostat tlsr9518adk80d FLASH 633666 633666 0 0.0
RAM 53400 53400 0 0.0
window-covering tlsr9118bdk40d FLASH 522646 522646 0 0.0
RAM 98540 98540 0 0.0
tizen all-clusters-app arm unknown 4808 4808 0 0.0
FLASH 1700832 1700832 0 0.0
RAM 89348 89348 0 0.0
chip-tool-ubsan arm unknown 10236 10236 0 0.0
FLASH 17306958 17306958 0 0.0
RAM 7560464 7560464 0 0.0

Copy link

github-actions bot commented Aug 16, 2024

PR #35028: Size comparison from e8e9fc5 to 25d11ca

Full report (72 builds for bl602, bl702, bl702l, cyw30739, linux, nrfconnect, nxp, psoc6, qpg, stm32, telink, tizen)
platform target config section e8e9fc5 25d11ca change % change
bl602 lighting-app bl602 FLASH 1278128 1278128 0 0.0
RAM 95928 95928 0 0.0
bl602+mfd FLASH 1292238 1292238 0 0.0
RAM 96072 96072 0 0.0
bl602+rpc FLASH 1317092 1317092 0 0.0
RAM 104352 104352 0 0.0
bl702 lighting-app bl702 FLASH 943988 943988 0 0.0
RAM 15209 15209 0 0.0
bl702+mfd FLASH 946388 946388 0 0.0
RAM 15353 15353 0 0.0
bl702+rpc FLASH 1039044 1039044 0 0.0
RAM 24221 24221 0 0.0
bl706-eth FLASH 646706 646706 0 0.0
RAM 25305 25305 0 0.0
bl706-wifi FLASH 894312 894312 0 0.0
RAM 14525 14525 0 0.0
bl702l lighting-app bl702l FLASH 960392 960392 0 0.0
RAM 16868 16868 0 0.0
bl702l+mfd FLASH 963270 963270 0 0.0
RAM 17012 17012 0 0.0
cyw30739 light CYW30739B2-P5-EVK-01 unknown 2040 2040 0 0.0
FLASH 672289 672289 0 0.0
RAM 78348 78348 0 0.0
CYW30739B2-P5-EVK-02 unknown 2040 2040 0 0.0
FLASH 692149 692149 0 0.0
RAM 80980 80980 0 0.0
CYW30739B2-P5-EVK-03 unknown 2040 2040 0 0.0
FLASH 692149 692149 0 0.0
RAM 80980 80980 0 0.0
CYW930739M2EVB-02 unknown 2040 2040 0 0.0
FLASH 649077 649077 0 0.0
RAM 73416 73416 0 0.0
light-switch CYW30739B2-P5-EVK-01 unknown 2040 2040 0 0.0
FLASH 610721 610721 0 0.0
RAM 71340 71340 0 0.0
CYW30739B2-P5-EVK-02 unknown 2040 2040 0 0.0
FLASH 630349 630349 0 0.0
RAM 73892 73892 0 0.0
CYW30739B2-P5-EVK-03 unknown 2040 2040 0 0.0
FLASH 630349 630349 0 0.0
RAM 73892 73892 0 0.0
lock CYW30739B2-P5-EVK-01 unknown 2040 2040 0 0.0
FLASH 628769 628769 0 0.0
RAM 74356 74356 0 0.0
CYW30739B2-P5-EVK-02 unknown 2040 2040 0 0.0
FLASH 648477 648477 0 0.0
RAM 76908 76908 0 0.0
CYW30739B2-P5-EVK-03 unknown 2040 2040 0 0.0
FLASH 648477 648477 0 0.0
RAM 76908 76908 0 0.0
thermostat CYW30739B2-P5-EVK-01 unknown 2040 2040 0 0.0
FLASH 601717 601717 0 0.0
RAM 68388 68388 0 0.0
CYW30739B2-P5-EVK-02 unknown 2040 2040 0 0.0
FLASH 621577 621577 0 0.0
RAM 71020 71020 0 0.0
CYW30739B2-P5-EVK-03 unknown 2040 2040 0 0.0
FLASH 621577 621577 0 0.0
RAM 71020 71020 0 0.0
linux air-purifier-app debug unknown 4624 4624 0 0.0
FLASH 2754557 2754557 0 0.0
RAM 128408 128408 0 0.0
all-clusters-app debug unknown 5408 5408 0 0.0
FLASH 6036614 6036614 0 0.0
RAM 509704 509704 0 0.0
all-clusters-minimal-app debug unknown 5304 5304 0 0.0
FLASH 5376114 5376114 0 0.0
RAM 240072 240072 0 0.0
bridge-app debug unknown 5288 5288 0 0.0
FLASH 4728354 4728354 0 0.0
RAM 216952 216952 0 0.0
chip-tool debug unknown 5832 5832 0 0.0
FLASH 12488030 12488030 0 0.0
RAM 557202 557202 0 0.0
chip-tool-ipv6only arm64 unknown 20312 20312 0 0.0
FLASH 11163548 11163548 0 0.0
RAM 607272 607272 0 0.0
fabric-admin debug unknown 5672 5672 0 0.0
FLASH 11220897 11220897 0 0.0
RAM 555306 555306 0 0.0
fabric-bridge-app debug unknown 4520 4520 0 0.0
FLASH 4539296 4539296 0 0.0
RAM 203456 203456 0 0.0
lighting-app debug+rpc+ui unknown 5936 5936 0 0.0
FLASH 5662913 5662913 0 0.0
RAM 228008 228008 0 0.0
lock-app debug unknown 5224 5224 0 0.0
FLASH 4783920 4783920 0 0.0
RAM 203736 203736 0 0.0
ota-provider-app debug unknown 4600 4600 0 0.0
FLASH 4423174 4423174 0 0.0
RAM 197720 197720 0 0.0
ota-requestor-app debug unknown 4536 4536 0 0.0
FLASH 4561792 4561792 0 0.0
RAM 202256 202256 0 0.0
shell debug unknown 4176 4176 0 0.0
FLASH 3076093 3076093 0 0.0
RAM 159200 159200 0 0.0
thermostat-no-ble arm64 unknown 9352 9352 0 0.0
FLASH 4363444 4363444 0 0.0
RAM 242416 242416 0 0.0
tv-app debug unknown 5496 5496 0 0.0
FLASH 6006453 6006453 0 0.0
RAM 582968 582968 0 0.0
tv-casting-app debug unknown 5168 5168 0 0.0
FLASH 10691933 10691933 0 0.0
RAM 644280 644280 0 0.0
nrfconnect all-clusters-app nrf52840dk_nrf52840 FLASH 909012 909012 0 0.0
RAM 142255 142255 0 0.0
nrf7002dk_nrf5340_cpuapp FLASH 880932 880932 0 0.0
RAM 140394 140394 0 0.0
all-clusters-minimal-app nrf52840dk_nrf52840 FLASH 840848 840848 0 0.0
RAM 141074 141074 0 0.0
nxp contact k32w0+release FLASH 577372 577372 0 0.0
RAM 70468 70468 0 0.0
k32w1+release FLASH 590000 590000 0 0.0
RAM 62512 62512 0 0.0
light k32w0+release FLASH 612816 612816 0 0.0
RAM 69940 69940 0 0.0
k32w1+release FLASH 674672 674672 0 0.0
RAM 71496 71496 0 0.0
psoc6 all-clusters cy8ckit_062s2_43012 FLASH 1639108 1639108 0 0.0
RAM 210952 210952 0 0.0
all-clusters-minimal cy8ckit_062s2_43012 FLASH 1543892 1543892 0 0.0
RAM 207672 207672 0 0.0
light cy8ckit_062s2_43012 FLASH 1463796 1463796 0 0.0
RAM 200776 200776 0 0.0
lock cy8ckit_062s2_43012 FLASH 1463020 1463020 0 0.0
RAM 225112 225112 0 0.0
qpg lighting-app qpg6105+debug FLASH 655908 655908 0 0.0
RAM 105152 105152 0 0.0
lock-app qpg6105+debug FLASH 613784 613784 0 0.0
RAM 99636 99636 0 0.0
stm32 light STM32WB5MM-DK FLASH 478304 478304 0 0.0
RAM 144764 144764 0 0.0
telink air-quality-sensor-app tlsr9528a_retention FLASH 620118 620118 0 0.0
RAM 50940 50940 0 0.0
all-clusters-app tlsr9118bdk40d FLASH 680630 680630 0 0.0
RAM 149592 149592 0 0.0
all-clusters-minimal-app tlsr9528a FLASH 773898 773898 0 0.0
RAM 110752 110752 0 0.0
bridge-app tlsr9258a FLASH 678806 678806 0 0.0
RAM 91636 91636 0 0.0
contact-sensor-app tlsr9528a_retention FLASH 621714 621714 0 0.0
RAM 50980 50980 0 0.0
light-switch-app-ota-shell-factory-data tlsr9528a FLASH 707596 707596 0 0.0
RAM 74320 74320 0 0.0
lighting-app-ota-factory-data tlsr9118bdk40d FLASH 620640 620640 0 0.0
RAM 145580 145580 0 0.0
lighting-app-ota-rpc-factory-data-4mb tlsr9518adk80d FLASH 806726 806726 0 0.0
RAM 99504 99504 0 0.0
lock-app-dfu tlsr9528a FLASH 654686 654686 0 0.0
RAM 67016 67016 0 0.0
ota-requestor-app tlsr9258a FLASH 696822 696822 0 0.0
RAM 91320 91320 0 0.0
pump-app-usb tlsr9518adk80d FLASH 631102 631102 0 0.0
RAM 55760 55760 0 0.0
pump-controller-app tlsr9518adk80d FLASH 608612 608612 0 0.0
RAM 53004 53004 0 0.0
shell tlsr9518adk80d FLASH 466810 466810 0 0.0
RAM 68660 68660 0 0.0
smoke_co_alarm-app tlsr9528a_retention FLASH 628502 628502 0 0.0
RAM 52700 52700 0 0.0
temperature-measurement-app-mars-ota tlsr9518adk80d FLASH 652482 652482 0 0.0
RAM 56640 56640 0 0.0
thermostat tlsr9518adk80d FLASH 633666 633666 0 0.0
RAM 53400 53400 0 0.0
window-covering tlsr9118bdk40d FLASH 522646 522646 0 0.0
RAM 98540 98540 0 0.0
tizen all-clusters-app arm unknown 4808 4808 0 0.0
FLASH 1700832 1700832 0 0.0
RAM 89348 89348 0 0.0
chip-tool-ubsan arm unknown 10236 10236 0 0.0
FLASH 17306958 17306958 0 0.0
RAM 7560464 7560464 0 0.0

Copy link

github-actions bot commented Aug 16, 2024

PR #35028: Size comparison from e8e9fc5 to 2eea9ce

Full report (74 builds for bl602, bl702, bl702l, cyw30739, esp32, linux, nrfconnect, nxp, psoc6, qpg, stm32, telink, tizen)
platform target config section e8e9fc5 2eea9ce change % change
bl602 lighting-app bl602 FLASH 1278128 1278128 0 0.0
RAM 95928 95928 0 0.0
bl602+mfd FLASH 1292238 1292238 0 0.0
RAM 96072 96072 0 0.0
bl602+rpc FLASH 1317092 1317092 0 0.0
RAM 104352 104352 0 0.0
bl702 lighting-app bl702 FLASH 943988 943988 0 0.0
RAM 15209 15209 0 0.0
bl702+mfd FLASH 946388 946388 0 0.0
RAM 15353 15353 0 0.0
bl702+rpc FLASH 1039044 1039044 0 0.0
RAM 24221 24221 0 0.0
bl706-eth FLASH 646706 646706 0 0.0
RAM 25305 25305 0 0.0
bl706-wifi FLASH 894312 894312 0 0.0
RAM 14525 14525 0 0.0
bl702l lighting-app bl702l FLASH 960392 960392 0 0.0
RAM 16868 16868 0 0.0
bl702l+mfd FLASH 963270 963270 0 0.0
RAM 17012 17012 0 0.0
cyw30739 light CYW30739B2-P5-EVK-01 unknown 2040 2040 0 0.0
FLASH 672289 672289 0 0.0
RAM 78348 78348 0 0.0
CYW30739B2-P5-EVK-02 unknown 2040 2040 0 0.0
FLASH 692149 692149 0 0.0
RAM 80980 80980 0 0.0
CYW30739B2-P5-EVK-03 unknown 2040 2040 0 0.0
FLASH 692149 692149 0 0.0
RAM 80980 80980 0 0.0
CYW930739M2EVB-02 unknown 2040 2040 0 0.0
FLASH 649077 649077 0 0.0
RAM 73416 73416 0 0.0
light-switch CYW30739B2-P5-EVK-01 unknown 2040 2040 0 0.0
FLASH 610721 610721 0 0.0
RAM 71340 71340 0 0.0
CYW30739B2-P5-EVK-02 unknown 2040 2040 0 0.0
FLASH 630349 630349 0 0.0
RAM 73892 73892 0 0.0
CYW30739B2-P5-EVK-03 unknown 2040 2040 0 0.0
FLASH 630349 630349 0 0.0
RAM 73892 73892 0 0.0
lock CYW30739B2-P5-EVK-01 unknown 2040 2040 0 0.0
FLASH 628769 628769 0 0.0
RAM 74356 74356 0 0.0
CYW30739B2-P5-EVK-02 unknown 2040 2040 0 0.0
FLASH 648477 648477 0 0.0
RAM 76908 76908 0 0.0
CYW30739B2-P5-EVK-03 unknown 2040 2040 0 0.0
FLASH 648477 648477 0 0.0
RAM 76908 76908 0 0.0
thermostat CYW30739B2-P5-EVK-01 unknown 2040 2040 0 0.0
FLASH 601717 601717 0 0.0
RAM 68388 68388 0 0.0
CYW30739B2-P5-EVK-02 unknown 2040 2040 0 0.0
FLASH 621577 621577 0 0.0
RAM 71020 71020 0 0.0
CYW30739B2-P5-EVK-03 unknown 2040 2040 0 0.0
FLASH 621577 621577 0 0.0
RAM 71020 71020 0 0.0
esp32 all-clusters-app c3devkit DRAM 94176 94176 0 0.0
FLASH 1533510 1533510 0 0.0
IRAM 82538 82538 0 0.0
m5stack DRAM 115104 115104 0 0.0
FLASH 1543238 1543238 0 0.0
IRAM 117039 117039 0 0.0
linux air-purifier-app debug unknown 4624 4624 0 0.0
FLASH 2754557 2754557 0 0.0
RAM 128408 128408 0 0.0
all-clusters-app debug unknown 5408 5408 0 0.0
FLASH 6036614 6036614 0 0.0
RAM 509704 509704 0 0.0
all-clusters-minimal-app debug unknown 5304 5304 0 0.0
FLASH 5376114 5376114 0 0.0
RAM 240072 240072 0 0.0
bridge-app debug unknown 5288 5288 0 0.0
FLASH 4728354 4728354 0 0.0
RAM 216952 216952 0 0.0
chip-tool debug unknown 5832 5832 0 0.0
FLASH 12488030 12488030 0 0.0
RAM 557202 557202 0 0.0
chip-tool-ipv6only arm64 unknown 20312 20312 0 0.0
FLASH 11163548 11163548 0 0.0
RAM 607272 607272 0 0.0
fabric-admin debug unknown 5672 5672 0 0.0
FLASH 11220897 11220897 0 0.0
RAM 555306 555306 0 0.0
fabric-bridge-app debug unknown 4520 4520 0 0.0
FLASH 4539296 4539296 0 0.0
RAM 203456 203456 0 0.0
lighting-app debug+rpc+ui unknown 5936 5936 0 0.0
FLASH 5662913 5662913 0 0.0
RAM 228008 228008 0 0.0
lock-app debug unknown 5224 5224 0 0.0
FLASH 4783920 4783920 0 0.0
RAM 203736 203736 0 0.0
ota-provider-app debug unknown 4600 4600 0 0.0
FLASH 4423174 4423174 0 0.0
RAM 197720 197720 0 0.0
ota-requestor-app debug unknown 4536 4536 0 0.0
FLASH 4561792 4561792 0 0.0
RAM 202256 202256 0 0.0
shell debug unknown 4176 4176 0 0.0
FLASH 3076093 3076093 0 0.0
RAM 159200 159200 0 0.0
thermostat-no-ble arm64 unknown 9352 9352 0 0.0
FLASH 4363444 4363444 0 0.0
RAM 242416 242416 0 0.0
tv-app debug unknown 5496 5496 0 0.0
FLASH 6006453 6006453 0 0.0
RAM 582968 582968 0 0.0
tv-casting-app debug unknown 5168 5168 0 0.0
FLASH 10691933 10691933 0 0.0
RAM 644280 644280 0 0.0
nrfconnect all-clusters-app nrf52840dk_nrf52840 FLASH 909012 909012 0 0.0
RAM 142255 142255 0 0.0
nrf7002dk_nrf5340_cpuapp FLASH 880932 880932 0 0.0
RAM 140394 140394 0 0.0
all-clusters-minimal-app nrf52840dk_nrf52840 FLASH 840848 840848 0 0.0
RAM 141074 141074 0 0.0
nxp contact k32w0+release FLASH 577372 577372 0 0.0
RAM 70468 70468 0 0.0
k32w1+release FLASH 590000 590000 0 0.0
RAM 62512 62512 0 0.0
light k32w0+release FLASH 612816 612816 0 0.0
RAM 69940 69940 0 0.0
k32w1+release FLASH 674672 674672 0 0.0
RAM 71496 71496 0 0.0
psoc6 all-clusters cy8ckit_062s2_43012 FLASH 1639108 1639108 0 0.0
RAM 210952 210952 0 0.0
all-clusters-minimal cy8ckit_062s2_43012 FLASH 1543892 1543892 0 0.0
RAM 207672 207672 0 0.0
light cy8ckit_062s2_43012 FLASH 1463796 1463796 0 0.0
RAM 200776 200776 0 0.0
lock cy8ckit_062s2_43012 FLASH 1463020 1463020 0 0.0
RAM 225112 225112 0 0.0
qpg lighting-app qpg6105+debug FLASH 655908 655908 0 0.0
RAM 105152 105152 0 0.0
lock-app qpg6105+debug FLASH 613784 613784 0 0.0
RAM 99636 99636 0 0.0
stm32 light STM32WB5MM-DK FLASH 478304 478304 0 0.0
RAM 144764 144764 0 0.0
telink air-quality-sensor-app tlsr9528a_retention FLASH 620118 620118 0 0.0
RAM 50940 50940 0 0.0
all-clusters-app tlsr9118bdk40d FLASH 680630 680630 0 0.0
RAM 149592 149592 0 0.0
all-clusters-minimal-app tlsr9528a FLASH 773898 773898 0 0.0
RAM 110752 110752 0 0.0
bridge-app tlsr9258a FLASH 678806 678806 0 0.0
RAM 91636 91636 0 0.0
contact-sensor-app tlsr9528a_retention FLASH 621714 621714 0 0.0
RAM 50980 50980 0 0.0
light-switch-app-ota-shell-factory-data tlsr9528a FLASH 707596 707596 0 0.0
RAM 74320 74320 0 0.0
lighting-app-ota-factory-data tlsr9118bdk40d FLASH 620640 620640 0 0.0
RAM 145580 145580 0 0.0
lighting-app-ota-rpc-factory-data-4mb tlsr9518adk80d FLASH 806726 806726 0 0.0
RAM 99504 99504 0 0.0
lock-app-dfu tlsr9528a FLASH 654686 654686 0 0.0
RAM 67016 67016 0 0.0
ota-requestor-app tlsr9258a FLASH 696822 696822 0 0.0
RAM 91320 91320 0 0.0
pump-app-usb tlsr9518adk80d FLASH 631102 631102 0 0.0
RAM 55760 55760 0 0.0
pump-controller-app tlsr9518adk80d FLASH 608612 608612 0 0.0
RAM 53004 53004 0 0.0
shell tlsr9518adk80d FLASH 466810 466810 0 0.0
RAM 68660 68660 0 0.0
smoke_co_alarm-app tlsr9528a_retention FLASH 628502 628502 0 0.0
RAM 52700 52700 0 0.0
temperature-measurement-app-mars-ota tlsr9518adk80d FLASH 652482 652482 0 0.0
RAM 56640 56640 0 0.0
thermostat tlsr9518adk80d FLASH 633666 633666 0 0.0
RAM 53400 53400 0 0.0
window-covering tlsr9118bdk40d FLASH 522646 522646 0 0.0
RAM 98540 98540 0 0.0
tizen all-clusters-app arm unknown 4808 4808 0 0.0
FLASH 1700832 1700832 0 0.0
RAM 89348 89348 0 0.0
chip-tool-ubsan arm unknown 10236 10236 0 0.0
FLASH 17306958 17306958 0 0.0
RAM 7560464 7560464 0 0.0

@feasel0 feasel0 marked this pull request as ready for review August 20, 2024 13:58
@mergify mergify bot merged commit 6144736 into project-chip:master Sep 4, 2024
70 checks passed
shgutte pushed a commit to shgutte/connectedhomeip that referenced this pull request Sep 10, 2024
…ip#35028)

* silabs full changes, flashable just if

* silabs full changes, flashable just if (corrected)

* silabs changes, flashable changes

* yes executables.gni, cts.gni, args.gni, test_driver build.gn

* yes executables.gni, args.gni, test_driver build.gn

* Modified chip_test_suite to handle logic for both efr32 test_driver and chip_link_test

* Doc update

* Added final newline

* Comment updates

* Remove deprecated `tests` variable for per-test custom mains.

* switched to shutil.copy instead of subprocess copy

* Added chip_link_tests to test_driver/efr32/args.gni and removed special logic from chip_test_suite

* Restyled by gn

* Restyled by autopep8

* Punctuation change

* Added special exception for darwin to always include test_sources in common lib.

* Added comment re darwin exception

* Restyled by gn

* Revisions to builder scripts - removing map() usage and propagating OSError to make_wrapper.

* Restyled by autopep8

---------

Co-authored-by: Restyled.io <commits@restyled.io>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
changing-submodules-on-purpose Marker that this PR is changing submodules (and it is not a "commit all" typo/mistake) github gn review - approved scripts test driver
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants