Matter installation is failed when ./install.sh is ran (This has been working two weeks back)

[aggaddam]

Describe the bug
We have been esp-matter SDK commit "6aa7601258b10eaa0cb3845c39f41109ac0bfbaf" for a while in our products, but recently we are facing an issue when we run the ./install.sh command in esp-matter

Environment

• ESP-Matter Commit Id: 6aa7601 (main)
• ESP-IDF Commit Id: 697e3e8eace4a7d71bdffb2f53b49a0cacdaee9b (release/v5.1)
• SoC (eg: ESP32 or ESP32-C3): ESP32 and ESP32C3
• Device Logs (Please attach the log file):
• Host Machine OS:
  Distributor ID: Ubuntu
  Description: Ubuntu 22.04.4 LTS
  Release: 22.04
  Codename: jammy
• Commissioner app and versions if present: NA
• Commissioner's logs if present: NA

Any additional details
...
matter_install_fail.log

[lboue]

It's related to protobuf:

ERROR: Cannot install -r python/gen/matter_build_venv/generated_requirements.txt (line 83), protobuf and protobuf~=3.20.1 because these package versions have conflicting dependencies.

@aggaddam What do you have in python/gen/matter_build_venv/generated_requirements.txt file?

pip._vendor.resolvelib.resolvers.ResolutionImpossible: [RequirementInformation(requirement=SpecifierRequirement('protobuf'), parent=None), RequirementInformation(requirement=SpecifierRequirement('protobuf~=3.20.1'), parent=None), RequirementInformation(requirement=SpecifierRequirement('protobuf!=3.20.0,!=3.20.1,!=4.21.1,!=4.21.2,!=4.21.3,!=4.21.4,!=4.21.5,<5.0.0.dev0,>=3.19.5'), parent=LinkCandidate('https://files.pythonhosted.org/packages/dc/a6/12a0c976140511d8bc8a16ad15793b2aef29ac927baa0786ccb7ddbb6e1c/googleapis_common_protos-1.63.0-py2.py3-none-any.whl (from https://pypi.org/simple/googleapis-common-protos/) (requires-python:>=3.7)')), RequirementInformation(requirement=SpecifierRequirement('protobuf'), parent=None), RequirementInformation(requirement=SpecifierRequirement('protobuf~=3.20.1'), parent=None), RequirementInformation(requirement=SpecifierRequirement('protobuf!=3.20.0,!=3.20.1,!=4.21.1,!=4.21.2,!=4.21.3,!=4.21.4,!=4.21.5,<5.0.0.dev0,>=3.19.5'), parent=LinkCandidate('https://files.pythonhosted.org/packages/f0/43/c9d8f75ddf08e2a0a27db243c13a700c3cc7ec615b545b697cf6f715ad92/googleapis_common_protos-1.62.0-py2.py3-none-any.whl (from https://pypi.org/simple/googleapis-common-protos/) (requires-python:>=3.7)')), RequirementInformation(requirement=SpecifierRequirement('protobuf'), parent=None), RequirementInformation(requirement=SpecifierRequirement('protobuf~=3.20.1'), parent=None), RequirementInformation(requirement=SpecifierRequirement('protobuf!=3.20.0,!=3.20.1,!=4.21.1,!=4.21.2,!=4.21.3,!=4.21.4,!=4.21.5,<5.0.0.dev0,>=3.19.5'), parent=LinkCandidate('https://files.pythonhosted.org/packages/21/49/12996dc0238e017504dceea1d121a48bd49fb3f4416f40d59fc3e924b4f3/googleapis_common_protos-1.61.0-py2.py3-none-any.whl (from https://pypi.org/simple/googleapis-common-protos/) (requires-python:>=3.7)')), RequirementInformation(requirement=SpecifierRequirement('protobuf'), parent=None), RequirementInformation(requirement=SpecifierRequirement('protobuf~=3.20.1'), parent=None), RequirementInformation(requirement=SpecifierRequirement('protobuf!=3.20.0,!=3.20.1,!=4.21.1,!=4.21.2,!=4.21.3,!=4.21.4,!=4.21.5,<5.0.0.dev0,>=3.19.5'), parent=LinkCandidate('https://files.pythonhosted.org/packages/a7/bc/416a1ffeba4dcd072bc10523dac9ed97f2e7fc4b760580e2bdbdc1e2afdd/googleapis_common_protos-1.60.0-py2.py3-none-any.whl (from https://pypi.org/simple/googleapis-common-protos/) (requires-python:>=3.7)')), RequirementInformation(requirement=SpecifierRequirement('protobuf'), parent=None), RequirementInformation(requirement=SpecifierRequirement('protobuf~=3.20.1'), parent=None), RequirementInformation(requirement=SpecifierRequirement('protobuf!=3.20.0,!=3.20.1,!=4.21.1,!=4.21.2,!=4.21.3,!=4.21.4,!=4.21.5,<5.0.0.dev0,>=3.19.5'), parent=LinkCandidate('https://files.pythonhosted.org/packages/b3/b7/bbaa556e9ff0580f408c64ccf4db0c1414eec79e7151d33a10bc209ffb6d/googleapis_common_protos-1.59.1-py2.py3-none-any.whl (from https://pypi.org/simple/googleapis-common-protos/) (requires-python:>=3.7)')), RequirementInformation(requirement=SpecifierRequirement('protobuf'), parent=None), RequirementInformation(requirement=SpecifierRequirement('protobuf~=3.20.1'), parent=None), RequirementInformation(requirement=SpecifierRequirement('protobuf!=3.20.0,!=3.20.1,!=4.21.1,!=4.21.2,!=4.21.3,!=4.21.4,!=4.21.5,<5.0.0dev,>=3.19.5'), parent=LinkCandidate('https://files.pythonhosted.org/packages/a7/8d/7ccf8f63ab0a768e13720262374c0d6a1489f7f23f1b89a16c92af452f09/googleapis_common_protos-1.59.0-py2.py3-none-any.whl (from https://pypi.org/simple/googleapis-common-protos/) (requires-python:>=3.7)')), RequirementInformation(requirement=SpecifierRequirement('protobuf'), parent=None), RequirementInformation(requirement=SpecifierRequirement('protobuf~=3.20.1'), parent=None), RequirementInformation(requirement=SpecifierRequirement('protobuf!=3.20.0,!=3.20.1,!=4.21.1,!=4.21.2,!=4.21.3,!=4.21.4,!=4.21.5,<5.0.0dev,>=3.19.5'), parent=LinkCandidate('https://files.pythonhosted.org/packages/32/4e/ed585842aaa704d87495a0e99317aaa44c5007a597c05b995fa8cfc4dfbe/googleapis_common_protos-1.58.0-py2.py3-none-any.whl (from https://pypi.org/simple/googleapis-common-protos/) (requires-python:>=3.7)')), RequirementInformation(requirement=SpecifierRequirement('protobuf'), parent=None), RequirementInformation(requirement=SpecifierRequirement('protobuf~=3.20.1'), parent=None), RequirementInformation(requirement=SpecifierRequirement('protobuf!=3.20.0,!=3.20.1,!=4.21.1,!=4.21.2,!=4.21.3,!=4.21.4,!=4.21.5,<5.0.0dev,>=3.19.5'), parent=LinkCandidate('https://files.pythonhosted.org/packages/76/b9/fc6a31a90e3c78cea00d209d48f1e5c6c9edc6b14f3039470c3f7fae60a1/googleapis_common_protos-1.57.1-py2.py3-none-any.whl (from https://pypi.org/simple/googleapis-common-protos/) (requires-python:>=3.7)')), RequirementInformation(requirement=SpecifierRequirement('protobuf'), parent=None), RequirementInformation(requirement=SpecifierRequirement('protobuf~=3.20.1'), parent=None), RequirementInformation(requirement=SpecifierRequirement('protobuf!=3.20.0,!=3.20.1,!=4.21.1,!=4.21.2,!=4.21.3,!=4.21.4,!=4.21.5,<5.0.0dev,>=3.19.5'), parent=LinkCandidate('https://files.pythonhosted.org/packages/f0/2a/25d8c1ceedc5af97de37434c9c5e38ce28aaa45960aa2bd7aa215fc420c0/googleapis_common_protos-1.57.0-py2.py3-none-any.whl (from https://pypi.org/simple/googleapis-common-protos/) (requires-python:>=3.7)'))]

[aggaddam]

@lboue We have been using this commit ID for the last 4 months. We have been facing installation issue since last two weeks. Have any dependency packages been updated?

[aggaddam]

protobuf

[lboue]

protobuf/3.20.1 is an old version released in Mar 25, 2022. Maybe it should be upgraded to a newer.

[aggaddam]

protobuf/3.20.1 is an old version released in Mar 25, 2022. Maybe it should be upgraded to a newer.

Any recommendation on updating protobuff ? Do we need to change the constraint.txt file with updated version ?

[lboue]

It seems also related to googleapis-common-protos dependencies:
protobuf!=3.20.0,!=3.20.1,!=4.21.1,!=4.21.2,!=4.21.3,!=4.21.4,!=4.21.5,<5.0.0.dev0,>=3.19.5'

pip._vendor.resolvelib.resolvers.ResolutionImpossible: [RequirementInformation(requirement=SpecifierRequirement('protobuf'), parent=None), 
RequirementInformation(requirement=SpecifierRequirement('protobuf~=3.20.1'), parent=None), 
RequirementInformation(requirement=SpecifierRequirement('protobuf!=3.20.0,!=3.20.1,!=4.21.1,!=4.21.2,!=4.21.3,!=4.21.4,!=4.21.5,<5.0.0.dev0,>=3.19.5'), parent=LinkCandidate('https://files.pythonhosted.org/packages/dc/a6/12a0c976140511d8bc8a16ad15793b2aef29ac927baa0786ccb7ddbb6e1c/googleapis_common_protos-1.63.0-py2.py3-none-any.whl (from https://pypi.org/simple/googleapis-common-protos/) (requires-python:>=3.7)')), 
RequirementInformation(requirement=SpecifierRequirement('protobuf'), parent=None), 
RequirementInformation(requirement=SpecifierRequirement('protobuf~=3.20.1'), parent=None), 
RequirementInformation(requirement=SpecifierRequirement('protobuf!=3.20.0,!=3.20.1,!=4.21.1,!=4.21.2,!=4.21.3,!=4.21.4,!=4.21.5,<5.0.0.dev0,>=3.19.5'), parent=LinkCandidate('https://files.pythonhosted.org/packages/f0/43/c9d8f75ddf08e2a0a27db243c13a700c3cc7ec615b545b697cf6f715ad92/googleapis_common_protos-1.62.0-py2.py3-none-any.whl (from https://pypi.org/simple/googleapis-common-protos/) (requires-python:>=3.7)')), 

[lboue]

protobuf/3.20.1 is an old version released in Mar 25, 2022. Maybe it should be upgraded to a newer.

Any recommendation on updating protobuff ? Do we need to change the constraint.txt file with updated version ?

You can try it while waiting for an official answer from Espressif.

[aggaddam]

@lboue A Similar issue is logged in the connectedhomeip repo
project-chip/connectedhomeip#32533

[aggaddam]

EspressIf team, Any update on this issue ?

[shubhamdp]

Some python dependencies broke this setup. Can you try bumping the few python module versions and give it a try?

cd connectedhomeip/connectedhomeip
git apply | curl https://github.com/shubhamdp/connectedhomeip/commit/b636dc0d0f7d20e249e8b5a400fdfa668254d2a9.diff

NOTE: This patch was curated on esp-matter commit 6aa7601 and may not work as is on others, so please check the diff and make changes accordingly for other revision.

[shubhamdp]

@aggaddam if this is not an issue anymore and can be solved by above comment, can you close it.

[dhrishi]

Closing this now

[aggaddam]

@aggaddam if this is not an issue anymore and can be solved by above comment, can you close it.

@shubhamdp I am still facing the issue even after applying this patch

cd connectedhomeip/connectedhomeip
git apply | curl https://github.com/shubhamdp/connectedhomeip/commit/b636dc0d0f7d20e249e8b5a400fdfa668254d2a9.diff

Attached log file
matter_install_fail_with_patch.txt