TorchFX: GPTQ accuracy fix

[cavusmustafa]

Details:

• Fix for the accuracy issues discovered in Llama2 GPTQ with aot_autograd

Tickets:

• CVS-149032

[rkazants]

Where is the test to check accuracy?

[cavusmustafa]

Where is the test to check accuracy?

Test for GPTQ will require to create a certain pattern and check if all the related passes are applied and the execution is optimized as expected. I am sharing the link to the ticket to track the progress on GPTQ tests and additional improvements. But I don't think it will be part of this PR and I don't think it will be ready in next 2-3 weeks due to other priorities.
https://jira.devtools.intel.com/browse/CVS-152181

[cavusmustafa]

gptq_test.py.txt
@rkazants, could you please help deciding where to add this test? Is this a good location to implement it?: https://github.com/openvinotoolkit/openvino/tree/master/tests/model_hub_tests/pytorch
I need to skip model conversion and run it as a regular pytorch model after torch.compile. Can I do it in this structure?
Attached is the standalone script to test GPTQ patterns in a HF model.

[mvafin]

@cavusmustafa Add the test here https://github.com/openvinotoolkit/openvino/tree/master/tests/model_hub_tests/transformation_tests
You will not be bound to existing workflow and can create your custom test.

[cavusmustafa]

@cavusmustafa Add the test here https://github.com/openvinotoolkit/openvino/tree/master/tests/model_hub_tests/transformation_tests You will not be bound to existing workflow and can create your custom test.

I just pushed into this directory. Can you review please?
@mvafin @rkazants

[mvafin]

@cavusmustafa Please add the test in here:
https://github.com/openvinotoolkit/openvino/blob/500284d6bdcf979b4c4eda6abfa0b45cfe8f0635/.github/workflows/job_pytorch_models_tests.yml

You can refer to PagedAttention Test as example

[cavusmustafa]

@cavusmustafa Please add the test in here: https://github.com/openvinotoolkit/openvino/blob/500284d6bdcf979b4c4eda6abfa0b45cfe8f0635/.github/workflows/job_pytorch_models_tests.yml

You can refer to PagedAttention Test as example

@mvafin, added the test into the ".yml" file. Please let me know if anything is missing. Thanks.

[mvafin]

Test fails