🐛 [Bug] torchtrt.dynamo.compile produces nan values

[cehongwang]

Bug Description

torchtrt.dynamo.compile is broken. Engines produces nan values

To Reproduce

Steps to reproduce the behavior:

1. pytest /home/TensorRT/tests/py/dynamo/models/test_models.py -k test_resnet18

FAILED tests/py/dynamo/models/test_models.py::test_resnet18 - AssertionError: False is not true : Resnet18 TRT outputs don't match with the original model. Cosine sim score: nan Threshold: 0.99
FAILED tests/py/dynamo/models/test_models.py::test_resnet18_half - AssertionError: False is not true : Resnet18 Half TRT outputs don't match with the original model. Cosine sim score: nan Threshold: 0.99

Expected behavior

All tests pass

Environment

Build information about Torch-TensorRT can be found by turning on debug messages

• Torch-TensorRT Version (e.g. 1.0.0):
• PyTorch Version (e.g. 1.0):
• CPU Architecture:
• OS (e.g., Linux):
• How you installed PyTorch (conda, pip, libtorch, source):
• Build command you used (if compiling from source):
• Are you using local sources or building from archives:
• Python version:
• CUDA version:
• GPU models and configuration:
• Any other relevant information:

Additional context

[narendasan]

Yes have been seeing this as well in multiple tests