Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

SDXL int8 export in Sharktank Model Integration Tests timing out #1006

Open
Tracked by #1004
renxida opened this issue Feb 25, 2025 · 2 comments
Open
Tracked by #1004

SDXL int8 export in Sharktank Model Integration Tests timing out #1006

renxida opened this issue Feb 25, 2025 · 2 comments

Comments

@renxida
Copy link
Contributor

renxida commented Feb 25, 2025

No description provided.

@renxida
Copy link
Contributor Author

renxida commented Feb 25, 2025

Run: https://github.com/nod-ai/shark-ai/actions/runs/13519729609/job/37776127497?pr=1003

Logs: https://productionresultssa14.blob.core.windows.net/actions-results/fa15427f-1428-4657-a61b-00a1ca03deaa/workflow-job-run-484426a5-eefe-5456-de97-4d3ac36916f4/logs/job/job-logs.txt?rsct=text%2Fplain&se=2025-02-25T17%3A46%3A24Z&sig=YNBj3QofOr0AJez8b6%2FPOYG2jiaKNx4kTOAX6cTx1D4%3D&ske=2025-02-26T05%3A20%3A16Z&skoid=ca7593d4-ee42-46cd-af88-8b886a2f84eb&sks=b&skt=2025-02-25T17%3A20%3A16Z&sktid=398a6654-997b-47e9-b12b-9515b896b4de&skv=2025-01-05&sp=r&spr=https&sr=b&st=2025-02-25T17%3A36%3A19Z&sv=2025-01-05

Error:

2025-02-25T11:17:49.0910831Z parent = <torch._dynamo.symbolic_convert.InliningInstructionTranslator object at 0x7fe23d7f26d0>
2025-02-25T11:17:49.0911460Z func = UserMethodVariable(), args = [UserDefinedObjectVariable()], kwargs = {}
2025-02-25T11:17:49.0911747Z 
2025-02-25T11:17:49.0911824Z     @staticmethod
2025-02-25T11:17:49.0912018Z     def inline_call_(
2025-02-25T11:17:49.0912388Z         parent, func: VariableTracker, args: List[VariableTracker], kwargs
2025-02-25T11:17:49.0912729Z     ):
2025-02-25T11:17:49.0912938Z         if isinstance(func, SkipFunctionVariable):
2025-02-25T11:17:49.0913348Z             unimplemented("inline with functions in skip files")
2025-02-25T11:17:49.0913653Z         assert isinstance(
2025-02-25T11:17:49.0913932Z             func,
2025-02-25T11:17:49.0914185Z             (UserFunctionVariable, NestedUserFunctionVariable),
2025-02-25T11:17:49.0914476Z         )
2025-02-25T11:17:49.0914735Z         result = InliningInstructionTranslator.check_inlineable(func)
2025-02-25T11:17:49.0915361Z         assert result.skipped is False
2025-02-25T11:17:49.0915755Z         try:
2025-02-25T11:17:49.0916027Z >           sub_locals, closure_cells = func.bind_args(parent, args, kwargs)
2025-02-25T11:17:49.0916786Z E           Failed: Timeout >600.0s

@renxida
Copy link
Contributor Author

renxida commented Feb 25, 2025

Looks like this isn't specific to the iree bump because this was failing pre-bump.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant