Skip to content

Remove unused static remote context and parallelize model build - #291

Merged
zhaixuejun1993 merged 2 commits into
ravi9:dev_backend_openvinofrom
zhaixuejun1993:xuejun/parallel_model_compile
Aug 28, 2026
Merged

zhaixuejun1993 merged 2 commits into
ravi9:dev_backend_openvinofrom
zhaixuejun1993:xuejun/parallel_model_compile

Conversation

@zhaixuejun1993

Copy link
Copy Markdown
Collaborator
  1. remove the remote context for static build
  2. parallelize the process of convert/compile/create infer req process for prefill & decode

@ravi9
ravi9 force-pushed the dev_backend_openvino branch from 8ba9348 to d691121 Compare August 24, 2026 16:49
@zhaixuejun1993
zhaixuejun1993 force-pushed the xuejun/parallel_model_compile branch from 26ffebf to e4bb983 Compare August 25, 2026 02:18
@ravi9
ravi9 force-pushed the dev_backend_openvino branch from d691121 to 407e209 Compare August 25, 2026 16:53
@zhaixuejun1993
zhaixuejun1993 force-pushed the xuejun/parallel_model_compile branch from e4bb983 to 3f2ffef Compare August 27, 2026 01:24
@zhaixuejun1993
zhaixuejun1993 merged this pull request into ravi9:dev_backend_openvino Aug 28, 2026
5 of 16 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant