Skip to content

Enable various operations in OpenVINO backend#159

Open
zhaixuejun1993 wants to merge 5 commits into
ravi9:dev_backend_openvinofrom
zhaixuejun1993:xuejun/enable-ops-sum-rows
Open

Enable various operations in OpenVINO backend#159
zhaixuejun1993 wants to merge 5 commits into
ravi9:dev_backend_openvinofrom
zhaixuejun1993:xuejun/enable-ops-sum-rows

Conversation

@zhaixuejun1993
Copy link
Copy Markdown
Collaborator

This pull request adds support for several new operations to the OpenVINO backend in the ggml library, including DIV, MUL_MAT_ID, SUM_ROWS, and CLAMP. It introduces the necessary translation logic for these operations, updates operator tables, and improves handling of certain edge cases and resource limits. The changes also refine the implementation of the PERMUTE operation.

New operator support and translation:

  • Added translation and support for DIV, including broadcasting and type conversion logic in openvino/op/div.cpp, and updated the operator table to use the new translation function. [1] [2] [3]
  • Added translation and support for MUL_MAT_ID, including input processing, expert weight selection, and shape handling in openvino/op/mul_mat_id.cpp, and updated the operator table. [1] [2] [3] [4]
  • Added translation and support for SUM_ROWS and CLAMP operations, including their translation logic and registration in the operator table. [1] [2] [3] [4] [5] [6] [7]

Operator support and scheduling improvements:

  • Updated the set of supported operations in ggml_backend_openvino_device_supports_op to include the new operations, and added checks to avoid scheduling unsupported or resource-intensive cases (e.g., large temporaries in MUL_MAT_ID, or unsupported input patterns for SUM_ROWS). [1] [2] [3] [4] [5]

Other improvements:

  • Refined the implementation of the PERMUTE operation to correctly interpret permutation parameters, improving axis mapping logic.

These changes collectively expand the backend's capabilities and robustness, allowing it to handle a wider range of models and operations.## Overview

Additional information

Requirements

@wine99
Copy link
Copy Markdown
Collaborator

wine99 commented May 11, 2026

you can merge on yourself when ci finishes

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants