Skip to content

Fix CI errors with torch-nightly #2956

Description

@justinchuby
    function_output = function_executor(test_name, reference_torch_outputs)(
tests/function_libs/torch_lib/ops_test_common.py:546: in _capture_graph_and_evaluate_torch_script_evaluator
    symbolic_outputs = function(*onnxscript_args, **onnxscript_kwargs)
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
onnxscript/_internal/values.py:485: in __call__
    return self.func(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^
onnxscript/function_libs/torch_lib/ops/nn.py:1839: in aten_scaled_dot_product_attention
    key, value = _attention_repeat_kv_for_group_query(query, key, value)
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
onnxscript/function_libs/torch_lib/ops/nn.py:1756: in _attention_repeat_kv_for_group_query
    query.shape[1] > key.shape[1] == value.shape[1] and query.shape[1] % key.shape[1] == 0
E   AssertionError: SDPA (GQA or MQA) requires q_num_heads > kv_num_heads & q_num_heads % kv_num_heads == 0
=============================== warnings summary ===============================

Metadata

Metadata

Labels

No labels
No labels

Type

No type

Fields

No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions