hi, is there a workaround for this <issue>? I'm fa...
# troubleshoot
r
hi, is there a workaround for this issue? I'm facing the same problem even when using the new method for specifying Params
this is the stacktrace:
Copy code
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/airflow/serialization/serialized_objects.py", line 830, in serialize_dag
    serialize_dag["tasks"] = [cls._serialize(task) for _, task in dag.task_dict.items()]
  File "/usr/local/lib/python3.7/site-packages/airflow/serialization/serialized_objects.py", line 830, in <listcomp>
    serialize_dag["tasks"] = [cls._serialize(task) for _, task in dag.task_dict.items()]
  File "/usr/local/lib/python3.7/site-packages/airflow/serialization/serialized_objects.py", line 308, in _serialize
    return SerializedBaseOperator.serialize_operator(var)
  File "/usr/local/lib/python3.7/site-packages/airflow/serialization/serialized_objects.py", line 578, in serialize_operator
    serialize_op['params'] = cls._serialize_params_dict(op.params)
  File "/usr/local/lib/python3.7/site-packages/airflow/serialization/serialized_objects.py", line 451, in _serialize_params_dict
    if f'{v.__module__}.{v.__class__.__name__}' == 'airflow.models.param.Param':
AttributeError: 'str' object has no attribute '__module__'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/airflow/models/taskinstance.py", line 1340, in _run_raw_task
    self._execute_task_with_callbacks(context)
  File "/usr/local/lib/python3.7/site-packages/airflow/models/taskinstance.py", line 1480, in _execute_task_with_callbacks
    self.task.post_execute(context=context, result=result)
  File "/usr/local/lib/python3.7/site-packages/airflow/lineage/__init__.py", line 124, in wrapper
    _backend.send_lineage(operator=self, inlets=self.inlets, outlets=self.outlets, context=context)
  File "/usr/local/lib/python3.7/site-packages/datahub_provider/lineage/datahub.py", line 118, in send_lineage
    config, operator, operator.inlets, operator.outlets, context
  File "/usr/local/lib/python3.7/site-packages/datahub_provider/_lineage_core.py", line 64, in send_lineage_to_datahub
    capture_owner=config.capture_ownership_info,
  File "/usr/local/lib/python3.7/site-packages/datahub_provider/client/airflow_generator.py", line 128, in generate_dataflow
    for (key, value) in SerializedDAG.serialize_dag(dag).items()
  File "/usr/local/lib/python3.7/site-packages/airflow/serialization/serialized_objects.py", line 851, in serialize_dag
    raise SerializationError(f'Failed to serialize DAG {dag.dag_id!r}: {e}')
airflow.exceptions.SerializationError: Failed to serialize DAG 'dag_id_redacted': 'str' object has no attribute '__module__'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/airflow/models/taskinstance.py", line 1741, in get_truncated_error_traceback
    execution_frame = _TASK_EXECUTION_FRAME_LOCAL_STORAGE.frame
AttributeError: '_thread._local' object has no attribute 'frame'
[2022-07-01, 16:33:14 UTC] {taskinstance.py:1774} ERROR - Task failed with exception
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/airflow/serialization/serialized_objects.py", line 830, in serialize_dag
    serialize_dag["tasks"] = [cls._serialize(task) for _, task in dag.task_dict.items()]
  File "/usr/local/lib/python3.7/site-packages/airflow/serialization/serialized_objects.py", line 830, in <listcomp>
    serialize_dag["tasks"] = [cls._serialize(task) for _, task in dag.task_dict.items()]
  File "/usr/local/lib/python3.7/site-packages/airflow/serialization/serialized_objects.py", line 308, in _serialize
    return SerializedBaseOperator.serialize_operator(var)
  File "/usr/local/lib/python3.7/site-packages/airflow/serialization/serialized_objects.py", line 578, in serialize_operator
    serialize_op['params'] = cls._serialize_params_dict(op.params)
  File "/usr/local/lib/python3.7/site-packages/airflow/serialization/serialized_objects.py", line 451, in _serialize_params_dict
    if f'{v.__module__}.{v.__class__.__name__}' == 'airflow.models.param.Param':
AttributeError: 'str' object has no attribute '__module__'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/airflow/models/taskinstance.py", line 1340, in _run_raw_task
    self._execute_task_with_callbacks(context)
  File "/usr/local/lib/python3.7/site-packages/airflow/models/taskinstance.py", line 1480, in _execute_task_with_callbacks
    self.task.post_execute(context=context, result=result)
  File "/usr/local/lib/python3.7/site-packages/airflow/lineage/__init__.py", line 124, in wrapper
    _backend.send_lineage(operator=self, inlets=self.inlets, outlets=self.outlets, context=context)
  File "/usr/local/lib/python3.7/site-packages/datahub_provider/lineage/datahub.py", line 118, in send_lineage
    config, operator, operator.inlets, operator.outlets, context
  File "/usr/local/lib/python3.7/site-packages/datahub_provider/_lineage_core.py", line 64, in send_lineage_to_datahub
    capture_owner=config.capture_ownership_info,
  File "/usr/local/lib/python3.7/site-packages/datahub_provider/client/airflow_generator.py", line 128, in generate_dataflow
    for (key, value) in SerializedDAG.serialize_dag(dag).items()
  File "/usr/local/lib/python3.7/site-packages/airflow/serialization/serialized_objects.py", line 851, in serialize_dag
    raise SerializationError(f'Failed to serialize DAG {dag.dag_id!r}: {e}')
Airflow version: 2.2.5 Datahub version: 0.8.39