Has any one successfully synced a Jira <> Sn...
# replication-troubleshooting
a
Has any one successfully synced a Jira <> Snowflake connection? I seem to continually hit this error on certain streams (such as _board_*).*
Copy code
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 111, in read
    yield from self._read_stream(
  File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 180, in _read_stream
    for record in record_iterator:
  File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 290, in _read_full_refresh
    for record_data_or_message in record_data_or_messages:
  File "/airbyte/integration_code/source_jira/streams.py", line 192, in read_records
    for board in super().read_records(**kwargs):
  File "/airbyte/integration_code/source_jira/streams.py", line 90, in read_records
    yield from super().read_records(**kwargs)
  File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py", line 413, in read_records
    yield from self._read_pages(
  File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py", line 430, in _read_pages
    yield from records_generator_fn(request, response, stream_state, stream_slice)
  File "/airbyte/integration_code/source_jira/streams.py", line 81, in parse_response
    yield self.transform(record=record, **kwargs)
  File "/airbyte/integration_code/source_jira/streams.py", line 197, in transform
    record["projectId"] = str(record["location"]["projectId"])
KeyError: 'projectId'
m
Can you upgrade Jira connector @AJ Floersch to latest version? This issue was fixed.
a
Hey, @Marcos Marx (Airbyte)! From what I can tell, it seems I am on the latest version (0.3.3).
n
Hey, AJ! Could you include a complete log file?
j
Same error encountered on 0.3.4, 0.3.0 and 0.3.3
This PR seems to address the issue, but its been stuck in CI for a few weeks now. Something is up with a gql mutation in the project’s private github action [action log]
Log:
Copy code
Syncing stream application_roles 0:00:00.245729
Syncing stream avatars 0:00:00.699659
2023-02-27 22:07:43 [1;31mERROR[m i.a.w.i.DefaultAirbyteStreamFactory(internalLog):116 - 'location'
Traceback (most recent call last):
  File "/airbyte/integration_code/main.py", line 13, in <module>
    launch(source, sys.argv[1:])
  File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/entrypoint.py", line 131, in launch
    for message in source_entrypoint.run(parsed_args):
  File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/entrypoint.py", line 122, in run
    for message in generator:
  File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 114, in read
    stream_is_available, error = stream_instance.check_availability(logger, self)
  File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/core.py", line 190, in check_availability
    return self.availability_strategy.check_availability(self, logger, source)
  File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/availability_strategy.py", line 45, in check_availability
    get_first_record_for_slice(stream, stream_slice)
  File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/utils/stream_helper.py", line 38, in get_first_record_for_slice
    return next(records_for_slice)
  File "/airbyte/integration_code/source_jira/streams.py", line 232, in read_records
    for board in read_full_refresh(self.boards_stream):
  File "/airbyte/integration_code/source_jira/utils.py", line 23, in read_full_refresh
    for record in records:
  File "/airbyte/integration_code/source_jira/streams.py", line 192, in read_records
    for board in super().read_records(**kwargs):
  File "/airbyte/integration_code/source_jira/streams.py", line 90, in read_records
    yield from super().read_records(**kwargs)
  File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py", line 419, in read_records
    yield from self._read_pages(
  File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py", line 436, in _read_pages
    yield from records_generator_fn(request, response, stream_state, stream_slice)
  File "/airbyte/integration_code/source_jira/streams.py", line 81, in parse_response
    yield self.transform(record=record, **kwargs)
  File "/airbyte/integration_code/source_jira/streams.py", line 197, in transform
    record["projectId"] = str(record["location"]["projectId"])
KeyError: 'location'
n
Hey, Jeff! I'll make time to look at that PR today and help get it moving
🤩 1
j
@Nataly Merezhuk (Airbyte) thank you!! I pulled in the changes locally and it does indeed work for the board_issues stream