Hi team, It's been a while since I posted this <fe...
# ask-community-for-troubleshooting
j
Hi team, It's been a while since I posted this feedback about zoom integration. Is there any progress on migration away from Singer? It's been a big pain for us. Lately I found Singer doesn't properly handle zoom API pagination but no one is maintaining it. cc @Marcos Marx (Airbyte) as you kindly answered my question last time 🙏
m
Yes, it was released a new version of Zoom connector! 😄
j
What's the airbyte image version? I am using Jitsu which is built on top of Airbyte and I am current at
0.2.4
Is this version too old? I tried setting up the integration with Zoom but this is having the same pagination issue as Singer
m
This is the data:
Copy code
- name: Zoom
  sourceDefinitionId: cbfd9856-1322-44fb-bcf1-0b39b7a8e92e
  dockerRepository: airbyte/source-zoom
  dockerImageTag: 0.1.0
  documentationUrl: <https://docs.airbyte.io/integrations/sources/zoom>
  sourceType: api
  icon: zoom.svg
  releaseStage: alpha
The source should be call only Zoom
j
How can I get access to the source code?
I am not sure if Airbyte Zoom connector also have this issue. The thing I found with Singer is they uses
page_number
for pagination but it's a deprecated query param. So it will always only return results of page 1
m
👀 1
🙏 1
j
thank you so much! this is awesome
I'll need to convince my vendor to onboard to this new docker image now haha
Hi @Marcos Marx (Airbyte) I managed to switch to the latest airbyte zoom connector but encounter some errors when running it. It was able to sync user/meeting/webinar table then failed for the report_meeting table. Unfortuantely I couldn't get much info from the error messgae. Could you help take a look and let me know if you have any clue? TY!
Copy code
2022-11-16 23:34:28 [INFO ] - Syncing stream: report_meetings 
2022-11-16 23:34:29 [ERROR] - Encountered an exception while reading stream report_meetings
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 113, in read
    yield from self._read_stream(
  File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 182, in _read_stream
    for record in record_iterator:
  File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 285, in _read_full_refresh
    for record in records:
  File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/declarative/declarative_stream.py", line 115, in read_records
    for record in self.retriever.read_records(sync_mode, cursor_field, stream_slice, stream_state):
  File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/declarative/retrievers/simple_retriever.py", line 348, in read_records
    for r in records_generator:
  File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py", line 416, in read_records
    yield from self.parse_response(response, stream_state=stream_state, stream_slice=stream_slice)
  File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/declarative/retrievers/simple_retriever.py", line 304, in parse_response
    raise ReadException(f"Request {response.request} failed with response {response}")
airbyte_cdk.sources.declarative.exceptions.ReadException: Request <PreparedRequest [GET]> failed with response <Response [404]>
2022-11-16 23:34:29 [INFO ] - Finished syncing report_meetings
2022-11-16 23:34:29 [INFO ] - SourceZoom runtimes:
Syncing stream meetings 0:01:13.462498
Syncing stream report_meetings 0:00:00.752694
Syncing stream users 0:00:00.345948
Syncing stream webinars 0:00:07.485865
2022-11-16 23:34:29 [DEBUG] - Request <PreparedRequest [GET]> failed with response <Response [404]>
Traceback (most recent call last):
  File "/airbyte/integration_code/main.py", line 13, in <module>
    launch(source, sys.argv[1:])
  File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/entrypoint.py", line 131, in launch
    for message in source_entrypoint.run(parsed_args):
  File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/entrypoint.py", line 122, in run
    for message in generator:
  File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 127, in read
    raise e
  File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 113, in read
    yield from self._read_stream(
  File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 182, in _read_stream
    for record in record_iterator:
  File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 285, in _read_full_refresh
    for record in records:
  File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/declarative/declarative_stream.py", line 115, in read_records
    for record in self.retriever.read_records(sync_mode, cursor_field, stream_slice, stream_state):
  File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/declarative/retrievers/simple_retriever.py", line 348, in read_records
    for r in records_generator:
  File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py", line 416, in read_records
    yield from self.parse_response(response, stream_state=stream_state, stream_slice=stream_slice)
  File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/declarative/retrievers/simple_retriever.py", line 304, in parse_response
    raise ReadException(f"Request {response.request} failed with response {response}")
airbyte_cdk.sources.declarative.exceptions.ReadException: Request <PreparedRequest [GET]> failed with response <Response [404]>
2022-11-16 23:34:29 [DEBUG] - {"type": "TRACE", "trace": {"type": "ERROR", "emitted_at": 1668641669576.961, "error": {"message": "Something went wrong in the connector. See the logs for more details.", "internal_message": "Request <PreparedRequest [GET]> failed with response <Response [404]>", "stack_trace": "Traceback (most recent call last):\n  File \"/airbyte/integration_code/main.py\", line 13, in <module>\n    launch(source, sys.argv[1:])\n  File \"/usr/local/lib/python3.9/site-packages/airbyte_cdk/entrypoint.py\", line 131, in launch\n    for message in source_entrypoint.run(parsed_args):\n  File \"/usr/local/lib/python3.9/site-packages/airbyte_cdk/entrypoint.py\", line 122, in run\n    for message in generator:\n  File \"/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py\", line 127, in read\n    raise e\n  File \"/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py\", line 113, in read\n    yield from self._read_stream(\n  File \"/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py\", line 182, in _read_stream\n    for record in record_iterator:\n  File \"/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py\", line 285, in _read_full_refresh\n    for record in records:\n  File \"/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/declarative/declarative_stream.py\", line 115, in read_records\n    for record in self.retriever.read_records(sync_mode, cursor_field, stream_slice, stream_state):\n  File \"/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/declarative/retrievers/simple_retriever.py\", line 348, in read_records\n    for r in records_generator:\n  File \"/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py\", line 416, in read_records\n    yield from self.parse_response(response, stream_state=stream_state, stream_slice=stream_slice)\n  File \"/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/declarative/retrievers/simple_retriever.py\", line 304, in parse_response\n    raise ReadException(f\"Request {response.request} failed with response {response}\")\nairbyte_cdk.sources.declarative.exceptions.ReadException: Request <PreparedRequest [GET]> failed with response <Response [404]>\n", "failure_type": "system_error"}}}
m
@Jin Gong are you able to use the Zoom connector or still have issues? Did you try latest version 0.1.1?