Hello, Can someone help me with this issue? While running this command -- python main.py check --config secrets/config.json I get -

{"type": "LOG", "log": {"level": "ERROR", "message": "Check failed"}}

{"type": "CONNECTION_STATUS", "connectionStatus": {"status": "FAILED", "message": "'Unable to connect to stream action - '"}}

But when I run -- python main.py check --debug --config secrets/config.json I get a response and connection success message

{"type": "LOG", "log": {"level": "INFO", "message": "Check succeeded"}}

{"type": "CONNECTION_STATUS", "connectionStatus": {"status": "SUCCEEDED"}}

do you see the request submitted and the response from the API when you run with

--debug

? Does the response include any errors?

Yes I see the request submitted and a response from API without any errors when running with --debug

can you share the raw response from the logs (make sure to strip it of any sensitive data)

Sure.

{"type": "DEBUG", "message": "Debug logs enabled", "data": {}}

{"type": "DEBUG", "message": "declarative source created from parsed YAML manifest", "data": {"source_name": "SourceImpactConnector", "parsed_config": "{\"version\": \"0.1.0\", \"definitions\": {\"selector\": {\"extractor\": {\"field_pointer\": []}}, \"requester\": {\"url_base\": \"<https://api.impact.com>\", \"http_method\": \"GET\", \"authenticator\": {\"type\": \"BasicHttpAuthenticator\", \"username\": \"{{ config['username'] }}\", \"password\": \"{{ config['password'] }}\"}}, \"retriever\": {\"record_selector\": {\"extractor\": {\"field_pointer\": []}}, \"paginator\": {\"type\": \"NoPagination\"}, \"requester\": {\"url_base\": \"<https://api.impact.com>\", \"http_method\": \"GET\", \"authenticator\": {\"type\": \"BasicHttpAuthenticator\", \"username\": \"{{ config['username'] }}\", \"password\": \"{{ config['password'] }}\"}}}, \"base_stream\": {\"retriever\": {\"record_selector\": {\"extractor\": {\"field_pointer\": []}}, \"paginator\": {\"type\": \"NoPagination\"}, \"requester\": {\"url_base\": \"<https://api.impact.com>\", \"http_method\": \"GET\", \"authenticator\": {\"type\": \"BasicHttpAuthenticator\", \"username\": \"{{ config['username'] }}\", \"password\": \"{{ config['password'] }}\"}}}}, \"action_stream\": {\"retriever\": {\"record_selector\": {\"extractor\": {\"field_pointer\": []}}, \"paginator\": {\"type\": \"NoPagination\"}, \"requester\": {\"url_base\": \"<https://api.impact.com>\", \"http_method\": \"GET\", \"authenticator\": {\"type\": \"BasicHttpAuthenticator\", \"username\": \"{{ config['username'] }}\", \"password\": \"{{ config['password'] }}\"}}}, \"$options\": {\"name\": \"action\", \"primary_key\": \"id\", \"path\": \"/Advertisers/{{ config['username'] }}/Actions?CampaignId=16349\"}, \"class_name\": \"airbyte_cdk.sources.declarative.declarative_stream.DeclarativeStream\"}}, \"streams\": [{\"retriever\": {\"record_selector\": {\"extractor\": {\"field_pointer\": []}}, \"paginator\": {\"type\": \"NoPagination\"}, \"requester\": {\"url_base\": \"<https://api.impact.com>\", \"http_method\": \"GET\", \"authenticator\": {\"type\": \"BasicHttpAuthenticator\", \"username\": \"{{ config['username'] }}\", \"password\": \"{{ config['password'] }}\"}}}, \"$options\": {\"name\": \"action\", \"primary_key\": \"id\", \"path\": \"/Advertisers/{{ config['username'] }}/Actions?CampaignId=16349\"}, \"class_name\": \"airbyte_cdk.sources.declarative.declarative_stream.DeclarativeStream\"}], \"check\": {\"stream_names\": [\"action\"]}}", "path_to_yaml": "impact_connector.yaml"}}

{"type": "DEBUG", "message": "declarative source created from parsed YAML manifest", "data": {"source_name": "SourceImpactConnector", "parsed_config": "{\"version\": \"0.1.0\", \"definitions\": {\"selector\": {\"extractor\": {\"field_pointer\": []}}, \"requester\": {\"url_base\": \"<https://api.impact.com>\", \"http_method\": \"GET\", \"authenticator\": {\"type\": \"BasicHttpAuthenticator\", \"username\": \"{{ config['username'] }}\", \"password\": \"{{ config['password'] }}\"}}, \"retriever\": {\"record_selector\": {\"extractor\": {\"field_pointer\": []}}, \"paginator\": {\"type\": \"NoPagination\"}, \"requester\": {\"url_base\": \"<https://api.impact.com>\", \"http_method\": \"GET\", \"authenticator\": {\"type\": \"BasicHttpAuthenticator\", \"username\": \"{{ config['username'] }}\", \"password\": \"{{ config['password'] }}\"}}}, \"base_stream\": {\"retriever\": {\"record_selector\": {\"extractor\": {\"field_pointer\": []}}, \"paginator\": {\"type\": \"NoPagination\"}, \"requester\": {\"url_base\": \"<https://api.impact.com>\", \"http_method\": \"GET\", \"authenticator\": {\"type\": \"BasicHttpAuthenticator\", \"username\": \"{{ config['username'] }}\", \"password\": \"{{ config['password'] }}\"}}}}, \"action_stream\": {\"retriever\": {\"record_selector\": {\"extractor\": {\"field_pointer\": []}}, \"paginator\": {\"type\": \"NoPagination\"}, \"requester\": {\"url_base\": \"<https://api.impact.com>\", \"http_method\": \"GET\", \"authenticator\": {\"type\": \"BasicHttpAuthenticator\", \"username\": \"{{ config['username'] }}\", \"password\": \"{{ config['password'] }}\"}}}, \"$options\": {\"name\": \"action\", \"primary_key\": \"id\", \"path\": \"/Advertisers/{{ config['username'] }}/Actions?CampaignId=16349\"}, \"class_name\": \"airbyte_cdk.sources.declarative.declarative_stream.DeclarativeStream\"}}, \"streams\": [{\"retriever\": {\"record_selector\": {\"extractor\": {\"field_pointer\": []}}, \"paginator\": {\"type\": \"NoPagination\"}, \"requester\": {\"url_base\": \"<https://api.impact.com>\", \"http_method\": \"GET\", \"authenticator\": {\"type\": \"BasicHttpAuthenticator\", \"username\": \"{{ config['username'] }}\", \"password\": \"{{ config['password'] }}\"}}}, \"$options\": {\"name\": \"action\", \"primary_key\": \"id\", \"path\": \"/Advertisers/{{ config['username'] }}/Actions?CampaignId=16349\"}, \"class_name\": \"airbyte_cdk.sources.declarative.declarative_stream.DeclarativeStream\"}], \"check\": {\"stream_names\": [\"action\"], \"class_name\": \"airbyte_cdk.sources.declarative.checks.check_stream.CheckStream\"}}", "path_to_yaml": "impact_connector.yaml"}}

{"type": "DEBUG", "message": "Making outbound API request", "data": {"headers": "{'User-Agent': 'python-requests/2.28.1', 'Accept-Encoding': 'gzip, deflate', 'Accept': '*/*', 'Connection': 'keep-alive', 'Authorization': 'Basic {{Removed TOKEN from here}}}'}", "request_body": "None", "url": "<https://api.impact.com/Advertisers/****/Actions?CampaignId=16349>"}}

the next line should contain the raw response

{"type": "DEBUG", "message": "Making outbound API request", "data": {"headers": "{'User-Agent': 'python-requests/2.28.1', 'Accept-Encoding': 'gzip, deflate', 'Accept': '*/*', 'Connection': 'keep-alive', 'Authorization': 'Basic =='}", "request_body": "None", "url": "<https://api.impact.com/Advertisers/****/Actions?CampaignId=16349>"}}

{"type": "DEBUG", "message": "Receiving response", "data": {"headers": "{'Date': 'Mon, 21 Nov 2022 19:40:50 GMT', 'Content-Type': 'application/xml; charset=UTF-8', 'Transfer-Encoding': 'chunked', 'Connection': 'keep-alive', 'X-RateLimit-Limit-hour': '1000', 'X-RateLimit-Remaining-hour': '998', 'Content-Language': 'en-US', 'Pragma': 'no-cache', 'Cache-Control': 'no-cache, no-store, max-age=0', 'Expires': 'Thu, 01 Jan 1970 00:00:00 GMT', 'Content-Security-Policy': \"default-src 'none'; frame-ancestors 'none'\", 'X-Content-Type-Options': 'nosniff', 'X-Frame-Options': 'DENY', 'Feature-Policy': \"'none'\", 'Referrer-Policy': 'no-referrer', 'Set-Cookie': 'epersist=117454346.40515.0000; path=/; Httponly; Secure, session=-WU5_wQ; Path=/; SameSite=Strict; Secure; HttpOnly', 'Vary': 'Accept-Encoding', 'Content-Encoding': 'gzip', 'X-RateLimit-Limit': '1000', 'X-RateLimit-Remaining': '998', 'X-RateLimit-Reset': '1150', 'X-Kong-Upstream-Latency': '84', 'X-Kong-Proxy-Latency': '2', 'Via': '1.1 google', 'CF-Cache-Status': 'DYNAMIC', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Server': 'cloudflare', 'CF-RAY': '76dbe641afff2863-DFW'}", "status": "200", "body": "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\r\n<ImpactRadiusResponse>\r\n <Actions page=\"1\" numpages=\"1\" pagesize=\"2000\" total=\"58\" start=\"0\" end=\"57\" uri=\"/Advertisers/****/Actions?CampaignId=16349\" firstpageuri=\"/Advertisers/****/Actions?PageSize=2000&Page=1&CampaignId=\" previouspageuri=\"\" nextpageuri=\"\" lastpageuri=\"/Advertisers/****/Actions?PageSize=2000&Page=1&CampaignId=16349\">\r\n

i see

Last few lines looks like this

erStatus/>\r\n   <Note/>\r\n   <CallerId/>\r\n   <CustomerArea>N/A</CustomerArea>\r\n   <CustomerCity>Vienna</CustomerCity>\r\n   <CustomerRegion>Virginia</CustomerRegion>\r\n   <CustomerCountry>US</CustomerCountry>\r\n   <SharedId/>\r\n   <Uri>/Advertisers/****/Actions/16349.5410.509543</Uri>\r\n  </Action>\r\n </Actions>\r\n</ImpactRadiusResponse>\r\n"}}

{"type": "LOG", "log": {"level": "INFO", "message": "Check succeeded"}}

{"type": "CONNECTION_STATUS", "connectionStatus": {"status": "SUCCEEDED"}}

there are two issues here 1. we only support API which return json-formatted responses at the moment 2. the check operation shouldn't return success (looks like a bug on our end. i'll investigate separately)

Is there a way I can update '`Content-Type': 'application/xml` to be application/JSON

sure thing, here's an example of how you can set headers https://github.com/airbytehq/airbyte/blob/master/airbyte-integrations/connectors/s[…]a-pageviews/source_wikipedia_pageviews/wikipedia_pageviews.yaml

Awesome. I will give that a try. TYSM for your help.