so i am unable to see further what went wrong on connection to postgres, even the log file mentioned has the same output in picture. no way to know if password is wrong or whats wrong?

i am getting a weird error on airbyte worker

Caused by: java.io.FileNotFoundException: /root/.kube/config (No such file or directory)

I there, I just opened a PR for a change to an existing connector. I’m not sure why, but there don’t seem to be any integration tests. Not sure why, could someone maybe take a look?

ahoi! we want to build a connector for Mindsdb, anyone with experience building connectors up for contract work?

Hi, I am trying to create a custom connector to connect to an API that return json, and i get following error:

ERROR i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$1):70 - Validation failed: {"type":"RECORD","record":{"stream":"sensorhistory","data":

logs and json schema attached for reference. Any idea what's wrong? Thanks :)

Hello guys, i wanted to understand reason to use SID instead of Service name to connect to oracle db ? service names are better and recommended way of doing it so just wanted to understand any specific reason to use SID. Thanks

Hello, what are Airbyte’s guidelines when dealing with quota errors in APIs. For instance, we are struggling with Google Analytics as it has strict quota limitations. We are running incremental synch and when it fails: • The state of the completed streams is saved but the state of the partially synched state is not saved I believe that there are potential improvements: • The state of the the partially synched state should be saved to allow the next run not to start from the beginning • The connector could sleep and regularly check if quota is restored instead of failing

Hi guys, I don't know if this goes here. I'm trying to get the google ads connector to work with GAQL but it won't let me use the segments.date field, why does this happen? Is there any way to use this field?. Thanks in advance

• @here : Airbyte version : 0.35.37-alpha When using postgres sql connection , connection is success but dont show schema objects... Any special permission we should give to schema or tables in the schema to visible in airbyte connection .....or is this issue with the airbyte product specific to postgre sql source . Any help would be appreciate

What have I missed that failed this test? https://github.com/airbytehq/airbyte/runs/5622313229?check_suite_focus=true From this PR: https://github.com/airbytehq/airbyte/pull/11060

I am creating a Zendesk support Source,the source has been crreated

I am creating a Zendesk support Source,the source has been created succesfully, but when connect that to MSSQL destination it gives me this `*ERROR* i.a.w.DefaultReplicationWorker(run):168 - Sync worker failed.`error in log while syncing data. Attaching log file for further reference. Thanks in anticipation. 😀

How difficult is it to port a singer tap over to airbyte? Are there any resources I can share with my developer to get after it? singer-io/tap-purecloud (github.com) is what i’m after.

Hello everyone, I am having some trouble running the unit tests in some of the source connectors. When I run _*python3 -m pytest -s unit_tests*_ what I am getting is E fixture 'requests_mock' not found

available fixtures: api, cache, capfd, capfdbinary, caplog, capsys, capsysbinary, common_params, config, creds_with_wrong_permissions, doctest_namespace, fake_properties_list, monkeypatch, oauth_config, pytestconfig, record_property, record_testsuite_property, record_xml_attribute, recwarn, some_credentials, tmp_path, tmp_path_factory, tmpdir, tmpdir_factory

use 'pytest --fixtures [testpath]' for help on them.

Some initial investigation implies that the requests mock decorator is not recognized in python 3 which seem pretty weird since according to the docs the supported Python version for Airbyte is > 3.7 On my local machine python3 --version resolves to Python 3.7.5

Hello Guys!!. I am trying to contribute to the https://github.com/airbytehq/airbyte/issues/11348 to support servicename for the oracle database. Completed development changes, but not able to create image to test it. Getting the following error: Can someone suggest the right approach to build the image for the existing connector?.

Hi all, I have raised an issue for developing the Jira connector to allow for the domain to end with jira.com (currently only allows to end with atlassian.net) https://github.com/airbytehq/airbyte/issues/11414

Hi everyone.. has the appsflyer connector been pulled? I can’t find it in the source list (using version 0.35.57 alpha). Thanks

is there a limit to how long exponential backoff can be? my target api requires that we wait 1 hour before retrying after a threshold is reached.

hello everyone 😉 I’m developing connector for API that allows me to specify

lastmodified

as a query param and returns rows without any information about modification time. My 2 concerns: • because I don’t have timestamp information in rows I need to take into consideration potential problems with upstream -> overlapping (e.g. grab 2 days instead of 1 during pull) is my only idea how to minimize - is that correct/‘the way’ with that API? • I want to emit state after all slices are processed - is it idiomatic to yield airbyte state message in

AbstractSource.read

? thanks in advance! have a nice day ☺️

Hello everyone! I’m new in airbyte connector’s developing :) I have a question: can I reload data in destination for period. For example, every day my source API-connector gets data for last 30 days and I need delete this 30 days in my destination database and loads new one. Is it real or only one way is load data incremental and then select latest version?

Hi all, I had a quick question about the Okta connector; as it stands today, how can I use the airbyte connector for okta to ingest custom user attributes? Or, do I have to fork the code from the existing connector and add a json schema config and classmethod for each custom attribute endpoint?

Any information on if/when the Mailchimp connector will support more endpoints, like getting who is subscribed, unsubscribed? Currently the endpoint doesn’t provide it and I also run into issues with the automatic transformation to Postgres (but I’ll document that issue somewhere else).

Can someone explain if we should be implementing

get_updated_state

for incremental streams, or should we be using

IncrementalMixin

?

Hello 👋, I am trying to extend the Mixpanel souce connector to support incremental syncs for some of the streams that can have custom properties by using user defined cursors. With that being said I'm not sure of what is the correct approach for retrieving the user defined cursor in a HttpStream if there is no default cursor 🤔 The immediate solutions that comes to my mind is to override the HttpStream read_records() method to get access to the configured stream cursor like in the following example

def read_records(self, sync_mode: SyncMode, cursor_field: List[str] = None, stream_slice: Mapping[str, Any] = None,
                     stream_state: Mapping[str, Any] = None) -> Iterable[Mapping[str, Any]]:
        cursor_name = cursor_field[-1]
        stream_state["cursor_key"] = cursor_name
        return super().read_records(sync_mode, cursor_field, stream_slice, stream_state = stream_state)

After this I will be able to access the cursor in the parse_response() and get_updated_state() methods in order to do the necessary filtering on the records. Is there a better approach to achieve this or is this the only way?

What do you need to define in your code so the cursor field can be defined by a user for the incremental sync (Python)? If I define cursor_field it says "set by source" in the UI, and you can't change it.

hi all, I found I need to add a new stream to an existing connector that we developed. This connector has been running incremental refreshes for about a month or two. Is it possible to add the new stream and not trigger a full resync? I'd hate to have to start from scratch on all the other streams as well

Currently I see a big difference between the code generated for a Python Source and the code used in the Python HTTP Source Tutorial here (https://docs.airbyte.com/connector-development/tutorials/cdk-tutorial-python-http/5-declare-schema) Is there a reason for this discrepancy? The is also a difference between the Building a Python Source documentation (https://docs.airbyte.com/connector-development/tutorials/building-a-python-source) and that of the Python HTTP Source Tutorial Which of these is the most up to date and correct method to follow?

If you have any questions regarding connector development or how to contribute to Airbyte, we also have 2 forum sections dedicated to that: Connector Development and Contributing to Airbyte. The team has brought down the time to develop a connector to 2 hours with our new version of CDK (Connector Development Kit).

I cannot even connect to the source mysql, I use localhost:3306 and user/pwd but Could not connect with provided configuration. Error: Cannot create PoolableConnectionFactory (Access denied for user ‘root’@‘…..’ (using password: YES)). I replaced the host with …

What can be a reason the cursor_field is empty at the start of my incremental sync? I added both

@property
    def supports_incremental(self) -> bool:
        return True

    @property
    def source_defined_cursor(self) -> bool:
        return False

And in the UI I am able to select a cursor_field, for the rest I have no deceleration in my code of cursor_field (I want it to be user defined). I have a log row in

def request_params()

containing

<http://self.logger.info|self.logger.info>(f"Cursor Field is = {self.cursor_field}")

my console output is as following:

2022-03-30 16:28:27 source > Syncing stream: XXX_Financial_Journalrules 
2022-03-30 16:28:27 source > Cursor Field is = []
2022-03-30 16:28:27 source > Doing request with params {'take': 10000, 'skip': 0}