Davin Chia (Airbyte)
Davin Chia (Airbyte)
* What went wrong:
Execution failed for task ':airbyte-cdk:python:checkPython'.
> Python call failed: python3 -m virtualenv .venv
anyone see this also?Jared Rhizor (Airbyte)
[DEPRECATED] Marcos Marx
Noel Gomez
05/11/2021, 3:00 PMMason Wheeler
05/11/2021, 6:19 PMMicah
05/11/2021, 7:29 PMMarco Sollie
05/12/2021, 8:48 AMHarshith (Airbyte)
Mason Wheeler
05/12/2021, 4:22 PM:airbyte-integrations:bases:airbyte-protocol:airbyteDocker
seems to be a particularly egregious offender, spending a ton of time rebuilding Docker containers and downloading stuff from Pip.
Anyone know of any way to fix this?Noel Gomez
05/12/2021, 4:36 PMChris (deprecated profile)
Saurav Swaroop
05/15/2021, 1:51 PMRohiitR
05/15/2021, 8:13 PMruslan
05/16/2021, 7:29 PMDavin Chia (Airbyte)
Alvis Wong
05/17/2021, 7:54 AMAlvis Wong
05/17/2021, 10:12 AMMason Wheeler
05/18/2021, 10:04 PM141223.148 [pool-4-thread-1] ERROR io.airbyte.workers.DefaultCheckConnectionWorker - ERROR StatusLogger Error parsing jarfile/airbyte/lib/io.airbyte-airbyte-commons-0.22.3-alpha.jar!/log4j2.xml
141223.155 [pool-4-thread-1] ERROR io.airbyte.workers.DefaultCheckConnectionWorker - javax.xml.parsers.ParserConfigurationException
141223.155 [pool-4-thread-1] ERROR io.airbyte.workers.DefaultCheckConnectionWorker - at oracle.xml.jaxp.JXDocumentBuilderFactory.setFeature(JXDocumentBuilderFactory.java:374)
141223.156 [pool-4-thread-1] ERROR io.airbyte.workers.DefaultCheckConnectionWorker - at org.apache.logging.log4j.core.config.xml.XmlConfiguration.setFeature(XmlConfiguration.java:213)
141223.156 [pool-4-thread-1] ERROR io.airbyte.workers.DefaultCheckConnectionWorker - at org.apache.logging.log4j.core.config.xml.XmlConfiguration.disableDtdProcessing(XmlConfiguration.java:205)
141223.156 [pool-4-thread-1] ERROR io.airbyte.workers.DefaultCheckConnectionWorker - at org.apache.logging.log4j.core.config.xml.XmlConfiguration.newDocumentBuilder(XmlConfiguration.java:194)
141223.156 [pool-4-thread-1] ERROR io.airbyte.workers.DefaultCheckConnectionWorker - at org.apache.logging.log4j.core.config.xml.XmlConfiguration.<init>(XmlConfiguration.java:92)
141223.157 [pool-4-thread-1] ERROR io.airbyte.workers.DefaultCheckConnectionWorker - at org.apache.logging.log4j.core.config.xml.XmlConfigurationFactory.getConfiguration(XmlConfigurationFactory.java:46)
141223.157 [pool-4-thread-1] ERROR io.airbyte.workers.DefaultCheckConnectionWorker - at org.apache.logging.log4j.core.config.ConfigurationFactory$Factory.getConfiguration(ConfigurationFactory.java:453)
141223.157 [pool-4-thread-1] ERROR io.airbyte.workers.DefaultCheckConnectionWorker - at org.apache.logging.log4j.core.config.ConfigurationFactory$Factory.getConfiguration(ConfigurationFactory.java:385)
141223.157 [pool-4-thread-1] ERROR io.airbyte.workers.DefaultCheckConnectionWorker - at org.apache.logging.log4j.core.config.ConfigurationFactory.getConfiguration(ConfigurationFactory.java:260)
141223.158 [pool-4-thread-1] ERROR io.airbyte.workers.DefaultCheckConnectionWorker - at org.apache.logging.log4j.core.LoggerContext.reconfigure(LoggerContext.java:615)
141223.158 [pool-4-thread-1] ERROR io.airbyte.workers.DefaultCheckConnectionWorker - at org.apache.logging.log4j.core.LoggerContext.reconfigure(LoggerContext.java:636)
141223.158 [pool-4-thread-1] ERROR io.airbyte.workers.DefaultCheckConnectionWorker - at org.apache.logging.log4j.core.LoggerContext.start(LoggerContext.java:231)
141223.158 [pool-4-thread-1] ERROR io.airbyte.workers.DefaultCheckConnectionWorker - at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:153)
141223.159 [pool-4-thread-1] ERROR io.airbyte.workers.DefaultCheckConnectionWorker - at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:45)
141223.159 [pool-4-thread-1] ERROR io.airbyte.workers.DefaultCheckConnectionWorker - at org.apache.logging.log4j.LogManager.getContext(LogManager.java:194)
141223.159 [pool-4-thread-1] ERROR io.airbyte.workers.DefaultCheckConnectionWorker - at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getContext(AbstractLoggerAdapter.java:121)
141223.159 [pool-4-thread-1] ERROR io.airbyte.workers.DefaultCheckConnectionWorker - at org.apache.logging.slf4j.Log4jLoggerFactory.getContext(Log4jLoggerFactory.java:43)
141223.169 [pool-4-thread-1] ERROR io.airbyte.workers.DefaultCheckConnectionWorker - at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getLogger(AbstractLoggerAdapter.java:46)
141223.169 [pool-4-thread-1] ERROR io.airbyte.workers.DefaultCheckConnectionWorker - at org.apache.logging.slf4j.Log4jLoggerFactory.getLogger(Log4jLoggerFactory.java:29)
141223.169 [pool-4-thread-1] ERROR io.airbyte.workers.DefaultCheckConnectionWorker - at org.slf4j.LoggerFactory.getLogger(LoggerFactory.java:355)
141223.170 [pool-4-thread-1] ERROR io.airbyte.workers.DefaultCheckConnectionWorker - at org.slf4j.LoggerFactory.getLogger(LoggerFactory.java:380)
141223.170 [pool-4-thread-1] ERROR io.airbyte.workers.DefaultCheckConnectionWorker - at io.airbyte.integrations.destination.jdbc.AbstractJdbcDestination.<clinit>(AbstractJdbcDestination.java:46)
141223.208 [pool-4-thread-1] ERROR io.airbyte.workers.DefaultCheckConnectionWorker - ERROR StatusLogger No logging configuration
Aditya Guru
05/19/2021, 3:08 AMMason Wheeler
05/19/2021, 6:22 PMjava.lang.NoClassDefFoundError: com/google/common/collect/Streamswhen running tests, what's the most likely culprit? Googling suggests that there's likely something missing from the classpath, but this error is being raised from core Airbyte code that I'm pulling in as a dependency, so it doesn't feel like my project should need something added to its classpath. On the other hand, I haven't touched those modules, and it doesn't seem as if other tests that depend on them have any trouble running, so the problem has to be in my project somewhere... right?
Artem Astapenko
05/19/2021, 9:47 PMairbyte-temporal | + nc -z db 5432
airbyte-temporal | nc: bad address 'db'
airbyte-temporal | + '[' 1 -eq 0 ']'
airbyte-temporal | + echo 'waiting for postgresql to start up'
airbyte-temporal | + sleep 1
airbyte-temporal | waiting for postgresql to start up
Jared Rhizor (Airbyte)
Mason Wheeler
05/20/2021, 7:39 PMJdbcBufferedConsumerFactory.toWriteConfig
has access to a NamingConventionTransformer
instance, and NamingConventionTransformer
has methods for generating table names, but it's not making use of them. (See lines 109-110.) Instead, it's unilaterally imposing a specific naming convention that doesn't work with all databases.
Is there any rationale for this?charles
* make a change in some core module, e.g. add a print statement in the server
* ./gradlew :composeBuild
* VERSION=dev docker-compose up -V
* expect print statement to fire
I would expect the print statement to run, but this isn't reliably happening in this workflow. It seems like there's some series of steps I need to run to get it to pick up changes. Still trying to figure out what the exact steps are (maybe includes ./gradlew clean
).
Anyone else experiencing similar?Mason Wheeler
05/20/2021, 10:37 PMcharles
# if everything fits except for the parent, just truncate the parent
elif (len(norm_child) + len(json_path_hash) + len(norm_suffix)) < (max_length - min_parent_length):
max_parent_length = max_length - len(norm_child) - len(json_path_hash) - len(norm_suffix)
return f"{norm_parent[:max_parent_length]}_{json_path_hash}_{norm_child}{norm_suffix}"
# otherwise first truncate parent to the minimum length and middle truncate the child
else:
norm_child_max_length = max_length - min_parent_length - len(json_path_hash) - len(norm_suffix)
trunc_norm_child = name_transformer.truncate_identifier_name(norm_child, norm_child_max_length)
return f"{norm_parent[:min_parent_length]}_{json_path_hash}_{trunc_norm_child}{norm_suffix}"
https://github.com/airbytehq/airbyte/blob/master/airbyte-integrations/bases/base-n[…]rmalization/normalization/transform_catalog/stream_processor.py
Could you help me understand why we would ever want to prefer this elif case over the else case? I think anything that the elif case hands can be handled by the else case and it has the added benefit of including at least some part of the parent.David Han
05/21/2021, 6:11 PMMason Wheeler
05/21/2021, 7:06 PMcharles