Hi all, I need help with the following three questions/issues. 1. [solved] when replicating

campaigns

data from Google Ads to postgres, the sync failed during normalization, it seems like a data type error

2022-11-25 20:46:06 normalization > Found 9 models, 0 tests, 0 snapshots, 0 analyses, 579 macros, 0 operations, 0 seed files, 2 sources, 0 exposures, 0 metrics
2022-11-25 20:46:06 normalization > Concurrency: 8 threads (target='prod')
2022-11-25 20:46:06 normalization > 1 of 4 START table model google_ads_raw.campaign_labels................................................................. [RUN]
2022-11-25 20:46:06 normalization > 2 of 4 START incremental model _airbyte_google_ads_raw.campaigns_stg.................................................... [RUN]
2022-11-25 20:46:06 normalization > 1 of 4 OK created table model google_ads_raw.campaign_labels............................................................ [SELECT 0 in 0.58s]
2022-11-25 20:46:06 normalization > 20:46:03 + "beamdatadw"._airbyte_google_ads_raw."campaigns_stg"._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh
2022-11-25 20:46:06 normalization > 2 of 4 ERROR creating incremental model _airbyte_google_ads_raw.campaigns_stg........................................... [ERROR in 1.09s]
2022-11-25 20:46:06 normalization > 3 of 4 SKIP relation google_ads_raw.campaigns_scd....................................................................... [SKIP]
2022-11-25 20:46:06 normalization > 4 of 4 SKIP relation google_ads_raw.campaigns........................................................................... [SKIP]
2022-11-25 20:46:06 normalization > Finished running 1 table model, 3 incremental models in 1.76s.
2022-11-25 20:46:06 normalization > Completed with 1 error and 0 warnings:
2022-11-25 20:46:06 normalization > Database Error in model campaigns_stg (models/generated/airbyte_incremental/google_ads_raw/campaigns_stg.sql)
2022-11-25 20:46:06 normalization >   invalid input syntax for type bigint: "0.0"
2022-11-25 20:46:06 normalization >   compiled SQL at ../build/run/airbyte_utils/models/generated/airbyte_incremental/google_ads_raw/campaigns_stg.sql
2022-11-25 20:46:06 normalization > Done. PASS=1 WARN=0 ERROR=1 SKIP=2 TOTAL=4
2022-11-25 20:46:06 INFO i.a.w.g.DefaultNormalizationWorker(run):82 - Normalization executed in 14 seconds.
2022-11-25 20:46:06 ERROR i.a.w.g.DefaultNormalizationWorker(run):90 - Normalization Failed.

2. [unsolved] when replicating data from HubSpot to postgres, the

forms

and

form_submissions

tables are not synced. The most recent data are from 2021-11-10 051426.000000. 3. [unsolved] when replicating data from HubSpot to postgres, I didn’t find the

call outcome

attribute in the engagement related tables. Thanks.

Can you confirm you’re using latest version of both connectors and Airbyte platform?

Hi @Marcos Marx (Airbyte) the connectors and schema are in latest version. The problem with Google Ads has been solved after I refreshed the schema. But the questions 2 and 3 remain unsolved. Can you help with those two? Thank you.

2. you have data in the tables but they aren’t updated? 3. I didn’t find this field in any stream in Hubspot connector, where did you see this field in the docs?

@Marcos Marx (Airbyte) 2. Yes. It’s kind weird and makes me wonder why. 3. Oh, I saw that HubSpot dashboard seems to have this option. And I saw that Airbyte did extract meeting outcomes. https://knowledge.hubspot.com/calling/create-custom-call-and-meeting-outcomes

2. Can you check the state of those streams? (check image) 3. Can you open a Github issue requesting the new fields?

the closest i can find in log is the one shown in the screenshot below. Or if you want, I can send you the log. Thanks @Marcos Marx (Airbyte)

@anni can you query the airbyte-db the state table?

can you use the filte based on the connection Id of Hubspot?

sorry, I don’t have access to the credentials (password), it might take some time for me to get back to you.

connection is this case is

df65af10-ddee-4892-a3f5-bebe90250487

so for my case is:

select * from state where connection_id='df65af10-ddee-4892-a3f5-bebe90250487';

Hi @Marcos Marx (Airbyte), here’s the output after filtering. Thank you.

form_submissions

doesn’t have incremental sync mode @anni the connector should retrieve all records everytime it run the sync. Can you check your job log to find the records read:

2022-12-21 18:57:05 source > Read 0 records from form_submissions stream
2022-12-21 18:57:05 source > Finished syncing SourceHubspot
2022-12-21 18:57:05 source > SourceHubspot runtimes:

@User 2022-12-21 025852 [32mINFO[m i.a.w.g.DefaultReplicationWorker(run):135 - configured sync modes: {null.form_submissions=full_refresh - overwrite} 2022-12-21 031549 [44msource[0m > Read 6402 records from form_submissions stream 2022-12-21 031549 [44msource[0m > Finished syncing SourceHubspot 2022-12-21 031549 [44msource[0m > SourceHubspot runtimes:

Anni looks airbyte is reading data from the endpoint, are you able to run manual API request with different data results?

@Marcos Marx (Airbyte) i don’t have access keys, let me talk to my manager first. I will update with you likely in next year! Happy holidays!

Same to you! See ya