user
02/26/2024, 11:19 PMREST
> GraphQL BULK Operations
where possible, fixed STATE
collisions for sub-streams
(#32345)
5fc6ca2 🏥 Source Mixpanel: updated version in pyproject.toml (#35537)
2c91211 🏥Source Hubspot: fix version in pyproject.toml (#35629)
11bd882 🏥Source GitLab: fix version in pyproject.toml (#35627)
7c11ea7 🏥Source Klaviyo: fix version in pyproject.toml (#35626)
5139a29 🏥Source GitHub: fix version in pyproject.toml (#35625)
6ed63f5 Source S3: run incremental syncs with concurrency (#34895)
a6b3f0c Cleaned up PyAibyte docs (PR # 35603) (#35603)
3918dc2 Docs: Add depecration notices to sunsetting connectors (#35446)
b2b9b7f reduce interrupt and shutdown delays to 1 minutes and 2 minutes when stopping a connector (initially set at 60minutes and 70minutes) (#35527)
040d363 Source Recurly: Enable in registries with updated CDK (#34622)
b247f89 delete metadata checks workflow (#35580)
399fc33 Destination Redshift: CDK T+D initial state refactor (#35354)
f6aa9e5 Destination Snowflake: CDK T+D initial state refactor (#35456)
a13bd80 Destination Postgres: CDK T+D initial state gathering (#35385)
airbytehq/airbyteuser
03/06/2024, 12:54 AMdestination-vertica
, restore destination-vectara
(#35806)
8209dad Source Recurly: update support level metadata (#35815)
7a85c0c Fix expected records
ef98194 Emit final state message for full refresh syncs and consolidate read flows (#35622)
e11f0fe minor changes to the java CDK test code (#35774)
160ec72 Destination bigquery: upgrade cdk (#35315)
24c8b44 airbyte-ci: add kotlin support, update license message template (#35784)
62abce9 Source Recurly: Unarchive and release as 1.0.0 (#35763)
e82ff2e 🏥Source Pinterest: fix CAT (#35788)
c5b8220 🐛 Source SalesForce: fix memory leak (OOM) (#35791)
8be5bbf 🏥Source Zendesk Talk: change order of authentication methods in spec (#35783)
2b08803 🏥Source Google Search Console: fix expected records (#35787)
8757058 🏥Source Paypal Transaction: fix CAT (#35781)
44668e4 airbyte-ci format: run a runner with more disk space (#35790)
dc35e13 add a timeout to junit test (#35767)
7063ea3 Postgres Strict Encrypt (#35762)
2a32688 Certify Postgres (#35760)
1685b27 Java CDK: Staging destinations include timezone in extracted_at in CSV file (#35313)
4efc065 DV2 destinations: Build DestinationState / Migration framework (#35303)
7277fc5 Use a separate concurrency group for Java CDK GH workflow. (#35758)
358a500 source-recurly is archived - remove from OSS registry
9e848c4 Archive the code of 8 sources with legacy state (#35757)
0f000b9 Archive connectors already hidden with legacy state (#35752)
e54f5de 🏥Source Sendgrid: fix CAT (#35753)
72f6362 🏥Source Twilio: fix CAT (#35751)
49f5dc1 remove archived conne…
airbytehq/airbyte[DEPRECATED] Marcos Marx
user
03/08/2024, 6:32 PMDeals Property History
and Companies Property History
to API v3
(#35662)
f09c97c connectors-qa: check cdk and language tags (#35685)
eabf39c GA release 4.0.0 (#35873)
0a9e0fe updated instructions for external logging (#35903)
55e6fbd Destination Snowflake: Handle NPE for state value. (#35899)
6b8cc39 Docs: Fix link in Core Concepts page (#35900)
1bb7a1c [source-postgres] State counter on postgres (#34724)
be6849f Source Ringcentral: add logo (#34242)
6f16ac5 📝 Updated Qdrant destination icon (#35104)
7d3a5f8 🤖 Bump patch version of Python CDK
4a808ee 🐛 follow up to #35471: update the cartesian stream slicer (#35865)
106102c 🤖 Bump patch version of Python CDK
858e61d Declarative CDK: Fix None error on stream_slice (#35879)
88314dd Source Metabase: Updates dashboards
stream, migrates to poetry (#35680)
6b26b27 speed up source-mssql tests (#35799)
666a3a3 source-mssql: reduce the number of containers used in tests (#35855)
0965ebd live-tests: add regression tests suite (#35837)
72eb8a6 ✨ Source Bing Ads: new streams: Audience Performance Report, Goals And Funnels Report, Product Dimension Performance Report (#35812)
8c862a8 Fix tags in metadata.yaml files: declare cdk tags (#35670)
fc03071 🐛 Source S3: Return iam docs (#35850)
df1cff1 Source Instagram: remove "total_interactions" from MediaInsights queries (#35875)
e4ccffb Docs: Tutorials formatting + from scratch connector tutorial cleanup (#33839)
4fcff41 [Source-postgres]: Add logging in case of multiple records with same LSN (#35842)
8ab77d4 Pass docker hub credentials to airbyte-ci's bump_version
command (#35802)
d5e91ae [source-mongodb] record count in state & initial iterator refactor (#35669)
8ee36d6 add background threads to MssqlTestDatabase (#35727)
aca8679 🐛 Destination Vectara: Improve title extraction logic (#35206)
da79f6e Destination Snowflake: Write extracted_at in UTC (#35308)
9ce9217 make query safer for servers that are case sensitive (#35816)
83cfcbf Source Microsoft Onedrive: Bump poetry.lock to upgrade transitive dependency (#35858)
cdf80f3 get source-mssql CI to green (#35721)
5f0d9c3 Source S3: upgrade dependencies to avoid transformers transitive dependency (#35857)
<https://github.com/airb…
airbytehq/airbyteJoe Bell (Airbyte)
03/11/2024, 4:55 PMuser
03/13/2024, 7:45 PM/telemetry
docs redirect (#36034)
7c0684d 🤖 Bump patch version of Python CDK
fd98267 configure debezium to correctly convert column with default value whe… (#36011)
95a8c8b Update linkedin-ads.md (#36030)
f679389 [airbyte-cdk] Fix tab delimiter configuration in CSV file type (#35901)
ef473c5 gradle: add kotlin support in all projects, warnings as errors (#36018)
d403d9b .editorconfig: add kotlin rules which approximate airbyte-ci format (#36017)
01da74e 🐛 [source-shopify] Fix discover command if shop name does not exist (#36000)
440df5d Archive Google Workspace Admin Reports (#35967)
b092a7f Disable Google Workspace Admin Reports in registries (#35965)
2ce32ab 🐛 Source Github: Handle rate limit exception as config error (#35986)
797ac00 🤖 Bump minor version of Python CDK
18f6515 Source Zoom: Fix authenticator bug and add missing fields (#35369)
75385c7 🤖 Bump patch version of Python CDK
15b9545 raise exception with the full class name if a class for a custom comp… (#35868)
5da29ac Source Amplitude: unpin CDK (#35987)
0113c52 🐛 Source Recharge: Add sort_by
to guarantee the records are in ASC
order (#35982)
36e9edd 🏥Source Mixpanel: fix expected records (#35964)
311e9f7 ✨Source Amazon Seller Partner: add GET_VENDOR_FORECASTING_REPORT
streams (#35954)
d804ff8 migrate live-test to a different repo (#35948)
c7e0d74 fix junit versionning mess (#35977)
a8b5296 Source Microsoft Onedrive: pin transformers transitive dependency (#35956)
c073e64 🤖 Bump patch version of Python CDK
b1f3b8a [airbyte-cdk] entrypoint wrapper should use per-stream state not legacy format (#35976)
ee6b1a0 [source-postgres] : Add retries back to the DBZ connector (#35904)
b09e560 [Docs] Edit recharge wording (#35975)
27d9207 Update enterprise setup guide for storage (#35966)
979b860 Source S3: pin transformers
transitive dependency (#35955)
3791a43 🐛 Source Shopify: Fixed bug when start date
was not provided, but the stream was using it (#35952)
a61f184 Update on-kubernetes-via-helm.md - 0.52.0 helm charts upgrade informa… (#35935)
46bf510 📝 Source Amazon Ads: Update tags in metadata.yaml (#35951)
4e05272 live-tests: add duckdb backend (#35923)
0bd29ba live-tests: pass connection id (#35922)
d6454f8 added integration instructions to getting started (#35861)
0f2685b 🤖 Bump minor version of Python CDK
2ac5248 Emit record counts in state messages for concurrent streams (#35907)
c8bec40 Improve Heartbeating External Docs. (#35934)
e66ec11 Better Heartbeating External Documentation. (#35932)
a4dca3b CDK: assert >0 state messages per read (fix tests) (#35906)
<https://github.com/airbytehq/airbyte/commit/acbdc2d6e1fc169bfe7df347f80fcd61662…
airbytehq/airbyteuser
03/14/2024, 12:00 AMcredit_ledger_entries
(#36036)
609d602 [Source-postgres] : Compare each record’s lsn_commit value instead of lsn_proc. (#35939)
airbytehq/airbyteuser
03/15/2024, 10:23 PMSTATE
messages frequency for the nested
sub-streams (#36170)
2c21cfe docs: fix or remove broken links (#36185)
0439fb3 Convert Async Destination Framework to Kotlin (#36033)
d243e0e 🎉 Source PayPal Transactions: Extend Disputes
stream schema with missing properties (#36173)
739287a upgrade launch darkly sdk to version 7.2.6 (#36013)
113e7e4 Add Enterprise API instructions (#36172)
3f3f866 [Docs] Release Notes for February 2024 (#35909)
0af41c4 update redshift docs (#36041)
2d7e1db [source-s3] Bump python-cdk version to include CSV tab delimiter fix (#36160)
ee999ee source-zoom: reference published version in breaking changes (#36135)
66bb8e9 java-cdk: change log level in log4j2-test.xml (#36023)
26b3db8 java-cdk: move log4j2-test.xml to test fixtures (#36021)
85c2929 java-cdk: prettier gradle dependency ordering (#36020)
737d9b4 java CDK: add static deserialize*(byte[]) methods to Jsons (#36019)
58eddcc Source Chargebee: Declare Unexpected Fields (#36037)
8e15d88 Update Issue Templates (#35896)
3fae982 extract out the connector changelog modification out of the bump_version code (#34586)
1d11ceb fix connector changelogs (#36039)
29b8afd Destination Redshift: Adopt CDK changes for airbyte_meta
(#35981)
ea2ca73 Source Greenhouse: unpin CDK (#35988)
bd83e35 Update on-kubernetes-via-helm.md (#35997)
1d6b93d Updated connector development overview doc (#36010)
airbytehq/airbyteJoe Bell (Airbyte)
03/18/2024, 5:50 PMuser
03/21/2024, 5:48 PM^0
(#36267)
2a9c91e remove dependency to java CDK sources (#36300)
34d36a2 [Source-mssql] : Remove mssql initial source operations (#36325)
d52f6b2 🤖 Bump minor version of Python CDK
01324ed bump CDK minimum python version to 3.9 (#36324)
157be91 ✨ File-based CDK: Add skip_wrong_number_of_fields_error
parameter for CSV parser (#36237)
bcd32a0 Resumable full refresh source-mongodb (#35845)
23b3d4e airbyte-ci: fix PR number ValueError
in migrate-to-poetry (#36319)
64fc7c7 Source Instagram: Unpin CDK (#36314)
5f78a37 📝 [docs] fix GCS documentation: avoid creating extra volumes and secret (#35973)
ccab316 Source Facebook Marketing: fix start_date selection behaviour (#36025)
5c26b69 📝Update certified connectors docs with full list of supported streams (#36235)
b581db6 🤖 Bump patch version of Python CDK
2f34f08 [ISSUE #6548] make all fields nullable except from pk and cursor field (#36201)
a38fdac 📝 [docs] fix small typo (#36052)
b7d8102 airbyte-ci: implement migrate-to-poetry connectors command (#35583)
e57252b Reworking Airbyte CI README: remove legacy connector_ops pieces (#36239)
bb478d5 Attempt to fix flakiness (#36258)
e5aea95 Custom convert incoming long for date and datetime types (#36263)
411115b Destination Redshift: Certification & docs update (#36255)
3339166 Update bing-ads.md (#36279)
838a50d Revert "sanity"
817dbe4 sanity
44f784e Remove most_recent_record
arg from Cursor.close_slice
(#36216)
f23881e Update supported-data-types and nullability (#36259)
8b849ab Source Typeform: Unpin CDK version (#36164)
f18e8e4 Add extensibility team to python connector approvers (#36248)
1a410aa Destination Redshift: Json transformer for graceful handling of large records (#36203)
a852963 Revert "Attempt to fix transient nightly build errors: Remove poetry … (#36206)
abb1d69 🤖 Bump patch version of Python CDK
240aa01 Airbyte CDK (low code): add refresh_token_error handler to DeclarativeOauth2Authenticator
(#36058)
36ae0cd 🤖 Bump minor version of Python CDK
ed3b87f java-cdk-destination: mark logs as debug (#36227)
875e5df low-code: Allow developers to use a custom schema loader (#36040)
e8c51cb 🚨🚨✨ Source Facebook Pages: Upgrade Facebook API to v19.0 (#36015)
80332d8 ✨ Source Microsoft SharePoint: Add parsing shared files (#35830)
f5c9a87 🏥 Source Twilio: Update expected records (#36228)
d77045d 🐛 Source Intercom: Fixed bug causing the header
val…
airbytehq/airbyteuser
03/22/2024, 12:44 AMJoe Bell (Airbyte)
03/22/2024, 11:20 PMuser
03/23/2024, 12:12 AMconversations
stream HttpError: 404 - User Not Found
(#36277)
878eb09 ✨ Destination DuckDB: track airbyte integration usage for MotherDuck (#36353)
b208835 Convert classes for destination-s3 to Kotlin (#36254)
0efbf23 do not log invalid message data (#36296)
33e9a81 Update cloud path in cdk publish pipeline (#36395)
374771c ✨ [source-orb] add end date parameter (#36288)
17a7e46 Destination Redshift: Suppress Jooq exception to avoid printing sql query (#36374)
ee48245 API merge instructions update (#36390)
8939298 ✨ Source Shopify: ensure Per-Stream Error Messaging and Record Counts In State (#36355)
991dc08 🤖 Bump minor version of Python CDK
242dd6a Airbyte CDK: request options allowed to be an array (#36357)
9f9dad1 Make destination-snowflake oAuth option hidden (#36240)
airbytehq/airbyteuser
03/26/2024, 12:28 AMsrc
so airbyte-ci
builds it (#36428)
b52c58d ✨ Source Microsoft OneDrive: Add fetching shared items (#35849)
4fae944 ✨ Source Microsoft SharePoint: Unpin CDK (#36381)
cc388fc airbyte-ci: allow empty pull request number for migrate-base-image
cmd (#36220)
3716a38 Fix missed PR number in airbyte-ci 4.6.1 changelog (#36423)
7fe4e23 destination-duckdb: fix formatting (#36415)
b9f6aab 🐛 Source Intercom: Fixed regression for the conversations
stream (#36414)
airbytehq/airbyteMarcos Marx (Airbyte)
03/26/2024, 9:15 PM$ref
instead of duplicating the entire parent stream definition
• All streams now point to a single shared base URL and Authenticator definition using $ref
instead of duplicating them in every stream
• Schemas are placed at the bottom of the YAML and pointed to with $ref
instead of being interleaved into the rest of the stream definition
• The YAML keys are now always ordered consistently by the Builder
• Top-level fields in the YAML are now separated by empty lines to improve readability
• Unused optional fields are now omitted from the YAML entirely instead of setting them to empty valuesuser
03/29/2024, 7:16 PMairbyte-lib
folder (#35910)
a2847fd 🤖 Bump minor version of Python CDK
c3c87ea follow up to #36294: allow migrate sub stream state with custom partition router (#36590)
23ecdb0 🐛 [source-slack] bump slack to 0.77.2 to emit record counts as float (#36579)
27c225a airbyte-ci: Update pipelines requests and pyjwt (#36607)
85d2469 🎉 Source Recharge: migrate to Low-Code (#35450)
ca6d722 ✨ Source Sentry: migrate to low code (#35755)
2b2f7ef 🎉 Source Zendesk Chat: migrate to YamlDeclarativeSource (Low-code)
(#35867)
f45db44 ci_credentials: add cryptography back 🙈 (#36614)
60456ea java-cdk: remove airbyte-api generation, pull dependency instead (#36610)
76e1057 disable some spotbugs checks for cdk tests (#36611)
45dae2c Source Mailchimp: fix acceptance tests (#36601)
552def8 disable spotbugs for CDK test and testFixtures submodules (#36606)
98e9956 Destination Postgres: airbyte_meta
, CDK upgrade and other fixes (#36363)
bbf77d6 ✨ Source Microsoft SharePoint: Update QL to 400 (#36573)
9df6aa9 Security: resolve cryptography-related warnings (#36597)
85ca7ec docs: fix pagination link header documentation (#36599)
c613853 airbyte-ci: Remove qa-engine in favor of connectors_qa (#36591)
3b50b0d connector-templates: Unpinning pytest and upgrading to recent base image version (#36596)
cc5d5d4 Bump requests from 2.25.1 to 2.31.0 in /airbyte-ci/connectors/common_utils (#36593)
5d48baf Bump black from 22.1.0 to 24.3.0 in /airbyte-cdk/python (#36568)
634db57 Python CDK: re…
airbytehq/airbyteuser
04/01/2024, 11:52 PMuser
04/02/2024, 9:32 PMuser
04/04/2024, 10:09 PMJoe Bell (Airbyte)
04/06/2024, 12:21 AMMarcos Marx (Airbyte)
04/11/2024, 6:48 PMJoe Bell (Airbyte)
04/13/2024, 3:24 PMuser
04/17/2024, 3:20 AMMarcos Marx (Airbyte)
04/19/2024, 6:33 PMabtcl
is Airbyte’s command line tool for running locally easy button airbyte rocket octavia thanks .
This week the engineering team released the abctl
tool.
This is a go package will make easier to install Airbyte in your local setup.
It is possible to install abctl
using the homebrew tap 🍺 :
• access is enabled by running brew tap airbytehq/tap
If you want to get more information check out the new deployment instructions where you can use abctl
to install Airbyte in 1 step.Joe Bell (Airbyte)
04/19/2024, 10:40 PMAngel Perez
04/23/2024, 12:55 PMPedro Lopez (Airbyte)
04/23/2024, 6:57 PMuser
04/23/2024, 7:23 PMpyarrow
batch insert as replacement of executemany
(#36715)
dfc933a DX: Add devcontainer configs for "Python generic" and "Default" (#34032)
54b0a7b MSSQL remove normalization (#36050)
8f6036e Live tests: update example in README to include --connection-id (#37470)
2836940 [source-MongoDB] Do not send estimate trace message if we don't have data (#37473)
9b9ec1c [source-postgres] : Remove legacy bad values handling code (#37445)
01381ae 🐛 Source Shopify: fix one-time
retry after Internal Server Error
for BULK streams (#37468)
5f1e4e6 source-twilio-taskrouter: ensure inline schemas, updated cdk, poetry (where possible) (#37278)
57a5943 source-zendesk-sunshine: ensure inline schemas, updated cdk, poetry (where possible) (#37302)
96f11a7 source-zapier-supported-storage: ensure inline schemas, updated cdk, poetry (where possible) (#37300)
33d1aca source-yahoo-finance-price: ensure inline schemas, updated cdk, poetry (where possible) (#37295)
66c7fef Docs (ci_credentials
): Add remote install instructions via pipx
(#35809)
614e15f [connector-templates] Switch python destination template to generate pyproject.toml instead of setup.py and requirements.txt (#37457)
383af5c Update salesforce.md (#19925)
d497014 🐛 Source Klaviyo: fix invalid path for '.coveragerc ' (#37439)
f493c7b Rename File format related classes to be agnostic of S3 (#37442)
7adfb7a 🐛 Source Salesforce and Stripe: Up CDK version to ensure config_errors are not translated as system_e… (#37448)
ef27741 Fix format (#37449)
7c85652 🤖 Cut version 0.83.1 of source-declarative-manifest
b110774 🤖 patch bump Python CDK to version 0.83.1
48af92a Concurrent CDK: if exception is AirbyteTracedException, raise this an… (#37443)
ebb57f0 pin zendesk-support 2.3.0 in cloud (#37446)
ae64db1 🤖 Cut version 0.83.0 of source-declarative-manifest
58cd487 🤖 minor bump Python CDK to version 0.83.0
b20cd1b ✨ airbyte-cdk - Adds JwtAuthenticator
to low-code (#37005)
<…
airbytehq/airbytePatrick Nilan
04/24/2024, 4:10 PMuser
04/26/2024, 1:10 AMairbyte-ci
(#37440)
c4ad3d9 convert destination-bigquery to kotlin CDK (#36899)
993aece [Source-mongo] : Implement fixed chunk size (1million) (#37559)
135e623 ✨ [source-zendesk-support] Fix the fields
data type to include the id
and value
(#36388)
07db1ca bump source-e2e-cloud version (#37583)
401eee7 bumping jsonschemafriend to 0.12.4 (#37581)
0de1b48 CI: Refactor commit and push steps of 'format-fix' workflow (#37580)
5629bb9 CI: fix missing slash command input args (#37564)
e172376 regression-test: automatically fetch connection candidates (#37384)
6399307 🐛 Source Mailchimp: fix date-time format issue for start_date
for email_activity
stream (#37572)
17a374e connectors-qa: add check for 'maxSecondsBetweenMessages' presence in certified connectors metadata (#36803)
3ca88e6 community-ci: upload reports as github action artifacts (#37571)
c578ee7 [Docs] Add schema propagation backfill feature (#37536)
ae022a6 community-ci: make the cdk test fail if they run on forks (#37569)
71ebd4a productionize community-ci
workflow (#37404)
e6b3874 CI: Fix git repo ref in format-check workflow (#37563)
5a56400 CI: fix git ref in format-check workflow (#37562)
f96d9f1 CI: Fix skip condition on forks (2 of 2) (#37554)
9b9f34e allow "java" connectors to be written in kotlin (#37485)
352fc28 🤖 Cut version 0.85.0 of source-declarative-manifest
fa2636c 🤖 minor bump Python CDK to version 0.85.0
8eb634c [Source-mongodb-v2] : Fix logic in determining whether a resume token is valid or not (#37557)
86ee91e Connector builder: read input state if it exists (#37495)
28209fd source-zenloop: ensure inline schemas, updated cdk, poetry (where possible) (#37304)
14820c5 CI: Fix fork check condition (#37553)
9459d4f source-marketo: ensure inline schemas, updated cdk, poetry (where possible) (#36650)
2e0e259 source-jira: ensure inline schemas, updated cdk, poetry (where possible) (#36646)
1c187e9 CI: Allow format fix on PRs from forks (#37393)
8aa506c airbyte-ci: add a contribution guide (#37533)
b339f1b 🐛 Source Zendesk Support: fix parse response for ticket metrics (#37450)
fce3409 bump s3 cdk version (#37546)
587e874 Remove excessive logs in counter (#37541)
d9ee103 [Source-mongo] : Adding a new iterator in preparation of adding chunking subqueries (#37525)
a384c59 Rbroughan/stream limits docs updates (#37526)
df67b36 🐛Source Rss: Fix Incremental Sync (#37535)
9eae446 🚨🚨 Source Linkedin Ads: Update pivotValues pk type for Ad Analytics streams (#37531)
d790b7d [Source-postgres] : Better error messages on switching between sync m… (#37509)
b5fef4e Live tests: update README (#37512)
c05c70b Sou…
airbytehq/airbyte