John (Airbyte)
John (Airbyte)
octavia import
◦ Users can get existing resources (#13254)
◦ Users can retrieve the JSON configuration from a remote resource using octavia get
, this can be useful for some scripting / orchestration use cases.
• Core Airbyte features:
◦ Per Stream State
▪︎ Per-Stream state new flow (#14634)
▪︎ Release per stream to the OSS project (#15008)
◦ Display new per-stream and global state to users when viewing connection settings (#15020)
◦ Base Normalization: handle airbyte_type from stream schema in normalization (#13591)
◦ Security: Upgrade platform to openjdk:19-slim-bullseye (#14971)
◦ Self Hosting: Refactor OSS Helm Charts (#14794)
◦ Monitoring: We’ve officially added an Open Telemetry interface to Airbyte OSS, along with a set of actionable metrics to use when running OSS Airbyte at scale!
◦ CDK: Add support for enabling debug from command line and some basic general debug logs (#14521)
◦ CDK: Add a schema_generator tool (#13518)
◦ Low Code CDK in development: take a peek! (#14402) (#14317) (#14288)(#14317)(#14004)
◦ Docs: improve doc for contributing locally (#14661)
◦ Docs: Airbyte Cloud’s Single vs. Multiple Workspaces (#14608)
• New Connector features:
◦ 🎉Redshift, Databricks, Snowflake, S3 Destinations: Make S3 output filename configurable (#14494)
◦ Destination S3: update INSTANCE_PROFILE to use AWSDefaultProfileCredential (#14231)
◦ Destination Oracle: custom JDBC parameters (#13841)
◦ Source Amazon Seller Partner: add FBA storage fees report (#14625)
◦ Source Amazon Seller Partner: Add new streams (#13604)
◦ Source Azure Table Storage: Add incremental append capability (#14212)
◦ Source BingAds: expose hourly/daily/weekly/monthly options from configuration (#13801)
◦ Source Cart.com: add order_statuses and increase pagesize to 1000 (#14752)
◦ Source File: add user-agent option (#14488)
◦ Source File: Add YAML format (#14588)
◦ Source Gitlab: add GroupIssueBoards stream (#13252)
◦ Source PayPal Transaction: added OAuth2.0
, fixed bug with normalization (#15000)
◦ Source Postgres: make initial cdc waiting time configurable (#14451)
◦ Source Okta: add User_Role_Assignments and Group_Role_Assignments stream (#14556)
◦ Source Okta: add GroupMembers stream (#14380)
◦ Source Okta: OAuth2.0 authorization method (#14710)
◦ Source Okta: add custom roles stream (#14610)
◦ Source Notion: add OAuth authorization for source-notion connector (#14706)
◦ Source Sendgrid: add /messages stream (#14256)
◦ Source Tiktok Marketing: Video metrics stream (#13650)John (Airbyte)
mergeable
to is_mergeable
(#14274)
• Source Google Ads: enable full refresh, disable incremental and expected_records (#14191)
• Source Tiktok marketing - remove granularity config option (#13890)
🐛 Bug fixes
• Destination BigQuery can handle nulls inside arrays (#14522)
• Destination Clickhouse: enabled normalization tests (#15069)
• Destination Clickhouse: Added socket_timeout property (#13516)
• Destination Google Sheets: flushes on every state message and flush when buffer gets too large (#14751)
• Destination Redshift: use s3 bucket path for s3 staging operations (#13916)
• Source Chargebee: fix transactions sort-by (#14672)
• Source Klaviyo: added new keys to schema (#14947)
• Source Klaviyo: unit test coverage 96% (#14872)
• Source Klaviyo: max_retries = 10 for Lists
stream (#14617)
• Source Kustomize: Use resources
since bases
is deprecated (#14037)
• Source Facebook Marketing: Fix since cannot be in the future in time_range error (#14831)
• Source Facebook Marketing: check “MANAGE” task permission (#14786)
• Source Facebook Marketing: allow configuration of MAX_BATCH_SIZE (#14267)
• Source Freshsales: tune get_view_id function (#14705)
• Source Freshdesk: Update parsing of start_date param (#14049)
• Source Github: improve schema for stream pull_request_commits
added “null” (#14613)
• Source Github: use GraphQL for reviews
stream (#13989)
• Source Github: add Retry for GraphQL API Resource limitations (#14376)
• Source Google Analytics v4: Add handle quota error (#14949)
• Source Google Analytics: Specify integer for dimension ga:dateHourMinute (#14298)
• Source Google Ads: Updated API version from v9 to v11 (#14614)
• Source Hubspot: do not limit reading data to 30 days for property History Stream (#15035)
• Source Hubspot: fixed SAT test, commented out expected_records (#14140)
• Source Hubspot: Add private app authentication (#14412)
• Source Hubspot: refactor PropertyHistory stream (#14666)
• Source Intercom: added state_checkpoint_interval
for all incremental streams (#14830)
• Source Intercom: fix conversation_parts
stream schema (#14554)
• Source Intercom: refactored slow streams to use /search
endpoint (#14403)
• Source Intercom: extend Contacts
schema with new properties (#14099)
• Source Monday: timeout errors (#14443)
• Source MySQL: test utf8 char in json column (#14865)
• Source MySQL: upgrade debezium version to 1.9.2 (#14542)
• Source MSSQL: aligned regular and cdc syncs and its datatype tests (#14379)
• Source Okta: unit tests were added (#14927)
• Source Orbit: remove workspace_old.json (#14208)
• Source Outreach: fix record parsing and cursor field access (#14386)
• Source Notion: fix normalization (#14505)
• Source Paypal Transaction: RESULTSET_TOO_LARGE validation (#14804)
• Source Postgres: retrieve only the tables in the publication under cdc mode (#14447)
• Source Recharge: fix additionaProperties
in spec.json (#14978)
• Source Recharge: increase unit_test
cov, fix schemas (#14902)
• Source S3: “decimal” type added for parquet (#14911)
• Source Singer: Fix incompatibilities and typing issues (#14148)
• Source Snowflake: Source/Destination doesn’t respect DATE data type (#14828)
• Source TiDb: Removed additionalProperties: false from spec (#14996)
• Source TikTok Marketing : Access token is null #14299 (#14461)
• Source Webflow add ids to streams (#14689)
• Source Zendesk Support: Convert ticket_audits.previous_value
values to string (#15036)
• Source Zendesk Support: Convert tickets.custom_fields
values to string (#14829)Nicolas Grenié
08/04/2022, 7:09 PMKaren (Airbyte)
Jordan Fox
08/05/2022, 7:45 PMAndy Yeo (Airbyte)