https://linen.dev logo
Join Slack
Powered by
# announcements
  • j

    Jovan Soldatovic

    03/11/2021, 11:11 AM
    But it lasts for couple of secs
  • j

    Jovan Soldatovic

    03/11/2021, 11:11 AM
    and than shows up
    👍 2
  • s

    Slackbot

    03/12/2021, 6:59 PM
    Reminder: This is office hour time!! Join now: https://us02web.zoom.us/meeting/register/tZcod-2rpzgvHtYBIUHq6f2u5Npy-Q4Hhh3o
  • j

    Jun Takeshita

    03/15/2021, 6:21 AM
    oops, sorry I tried to add new source on the Airbyte Sources screen. I would like to use mysql as my resource but happened The connection test failed
  • j

    Jun Takeshita

    03/15/2021, 6:22 AM
    Actually I prepered Mariadb instead of MySQL
  • j

    Jun Takeshita

    03/15/2021, 6:22 AM
    Is it enough?
  • j

    Jun Takeshita

    03/15/2021, 6:33 AM
    Well, MariaDB is working vagrant instance using docker compose
  • j

    Jun Takeshita

    03/15/2021, 6:35 AM
    port 3306 is working on macos and vagrant instance
  • j

    Jun Takeshita

    03/15/2021, 6:36 AM
    On the other hand, Airbyte is working in docker compose on macos
  • j

    Jun Takeshita

    03/15/2021, 6:36 AM
    yes, localhost, you are right
  • j

    Jun Takeshita

    03/15/2021, 6:38 AM
    what is main channel name as your meaning?
  • j

    Jun Takeshita

    03/15/2021, 6:39 AM
    general is not main channel?
  • j

    Jun Takeshita

    03/15/2021, 6:41 AM
    I attached log file about the error
    logs-11-0.txt
  • j

    John (Airbyte)

    03/15/2021, 7:17 AM
    let's try to keep conversations in threads 🙂
    👍 1
  • j

    John (Airbyte)

    03/16/2021, 8:59 PM
    <!channel> Hey everyone 👋! here are the updates for the past week: • 🎉 Our 1st community call is coming in 15 days on April 1st. Register here to learn how Jins Kadwood (CTO at AgriDigital) is leveraging Airbyte for their caching services. We will share a recording of it.  • 2 new connectors: ◦ Instagram ◦ Google Director • Features / fixes: ◦ Creating and deleting multiple workspaces is now supported via the API. Thanks to @Samuel Gordalina for contributing this feature! ◦ Facebook Marketing: support of API v10 ◦ Google Analytics: support incremental sync ◦ Jira: bug fix to consistently pull all tickets ◦ HTTP Source: bug fix to correctly parse JSON responses consistently ◦ Normalization now supports numeric types with precision greater than 32 bits ◦ Normalization now supports union data types ◦ Support longform text inputs in the UI for cases where you need to preserve formatting on connector inputs like .pem keys ◦ Expose the latest available connector versions in the API • Documentation: ◦ Airflow: published a new tutorial for how to use the Airbyte operator. Thanks @[DEPRECATED] Marcos Marx for writing the tutorial!  ◦ Connector Contributions: All connectors now describe how to contribute to them without having to touch Airbyte’s monorepo build system -- just work on the connector in your favorite dev setup! • Upcoming Updates ◦ Oracle DB is coming soon! ◦ You’ll be able to see what the latest versions are for each connector so you can stay up to date with all the latest bug fixes and features!
    đź’Ż 4
    🔥 1
    âś… 2
    🔥 9
    airbyte star 3
    🚀 4
    🥨 1
  • j

    Jovan Soldatovic

    03/16/2021, 9:00 PM
    2
  • j

    John (Airbyte)

    03/17/2021, 5:29 AM
    Hey community! We're looking for a contractor that is great at building dashboards (and tables) for a project 🙂 Please DM me if you're interested!
  • s

    Slackbot

    03/19/2021, 5:59 PM
    Reminder: This is office hour time!! Join now: https://us02web.zoom.us/meeting/register/tZcod-2rpzgvHtYBIUHq6f2u5Npy-Q4Hhh3o
  • j

    John (Airbyte)

    03/23/2021, 10:50 PM
    <!channel> Hey everyone 👋! here are the updates for the past week: • 🎉 Our 1st community call is coming in a week on April 1st. Register here to learn how Jins Kadwood (CTO at AgriDigital) is leveraging Airbyte for their caching services. We will share a recording of it.  • 2 new connectors:  ◦ Gitlab ◦ Airbyte-native Hubspot connector, and we deprecated the old Singer-based Hubspot connector • Fixes / features: ◦ Improved the speed of get spec, check connection, and discover schema by migrating to the Temporal workflow engine. ◦ Exposed cancellation for sync jobs in the API (will be exposed in the UI in the next week!). ◦ Developing connectors now requires almost no interaction with Gradle, Airbyte’s  monorepo build tool. If you’re building a Python connector, you never have to worry about developing outside your typical flow. See the updated documentation.  ◦ Bug fix: Fix issue where migration app was OOMing • We published the deck we used to raise the $5M with Accel. Hopefully, it will be interesting to other companies!
    🙏🏼 1
    airbyte heart 7
    🙏 1
    🙌 3
    airbyte rocket 5
    🎉 1
    airbyte star 2
    đź’Ż 1
    🔥 4
    octavia loves 4
  • s

    Slackbot

    03/26/2021, 5:59 PM
    Reminder: This is office hour time!! Join now: https://us02web.zoom.us/meeting/register/tZcod-2rpzgvHtYBIUHq6f2u5Npy-Q4Hhh3o
  • e

    Eli Jackson

    03/26/2021, 11:58 PM
    Thank you so much for the quick reply
  • c

    Chris (deprecated profile)

    03/29/2021, 8:50 AM
    Hello! Sorry for the confusion, if you’re using Airbyte release 0.17.2-alpha, we introduced a new button in the admin panel that allows users to upgrade their connectors to the latest version on the master branch. Unfortunately, destination connectors versions higher than 0.2.2 are now requiring a new field called “Destination Sync Mode” (with values either APPEND, OVERWRITE, DEDUPTED) which is tied to new functionality on the connection page only available starting from Airbyte 0.18.0-alpha that just got released! So you may want to wait until you are on Airbyte 0.18.0+ before upgrading your connectors too far. If you run into exceptions such as
    Undefined destination sync mode
    then, you can: 1. Upgrade your airbyte version to 0.18.0 following the steps described here: https://docs.airbyte.io/tutorials/upgrading-airbyte 2. If you wish to keep 0.17.2 or 0.17.3, then you can always downgrade your destination connectors in the admin page to a stable state (0.2.0 should be the recommended version here). Thanks!
    airbyte 1
    🙌 1
  • b

    Burak Emre Kabakcı

    03/29/2021, 2:46 PM
    That’s correct. Regarding the Fivetran dbt project, unfortunately the schema doesn’t match so we need to fork and maintain a dbt project for Airbyte separately. If we can develop airbyte-[source] (airbyte-stripe can be the first one) dbt projects and let airbyte run the dbt models along with the internal dbt run, that would be really helpful. Fivetran is pretty active on dbt slack workspace and they releases official dbt packages on dbthub so it feels like the most convenient solution for dbt users but looking at how Airbyte works and reading your blog posts, Airbyte should get more popularity among the dbt users. 🙂
    👍 1
  • r

    Roshan George

    03/29/2021, 6:00 PM
    Good job on the https://docs.airbyte.io/architecture/incremental#rules page. I was wondering if an incremental update requires a strictly unique cursor. Answer readily available. (Does not, you can use a timestamp field that increments but need not be unique per record).
    🙌 2
    🙌🏼 1
  • j

    John (Airbyte)

    03/30/2021, 6:54 AM
    <!channel> Hey everyone 👋! here are the updates for the past week: • 🎉 Our 1st community call is coming this week on April 1st at 1pm PST. Register here to: ◦ Learn how Jins Kadwood (CTO at AgriDigital) is leveraging Airbyte for their caching services.  ◦ Learn about our progress these past few weeks and the roadmap for the month of April! • Connector improvements: ◦ Redshift: implemented Copy strategy to improve its throughput. @Chris Kings-Lynne ◦ Instagram: bugfix an issue which caused media and media_insights streams to stop syncing prematurely ◦ We started measuring throughput of connectors. This will help us improve that point for all connectors.  ◦ Support NCHAR and NVCHAR types in SQL-based database sources ◦ Add the ability to specify a custom JDBC parameters for the MySQL source connector #2611 • Core 0.18.1-alpha version: ◦ Surface the health of each connection so that a user can spot any problems at a glance. (#2405 and #2546) ◦ Added support for deduplicating records in the destination using a primary key using incremental deduped* *(#2460) - Furthermore, a source’s extraction mode (incremental, full refresh) is now decoupled from the destination’s write mode -- so you can repeatedly append full refreshes to get repeated snapshots of data in your source. Here's the documentation about incremental deduped ◦ New “Upgrade all” button in Admin to upgrade all your connectors at once (#2620) ◦ New “Cancel job” button in Connections Status page when a sync job is running, so you can stop never-ending processes. (#2593)
    🙌 4
    👍 7
    airbyte rocket 9
    airbyte 4
    octavia loves 1
  • p

    Pedro Manuel

    03/30/2021, 2:02 PM
    Thanks
  • c

    Chaima Dridi

    03/30/2021, 3:06 PM
    @s I meant without docker entirely.
  • a

    Arturo Rangel

    03/31/2021, 5:21 AM
    perfect!, I’ll do the pull request because it might be useful
  • l

    Luke Mercado

    03/31/2021, 2:42 PM
    Just wanted to say that I love the approach being taken in https://github.com/airbytehq/airbyte/issues/2566#event-4523905449 to both gather feedback and explore options collaboratively.
    👍 3
  • j

    John (Airbyte)

    04/01/2021, 9:36 PM
    well it's not a hard science, but we got 38 votes in 25 min
    âś… 3
1...181920...24Latest