Great to see that we're getting Hub metrics regularly now! https://github.com/meltano/hub/pull/632 @feather.rw do you know if we're rebuilding the Hub on a daily basis? @pat_nadolny has the Squared project pulling metrics daily so ideally we'd have it updated on the Hub once a day as well.

https://hub.meltano.com/loaders/target-snowflake hub says target-snowflake only has 1 project? That seems a bit off

hey, we're planning on moving a couple of taps from personal github accounts to the

voxmedia

github org. other than updating relevant metadata in the meltano hub entry is there anything else y'all think we need to do to ensure nothing breaks for downstream users?

@pat_nadolny do you know if we have a JSON schema validating commands defined on a plugin? I’m not seeing it in the schemas directory, but I could be missing something.

Getting

301

status from https://hub.meltano.com/extractors/tap-google-analytics - not breaking anything but we did get some warnings, since we link to some hub pages from our docs.

I was chatting with @vincent_legendre and he mentioned that he was looking to get some fixes into target-bigquery, but didn't realize there were 2 other variants folks were working on for target-bigquery. I also saw that there is some kind of "Meltano bot" that's scraping github for taps / targets and pushed up a ton of new extractors/targets (awesome by the way) , are we missing new variants on existing taps/targets in the Meltano bot that's written?

Hey team, I'm trying to make a PR for the hub and want to test it locally, but am getting this error when running yarn on my branch:

(.venv) stephane@stephane-XPS-15-9510:~/Documents/open-source/hub$ yarn
yarn install v1.22.18
warning package-lock.json found. Your project contains lock files generated by tools other than Yarn. It is advised not to mix package managers in order to avoid resolution inconsistencies caused by unsynchronized lock files. To clear this warning, remove package-lock.json.
[1/4] Resolving packages...
warning Resolution field "sharp@0.29.3" is incompatible with requested version "sharp@^0.25.2"
success Already up-to-date.
Done in 0.40s.

Which leads to this:

gridsome: command not found

I'm not that familiar with yarn. Would there be a way to solve this issue?

i just transfered ownership for tap-instagram from my github account to the

voxmedia

org and made a PR to update on the Hub https://github.com/meltano/hub/pull/973

TIL useful-forks. It has an interesting diagram for how they determine activity level in forks for a repo: https://github.com/useful-forks/useful-forks.github.io#how-it-works it might be useful for the Hub at some point.

I was wondering if there is a reason to not show the different commands in the hub?

Looks like there's no way to easily put in a normal issue to https://github.com/meltano/hub I'll make it work by using the template and updating it, but fyi!

We've got a few updates landing on melty rainbow flame Meltano Hub melty rainbow flame today that I wanted to take a minute to call attention to: 1. EDK based utility plugins have been taken out of preview 🚀! This means that the recommended way to install transformers and orchestrators is now to use the utility plugin type i.e.

meltano add utility dbt-<adapter>

vs the traditional way using the plugin types

transformer

or

orchestrator

. Nothing is changing around the support for those existing

transformer

and

orchestrator

plugins but we're moving towards recommending the utility versions for new users. See the EDK docs for details on why we're moving in that direction. The Hub got a bit of an update to reflect these changes ✨. 2. More docs 📄 related to working in the Singer ecosystem singer logo. We want this to be a place to memorialize some of the less well known tips and tricks of working in the Singer ecosystem for both new and more experienced community members, things like: best practices, common patterns, and tips for evaluating a tap and target. Let us know if you have any thoughts or suggestions!

Is there a way to browse plugins built with the Meltano SDK? I see “built with the meltano sdk” badges on the Hub but I don’t see an obvious way to filter on that

is there a reason https://github.com/MeltanoLabs/meltano-map-transform isn’t on the Hub?

Guessing this isn't just me?

Today I built a new tap: tap-jaffle-shop, 🚀 which builds upon the brand new jafgen library from dbt-labs. dbt The tap generates sample data, with an input parameter for number of years which allows you to build larger or smaller sample datasets. It should be a nice starting point for POCs and tutorials - with the one caveat that it doesn't support "incremental" streams, due to the data being fully and randomly generated on each invocation. I plan to get this added to the hub next week, but the longer-term plan is to integrate it with an end-to-end Jaffle Shop project, in the style of MDS-in-a-Box, with dbt, DuckDB, and Evidence all pre-configured in a Codespace.

https://github.com/meltano/hub/pull/1248 new tap ready for PR review 🙂

I proposed changing the default tap-mongodb variant to z3z1ma in https://github.com/meltano/hub/pull/1231, looking for thoughts and opinions 🧵

https://github.com/meltano/hub/pull/1291 - tap-greenhouse written with meltano singer sdk. Still in development phase.. But, supports 3 Primary streams

We’re considering dropping the

meltano discover

command. https://github.com/meltano/meltano/issues/7656 Please leave a comment if you’re an active user of this command and how you use it in your workflow if you don’t think it should be removed

Tableau extension to refresh extracts: https://github.com/meltano/hub/pull/1333

Shoutout to ChatGPT for helping me to sort the search results by plugin type and then name! If you search on https://hub.meltano.com/ now you’ll see extractors first instead of utilities 😄

@pat_nadolny looks like we’re getting some reports that https://hub.meltano.com/extractors/tap-parquet is starting to not work for folks. We should reassess the gold badge on it.

When you type google ads both of these come up. The first one is the "old" google ads tap, I'd imagine folks would want the second one to pop up by default

Hey y’all 👋 Is there a process on getting a tap added to Meltano Hub? I assumed a PR was needed to add documentation in but was not entirely sure

Hello everyone, I have a question - Using meltano, I am able to configure requirements of a single user and fetch relevant data for that user via an extractor ( be it tap-gong, tap-salesforce etc). But suppose we want to create a platform, where multiple users can come and select multiple extractors as source for their data and we will load the data and show in the UI. I guess my question is, can I configure the meltano pipeline for gong/salesforce extractors to fetch data of multiple users wherein each user can have different configurations. I will be storing configuration for each user from into a database and meltano pipeline will pick the details for each user one-by-one or in parallel. What would be the best way to achieve this?

Hello, please can someone help me figure this out? I’m following this tutorial and after I do a test run, I don’t see any

commits.jsonl

file, or anything created in the outputs folder at all. Not quite sure if I’m doing something wrong, although I tried to follow everything in the documentation.

Looks like hub.meltano.com or docs.meltano.com are down

Unsure if this is the best place to mention this, but I think the transferwise variant of target-snowflake shouldn't have the "Active" badge for

Maintenance Status

. The repo says it was archived Sep 22, 2024.