📢 A_nnouncing a change in the schedule of Office Hours. Previously held biweekly, we are now moving to a monthly recurrence._ The first installment of the new monthly Office Hours will take place on June 19th, so save the date to come chat with the team, ask questions about Meltano, show off your latest creations, and discuss new features. As always, we encourage you to ask any questions you may have in the usual Slack channels.

Happy Monday! melty bouncy Singer SDK v0.38.0 was released today! melty bouncy Here are a few highlights: • Null replication key values are now handled correctly instead of crashing the tap • A detailed error message is now logged every time schema validation fails for any record See the complete release notes in GitHub.

📢 Office Hours starting in ~1.5 hours! melty bouncy Come chat with the team, ask questions about Meltano, show off your latest creations, and discuss new features. We’ll post the Zoom link in #C069A040BHT once we’re in the room.

Next Office Hours will be held on July 31st. Come join us on that date to share what you've been working on or hear about the latest updates from Meltano and the SDK! Slack Conversation

Happy Monday everyone! melty bouncy Meltano v3.5.0 was released today! melty bouncy • Docker Hub 🐋 • PyPI 🐍 Here are a few highlights: • Plugins are now auto-installed when commands require them. This change involves two new features: ◦ New CLI options: ▪︎

--install

▪︎

--no-install

▪︎

--only-install

◦ A new project-level setting auto_install. The value of this determines whether plugins are auto-installed when none of the above options are passed (the default). Set it to

false

to require

--install

to auto-install plugins. There are some known gaps that will be addressed in future releases, give them a 👍 to let us know they are affecting your use of this feature: ◦ https://github.com/meltano/meltano/issues/8660 Thanks to @Reuben (Matatika) for contributing this to Meltano! • A new CLI option --refresh-catalog and plugin-level extra use_cached_catalog. Use this if you need the extractor's catalog to reflect changes that occurred upstream, like often happens with database sources. Thanks to @andy_o_neal for contributing this feature! See the complete release notes in GitHub.

Hello folks, I'm happy to announce that we've added allcontributors to the Meltano repo: https://github.com/meltano/meltano/blob/main/CONTRIBUTORS.md I'm planning to add all folks that contribute to Meltano, the SDK, any MeltanoLabs repos, and MeltanoHub. Do comment here or in the issue if you notice you or someone else is missing. Slack Conversation

Happy Wednesday! melty bouncy Singer SDK v0.39.0 was released yesterday! melty bouncy Here are a few highlights: • The

json

module can now be used within stream maps

stream_maps:
  animals:
    id: id
    data: "json.dumps({'description': description, 'verified': verified, 'views': views, 'created_at': created_at})"
    __else__: null

• The crypto dependencies

PyJWT

and

cryptography

are now optional and can be installed by requesting the

jwt

extra, i.e.

singer-sdk[jwt]

. These are only currently required for JWT authentication, but if your package depends on any of these, make sure the dependency is explicit. • The

pendulum

and

python-dateutil

dependencies are no longer used by this library and will be removed in a future release. If your package relies on any of them, make sure the dependency is explicit. • We're working on supporting msgspec for more performant IO, so keep an eye out for that 😉. See the complete release notes in GitHub.

📢 Office Hours starting in ~2 hours! melty bouncy Come chat with the team, ask questions about Meltano, the Singer SDK and the plugin ecosystem. Show off your latest creations, and discuss new features. We’ll post the Zoom link in #C069A040BHT once we’re in the room.

Hey folks 👋 Just wanted to send a reminder that we have a full history of this community slack at https://discuss.meltano.com powered by Linen. We still encourage you to post here as this slack is where we actively monitor messages, but if you want to search a longer history then Linen is recommended. melty bouncy

📢 Office Hours starting in ~1 hour! melty bouncy Come chat with the team, ask questions about Meltano, the Singer SDK and the plugin ecosystem. Show off your latest creations, and discuss new features. We’ll post the Zoom link in #C069A040BHT once we’re in the room.

📢 Office Hours starting in ~1 hour! melty bouncy Come chat with the team, ask questions about Meltano, the Singer SDK and the plugin ecosystem. Show off your latest creations, and discuss new features. We’ll post the Zoom link in #C069A040BHT once we’re in the room.

Happy Wednesday! melty bouncy Singer SDK v0.41.0 was released today! melty bouncy The main highlight it that it's now easier for SQL tap developers to customize the mapping from SQL column types to JSON schema. See the guide for details. We're also working on native support for file taps on local and remote filesystem, so stay tuned! See the complete release notes in GitHub.

📢 Office Hours starting in ~1 hour! melty bouncy Come chat with the team, ask questions about Meltano, the Singer SDK and the plugin ecosystem. Show off your latest creations, and discuss new features. We’ll post the Zoom link in #C069A040BHT once we’re in the room.

Happy Wednesday! melty bouncy Singer SDK v0.42.0 was released a few days ago! melty bouncy Highlights • For SQL target developers, there is now a public and official API for overriding how JSON schema types are mapped into SQL types. Let us know if there's any improvements we can make to it to better suit your use case! • The name of the stream is now available in stream maps as

__stream_name__

, including in the context of

__alias__

expressions. • This is last minor version to support Python 3.8, which reached its EOL on 2024-10-07, the next release will only support Python 3.9+. See the complete release notes in GitHub.

📢 Office Hours starting in 2 hours! melty bouncy Come chat with the team, ask questions about Meltano, the Singer SDK and the plugin ecosystem. Show off your latest creations, and discuss new features. We’ll post the Zoom link in #C069A040BHT once we’re in the room.

Happy Monday! melty bouncy Meltano v3.6.0 was released today! melty bouncy Highlights • The default value of

elt.buffer_size

(docs) was bumped from 10 MiB to 100 MiB. This should reduce the number of broken pipelines you may encounter when taps emit hefty records. • Logs emitted with the `meltano.core.logging.json_log_formatter` now include an

exceptions

key containing a structured array of exception objects to aid in log parsing and debugging. • Mappings are now correctly auto-installed. • Python 3.8 (EOL 2024/10) is no longer supported. • Python 3.13 is now supported. See the complete release notes in GitHub.

Happy Wednesday! melty bouncy Singer SDK v0.43.0 was released yesterday! melty bouncy Here are a few highlights: • A new SQL tap class attribute exclude_streams allows developers to exclude certain database schemas by default from discovery. This can speed up discovery and avoid issues when mapping types from database-internal schemas. • Discovery for SQL taps should be about 35% faster now, thanks to using SQLAlchemy 2.0+ reflection features. • A new target built-in setting

process_activate_version_messages

lets users disable processing of

ACTIVATE_VERSION

messages. • Support for other content-types in REST streams with the new RESTStream.payload_as_json attribute. This should make it easier to work with APIs that expect non-JSON payloads, such as XML. • The

RESTStream.rest_method

attribute is deprecated in favor of RESTStream.http_method. • ⚠️ This release drops support for Python 3.8. Please make sure to upgrade your tap or target to support Python 3.9+. • ⚠️ SQL taps now require SQLAlchemy 2.0+. See the complete release notes in GitHub. postgresql MeltanoLabs/target-postgres v0.2.0 was also released yesterday! postgresql The main highlight of this release is support for more performant loading by setting the

use_copy

config to

true

. We encourage you to test it and report any issues!

📢 Office Hours starting in less than 1 hour! melty bouncy Come chat with the team, ask questions about Meltano, the Singer SDK and the plugin ecosystem. Show off your latest creations, and discuss new features. We’ll post the Zoom link in #C069A040BHT once we’re in the room.

📢 Next Wednesday we'll be hosting Office Hours. Take a look at the board and feel free to suggest topics in this thread. Happy New Year!

📢 Office Hours starting in 2 hours! melty bouncy Come chat with the team, ask questions about Meltano, the Singer SDK and the plugin ecosystem. Show off your latest creations, and discuss new features. We’ll post the Zoom link in #C069A040BHT once we’re in the room.

Hey <!everyone> in the Meltano Community! 👋 It’s been a while since we’ve shared an announcement here, but this one’s worth the wait. As a quick reminder, Arch Data, Inc. arch (formerly Meltano, Inc.) leverages Meltano as part of our end-to-end AI data & analytics platform. Arch is focused on helping less technical teams that may not have dedicated data engineers on staff—but Meltano continues to thrive, powering our platform and evolving through updates to the Core, the SDK, and MeltanoHub (checkout the Changelog for more info). Now we’re very excited to introduce "Mel", our AI-powered Data Engineer, designed to supercharge data engineering workflows with an AI-first approach. Here’s why we think Mel will excite the Meltano community: • Meltano at its Core: meltano Mel runs any Meltano connector—*custom, private, or public*—and supports nearly any destination. • Effortless Pipelines: Simply type commands like “Set up a connection between [Connector X] and [Warehouse Y]” and watch it happen in minutes. • Powerful Transformations: Run as many dbt Core transformations as you need. • Expert Support: Alongside Mel, you get access to the Arch team to handle scaling, orchestration, and infrastructure. Why Arch + Mel Might Not Be for Everyone: • It’s a paid service, so it may not suit those with tight budgets. • Not everything is fully code-first yet—though we’re working on this alignment with Meltano’s ethos. • We’re focused on Meltano SDK-based connectors and dbt transformations, so other utilities may not be supported. That said, if you’re a smaller team looking to bring AI into your data stack, level up your data engineering workflows, and save time, we’d love to chat. 🔗 Check out our blog and video here to see Mel in action and let us know your thoughts. We’d love to hear any ideas you have on workflows or features on your wishlist. We’re building something exciting and can’t wait to hear from you!

Happy Friday! melty bouncy Singer SDK v0.44 was released! melty bouncy Additionally, v0.44.1 and v0.44.2 were also released this week. Here are a few highlights: • Target developers can now map fields to database-specific data types using the

x-sql-datatype

extension. Read the docs for more details, and take a look at MeltanoLabs/target-postgres for a reference implementation. • Avoid writing an empty state. This could prevent the loss of state upon failures. Thanks @joaopamaral! • For contributors: the Singer SDK now uses uv to manage its dependencies. • For plugin developers: the cookiecutter templates now also use uv to manage their dependencies. We've updated the documentation with uv-based examples along the existing Poetry ones, and added a migration guide to switch from Poetry to uv. See the complete release notes in GitHub: • v0.44.0 • v0.44.1 • v0.44.2 postgresql MeltanoLabs/target-postgres v0.3.0 was also released a few days ago! postgresql The main highlight of this release is support for

x-sql-datatype

for Postgres integer types. Have a fun weekend!

Friendly reminder that if you're new to the community and haven't given the Meltano or SDK repos a GitHub star ⭐, it's greatly appreciated! We're almost at 2,000 for the Meltano repo 📈 melty bouncy

📢 Office Hours starting in 2 hours! melty bouncy Come chat with the team, ask questions about Meltano, the Singer SDK and the plugin ecosystem. Show off your latest creations, and discuss new features. We’ll post the Zoom link in #C069A040BHT once we’re in the room.

📢 PSA If plugin installation suddenly started failing for you, you might wanna check this out: https://github.com/meltano/meltano/discussions/9157 Slack Conversation

📢 Office Hours starting in ~1.5 hours! melty bouncy Come chat with the team, ask questions about Meltano, the Singer SDK and the plugin ecosystem. Show off your latest creations, and discuss new features. We’ll post the Zoom link in #C069A040BHT once we’re in the room.

Happy Wednesday! melty bouncy Meltano v3.7 was released! melty bouncy Here are a few highlights: • Settings of kind

date_iso8601

now support relative date values. • Custom State Backends • Improved logging and more options • The

uv

venv backend is no longer "experimental" Release notes: v3.7.0 Discussion: #9169 melty bouncy Singer SDK v0.45 was also released! melty bouncy Here are a few highlights: • Experimental msgspec IO •

singerlib

is now a public module • Singer Decimal string format Release notes: v0.45.0 Discussion: #2922 Join us if #C069A040BHT hours later today to talk about these releases!

⚠️ Office Hours Schedule Change Hi everyone and happy Monday! Just a quick note to let you know I’ve moved this week’s office hours to accommodate scheduling needs. • Previously: Wednesday, April 23rd at 16 UTC / 12 EDT / 11 CDT • New Time: Wednesday, April 30th at 16 UTC / 12 EDT / 11 CDT

Hey <!channel> I've messaged some of you directly but wanted to throw this to the rest of the community. We're hoping to talk with as many Meltano users over the next few weeks as possible. Specifically looking to understand your role within your respective orgs, challenges you're facing (w/ Meltano or not!), and how you're thinking about all of these AI tools. Please DM if you're willing to chat for ~30 minutes. And if you're able to chat in the next 2 days (4/24 and 4/25) we'll send you a special gift as a token of appreciation. melty bouncy Thank you!

📢 Office Hours starting in about an hour! melty bouncy Come chat with the team, ask questions about Meltano, the Singer SDK and the plugin ecosystem. Show off your latest creations, and discuss new features. We’ll post the Zoom link in #C069A040BHT once we’re in the room.