📢 Office Hours starting in ~2 hours! melty bouncy Come chat with the team, ask questions about Meltano, the Singer SDK and the plugin ecosystem. Show off your latest creations, and discuss new features. We’ll post the Zoom link in #C069A040BHT once we’re in the room.

Hey folks 👋 Just wanted to send a reminder that we have a full history of this community slack at https://discuss.meltano.com powered by Linen. We still encourage you to post here as this slack is where we actively monitor messages, but if you want to search a longer history then Linen is recommended. melty bouncy

📢 Office Hours starting in ~1 hour! melty bouncy Come chat with the team, ask questions about Meltano, the Singer SDK and the plugin ecosystem. Show off your latest creations, and discuss new features. We’ll post the Zoom link in #C069A040BHT once we’re in the room.

📢 Office Hours starting in ~1 hour! melty bouncy Come chat with the team, ask questions about Meltano, the Singer SDK and the plugin ecosystem. Show off your latest creations, and discuss new features. We’ll post the Zoom link in #C069A040BHT once we’re in the room.

Happy Wednesday! melty bouncy Singer SDK v0.41.0 was released today! melty bouncy The main highlight it that it's now easier for SQL tap developers to customize the mapping from SQL column types to JSON schema. See the guide for details. We're also working on native support for file taps on local and remote filesystem, so stay tuned! See the complete release notes in GitHub.

📢 Office Hours starting in ~1 hour! melty bouncy Come chat with the team, ask questions about Meltano, the Singer SDK and the plugin ecosystem. Show off your latest creations, and discuss new features. We’ll post the Zoom link in #C069A040BHT once we’re in the room.

Happy Wednesday! melty bouncy Singer SDK v0.42.0 was released a few days ago! melty bouncy Highlights • For SQL target developers, there is now a public and official API for overriding how JSON schema types are mapped into SQL types. Let us know if there's any improvements we can make to it to better suit your use case! • The name of the stream is now available in stream maps as

__stream_name__

, including in the context of

__alias__

expressions. • This is last minor version to support Python 3.8, which reached its EOL on 2024-10-07, the next release will only support Python 3.9+. See the complete release notes in GitHub.

📢 Office Hours starting in 2 hours! melty bouncy Come chat with the team, ask questions about Meltano, the Singer SDK and the plugin ecosystem. Show off your latest creations, and discuss new features. We’ll post the Zoom link in #C069A040BHT once we’re in the room.

Happy Monday! melty bouncy Meltano v3.6.0 was released today! melty bouncy Highlights • The default value of

elt.buffer_size

(docs) was bumped from 10 MiB to 100 MiB. This should reduce the number of broken pipelines you may encounter when taps emit hefty records. • Logs emitted with the `meltano.core.logging.json_log_formatter` now include an

exceptions

key containing a structured array of exception objects to aid in log parsing and debugging. • Mappings are now correctly auto-installed. • Python 3.8 (EOL 2024/10) is no longer supported. • Python 3.13 is now supported. See the complete release notes in GitHub.

Happy Wednesday! melty bouncy Singer SDK v0.43.0 was released yesterday! melty bouncy Here are a few highlights: • A new SQL tap class attribute exclude_streams allows developers to exclude certain database schemas by default from discovery. This can speed up discovery and avoid issues when mapping types from database-internal schemas. • Discovery for SQL taps should be about 35% faster now, thanks to using SQLAlchemy 2.0+ reflection features. • A new target built-in setting

process_activate_version_messages

lets users disable processing of

ACTIVATE_VERSION

messages. • Support for other content-types in REST streams with the new RESTStream.payload_as_json attribute. This should make it easier to work with APIs that expect non-JSON payloads, such as XML. • The

RESTStream.rest_method

attribute is deprecated in favor of RESTStream.http_method. • ⚠️ This release drops support for Python 3.8. Please make sure to upgrade your tap or target to support Python 3.9+. • ⚠️ SQL taps now require SQLAlchemy 2.0+. See the complete release notes in GitHub. postgresql MeltanoLabs/target-postgres v0.2.0 was also released yesterday! postgresql The main highlight of this release is support for more performant loading by setting the

use_copy

config to

true

. We encourage you to test it and report any issues!

📢 Office Hours starting in less than 1 hour! melty bouncy Come chat with the team, ask questions about Meltano, the Singer SDK and the plugin ecosystem. Show off your latest creations, and discuss new features. We’ll post the Zoom link in #C069A040BHT once we’re in the room.

📢 Next Wednesday we'll be hosting Office Hours. Take a look at the board and feel free to suggest topics in this thread. Happy New Year!

📢 Office Hours starting in 2 hours! melty bouncy Come chat with the team, ask questions about Meltano, the Singer SDK and the plugin ecosystem. Show off your latest creations, and discuss new features. We’ll post the Zoom link in #C069A040BHT once we’re in the room.

Hey <!everyone> in the Meltano Community! 👋 It’s been a while since we’ve shared an announcement here, but this one’s worth the wait. As a quick reminder, Arch Data, Inc. arch (formerly Meltano, Inc.) leverages Meltano as part of our end-to-end AI data & analytics platform. Arch is focused on helping less technical teams that may not have dedicated data engineers on staff—but Meltano continues to thrive, powering our platform and evolving through updates to the Core, the SDK, and MeltanoHub (checkout the Changelog for more info). Now we’re very excited to introduce "Mel", our AI-powered Data Engineer, designed to supercharge data engineering workflows with an AI-first approach. Here’s why we think Mel will excite the Meltano community: • Meltano at its Core: meltano Mel runs any Meltano connector—*custom, private, or public*—and supports nearly any destination. • Effortless Pipelines: Simply type commands like “Set up a connection between [Connector X] and [Warehouse Y]” and watch it happen in minutes. • Powerful Transformations: Run as many dbt Core transformations as you need. • Expert Support: Alongside Mel, you get access to the Arch team to handle scaling, orchestration, and infrastructure. Why Arch + Mel Might Not Be for Everyone: • It’s a paid service, so it may not suit those with tight budgets. • Not everything is fully code-first yet—though we’re working on this alignment with Meltano’s ethos. • We’re focused on Meltano SDK-based connectors and dbt transformations, so other utilities may not be supported. That said, if you’re a smaller team looking to bring AI into your data stack, level up your data engineering workflows, and save time, we’d love to chat. 🔗 Check out our blog and video here to see Mel in action and let us know your thoughts. We’d love to hear any ideas you have on workflows or features on your wishlist. We’re building something exciting and can’t wait to hear from you!

Happy Friday! melty bouncy Singer SDK v0.44 was released! melty bouncy Additionally, v0.44.1 and v0.44.2 were also released this week. Here are a few highlights: • Target developers can now map fields to database-specific data types using the

x-sql-datatype

extension. Read the docs for more details, and take a look at MeltanoLabs/target-postgres for a reference implementation. • Avoid writing an empty state. This could prevent the loss of state upon failures. Thanks @joaopamaral! • For contributors: the Singer SDK now uses uv to manage its dependencies. • For plugin developers: the cookiecutter templates now also use uv to manage their dependencies. We've updated the documentation with uv-based examples along the existing Poetry ones, and added a migration guide to switch from Poetry to uv. See the complete release notes in GitHub: • v0.44.0 • v0.44.1 • v0.44.2 postgresql MeltanoLabs/target-postgres v0.3.0 was also released a few days ago! postgresql The main highlight of this release is support for

x-sql-datatype

for Postgres integer types. Have a fun weekend!

Friendly reminder that if you're new to the community and haven't given the Meltano or SDK repos a GitHub star ⭐, it's greatly appreciated! We're almost at 2,000 for the Meltano repo 📈 melty bouncy

📢 Office Hours starting in 2 hours! melty bouncy Come chat with the team, ask questions about Meltano, the Singer SDK and the plugin ecosystem. Show off your latest creations, and discuss new features. We’ll post the Zoom link in #C069A040BHT once we’re in the room.

📢 PSA If plugin installation suddenly started failing for you, you might wanna check this out: https://github.com/meltano/meltano/discussions/9157 Slack Conversation

📢 Office Hours starting in ~1.5 hours! melty bouncy Come chat with the team, ask questions about Meltano, the Singer SDK and the plugin ecosystem. Show off your latest creations, and discuss new features. We’ll post the Zoom link in #C069A040BHT once we’re in the room.

Happy Wednesday! melty bouncy Meltano v3.7 was released! melty bouncy Here are a few highlights: • Settings of kind

date_iso8601

now support relative date values. • Custom State Backends • Improved logging and more options • The

uv

venv backend is no longer "experimental" Release notes: v3.7.0 Discussion: #9169 melty bouncy Singer SDK v0.45 was also released! melty bouncy Here are a few highlights: • Experimental msgspec IO •

singerlib

is now a public module • Singer Decimal string format Release notes: v0.45.0 Discussion: #2922 Join us if #C069A040BHT hours later today to talk about these releases!

⚠️ Office Hours Schedule Change Hi everyone and happy Monday! Just a quick note to let you know I’ve moved this week’s office hours to accommodate scheduling needs. • Previously: Wednesday, April 23rd at 16 UTC / 12 EDT / 11 CDT • New Time: Wednesday, April 30th at 16 UTC / 12 EDT / 11 CDT

Hey <!channel> I've messaged some of you directly but wanted to throw this to the rest of the community. We're hoping to talk with as many Meltano users over the next few weeks as possible. Specifically looking to understand your role within your respective orgs, challenges you're facing (w/ Meltano or not!), and how you're thinking about all of these AI tools. Please DM if you're willing to chat for ~30 minutes. And if you're able to chat in the next 2 days (4/24 and 4/25) we'll send you a special gift as a token of appreciation. melty bouncy Thank you!

📢 Office Hours starting in about an hour! melty bouncy Come chat with the team, ask questions about Meltano, the Singer SDK and the plugin ecosystem. Show off your latest creations, and discuss new features. We’ll post the Zoom link in #C069A040BHT once we’re in the room.

⚠️ Office Hours Schedule Change Hi everyone and happy Tuesday! Just a quick note to let you know I’ve moved this tomorrow's office hours to accommodate scheduling needs. • Previously: Wednesday, May 28th at 16 UTC / 11 CDT / 9 PDT • New Time: Wednesday, June 4th at 16 UTC / 11 CDT / 9 PDT

📢 Office Hours starting in about an hour! melty bouncy Come chat with the team, ask questions about Meltano, the Singer SDK and the plugin ecosystem. Show off your latest creations, and discuss new features. We’ll post the Zoom link in #C069A040BHT once we’re in the room.

Happy Thursday! melty bouncy The Singer SDK v0.47 was released last week! melty bouncy Here are a few highlights: • Taps can now opt-in to emit

ACTIVATE_VERSION

. • Setting the

<APP_NAME>_LOGLEVEL

or

LOGLEVEL

environment variables will now apply that level to all logs generated by taps , mappers and targets. • The stream

post_process

method is now executed for all stream types automatically. This can result in duplicate calls to the function if you have a stream with a custom

get_records

implementation. Release notes: v0.47.0 Docs: https://sdk.meltano.com/en/v0.47.3/

Happy Monday! melty bouncy Meltano v3.8.0 was released today! melty bouncy Here are a few highlights: Simplified plugin management Plugin management commands no longer require the plugin type as a positional argument. For example, all these commands are now supported:

meltano add --no-install tap-github
meltano install tap-github
meltano remove tap-github

Friendlier console output The default console log format now displays fewer stack frames when an exception occurs. This makes the output easier to understand and share. See the logging guide for details on how to further control the maximum number of frames displayed. uv by default The *venv.backend* setting now defaults to

uv

. If you want to continue using virtualenv+pip, configure Meltano with:

meltano config meltano set venv.backend virtualenv

Improved Python version discovery The configured *python* setting can find more Python versions now by relying on uv's and virtualenv's own Python version discovery. This also means that uv-managed Python versions can be auto-installed. For example, if Python 3.9 is not available on your computer, it will be automatically installed when you run

meltano add --python 3.9 tap-postgres

To disable this behavior, set

UV_PYTHON_DOWNLOADS=never

in your environment. Release notes: v3.8.0

Hey <!channel>! I wanted to share that we've opened up more capacity in our professional services team to help companies modernize their data stack and make it AI-ready. If your team needs quick, expert help getting a modern data stack up and running (think Meltano plus your choice of warehouse, orchestrator, and transformation tool), we offer full-stack data engineering support to get you operational fast — whether in the cloud, on-prem, or hybrid. If you're interested, shoot me a message or put some time on my calendar. melty bouncy

Happy Tuesday, new releases of Meltano and the Singer SDK! melty bouncy Meltano v3.9.0 melty bouncy •

meltano add

is now idempotent: Running

meltano add

a second time with the same plugin variant will update the plugin definition in

meltano.yml

. The old behavior of failing if the plugin already exists is available using the

--no-update

flag. • Run IDs are now time-ordered: Meltano leverages UUIDv7 to generate run IDs that sort by the time they were created. Full release notes: v3.9.0 melty bouncy Singer SDK v0.48.0 melty bouncy • The Singer SDK now provides an extensible API for loading schemas from various sources through the

SchemaSource

API. For example,

from singer_sdk import OpenAPISchema, StreamSchema

# Load from OpenAPI spec
openapi_source = OpenAPISchema("<https://api.example.com/openapi.json>")

class UsersStream(RESTStream):
    name = "users"
    schema = StreamSchema(openapi_source, key="User")  # Load "User" component

Full release notes: v0.48.0

Hey <!channel> ! I'm excited to announce that we've built a new product that tackles one of our biggest daily challenges: getting failed pipelines back to green ASAP with automated PRs. I've got a short tweet thread about this, but the TLDR is: • When pipelines fail, Arch automatically creates PRs with problem summaries, code changes, AND root cause analysis • We support all major orchestrators and issue trackers • Works great with Meltano (of course! melty ) and many other data tools • We dogfood this daily because we're managing pipelines for a number of our customers Even the most reliable data systems (yes, even Meltano!) occasionally breaks. Instead of manually debugging and clicking through multiple tools, imagine the fix is prepped and ready to go in your code collaboration tool. ✅ I'd love to chat with you if this is interesting. It's worth it if you're tired of the usual "pipeline broke at 3am" scramble 😅