<@U04S8PLJWMT> ActivityLog showing a lot of missin...
# replication-ask-ai
f
@kapa.ai ActivityLog showing a lot of missing data especially in a few years. is there anyone to recover those?
k
I'm sorry, but the knowledge sources do not contain enough information to answer your query about recovering missing data from an "ActivityLog" stream specifically. However, based on related issues in the knowledge sources, here are some general approaches that have been suggested for recovering missing data in Airbyte: 1. Set up a separate connection for backfill: Create a dedicated connection with a historical start date to re-ingest the missing records. This avoids disrupting your main sync. [Partial Resync Approach] 2. Reset the stream: If the missing data is due to a cursor/state issue, resetting the stream's state and performing a full re-sync of just the affected stream can help recover historical records. 3. Schedule more frequent syncs temporarily: For incremental streams with pagination limits, running syncs more frequently can help the connector "catch up" on missing records over time. [source-pardot issue] To give you a more precise answer, could you clarify: • Which source connector are you using (e.g., Salesforce, HubSpot, Pardot, etc.)? • What sync mode is configured (Full Refresh or Incremental)? • Are you seeing any errors in the sync logs? With that information, I or the Airbyte community may be able to point you to a more specific solution or known issue. šŸ‘ 0 button šŸ‘Ž 0 button ā„¹ļø Tip: Mention @kapa.ai in the thread for follow-ups or DM the app for 1-to-1 help.
f
monday data. it generates activitylog which im extracting with airbyte. however we can cleary detect missing data in a lot of days. anyway to recover it? @kapa.ai
k
Based on the knowledge sources, there are a few important things to understand about the Monday.com Activity Logs stream and recovering missing data: Known Limitations of Activity Logs The incremental sync for the Activity Logs stream has a critical limitation: > If the time between syncs exceeds the activity log retention period for your Monday.com plan, some changes may not be captured during incremental syncs. This means if your syncs were infrequent or your Monday.com plan has a short activity log retention window, that data may be permanently unavailable from the source and unrecoverable. [Supported Streams] Recovery Options 1. Perform a Refresh Sync If the data still exists in Monday.com's activity log retention window, you can trigger a Refresh Sync in Airbyte to re-sync from the beginning: • Refresh and Remove Records — replaces destination data with freshly synced data • Refresh and Retain Records — keeps old data alongside newly synced data, useful for comparing generations [Refreshing Your Data] The refresh won't cause data downtime — your existing data remains queryable until the refresh completes. 2. Check for the KeyError: 'data' Bug There is an open bug in connector version 2.30 where the connector fails to access the
"data"
key in the API response, potentially causing record loss (reportedly ~5k records). [GitHub Issue] If you're on version 2.30, upgrading the connector may help recover records going forward. 3. Cursor Expiration Issue For large boards, Monday.com's pagination cursors expire after 60 minutes. If processing takes longer, the connector resets pagination and re-reads from the beginning, which can cause incomplete syncs. [Contributing Docs] Recommendation 1. Check your connector version and upgrade if you're on 2.30 or earlier. 2. Trigger a Refresh Sync to re-pull all available activity log data from Monday.com. 3. Be aware that data outside Monday.com's activity log retention window for your plan cannot be recovered through Airbyte, as it's no longer available at the source. šŸ‘ 0 button šŸ‘Ž 0 button ā„¹ļø Tip: Mention @kapa.ai in the thread for follow-ups or DM the app for 1-to-1 help.