The discrepancy between the number of tests shown in the Slack summary and the Elementary report UI is a known issue that has been discussed in the Elementary community. The most likely causes, based on the knowledge sources, are: 1. Skipped Tests and Summary Calculation Differences There have been reports where the Slack summary includes counts for tests that are skipped or not shown in the main report UI, leading to mismatches. For example, warnings in the Slack summary may include skipped tests, while the report UI only shows actual warnings. This was confirmed in a community thread where users noticed the Slack summary showed warnings that were not present in the report, and the explanation was that skipped tests were being counted in the summary but not in the report UI [Slack thread: skipped tests in summary](https://slack.com/archives/C02CTC89LAX/p1699281535566889). 2. Summary Not Filtering by Invocation or Tag There is also a known issue where the Slack summary does not always respect the

--select invocation_id:...

or similar filters, and instead summarizes all recent test results, not just those for the selected invocation. This can cause the Slack summary to show numbers that do not match the filtered report UI. The Elementary team has acknowledged this and suggested opening a GitHub issue for tracking [Slack thread: summary ignores invocation filter](https://slack.com/archives/C02CTC89LAX/p1736401455291439). 3. Freshness Tests Handling Freshness tests are sometimes handled differently in the summary versus the report UI. For example, the report UI may break out freshness tests separately, while the Slack summary may aggregate them with other test types, or not include them at all, depending on the version and configuration [Slack thread: source freshness in report](https://slack.com/archives/C02CTC89LAX/p1689088826025229). What you can do: - Be aware that, as of now, the Slack summary may not always match the report UI due to the above issues. - If you need the summary to match the report UI exactly, you may need to wait for a fix or workaround from the Elementary team. They have indicated that improvements to summary generation and filtering are in progress [Slack thread: summary ignores invocation filter](https://slack.com/archives/C02CTC89LAX/p1736401455291439). - You can open or follow issues on the [Elementary GitHub](https://github.com/elementary-data/elementary/issues) for updates. Summary: The mismatch is most likely due to the Slack summary including skipped tests or not respecting invocation/tag filters, while the report UI shows only the filtered, actual test results. This is a known issue and is being addressed by the Elementary team. If you need more precise troubleshooting, sharing your

edr.log

and

elementary_output.json

files with the Elementary support team can help them diagnose your specific case [Slack thread: skipped tests in summary](https://slack.com/archives/C02CTC89LAX/p1699281535566889).