Has anyone been successful to run test locally? In...
# developersá
Ángel Rivera-Págan
05/23/2023, 1:02 PMHas anyone been successful to run test locally? In my case they fail, but if I run them directly, they seem to be fine. And sometimes they don’t even fail with the E2E. It seems randomly? I would appreciate any help. Please
Ángel Rivera-Págan
05/23/2023, 5:28 PMAfter checking the cal.com pipeline on github, it seems that what I get as an error, for you guys it shows as flaky. Is there a ticket to make these tests work again?
z
zomars
05/23/2023, 6:42 PMWhich tests are failing specifically?
á
Ángel Rivera-Págan
05/24/2023, 2:56 PM@zomars
The fails always tend to vary. My theory is that the browser changes or closes too slow/fast vs the tests. These are different tests that were ran consecutively.
Copy code
6 failed
[@calcom/web] › apps/web/playwright/auth/forgot-password.e2e.ts:7:5 › Can reset forgotten password
[@calcom/web] › apps/web/playwright/embed-code-generator.e2e.ts:186:9 › Embed Code Generator Tests › Event Type Edit Page › open Embed Dialog for the Event Type
[@calcom/web] › apps/web/playwright/managed-event-types.e2e.ts:8:7 › Managed Event Types tests › Can create managed event type
[@calcom/web] › apps/web/playwright/reschedule.e2e.ts:159:7 › Reschedule Tests -- new-booker › Paid rescheduling should go to success page
[@calcom/web] › apps/web/playwright/reschedule.e2e.ts:159:7 › Reschedule Tests -- old-booker › Paid rescheduling should go to success page
[@calcom/web] › apps/web/playwright/wipe-my-cal.e2e.ts:13:7 › Wipe my Cal App Test › Browse upcoming bookings and validate button shows and triggering wipe my cal button Copy code
5 failed
[@calcom/web] › apps/web/playwright/auth/delete-account.e2e.ts:7:5 › Can delete user account ───
[@calcom/web] › apps/web/playwright/booking-seats.e2e.ts:157:9 › Booking with Seats -- new-booker › Reschedule for booking with seats -- old-booker › Should reschedule booking with seats and if everyone rescheduled it should be deleted
[@calcom/web] › apps/web/playwright/event-types.e2e.ts:67:9 › Event Types tests › user -- old-booker › can duplicate an existing event type
[@calcom/web] › apps/web/playwright/reschedule.e2e.ts:159:7 › Reschedule Tests -- new-booker › Paid rescheduling should go to success page
[@calcom/web] › apps/web/playwright/reschedule.e2e.ts:159:7 › Reschedule Tests -- old-booker › Paid rescheduling should go to success page Copy code
4 failed
[@calcom/web] › apps/web/playwright/booking-seats.e2e.ts:157:9 › Booking with Seats -- old-booker › Reschedule for booking with seats -- old-booker › Should reschedule booking with seats and if everyone rescheduled it should be deleted
[@calcom/web] › apps/web/playwright/embed-code-generator.e2e.ts:186:9 › Embed Code Generator Tests › Event Type Edit Page › open Embed Dialog for the Event Type
[@calcom/web] › apps/web/playwright/reschedule.e2e.ts:159:7 › Reschedule Tests -- new-booker › Paid rescheduling should go to success page
[@calcom/web] › apps/web/playwright/reschedule.e2e.ts:159:7 › Reschedule Tests -- old-booker › Paid rescheduling should go to success page Copy code
5 failed
[@calcom/web] › apps/web/playwright/auth/delete-account.e2e.ts:7:5 › Can delete user account ───
[@calcom/web] › apps/web/playwright/booking-seats.e2e.ts:157:9 › Booking with Seats -- old-booker › Reschedule for booking with seats -- old-booker › Should reschedule booking with seats and if everyone rescheduled it should be deleted
[@calcom/web] › apps/web/playwright/managed-event-types.e2e.ts:8:7 › Managed Event Types tests › Can create managed event type
[@calcom/web] › apps/web/playwright/reschedule.e2e.ts:159:7 › Reschedule Tests -- new-booker › Paid rescheduling should go to success page
[@calcom/web] › apps/web/playwright/reschedule.e2e.ts:159:7 › Reschedule Tests -- old-booker › Paid rescheduling should go to success pageÁngel Rivera-Págan
05/24/2023, 2:57 PMThey tend to be similar tho, and so are the ones that I have noticed at the cal.com pipeline that does not fail, but show as flaky, allowing people to pass the tests and merge their PRs.