If it didn't work like this then pipeline level tests would be somewhat pointless (custom config for the pipeline not applied)