How do I query for all rows of a table that has a foreign key, by a column on the table of that foreign key?

I think this is what you are looking for. https://supabase.com/docs/reference/javascript/select#filtering-with-inner-joins