We were all new once!
@David E (Variant Lit) makes a good point: it's good form to refer to place of first publication if you subsequently put your work into a chapbook or collection of your own - even if the original venue is now defunct. In many cases, such citation is actually a condition of the rights reverting to you.
More generally, the place you're submitting to should be making it clear which rights they are taking - either on their website, in their acceptance letter, or in the contract you have with them, depending. Always check this before you submit, to avoid being surprised later.