It's not silly at all. As writers, we often struggle with 'imposter syndrome' and question our own ability. The very last thing we need is other people dismissing our struggles and making that self-doubt even worse.