As nf-parquet plugin is reaching more than 2k down...
# shameless-promo
j
As nf-parquet plugin is reaching more than 2k downloads, I'm excited to announce the release of version v0.2.2! This update introduces powerful new splitting capabilities including
by
,
file
, and
count
options, bringing it in line with standard Nextflow splitters as splitFasta for example. Specifically, the
file
option allows you to partition large datasets into smaller chunks, enabling seamless parallel processing when handling high record volume Additionally, this version includes an experimental feature for reading files directly from S3, streamlining cloud-based data integration Read more at https://nextflow-io.github.io/nf-parquet/
🙌🏻 1
🙌 12