Skip to main content
Version: Next

parquet

Description​

stores events in Parquet

Required input​

This sink does not have any requirements and works with any incoming event type.

Configuration​

SchemaName​

The name of the schema to be used for the Parquet file.

SchemaNamespace​

The namespace of the schema to be used for the Parquet file.

ParquetFileName​

The name of the Parquet file to be created.

ParquetGenerationDirectory​

The directory where the Parquet file will be generated.

RowGroupSize​

The size of the row group in bytes. The default value is 134217728, which means that the row group size will be determined by the Parquet library.

PageSize​

The size of the page in bytes. The default value is 1048576, which means that the page size will be determined by the Parquet library.

CompressionCodecName​

The compression codec to be used for the Parquet file. The default value is "UNCOMPRESSED", which means that no compression will be applied. Other options are "SNAPPY", "GZIP", "LZO", "BROTLI", "LZ4", and "ZSTD".

Last updated on by Dominik Riemer