[C++] Is it possible to serialize row groups in parallel?

[Zechariah2001]

Describe the usage question you have. Please include as many useful details as possible.

I'm trying to lower the time cost of writing RecordBatch into a single parquet file, the current method is using parquet::arrow::FileWriter::WriteRecordBatch with set_use_threads(true), and the result is not very satisfying.

I know that set_use_threads(true) is serializing row groups in columns, and I still need to encode row groups one by one. So I wonder if it's possible to encode different row groups in parallel?

Component(s)

C++

[github-actions]

This issue has been marked as stale because it has had no activity in the past 365 days. Please remove the stale label or comment below, or this issue will be closed in 14 days. If this usage question has evolved into a feature request or docs update, please remove the 'Type: usage' label and add the 'Type: enhancement' label instead.

[thisisnic]

Closing as stale usage question with no recent activity.