The Wayback Machine - https://web.archive.org/web/20210723021806/https://github.com/cockroachdb/cockroach/issues/67710
Skip to content

/ cockroach

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Ability to export to Apache Parquet format #67710

Open
lancel66 opened this issue Jul 16, 2021 · 2 comments
Open

Ability to export to Apache Parquet format #67710

lancel66 opened this issue Jul 16, 2021 · 2 comments
Labels
A-bulkio C-enhancement E-starter O-community T-bulkio X-blathers-triaged good first issue
Projects
Bulk I/O Backlog

Comments

@lancel66
Copy link

@lancel66 lancel66 commented Jul 16, 2021

Describe the solution you'd like
Ability to export to Apache Parquet format.

EXPORT INTO PARQUET
  'azure://acme-co/customer-export-data?AZURE_ACCOUNT_KEY=hash&AZURE_ACCOUNT_NAME=acme-co'
   FROM TABLE bank.customers;

Describe alternatives you've considered
Using CSV format

Additional context
Parquet stores the file schema in the file metadata. CSV files don't store file metadata, so readers need to either be supplied with the schema or the schema needs to be inferred. Supplying a schema is tedious and inferring a schema is error prone / expensive. A couple of large customers are asking for this feature.
@blathers-crl
Copy link

@blathers-crl blathers-crl bot commented Jul 16, 2021

Hello, I am Blathers. I am here to help you get the issue triaged.

It looks like you have not filled out the issue in the format of any of our templates. To best assist you, we advise you to use one of these templates.

I have CC'd a few people who may be able to assist you:

  • @cockroachdb/bulkio (found keywords: export)

If we have not gotten back to your issue within a few business days, you can try the following:

  • Join our community slack channel and ask on #cockroachdb.
  • Try find someone from here if you know they worked closely on the area and CC them.

🦉 Hoot! I am a Blathers, a bot for CockroachDB. My owner is otan.
@blathers-crl blathers-crl bot added this to Triage in Bulk I/O Backlog Jul 16, 2021
@livlobo livlobo moved this from Triage to IMPORT in Bulk I/O Backlog Jul 19, 2021
@techytoes
Copy link
Contributor

@techytoes techytoes commented Jul 22, 2021

Hi @livlobo, Can I pick this up? Also would be great if you can give a little context regarding what approach you have in mind?
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
A-bulkio C-enhancement E-starter O-community T-bulkio X-blathers-triaged good first issue
3 participants
@lancel66 @techytoes @livlobo