Skip to content

RFC for table encryption#2183

Draft
xanderbailey wants to merge 3 commits intoapache:mainfrom
xanderbailey:xb/encryption_rfc
Draft

RFC for table encryption#2183
xanderbailey wants to merge 3 commits intoapache:mainfrom
xanderbailey:xb/encryption_rfc

Conversation

@xanderbailey
Copy link

Which issue does this PR close?

RFC for table encryption
Part of: #2034
Rough draft with some of the key parts: #2042

  • Closes #.

What changes are included in this PR?

Are these changes tested?

@mbutrovich
Copy link
Collaborator

Not specific feedback for the RFC, just sharing some context links and previous discussion that was helpful in getting the EncryptionFactory design into DataFusion that interfaces with the parquet crate. Comet makes good use of this design with a custom EncryptionFactory that uses JNI to interface with Spark-based custom KMSs.

apache/datafusion#16779
apache/datafusion#15216 (comment)

Also tagging @ggershinsky in case he has any cycles to read this. His guidance was instrumental on the DataFusion and Arrow-rs PME work, as well as Iceberg Java encryption implementation.

@ggershinsky
Copy link

Thanks, I'll be glad to have a look.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants