Skip to content

Support Concurrency Safety Validation: Implement validateDeletedDataFiles #1928

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
sungwy opened this issue Apr 18, 2025 · 0 comments · May be fixed by #1938
Open

Support Concurrency Safety Validation: Implement validateDeletedDataFiles #1928

sungwy opened this issue Apr 18, 2025 · 0 comments · May be fixed by #1938

Comments

@sungwy
Copy link
Collaborator

sungwy commented Apr 18, 2025

There's been a lot of continued interest in using multiple PyIceberg applications concurrently and having proper support for optimistic concurrency.

I think the best place to start is through the implementation of the individual validation functions

This subtask tracks the implementation of validateDeletedDataFiles function. The Java Reference implementation can be found here

@sungwy sungwy changed the title Implement validateDeletedDataFiles: [Java Reference](https://github.com/apache/iceberg/blob/9fc49e187069c7ec2493ac0abf20f73175b3df89/core/src/main/java/org/apache/iceberg/MergingSnapshotProducer.java#L618-L636) Support Concurrency Safety Validation: Implement validateDeletedDataFiles Apr 18, 2025
@jayceslesar jayceslesar linked a pull request Apr 19, 2025 that will close this issue
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant