Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEA] Consider fuzz testing with hypothesis #16129

Open
vyasr opened this issue Jun 28, 2024 · 0 comments
Open

[FEA] Consider fuzz testing with hypothesis #16129

vyasr opened this issue Jun 28, 2024 · 0 comments
Labels
feature request New feature or request pylibcudf Issues specific to the pylibcudf package Python Affects Python cuDF API. tests Unit testing for project

Comments

@vyasr
Copy link
Contributor

vyasr commented Jun 28, 2024

Is your feature request related to a problem? Please describe.
Currently tests of libcudf, pylibcudf, and cuDF Python are a large set of manually written tests. While we endeavor to achieve high coverage rates of the APIs, we inevitably miss data-dependent edge cases, particularly around things like empty data sets.

Describe the solution you'd like
We should consider using hypothesis or another fuzz testing library to add more systematic verification of different inputs. I recommend doing this at the Python layer since there is better and simpler tooling available, and because pylibcudf testing can be treated as a superset of libcudf testing in this respect to ensure good coverage of the C++.

Describe alternatives you've considered
We could also implement fuzz testing in C++ directly using e.g. Google's fuzztest, but that will be a bit more cumbersome to do.

@vyasr vyasr added feature request New feature or request tests Unit testing for project labels Jun 28, 2024
@lithomas1 lithomas1 added pylibcudf Issues specific to the pylibcudf package Python Affects Python cuDF API. labels Jun 29, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature request New feature or request pylibcudf Issues specific to the pylibcudf package Python Affects Python cuDF API. tests Unit testing for project
Projects
Status: In Progress
Development

No branches or pull requests

2 participants