Skip to content

Issues: IBM/data-prep-kit

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

168 Open 226 Closed
168 Open 226 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

[Bug] Parallel KFR execution of the same simple pipeline bug Something isn't working
#1109 opened Mar 7, 2025 by roytman
2 tasks done
1
@roytman
[Feature] Ability to inject XML/JATs into parquet for extended training enhancement New feature or request
#1107 opened Mar 6, 2025 by touma-I
1 of 2 tasks
[Feature] Investigate new approach for further simplification by eliminating python runtime, ray runtime and spark runtime enhancement New feature or request
#1105 opened Mar 6, 2025 by touma-I
1 of 2 tasks
@touma-I @ian-cho
1
Bring in cookbooks, recipes, and scripts for post-processing applications to DPK enhancement New feature or request
#1104 opened Mar 5, 2025 by shahrokhDaijavad
1 of 2 tasks
[Feature] Enable in-memory chaining and parallel execution of transforms enhancement New feature or request
#1102 opened Mar 5, 2025 by touma-I
2 tasks done
@swith005
Drop support for Spark and "bare" Python. Use Ray only.
#1101 opened Mar 5, 2025 by deanwampler
[Bug] S3 creds are printed to the logs bug Something isn't working
#1100 opened Mar 5, 2025 by revit13
1 of 2 tasks
[Bug] HuggingFace token is exposed in kfp pipelines bug Something isn't working
#1098 opened Mar 5, 2025 by revit13
2 tasks done
[Feature] Analyze transforms on the inner and covert to outer enhancement New feature or request
#1096 opened Mar 4, 2025 by touma-I
1 of 2 tasks
@klwuibm @ian-cho
[Bug] Wrong/ambiguous explanation in the ededup README file bug Something isn't working sprint-Mar-7
#1086 opened Mar 2, 2025 by roytman
1 of 2 tasks
@shahrokhDaijavad @cmadam
1
Update the main README table with the list of new GneissWeb Transforms enhancement New feature or request sprint-Mar-7
#1069 opened Feb 26, 2025 by shahrokhDaijavad
1 of 2 tasks
@shahrokhDaijavad
On-boarding Multi-lingual transforms to DPK enhancement New feature or request sprint-Mar-21
#1065 opened Feb 25, 2025 by shahrokhDaijavad
1 of 2 tasks
2
[Bug] HAP transform crashes if "contents" is empty bug Something isn't working sprint-Mar-7
#1048 opened Feb 13, 2025 by burn2l
2 tasks done
7
[Feature]New DPK transform to get the distributions of quality metrics enhancement New feature or request sprint-Mar-21
#1045 opened Feb 11, 2025 by Hajar-Emami
1 of 2 tasks
@Hajar-Emami
3
[Feature] Filter both the parquet and arrow files and update the metadata simultaneously enhancement New feature or request Pending
#1044 opened Feb 11, 2025 by Hajar-Emami
1 of 2 tasks
@klwuibm @Hajar-Emami
7
[Feature] Enable crawling of websites that require credentials via SSO or 2FA enhancement New feature or request Pending
#1040 opened Feb 11, 2025 by touma-I
1 of 2 tasks
@hmtbr
3
[Bug] Error running lang_id and code_quality kfp pipelines bug Something isn't working sprint-Mar-7
#1038 opened Feb 11, 2025 by revit13
1 of 2 tasks
@touma-I
3
Rep_removal for large data files crashes on 16GB memory bug Something isn't working
#1035 opened Feb 10, 2025 by shahrokhDaijavad
1 of 2 tasks
5
[Feature] Enabling gneissweb_classification transform by using multiple fasttext classifiers simultaneously enhancement New feature or request sprint-Mar-7
#1034 opened Feb 10, 2025 by Hajar-Emami
1 of 2 tasks
@issei-ibm @ran-iwamoto
5
[Feature] Update PII sample notebook to use simple APIs enhancement New feature or request sprint-Mar-7
#1032 opened Feb 10, 2025 by sujee
2 tasks done
@sujee
2
On-boarding Multimodal transforms to DPK enhancement New feature or request sprint-Apr-11
#1020 opened Feb 6, 2025 by shahrokhDaijavad
1 of 2 tasks
@shahrokhDaijavad
1
Improve performance of the Readability transform enhancement New feature or request sprint-Mar-7
#1015 opened Feb 5, 2025 by shahrokhDaijavad
1 of 2 tasks
@cmadam
5
Consistency of defined configuration parameters with the CLI Options in all transforms READMEs and Notebooks enhancement New feature or request
#1002 opened Jan 30, 2025 by shahrokhDaijavad
2 tasks done
[Feature] how to find which DPK 'modules' are installed enhancement New feature or request
#996 opened Jan 29, 2025 by sujee
1 of 2 tasks
@touma-I @agoyal26
4
[Bug] Unable to access quay.io/dataprep1/data-prep-kit/doc_chunk-ray:latest bug Something isn't working
#995 opened Jan 29, 2025 by touma-I
2 tasks done
@touma-I
2
ProTip! What’s not been updated in a month: updated:<2025-02-09.