You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Right now we infer every string/binary column in files to view types, and canonicalize all data into them. That generates extra work and might just not be what the user wants, we should allow them to control this behavior, either by hinting to the compressor or adding some metadata to the file's footer. (See #1736 for the issue/impact).
The text was updated successfully, but these errors were encountered:
AdamGS
changed the title
Allow to hint arrow target type in infer_schema
Allow users to constrain arrow target type in infer_schemaJan 3, 2025
Right now we infer every string/binary column in files to view types, and canonicalize all data into them. That generates extra work and might just not be what the user wants, we should allow them to control this behavior, either by hinting to the compressor or adding some metadata to the file's footer. (See #1736 for the issue/impact).
The text was updated successfully, but these errors were encountered: