Skip to content

usecols investigation for various I/O functions #61538

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
eicchen opened this issue Jun 2, 2025 · 1 comment
Closed

usecols investigation for various I/O functions #61538

eicchen opened this issue Jun 2, 2025 · 1 comment
Labels
IO CSV read_csv, to_csv Needs Discussion Requires discussion from core team before further action

Comments

@eicchen
Copy link
Contributor

eicchen commented Jun 2, 2025

pasting my comment from #61386 for visibility with relevant decisionmakers

As promised during the sync meeting today, I went and compiled how various read functions handle columns being specified. Functions that take usecols (read_csv, read_clipboard, read_excel, and read_hdf(undocumented)) don't take into account input order, whereas functions that ask for columns instead do (hdf, feather, parquet, orc, starata, sql).

Finally, there are also some that straight up don't take column specifiers.

I'd expect functions that use usecols to be using the same function in the backend, but I'd have to verify it if we're planning to standardize the parameter.

CSV attached below of functions tested (those with a read and write function in pandas)
does_it_use_order.csv

@arthurlw arthurlw added IO CSV read_csv, to_csv Needs Discussion Requires discussion from core team before further action labels Jun 3, 2025
@mroeschke
Copy link
Member

Thanks, but let's centralize discussion in the original issue (#61386) so closing this one

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
IO CSV read_csv, to_csv Needs Discussion Requires discussion from core team before further action
Projects
None yet
Development

No branches or pull requests

3 participants