The Best File Format To Store A Pandas DataFrame
www.blog.dailydoseofds.com
Discover more from Daily Dose of Data Science
High-quality insights on Data Science and Python, along with best practices — shared daily.
Get a free 550+ page data science PDF guide and 450+ practice questions notebook.
Over 50,000 subscribers
Continue reading
The Best File Format To Store A Pandas DataFrame
In the image above, you can find the run-time comparison of storing a Pandas DataFrame in various file formats.
Although CSVs are a widely adopted format, it is the slowest format in this list.
Thus, CSVs should be avoided unless you want to open the data outside Python (in Excel, for instance).
Read more in my blog: Medium.
Share this post on LinkedIn: Post Link.
The code snippets for the posts I have shared here are available on GitHub. Check out this repository: GitHub.
I like to explore, experiment and write about data science concepts and tools. You can read my articles on Medium. Also, you can connect with me on LinkedIn.