Skip to content Skip to sidebar Skip to footer

Best Way To Use Big Csv File As Lookup To Fill Data In Dataframe

I have a DataFrame with a column that needs to be filled with values from a big csv file. What would be the best (possibly memory and computation efficient) way to load in the csv

Solution 1:

Probably an approach could be using dask and particularly dask read_csv.

In any case you may consider, as suggested by @jazreal, to store it in an SQL db.

Post a Comment for "Best Way To Use Big Csv File As Lookup To Fill Data In Dataframe"