examples/tutorial/jupyter/execution/pandas_on_unidist/local/exercise_4.ipynb
GOAL: Explore some of the experimental features being added to Modin.
For those who have worked with Excel, the Spreadsheet API will definitely feel familiar! The Spreadsheet API is a Jupyter notebook widget that allows us to interact with Modin DataFrames in a spreadsheet-like fashion while taking advantage of the underlying capabilities of Modin. The widget makes it quick and easy to explore, sort, filter, and edit data as well as export the changes as reproducible code.
Let's look back at a subset of the 2015 NYC Taxi Data from Exercise 2, and see how the Spreadsheet API can make it easy to play with the data!
!jupyter nbextension enable --py --sys-prefix modin_spreadsheet
import modin.pandas as pd
import modin.experimental.spreadsheet as mss
import modin.config as modin_cfg
import unidist.config as unidist_cfg
modin_cfg.Engine.put("unidist")
unidist_cfg.Backend.put("mpi")
s3_path = "s3://dask-data/nyc-taxi/2015/yellow_tripdata_2015-01.csv"
modin_df = pd.read_csv(s3_path, parse_dates=["tpep_pickup_datetime", "tpep_dropoff_datetime"], quoting=3, nrows=1000)
spreadsheet = mss.from_dataframe(modin_df)
spreadsheet