subgrounds.dataframe_utils module#

Pandas DataFrame utility module containing functions related to the formatting of GraphQL JSON data into DataFrames.

subgrounds.dataframe_utils.gen_columns(data, prefix='')#
subgrounds.dataframe_utils.fmt_cols(df, col_map)#
class subgrounds.dataframe_utils.DataFrameColumns(key, fpaths)#

Bases: object

Helper class that holds data related to the shape of a DataFrame

key: str#
fpaths: list[str]#
combine(other)#

Returns new DataFrameColumns containing the union of self and other's columns

Parameters:

other (DataFrameColumns) -- Columns to be combined to self

Returns:

New DataFrameColumns containing the union of

self and other

Return type:

DataFrameColumns

mk_df(data, path_map)#

Formats the JSON data data into a DataFrame containing the columns defined in self.

Parameters:

  • data (list[dict[str, Any]]) -- The JSON data to be formatted into a dataframe

  • path_map (dict[str, FieldPath]) -- A dictionary of (key-FieldPath) pairs

Returns:

The JSON data formatted into a DataFrame

Return type:

pd.DataFrame

subgrounds.dataframe_utils.columns_of_selections(selections)#

Generates a list of DataFrame columns specifications based on a list of Selection trees.

Parameters:

selections (list[Selection]) -- The selection trees

Returns:

The list of DataFrame columns specifications

Return type:

list[DataFrameColumns]

subgrounds.dataframe_utils.df_of_json(json_data, fpaths, columns=None, concat=False)#

Formats the JSON data json_data into Pandas DataFrames, flattening the data in the process.

Depending on the request's fieldpaths, either one or multiple dataframes will be returned based on how flattenable the response data is.

fpaths is a list of FieldPath objects corresponding to the set of fieldpaths that were used to get the response data json_data.

columns is an optional argument used to rename the dataframes(s) columns. The length of columns must be the same as the number of columns of all returned dataframes.

concat indicates whether or not the resulting dataframes should be concatenated together. The dataframes must have the same number of columns, as well as the same column names (which can be set using the columns argument).

Parameters:

  • json_data (list[dict[str, Any]]) -- Response data

  • fpaths (list[FieldPath]) -- Fieldpaths that yielded the response data

  • columns (Optional[list[str]], optional) -- Column names. Defaults to None.

  • concat (bool, optional) -- Flag indicating whether or not to concatenate the resulting dataframes, if there are more than one. Defaults to False.

Returns:

The resulting dataframe(s)

Return type:

pd.DataFrame | list[pd.DataFrame]