python - 使用 Lambda 的 Pandas DataFrame Groupby 命名聚合导致 KeyError,Dict-of-Dicts 方法工作正常

标签 python pandas pandas-groupby

Groupby.Agg() 使用 Dict-of-Dict 参数来命名结果列已被弃用,取而代之的是新的命名聚合方法。但是,我无法应用以前运行良好的 lambda 函数(使用 Dict-of-Dict)。

我正在使用 Python 3.7.4、NumPy 1.16.4、Pandas 0.25.0

import numpy as np
import pandas as pd

data = [['tom', 10, 'blue', 1000, 'a'], ['nick', 15, 'blue', 2000, 'b'], ['julie', 14, 'green', 3000, 'a'], ['bob', 11, 'green', 4000, 'a'], ['cindy', 16, 'red', 5000, 'b']]

df = pd.DataFrame(data, columns = ['Name', 'Age', 'Color', 'Num', 'Letter'])

# Dict-style renaming seems to work fine:
df.groupby(by='Color').agg({'Num': {'SumNum' : np.sum, 'SumNumIfLetterA': lambda x: x[df.iloc[x.index].Letter=='a'].sum()}})

C:\Users\AppData\Local\Continuum\anaconda3\Lib\site-packages\pandas\core\groupby\generic.py:1455: FutureWarning: using a dict with renaming is deprecated and will be removed
in a future version.

For column-specific groupby renaming, use named aggregation

df.groupby(...).agg(name=('column', aggfunc))

  return super().aggregate(arg, *args, **kwargs)

Out[4]: 
         Num                
      SumNum SumNumIfLetterA
Color                       
blue    3000            1000
green   7000            7000
red     5000               0

# Named aggregation throws a KeyError:
df.groupby(by='Color').agg(SumNum = ('Num', np.sum), SumNumIfLetterA = ('Num', lambda x: x[df.iloc[x.index].Letter=='a'].sum()))


Traceback (most recent call last):

  File "<ipython-input-5-9be7b560a3f5>", line 2, in <module>
    df.groupby(by='Color').agg(SumNum = ('Num', np.sum), SumNumIfLetterA = ('Num', lambda x: x[df.iloc[x.index].Letter=='a'].sum()))

  File "C:\Users\AppData\Local\Continuum\anaconda3\Lib\site-packages\pandas\core\groupby\generic.py", line 1455, in aggregate
    return super().aggregate(arg, *args, **kwargs)

  File "C:\Users\AppData\Local\Continuum\anaconda3\Lib\site-packages\pandas\core\groupby\generic.py", line 264, in aggregate
    result = result[order]

  File "C:\Users\AppData\Local\Continuum\anaconda3\Lib\site-packages\pandas\core\frame.py", line 2981, in __getitem__
    indexer = self.loc._convert_to_indexer(key, axis=1, raise_missing=True)

  File "C:\Users\AppData\Local\Continuum\anaconda3\Lib\site-packages\pandas\core\indexing.py", line 1271, in _convert_to_indexer
    return self._get_listlike_indexer(obj, axis, **kwargs)[1]

  File "C:\Users\AppData\Local\Continuum\anaconda3\Lib\site-packages\pandas\core\indexing.py", line 1078, in _get_listlike_indexer
    keyarr, indexer, o._get_axis_number(axis), raise_missing=raise_missing

  File "C:\Users\AppData\Local\Continuum\anaconda3\Lib\site-packages\pandas\core\indexing.py", line 1171, in _validate_read_indexer
    raise KeyError("{} not in index".format(not_found))

KeyError: "[('Num', '<lambda>')] not in index"

最佳答案

我有一个非常相似的问题。在深入研究 github 之后,我通过在主数据框中创建一个虚拟列找到了一种解决方法。所以在你的代码中,如果你执行以下操作,它应该可以工作

data = [['tom', 10, 'blue', 1000, 'a'], ['nick', 15, 'blue', 2000, 'b'], ['julie', 14, 'green', 3000, 'a'], ['bob', 11, 'green', 4000, 'a'], ['cindy', 16, 'red', 5000, 'b']]

df = pd.DataFrame(data, columns = ['Name', 'Age', 'Color', 'Num', 'Letter'])
#Dummy Columns
df['Num1']=df['Num']
#now your groupby with NamedAgg on Num and Num1
df.groupby(by='Color').agg(SumNum = ('Num', np.sum), SumNumIfLetterA = ('Num1', lambda x: x[df.iloc[x.index].Letter=='a'].sum()))

Ipython 控制台的输出

df['Num1']=df['Num']

df.groupby(by='Color').agg(SumNum = ('Num', np.sum), SumNumIfLetterA = ('Num1', lambda x: x[df.iloc[x.index].Letter=='a'].sum()))
Out[46]: 
       SumNum  SumNumIfLetterA
Color                         
blue     3000             1000
green    7000             7000
red      5000                0

希望这能奏效!

关于python - 使用 Lambda 的 Pandas DataFrame Groupby 命名聚合导致 KeyError,Dict-of-Dicts 方法工作正常,我们在Stack Overflow上找到一个类似的问题: https://stackoverflow.com/questions/57452194/

相关文章:

python - 按给定的时间增量查找数据帧列中的时间戳

python - 计算 Pandas 数据框中 np.nan 的数量

python - Pandas - 组合 df.loc 进行多项操作?

python - 自动创建未分组条形图的功能

python - 用 Numpy 矩阵乘法数组

python - 张量比较未按预期进行

python - 如何为 FileField Django 查找图像的高度和宽度

python - Pandas : extracting column1's value at column2th position

python - groupby.shift 时的性能问题

python - 如何通过对第 3 列中的值求和来将前 2 列中具有相同值的 Pandas Dataframe 行组合在一起?