嗨,我是 pyspark 的新手,我正在尝试将 pyspark.sql.dataframe 转换为字典列表。
下面是我的数据框,类型是
我想将其转换为:+------------------+----------+------------------------+
| title|imdb_score|Worldwide_Gross(dollars)|
+------------------+----------+------------------------+
| The Eight Hundred| 7.2| 460699653|
| Bad Boys for Life| 6.6| 426505244|
| Tenet| 7.8| 334000000|
|Sonic the Hedgehog| 6.5| 308439401|
| Dolittle| 5.6| 245229088|
+------------------+----------+------------------------+
我该怎么做?提前致谢![{"title":"The Eight Hundred", "imdb_score":7.2, "Worldwide_Gross(dollars)":460699653},
{"title":"Bad Boys for Life", "imdb_score":6.6, "Worldwide_Gross(dollars)":426505244},
{"title":"Tenet", "imdb_score":7.8, "Worldwide_Gross(dollars)":334000000},
{"title":"Sonic the Hedgehog", "imdb_score":6.5, "Worldwide_Gross(dollars)":308439401},
{"title":"Dolittle", "imdb_score":5.6, "Worldwide_Gross(dollars)":245229088}]
最佳答案
您可以将每一行映射到字典中并收集结果:df.rdd.map(lambda row: row.asDict()).collect()
关于python - 将pyspark数据帧转换为python字典列表,我们在Stack Overflow上找到一个类似的问题: https://stackoverflow.com/questions/65059995/