apache-spark-sql

英文: How to use a Spark UDF that takes an array of struct as an argument in order to build a new colu...

英文: How to select different rows base on conditions in Spark sql 问题 我创建了一个基于 num 列并按名称分组的排名列。我试图实现逻辑...

英文: Set "table" in spark session 问题 You can set salaryData as a table in a SparkSession us...

英文: Pyspark: check if the consecutive values of a column are the same 问题 我有一个带有以下格式的pyspark datafram...

英文: I need to calculate profit/loss for given stock data set, ensuring that the first bought items a...

英文: why sbt doesn't compile the code and the main libraries aren't even recognised? 问题 This ...

英文: Split spark dataset based on number of rows 问题 我正在从 DynamoDB 中读取数据，并将其存储在 Spark 的 Dataset 中，代码如下...

英文: Databricks: SQL Pivot does not work - but Python does 问题 I am trying to pivot a SQL table in Dat...

英文: Spark session value not updating 问题 我正在使用以下代码设置Spark会话值： spark = (SparkSession .builder .appName...

英文: Table gets deleted when trying to overwrite the data in it from databricks spark 问题 我正在尝试使用pyspa...