apache-spark

英文: How to create Predicate for reading data using Spark SQL in Scala 问题 I can read the Oracle table...

英文: Why different behavior when mixed case are used, vs same case are used in spark 3.2 问题 以下是翻译好的部分...

英文: How to store and aggregate data in ~300m JSON objects efficiently 问题 我有一个应用程序，从一个Kafka主题中接收到300m...

英文: How to delete RDD with unpersist 问题 I'm trying to understand how RDD.unpersist() works but I'm r...

英文: How to replace \" with " in string columns scala 问题 { "translation": "我...

英文: extracting year from string using regexp_extract pyspark 问题 这是我的结果的一部分： 1995 2006 2013 2009 1952...

英文: Pyspark extracting exactly 4 consecutive numeric digit from a column and return it in a new colu...

英文: How to Convert Column into a List based on the other column in pyspark 问题 我在pyspark中有一个数据框，如下所示：...

英文: Spark how to union two arrays column without removing duplicates 问题 有一个名为array_union的函数，它可以合并两个数...

英文: spark Connect Two Database tables to produce a third data 问题 DataFrameLoadedFromLeftDatabase = 使...