반응형
case
-
[Spark] The case sensitive option of sparkOpen Source/Spark 2020. 10. 21. 12:56
Used spark version: 2.4.4 The column of spark DataFrame can be selected regardless of case. Because the spark uses case-sensitive option (spark.sql.caseSensitive : default is False). 1. Example of case-sensitive option is False (default) You can select columns ignoring the case of column name. df = spark.createDataFrame([{'ABC': 1, 'abc': 2}]) df.show() ''' output: +---+---+ |ABC|abc| +---+---+ ..