Spark UDFs that work on Any
How do I create a UDF to use in SQL expressions that can take in Any type? Something like: sqlContext.udf.register("myudf", (x: Any) => x) throws Schema for type Any is not supported while this works, obviously: sqlContext.udf.register("myudf", (x: String) => x)
SparkSQL spanning of Cassandra logical rows
Persisting data to DynamoDB using Apache Spark
When trying to register a UDF using Python on I get an error about Spark BUILD with HIVE
Spark + Cassandra on EMR LinkageError
Spark: Use Temporary Table Twice in Query?
How can I define my ENV variables once in the DockerFile and pass them down to my spark image which is submitted by a supervisord managed script?
Unbalanced keys lead to performance problems in Spark
How to remove null data from JavaPairRDD
Spark Streaming: How Spark and Kafka communication happens?
Error while invoking spark-shell on windows
Best way to iterate/stream a Spark Dataframe
Is it is required to be data in hive matastore to be used in sql-context from spark?
How to modify a Spark Dataframe with a complex nested structure?
Object not serializable error on org.apache.avro.generic.GenericData$Record
How to run Spark Sql on a 10 Node cluster
How to do group by range query