Python Playground

In Python, we have the star (or '*' or 'unpack') operator, that allows us to unpack… Read more Is There A Scala Equivalent Of The Python List Unpack (a.k.a. "*") Operator?

I am trying to understand as to what happens when we run the collectAsMap() function in spark. As p… Read more How Does The Collectasmap() Function Work For Spark Api

Let us Assume, I have a key value pair in Spark, such as the following. [ (Key1, Value1), (Key1, Va… Read more How Can A Reduce A Key Value Pair To Key And List Of Values?

The following is possible using Python: $ apt-get install python $ easy_install Flask $ cat > he… Read more Bootstrapping A Web Server In Scala

I want to be able to use a Scala function as a UDF in PySpark package com.test object ScalaPySpark… Read more How To Use Scala Udf In Pyspark?

I have a dataset consisting of 100k unique data records, to benchmark the code, I need to test on d… Read more Generate Data By Using Existing Dataset As The Base Dataset