Python Playground

How to get a list of files from hdfs (hadoop) directory using python script? I have tried with foll… Read more Get List Of Files From Hdfs (hadoop) Directory Using Python Script

I am running a Hadoop program and have the following as my input file, input.txt: 1 2 mapper.py: i… Read more Hadoop: Output File Has Double Output

I have installed, pip install thrift pip install PyHive pip install thrift-sasl and since pip ins… Read more Pyhive, Sqlalchemy Can Not Connect To Hadoop Sandbox

I've seen the documentatio here, but I confess that I feel it rather lacking. I was wondering … Read more Python Udfs In Pig

I get the following error when I try to call I use python client for the spark. lines = sc.textFil… Read more Spark Java.lang.verifyerror

I am trying to read a JSON file, from Amazon s3, to create a spark context and use it to process th… Read more Connect To S3 Data From Pyspark