Skip to content Skip to sidebar Skip to footer
Showing posts with the label Hive

Pyhive, Sqlalchemy Can Not Connect To Hadoop Sandbox

I have installed, pip install thrift pip install PyHive pip install thrift-sasl and since pip ins… Read more Pyhive, Sqlalchemy Can Not Connect To Hadoop Sandbox

Collect Set By Group?

I am working with Hive data pulled into a Python Jupyter notebook using a Hive wrapper written in P… Read more Collect Set By Group?

Spark 2.2 Thrift Server Error On Dataframe Numberformatexception When Query Hive Table

I have Hortonworks HDP 2.6.3 running Spark2 (v2.2). My test case is very simple: Create a Hive tab… Read more Spark 2.2 Thrift Server Error On Dataframe Numberformatexception When Query Hive Table

Start Hivethriftserver Programmatically In Python

In the spark-shell (scala), we import, org.apache.spark.sql.hive.thriftserver._ for starting Hive T… Read more Start Hivethriftserver Programmatically In Python

Reading And Writing From Hive Tables With Spark After Aggregation

We have a hive warehouse, and wanted to use spark for various tasks (mainly classification). At tim… Read more Reading And Writing From Hive Tables With Spark After Aggregation