Skip to content Skip to sidebar Skip to footer
Showing posts with the label Pyspark Dataframes
How To Get 1000 Records From Dataframe And Write Into A File Using Pyspark?

How To Get 1000 Records From Dataframe And Write Into A File Using Pyspark?

Post a Comment
I am having 100,000+ of records in dataframe. I want to create a file dynamically and push 1000 rec… Read more How To Get 1000 Records From Dataframe And Write Into A File Using Pyspark?
Update The Nested Json With Another Nested Json Using Python

Update The Nested Json With Another Nested Json Using Python

Post a Comment
For example, I have one full set of nested JSON, I need to update this JSON with the latest values … Read more Update The Nested Json With Another Nested Json Using Python
Drop Table In SQL Database From Azure Databricks

Drop Table In SQL Database From Azure Databricks

Post a Comment
I need to drop a table in SQL Database using Azure Databricks (PySpark). I am required to not use a… Read more Drop Table In SQL Database From Azure Databricks