To read a Parquet file in Spark, you can use the spark.read.parquet() method, which returns…
Month: December 2021
AWS Glue : Example on how to read a sample csv file with PySpark
user December 28, 2021 0 Comments on AWS Glue : Example on how to read a sample csv file with PySpark
Reading a sample csv file using PySpark Here assume that you have your CSV data in AWS S3 bucket. The…
How to renaming Spark Dataframe having a complex schema with AWS Glue – PySpark
user December 18, 2021 0 Comments on How to renaming Spark Dataframe having a complex schema with AWS Glue – PySpark
There can be multiple reason to rename the Spark Data frame . Even though withColumnRenamed can be used to rename…