from_json If you have JSON object in a column, and need to do any transformation…
Category: article
Converts a column containing a StructType, ArrayType or a MapType into a JSON string-PySpark(to_json)
You can convert a column containing a StructType, ArrayType or a MapType into a JSON string using to_json function. pyspark.sql.functions.to_json…
Gradle DevOps Interview Questions and Answers for Freshers and Experienced
1. What Are Benefits Of Daemon in Gradle 3.0 a. It has good UX b. It is very powerful c….
How to move WhatsApp conversations from an Android to an iPhone
Please follow the steps to move WhatsApp conversations from an Android to an iPhone. Step 1: On your Android phone,…
How to get json object from a json string based on json path specified – get_json_object – PySpark
get_json_object get_json_object will extracts json object from a json string based on json path mentioned and this will and returns…
Google Sheet Quick Reference Guide and Keyboard Shortcuts
Google Sheet Quick Reference Guide and Keyboard Shortcuts Create a Spreadsheet from Google Drive: In Google Drive, click the New…
How to round the given value to scale decimal places using HALF_EVEN rounding in Spark – PySpark
bround function bround function returns the rounded expr using HALF_EVEN rounding mode. That means bround will round the given value…
Descriptive vs Diagnostic vs Predictive vs Prescriptive: 4 type of Analytics
a. Descriptive: This tells you what happened in the past. You will get the data from the past and report…
Excel shortcuts for daily use tasks
Shortcuts that you can use for your daily tasks 1 CTRL*A Select All 2 CTRL+C Copy all Cells in Highlighted…
What are the Optimization Techniques that you can apply on Apache Hive ?
1. Partitioning : Partitioning works by dividing the data into smaller segments, These are created using logical grouping based on…
How to replace a value with another value in a column in Pyspark Dataframe ?
In PySpark we can replace a value in one column or multiple column or multiple values in a column to…