Author: user

PySpark @ Freshers.in

Extracting Unique Values From Array Columns in PySpark

When dealing with data in Spark, you may find yourself needing to extract distinct values from array columns. This can…

Continue Reading Extracting Unique Values From Array Columns in PySpark
Shell Scripting @ Freshers.in

Shell : Connecting to a remote server and execute a series of Git commands

ssh -o StrictHostKeyChecking=no "$server" "cd ~/work/${project_name}/; git fetch; git checkout $GIT_BRANCH; git pull The command will use the Secure Shell…

Continue Reading Shell : Connecting to a remote server and execute a series of Git commands
Shell Scripting @ Freshers.in

Unix : Finding the size of a folder in GB

To find the size of a folder in gigabytes (GB) using the shell, you can use the du command with…

Continue Reading Unix : Finding the size of a folder in GB