What is the problem in having lots of small files in HDFS? What is the remediation plan?
In Hadoop ecosystem we are storing files under folders in HDFS, most of the time the folder name we are…
Explain distributed cache in Hadoop ?
Distributed cache is a facility provided by Hadoop map reduce framework to access small file needed by application during its…
What is Swappiness Value? What is the role of Swappiness Value during the cluster set up?
vm.swappiness is one of the Kernel Parameter in Linux or UNIX, vm.swappiness value is from 0-100 which controls the swapping…
What are the Python Modules provided in AWS Glue
AWS Glue version 2.0 supports the following python modules. Note : Different Glue versions support different Python versions. boto3==1.12.4 botocore==1.15.4…
Snowflake : How to load data from Amazon S3 to Snowflake table using Copy
With Snowflake COPY command you can load data from staged files on internal/external locations to an existing table or vice…
In Snowflake how to Encrypts a BINARY value using a BINARY key ?
ENCRYPT_RAW is used to Encrypts a BINARY value using a BINARY key. Syntax ENCRYPT_RAW( <value_to_encrypt> , <key> , <iv> ,…
How to encrypt VARCHAR or BINARY in Snowflake ? What are the Encryption Functions in Snowflake ?
In Snowflake Encryption functions encrypt or decrypt VARCHAR or BINARY values. ENCRYPT : This function will Encrypts a VARCHAR or…
What are the different Python List Methods?
In Python Lists are used to store multiple items in a single variable. There are multiple built-in methods that you can use…
What are the Unix Specific Services in Python ?
The following are the unix specific services in Python posix : The most common POSIX system calls (This module provides…
What is Snowflake Merge Command ? How to use it ?
The Snowflake Merge command will allows you to perform merge operations between two tables. The Merge operation includes Insert, Delete,…