AWS ENI @ Freshers.in

Elastic Network Interfaces quick reference and cheat sheet

Elastic Network Interfaces – ENIs are virtual network cards you can attach to your EC2 instances. They are used to…

AWS EC2 @ Freshers.in

AWS EC2 quick reference and cheat sheet

Amazon EC2 is the virtual server instances on the AWS cloud. Amazon EC2 provides varying combinations of CPU, memory, storage,…

PySpark @ Freshers.in

PySpark-How to create and RDD from a List and from AWS S3

In this article you will learn , what an RDD is ?  How can we create an RDD from a…

WaterLight – A portable lantern that can be charged with salt water (used for charging Mobile)

E-Dina, a Colombian renewable energy start-up has developed a cordless light which can converts salt water into electricity as a…

PySpark @ Freshers.in

How to run dataframe as Spark SQL – PySpark

If you have a situation that you can easily get the result using SQL/ SQL already existing , then you…

PySpark @ Freshers.in

How to get all combination of columns using PySpark? What is Cube in Spark ?

A cube is a multi-dimensional generalization of a two- or three-dimensional spreadsheet. Cube is a shorthand for multidimensional dataset, given…

How to convert xls to csv ? I can see first header column got shifted to next column- Solved

The requirement is to convert and xls to csv using python. Initially we used pandas ,  pandas.read_excel to read an…

How can I get all the hive tables and its external location,partitions etc ?

There may be some situations where you may need to give all the hive tables created and its location and…

Hive – Where can I get the hive metastore details (Credentials,Host,Server etc)

In General we don’t deal directly with Hive metastore . But there are some situation that we may need to…

Hive – What are the metastore tables in Hive ?

Metastore is the central repository of Apache Hive metadata. It stores metadata for Hive tables AUX_TABLE BUCKETING_COLS CDS COLUMNS_V2 COMPACTION_QUEUE…