What are the Python libraries provided by AWS Glue Version 2.0

AWS Glue @ Freshers.in

The defaults Python libraries available in AWS Glue version 2.0 are as below

boto3==1.12.4
botocore==1.15.4
certifi==2019.11.28
chardet==3.0.4
cycler==0.10.0
Cython==0.29.15
docutils==0.15.2
enum34==1.1.9
fsspec==0.6.2
idna==2.9
jmespath==0.9.4
joblib==0.14.1
kiwisolver==1.1.0
matplotlib==3.1.3
mpmath==1.1.0
numpy==1.18.1
pandas==1.0.1
patsy==0.5.1
pmdarima==1.5.3
ptvsd==4.3.2
pyarrow==0.16.0
pydevd==1.9.0
pyhocon==0.3.54
PyMySQL==0.9.3
pyparsing==2.4.6
python_dateutil==2.8.1
pytz==2019.3
requests==2.23.0
s3fs==0.4.0
s3transfer==0.3.3
scikit-learn==0.22.1
scipy==1.4.1
setuptools==45.2.0
setuptools==45.2.0
six==1.14.0
statsmodels==0.11.1
subprocess32==3.5.4
sympy==1.5.1
tbats==1.0.9
urllib3==1.25.8

How to add additional Python Libraries in a AWS Glue Development Endpoint?

AWS Glue : Example on how to read a sample csv file with PySpark.

How to renaming Spark Dataframe having a complex schema with AWS Glue?

Author: user

Leave a Reply