Data Solutions

My personal journey in this world full of data and continuous efforts to provide solutions to some of the technical challenges i've encountered so far.

Menu

▼

AWS Glue crawler cannot extract CSV headers properly

Scenario: You have an UTF-8 encoded CSV stored at S3. You ran a Glue crawler to create a metadata table and further read the table in Athen...

Convert CSV to Parquet using AWS Glue

Today we will learn on how to convert CSV to Parquet using AWS Glue ETL Job

AWS Glue Fatal exception com.amazonaws.services.glue.readers unable to parse file data.csv

Error in AWS Glue: Fatal exception com.amazonaws.services.glue.readers unable to parse file data.csv Resolution: This error comes when yo...

Create an AWS Glue crawler to load CSV from S3 into Glue and query via Athena

Let's see how we can load CSV data from S3 into Glue data catalog using Glue crawler and run SQL query on the data in Athena Steps: Go t...

Setup Git on AWS EC2 Linux and clone the repo on Local Windows Machine

Scenario: Setup and Launch an EC2 linux Instance Install Git on EC2 linux Create multiple users on EC2 linux to access the machine and use G...

Ingest data from external REST API into S3 using AWS Glue

Today we will learn on how to ingest weather api data into S3 using AWS Glue Steps: Create a S3 bucket with the below folder structure: S...

View web version

Powered by Blogger.