Testimonials

Services

Video meeting . 30 mins
4.5
$25
Video meeting . 30 mins
5
$25
Video meeting . 30 mins
4.8
$25
Popular

About me

• Currently working as a Big Data Engineer with Systems Limited. • Experience Designing and Architecting Large Scale Distributed Systems using various Big Data technologies. • Experienced on building complex high-performing Data Pipelines natively or microservices based. • Experienced in Big Data spark python and SQL. • Experienced in AWS cloud technologies. • I have experience in developing Big Data solutions on Amazon Web Services (EMR, Glue, RDS, S3, Step Functions, EC2, cloud formation, lambda, AWS Kinesis etc). I have also designed and implemented multiple S3 based Data Lakes on Amazon Web Services. For building Data Lake solutions and ETL pipelines, I have worked on distributed processing engines like Apache Spark on AWS EMR. • Experienced with big data frameworks. • Experience in developing automation pipelines, and integrate with AWS to invoke the step function and lambda. • Use AWS Athena to analyze data using s3 SQL. Simply point data in s3, define the schema and start querying. • Use AWS Redshift for Datawarehouse, copy data from s3 to Redshift for analysis. Cloud Technologies - Apache Spark, Hadoop, Redshift, Athena, Hbase, Docker, Elasticsearch,AWS Technologies.