AWS Data Engineer with Python Pyspark Terraform - Bloomfield, United States - Tata Consultancy Services

Description

• Knowledge in Terraform, S3, API Gateway,Lamba, SNS and SQS
  .
• Should have wide experience in AWS servicessuch as Glue, EMR, Lambda, Step Functions, CloudTrail, CloudWatch, SNS, SQS,S3, VPC, EC2, RDS, IAM, Node JS, Glue ETL
• Should have CICD experience using toolslike GIT, Jenkins etc
• Should have extensive handson exp erience withSPARK and real time analytic frameworks, data streaming & Structured streaming.
• Knowledge in Databricks reporting.
• 
  They need to be experienced in programminglanguage (Python, Pyspark)
• Hands-on experience integrating open-sourcecomponents into data-analytic solutions
• Working with vendors to enhance tool capabilitiesto meet enterprise needs
• Willingness to continuously learn &share learnings with others
• Strong troubleshooting and performancetuning skills.
• Experience building multi-tenant,virtualized infrastructure a strong plus