Developer - Philadelphia, United States - Tata Consultancy Services

Description

Skill: AWS Pyspark Senior Developer

• Strong development experience in AWS Glue 3.0 (Good experience in pyspark functions).
• Proficiency in Pyspark Development, AWS Glue.
• Good experience S3 files and CSV file reading in Glue Jobs.
• Athena with partitioning and database experience.
• Delta Lake.
• Must good in SQL, Redshift.
• Experience in Lambda function, Cloudwatch event, Step function.
• Migration project experience in an added advantage.
• AWS Batch.
• Strong Hands-on S3, EC2, RDS, EFS, Lambda and other serverless.
• Strong programming skills in Java or Python.

• Understanding of security concepts such Active Directory, LDAP, SSO/SAML, Linux / SQL Server/Oracle service accounts.
• Understanding of Agile concepts and tools such as Rally, Jira and Confluence.
• Good communication skills and ability to identify dependencies.
• Ability to support and influence cloud and on premise integrations / platforms.
• Ability to use a wide variety of open source technologies and tools.

• Perform AWS Pyspark development.
• Leading Onsite team and coorodinate with offshore.
• Document cloud infrastructure and policies.
• Work with Projects to help them adopt cloud infrastructure and services in order to reduce cost and deployment times.
• Mentor and train other members of the client's IT team.
• Understand on-premise policies, solutions, and technologies and integrate with the cloud infrastructure where applicable.
• Understanding cloud security best practices and work with Security teams to design and implement a security infrastructure.
• Serve as a technical point of contract for cloud services and help with communication of cloud services to projects.
• Act as a technical liaison between customers, service engineering teams and support.
• Set up Data warehousing and Data Lake solutions on AWS using services like Redshift spectrum etc.