Data Engineer - Malvern, United States - Siri InfoSolutions Inc

Description

Job Description

Job Description:

• Min 8 yrs hands on experience in Spark, Python, Scala, Hadoop, Java.
• Must have hands on experience in AWS ETL Glue, Lambda, DynamoDB.
• Must have hands on experience in PySpark on Jupyter notebook.
• Must have experience in CI/CD, AWS S3, AWS EC2, AWS IAM, AWS Data Lake, SQL.
• Building and managing public and private cloud infrastructure with AWS, EC2 and S3 resources.
• Participating in requirement analysis and planning the development.
• Support production environment.
• Designing automation processes as per the operational needs of an organization.
• Reviewing the code, design and providing expertise in the development and integration of systems.

Responsibilities:

• Work with the business team to understand the requirements.
• Work in the Agile methodology (SCRUM).
• Collaborate with the team to work on developing new features.
• Participating in High level design session and collaborating with Business on the best practices and solutions that maximize the client needs.