Data Engineer - Malvern, United States - Centraprise

    Centraprise
    Centraprise Malvern, United States

    2 weeks ago

    Default job background
    Description
    Data EngineerMalvern, PAFulltime PermanentRoles &


    Responsibilities:
    Min 8 yrs hands on experience in Spark, Python, Scala, Hadoop, Java.

    Must have hands on experience in AWS ETL Glue, Lambda, DynamoDB.Must have hands on experience in PySpark on Jupyter notebook.

    Must have experience in CI/CD, AWS S3, AWS EC2, AWS IAM, AWS Data Lake, SQL.Building and managing public and private cloud infrastructure with AWS, EC2 and S3 resources.

    Participating in requirement analysis and planning the development.
    Support production environment.
    Designing automation processes as per the operational needs of an organization.
    Reviewing the code, design and providing expertise in the development and integration of systems.


    Responsibilities:
    Work with the business team to understand the requirements.
    Work in the Agile methodology (SCRUM).Collaborate with the team to work on developing new features.

    Participating in High level design session and collaborating with Business on the best practices and solutions that maximize the client needs.

    #J-18808-Ljbffr