Data Engineer - Plano, United States - Tata Consultancy Services

    Tata Consultancy Services
    Tata Consultancy Services Plano, United States

    2 weeks ago

    Tata Consultancy Services background
    Description

    • 10+ to 15 years of experience in Development, design, Architect implementation, and analytics solutions
    • 6+ Years of Experience on Python
    • 6+ Years of Experience on AWS
    • Hands on development Design and Develop applications using Python/Pyspark and AWS
    • Terraform Knowledge/Version changesHands on experience is required
    • Snowflake and Datawarehouse experience are required
    • Data Bricks experience is added advantage.
    • From an AWS perspective, candidates need to be very well versed with Terraform, Glue, Lambda, S3 and their usage and practical issues faced when dealing withthem.
    • At least 5+ Experience on AWS (Glue, S3, lambda at the minimum)
    • Candidates need to be very skilled in Python core programming and Spark.
    • Ability to design and demonstrate system Architecture with different environments.
    • Hands on experience on Data Warehousing and SQL
    • Experience on Pandas
    • Experience in Hadoop-Big data
    • Strong expertise in SQL is required.
    • Solid experience with git software version control and good
    understanding of code branching strategies and organization for code reuse


    • Data Bricks knowledge added advantage
    • Experience with DevOps & CI/CD toolsJenkins, Cloudbees, Please Build, etc.
    • Proficiency working with large data stores and data sets
    • Health care knowledge is preferred.
    • Agile methodology (Jira Preferable)
    Roles & Responsibilities


    • Must have capability to understand the current Architecture
    • Coding, testing and implementation of cloud-based Spark apps
    • support existing code thru enhancing, trouble shooting and maintaining per requirements
    • maintain consistent practices for source code management in github
    • comply with established CICD practices, and participate in the creation of new CICD methods
    • attend daily scrum calls, and actively participate in updating/creating user stories and tasks in Jira
    • Work closely with business analysts.
    • Lead innovation by exploring, investigating, recommending, benchmarking, and implementing data centric technologies for the platform.
    • Collaborating within a project team to solve complex problems.
    • Lead by example coaching and mentoring those of your peers and mentoring less experienced team members. Operate as part of the extended management team.