Jobs
>
South Plainfield

    CAN | Data Engineer_L3 - South Plainfield, United States - eTeam

    eTeam
    eTeam South Plainfield, United States

    1 week ago

    eTeam background
    Description

    Role: Azure Data Eng/Dev

    Location: Brampton, CA (Remote)

    Start date: Immediate availability

    Background check MANDA TORY

    Request ID:

    Job Description:

    Work closely with client technical heads, business heads, and business analysts to understand and document business and technical requirements and constraints.

    Ability to implement ETL pipeline using Databricks, Azure ADF ETL pipeline .

    Experience in migrating batch ,streaming data from On-Prem Hadoop/Oracle to Azure ADLS

    Drive technical architecture meetings and help clients select the right architecture for their solutions that meet both functional and non-functional requirements today and in future.

    Develop PoCs, strategies, and provide direction around data security, archiving, and retention, high availability, and disaster recovery.Should have project hands-on experience in Azure ADF ,Databricks, Delta Lake, Pyspark(Databricks), Azure Functions, ADLS(Gen2)

    Expert in Hadoop, Hive, sqoop, python, Pyspark, Scala spark , Kafka and other related big data related technologies and have related project experience.

    Develop data standards, best practices, processes, and definitions of project and data requirements in support of strategy and ongoing operational support.

    Expert in large distributed, high concurrency, high load system design, development, and optimization

    Deliver scalable and reliable Big Data solutions leveraging Hortonworks HDP Hadoop platform, RDBMS, SaaS platforms and APIs.

    Apply concepts, industry research, best practices and agile methodologies and tools (Jira, Confluence) to implement Big Data solutionsAzure Certifications (DP-203 or DP-200,DP-201)

    Nice to Have knowledge of Machine Learning, Python, R and other Data science technologies

    Knowledge of SAS language .Strong ability to independently complete big data application architect design, framework design and optimization.

    Strong verbal and written communication skills.

    Demonstrated ability to work in a demanding team-oriented environment.

    Highly effective communication and collaboration skills working in a distributed team environment.

    Technical leadership and strong independent problem-solving skills.?

    Missing details in comments section

    Missing text box in the header

    Photo ID included containing personal information other than legal name and photo