Big Data Developer - San Francisco, United States - Infinite Computer Solutions

    Default job background
    Description
    Job description

    1. Azure databricks(creating notebooks, creating WF's), Azure Data Factory(buidling ETL pipelines)
    2. Knowledge on Azure devops for code integration and buidling CI/CD pipelines
    3. Intermediate knowledge on SQL server (no need to optimize or anything, but need basic SQL language to write queries based on use cases)
    4. Good knowledge on python/scala coding for building and understanding existing pipelines.
    5. good to have JIRA skills
    6. Troubleshooting job failures (WF's/ADF jobs)
    7. optimizing spark jobs