Senior Azure Data Engineer - Richmond, United States - PeerSource

    Default job background
    Description
    PeerSource is currently recruiting for multiple

    Senior Azure Data Engineers

    on a

    Direct Hire

    basis.

    This position is fully remote but candidate must be presently located in 1 of the following states:
    FL, NC, TX, VA, CO, HI, GA, TN, PA, AZ, WA, IL, MA.

    Summary


    This individual will be working with AI and Analytics teams, delivering data-related products, features, and functionality that serves business and technical leaders.

    This Engineer will have a strong Microsoft and Azure data background, defining high volume data processing pipelines in a multi-tenant environment, verifying data integrity and curating data for consumption by data warehouse, third-party data analytics tools and machine learning models.

    You will be involved in the design and development efforts for our big data solutions including data lake, Business Intelligence Solutions, Machine Learning, Data Pipeline, and cloud-based data warehouse products.

    Responsibilities
    Work with clients to understand data analytics requirements. Analyze data to ensure it meets specific data management, data governance, and data quality assurance requirements before processing the data within the Data Lake and data warehouse
    Work with the Product Managers, Database Architect or BI Architect to understand data pipeline and data life cycle processing requirements and patterns
    Install and configure data sources for use by the data pipelines
    Work with the Database Architect to define data management, data governance, and data quality assurance requirements to manage the entire data processing life cycle
    Acts as a key contributor to all phases of the design and development lifecycle of analytic applications utilizing Microsoft Azure and BI technology platforms
    Curates data for analyses, business reviews, and operational data analysis demands
    Use an agile approach to define requirements, design and develop data pipeline solutions to enable near real-time change data capture (CDC) and data consumption

    Required Skills
    10+ years of experience with designing and developing complex data analytics solutions with advance SQL development skills
    5+ years of experience with Microsoft Big Data solutions with experience in SQL Server (2017 or higher), Azure SQL technologies (Azure Data Lake Gen2, Azure Databricks, Azure Databricks Unity Catalog, Databricks API, Databricks Row-level security, Databricks error logging, Azure SQL Server, and Azure Analysis Services), and a broad experience with related tools (CDC, Columnstore Index, In-memory Table, SSAS Tabular, DAX, T-SQL, SSIS)
    Experience in Power BI, Power BI Embedded, Power BI Services, Power BI Gateway, and Power BI Dataflow
    Experience using Azure DevOps and CI/CD as well as Agile tools and processes including Git, Jenkins, Jira, and Confluence
    Experience with data integration through APIs, Web Services, SOAP, and/or REST services
    Experience with Lakehouse architecture and design for multi-tenant, OLTP data modeling, dimensional data modeling, composite modeling, data transformation, row-level security, and designing the most optimal analytical data structures for near real-time data analytics
    Adept at using large data sets to find opportunities for product and process optimization and using models to test the effectiveness of different courses of action
    Bachelor's degree in Computer Science
    Additional programming experience is a plus (preferably.
    NET) or other languages such as Python, Scala, R.

    No third parties. H1 sponsorship is not available.

    PeerSource is a nationwide technology recruiting firm that prioritizes building strong relationships with the talented professionals we are fortunate to serve.

    We offer contract, contract-to-hire, and direct hire opportunities throughout the US and support W2 as well as independent consultants working on a Corp-to-Corp basis.

    W2 benefits with PeerSource include health, dental, vision, and life insurance as well as a matching retirement plan. Contact us for more details

    #J-18808-Ljbffr