Jobs
>
Dallas

    Lead Azure Data Engineer - Dallas, United States - InfoVision Inc.

    InfoVision Inc.
    InfoVision Inc. Dallas, United States

    3 weeks ago

    Default job background
    Technology / Internet
    Description

    Qualifications:

    • 15+ years of experience (including 7+ years in Azure) in Data Engineering, ETL & Data Warehousing
    • Should have excellent leadership, communication & client-facing skills
    • Should have in depth knowledge on Azure Data Factory, Databricks, SSIS, Azure Functions, Logic Apps, Azure Event Hubs, PySpark, Spark Streaming, ADLS Gen2, Azure Blob, Azure Synapse, Azure SQL, SQL Server and good working knowledge on Tableau.
    • Should have executed at least 2 Azure Cloud Data Warehousing projects
    • Should have worked on Batch, API, Event & Streaming data processing,
    • Should have working experience in building CI\CD pipelines using tools like Azure DevOps, GitHub, Jenkins, etc
    • Should have working knowledge on handling various file formats like JSON, XML, CSV, Parquet, Delta, etc.
    • Should have good knowledge of Agile methodology and able to work in a Scrum Master capacity.
    • Should have worked in creating repeatable modules to support automation to drive dynamic data ingestion, processing, quality checks & error handling.
    • Should have working knowledge on creating complex Databricks notebooks and integrate with Azure Ecosystem.
    • Should have working knowledge of creating SQL queries to analyze and extract semi-structured data
    • Should have in depth understanding on Data Warehousing, Data Analysis, Data Profiling, Data Quality & Data Mapping
    • Should have cross global location experience and led a team of at least 10+ members in a global delivery model
    • Should have experience in working with product managers, project managers, business users, applications development team members, DBA teams and Data Governance team on a daily basis to analyze requirements, design, development and deployment technical solutions

    Responsibilities:

    • Work with business and technology stakeholders to gather, understand their business requirements and manage their expectations
    • Design, build and deploy data pipelines using state-of-the-art techniques.
    • Design, build and deploy repeatable modules using state-of-the-art techniques.
    • Technical owner/lead and the scrum master for the entire workstream.
    • Provide technical leadership to a team of data engineers, guiding them in implementing the best practices and innovation.
    • Collaborate with cross-functional teams including data scientists, business analysts, solution architects, and DevOps engineers, to deliver end-to-end data solutions that meet business requirements.
    • Integrate data from various sources, including on-prem systems, Cloud-based applications, APIs, to provide a unified view of data for analytics, and reporting purpose.
    • Analyze the different source systems, profile data, understand, document & fix Data Quality issues
    • Create design documents and review Source to Target Mapping documents and any supporting documents needed for deployment/migration
    • Implement CI\CD pipelines for automating the deployment
    • Review Test cases, Test plans and Test results
    • Support team during troubleshooting & debugging defects & bug fixes, business requests, environment migrations & other adhoc requests
    • Document best practices, code base, and share knowledge
    • Maintain and improve already existing processes
    • Ensure that the data pipelines are stable, secure, maintainable and highly available
  • MCKESSON

    Data Engineer

    6 days ago

    MCKESSON Dallas, United States Full time

    McKesson is an impact-driven, Fortune 10 company that touches virtually every aspect of healthcare. We are known for delivering insights, products, and services that make quality care more accessible and affordable. Here, we focus on the health, happiness, and well-being of you a ...

  • Apex Systems

    Data Engineer

    3 weeks ago

    Apex Systems Dallas, United States

    Position: Data Engineer · Location: Hybrid in Plano, Texas (3 days a week onsite) · Duration: 6 months contract to hire · Pay Rate: Starting at $65/HR · Contract Type: W2 Only (No C2C at this time) · Role: · This position is responsible for Data Engineering and Security... this r ...

  • Evolution Recruitment Solutions, USA

    Data Engineer

    3 weeks ago

    Evolution Recruitment Solutions, USA Dallas, United States

    Data Engineer - Must be a US citizen or Green Card Holder · Contract: 6 months initial and full-time after 6 months · Rate: $70-$90 per hour · Location: Dallas 2 days on-site per week · We are seeking a skilled Data Engineer with extensive experience in DBT, Snowflake, and Azur ...

  • Grid Dynamics

    Data Engineer

    3 weeks ago

    Grid Dynamics Dallas, United States

    Position at Grid Dynamics We are seeking an experienced Data Engineer with an exceptional command of SQL queries and proficiency in handling data from our warehouse system. This role will be instrumental in filtering and processing data using specified parameters and ensuring com ...

  • IT Vision Group

    Data Engineer

    2 weeks ago

    IT Vision Group Dallas, United States

    Job Description · Job DescriptionTitle : Data Engineer · Location: Remote · Duration: 12 Months+ · We are looking for an onshore Data engineer with the following requirement to start ASAP: · Must have: SQL, data profiling, data cleansing, and data modeling experience; comfortable ...

  • Addison Group

    Data Engineer

    2 weeks ago

    Addison Group Dallas, United States

    On-site, Monday-Friday, in Dallas, TX, Remote days can and will be earned. · The Data Engineer is primarily responsible for resource designing, building, and maintaining our large-scale data infrastructure. This includes data pipelines, ensuring high data quality and accessibili ...

  • Zendr

    Data Engineer

    3 weeks ago

    Zendr Dallas, United States

    One of our top clients, a multinational consulting firm, is looking to add experienced Data Engineers to work within their Financial Services Division. · Requirements: · 3-5+ years of experience in Data Engineering · Experience with Big Data technologies (Hadoop, Spark, Hive, e ...

  • ShiftCode Analytics

    Data Engineer

    2 weeks ago

    ShiftCode Analytics Dallas, United States

    DATA ENGINEER · 9+ MONTHS CONTRACT · DALLAS, TEXAS · NEED LOCAL TO DALLAS MILES) · HYBRID (2-3 DAYS/WEEK) · CLIENT DOMAIN- MORTGAGE INDUSTRY · This nationwide mortgage industry leader has an immediate 9+ month contract opportunity for a Data Integration ETL Engineer/Develope ...

  • Ascendion

    Data Engineer

    3 weeks ago

    Ascendion Dallas, United States

    About Ascendion · Ascendion is a full-service digital engineering solutions company. We make and manage software platforms and products that power growth and deliver captivating experiences to consumers and employees. Our engineering, cloud, data, experience design, and talent so ...

  • Protagona

    Data Engineer

    2 weeks ago

    Protagona Dallas, United States

    As a Data Engineer, you will be part of a talented team of engineers responsible for the deployment and configuration of cloud resources to meet individual client business needs in AWS. Client engagements cover a wide variety of business requirements and require our engineers to ...

  • Sogeti

    Data Engineer

    3 weeks ago

    Sogeti Dallas, United States

    Sogeti is a leading provider of professional technology services, specializing in Application Management, Infrastructure Management and High-Tech Engineering. Sogeti offers cutting-edge solutions around Testing, Business Intelligence, Mobility, Cloud and Security, combining world ...

  • Coca-Cola Southwest Beverages

    Data Engineer

    2 weeks ago

    Coca-Cola Southwest Beverages Dallas, United States

    Req ID:188046 · General Purpose This role is responsible for designing ETL (Extract, Transform, Load) processes in the cloud with the objective of obtaining both external and internal data sources to feed the team's data repository following guidelines and best practice standard ...

  • PRIMUS Global Services Inc.

    Data Engineer

    1 week ago

    PRIMUS Global Services Inc. Dallas, United States

    Data Engineer · We have an immediate long-term opportunity with one of our prime clients for a position of Data Engineer to work in Dallas, TX on Hybrid basis. · Description: Designs, develops, and implements using the skillset Pyspark, Azure Databricks, Azure Data Factory, Pyth ...

  • Loopback LLC

    Data Engineer

    2 weeks ago

    Loopback LLC Dallas, United States

    About the Job · Loopback Analytics is hiring a Data Engineer to aid with development of healthcare analytics systems. This role consists mostly of coding in Python/Pyspark, specifically to aid with Loopback's product focused on critical outcomes for specific diseases. This posit ...

  • JBB Advanced Technologies

    Data Engineer

    3 weeks ago

    JBB Advanced Technologies Dallas, United States

    Company Overview · JBB Advanced Technologies is a Dallas-based holding company that develops and acquires valuable intellectual properties in diverse areas, including blockchain, artificial intelligence, and renewable energy. · The Opportunity · We have an immediate need for a ...

  • Insight Global

    Data Engineer

    3 weeks ago

    Insight Global Dallas, United States

    Title: Data Engineer · Location: Hybrid in office 3 days per week in Atlanta or Dallas · Duration: 12 month contract + extensions · MUST HAVE · 8+ years of database design and development (Oracle, PL/SQL required) · Hands-on expertise with Hibernate to connect database to web s ...

  • IT Vision Group

    Data Engineer

    2 weeks ago

    IT Vision Group Dallas, United States

    Job Description · Job DescriptionTitle : Data Engineer · Location: Dallas, TX · Duration: 12 Months+ · Job Description : · Architecting cloud native solutions across multiple B2B and B2B2C data domains · Develop a plan to migrate on-premise transactional and warehousing solutions ...

  • Apex Systems

    Data Engineer

    3 weeks ago

    Apex Systems Dallas, United States

    Position: Data Engineer · Location: Hybrid in Plano, Texas (3 days a week onsite) · Duration: 6 months contract to hire · Pay Rate: Starting at $65/HR · Contract Type: W2 Only (No C2C at this time) · Role: · This position is responsible for Data Engineering and Security... ...

  • Evolution Recruitment Solutions

    Data Engineer

    4 weeks ago

    Evolution Recruitment Solutions Dallas, United States

    Data Engineer - Must be a US citizen or Green Card Holder · All potential applicants are encouraged to scroll through and read the complete job description before applying. · Contract: 6 months initial and full-time after 6 months · Rate: $70-$90 per hour · Location: Dallas 2 ...

  • Constellation Search Group

    Data Engineer

    4 weeks ago

    Constellation Search Group Dallas, United States

    Title: · Data Analyst & Engineer · Location: · Dallas, TX *(Hybrid) · Compensation: · to 100k · Type: · Direct · Overview · As a Data Analyst & Engineer specializing in Amazon Web Services (AWS), you will play a pivotal role in the design, development, and maintenance of dat ...