Jobs
>
Dallas

    Senior Data Engineer - Dallas, United States - Brooksource

    Brooksource
    Brooksource Dallas, United States

    3 weeks ago

    Default job background
    Description

    Senior Data Engineer

    6+ Month Contract

    Chicago, Boston, Dallas, or Washington, DC Area

    Summary:

    We are seeking a highly experienced Senior Data Engineer with a deep understanding of PySpark using Databricks or AWS Glue or AWS EMR and cloud-based databases such as Snowflake. Proficiency in workflow management tools like Airflow a is essential. Healthcare industry experience is a significant advantage. The ideal candidate will be responsible for designing, implementing, and maintaining data pipelines, while ensuring the highest levels of performance, security, and data quality.

    Responsibilities:

    • Design, develop, and maintain scalable, reliable, and secure data pipelines to process large volumes of structured and unstructured healthcare data using PySpark and cloud-based databases.
    • Collaborate with data architects, data scientists, and analysts to understand data requirements and implement solutions that meet business and technical objectives.
    • Leverage AWS or Azure cloud services for data storage, processing, and analytics, optimizing cost and performance.
    • Utilize tools like Airflow for workflow management and Kubernetes for container orchestration to ensure seamless deployment, scaling, and management of data processing applications.
    • Develop and implement data ingestion, transformation, and validation processes to ensure data quality, consistency, and reliability across various healthcare datasets.
    • Monitor and troubleshoot data pipelines, proactively identifying and resolving issues to minimize downtime and ensure optimal performance.
    • Establish and enforce data engineering best practices, ensuring compliance with data privacy and security regulations specific to the healthcare industry.
    • Continuously evaluate and adopt new tools, technologies, and frameworks to improve the data infrastructure and drive innovation.
    • Mentor and guide junior data engineers, fostering a culture of collaboration, learning, and growth within the team.
    • Collaborate with cross-functional teams to align data engineering efforts with broader organizational goals and strategies.
    • Is familiar with SOC 2 compliance and its impact on company policies and processes.
    • Understands importance of adhering to SOC 2 requirements and maintains an effort to do so.
    • Reviews and understands the Employee Handbook, and internal policies that define individual security responsibilities, and maintains segregation of duties in accordance to their role requirements

    Requirements:

    • Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
    • 5+ years of experience in data engineering, with a strong background in Apache Spark and cloud-based databases such as Snowflake.
    • Strong Knowledge in Big Data Technologies, PySpark, thorough in one or more programming language like Python
    • Proven experience with AWS or Azure cloud services for data storage, processing, and analytics.
    • Expertise in workflow management tools like Airflow and container orchestration systems such as Kubernetes.
    • Strong knowledge of SQL and NoSQL databases, as well as data modeling and schema design principles.
    • Familiarity with healthcare data standards, terminologies, and regulations, such as HIPAA and GDPR, is highly desirable.
    • Excellent problem-solving, communication, and collaboration skills, with the ability to work effectively in cross-functional teams.
    • Demonstrated ability to manage multiple projects, prioritize tasks, and meet deadlines in a fast-paced environment.
    • A strong desire to learn, adapt, and contribute to a rapidly evolving data landscape.

    Eight Eleven Group provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, national origin, age, sex, citizenship, disability, genetic information, gender, sexual orientation, gender identity, marital status, amnesty or status as a covered veteran in accordance with applicable federal, state, and local laws.

  • MCKESSON

    Data Engineer

    1 week ago

    MCKESSON Dallas, United States Full time

    McKesson is an impact-driven, Fortune 10 company that touches virtually every aspect of healthcare. We are known for delivering insights, products, and services that make quality care more accessible and affordable. Here, we focus on the health, happiness, and well-being of you a ...

  • Evolution Recruitment Solutions, USA

    Data Engineer

    3 weeks ago

    Evolution Recruitment Solutions, USA Dallas, United States

    Data Engineer - Must be a US citizen or Green Card Holder · Contract: 6 months initial and full-time after 6 months · Rate: $70-$90 per hour · Location: Dallas 2 days on-site per week · We are seeking a skilled Data Engineer with extensive experience in DBT, Snowflake, and Azur ...

  • Ascendion

    Data Engineer

    3 weeks ago

    Ascendion Dallas, United States

    About Ascendion · Ascendion is a full-service digital engineering solutions company. We make and manage software platforms and products that power growth and deliver captivating experiences to consumers and employees. Our engineering, cloud, data, experience design, and talent so ...

  • Addison Group

    Data Engineer

    2 weeks ago

    Addison Group Dallas, United States

    On-site, Monday-Friday, in Dallas, TX, Remote days can and will be earned. · The Data Engineer is primarily responsible for resource designing, building, and maintaining our large-scale data infrastructure. This includes data pipelines, ensuring high data quality and accessibili ...

  • Zendr

    Data Engineer

    3 weeks ago

    Zendr Dallas, United States

    One of our top clients, a multinational consulting firm, is looking to add experienced Data Engineers to work within their Financial Services Division. · Requirements: · 3-5+ years of experience in Data Engineering · Experience with Big Data technologies (Hadoop, Spark, Hive, e ...

  • Zendr

    Data Engineer

    2 weeks ago

    Zendr Dallas, United States

    One of our top clients, a multinational consulting firm, is looking to add experienced Data Engineers to work within their Financial Services Division. · This opportunity is perfect for experienced data engineers looking for a more client-facing role and to widen their skillset w ...

  • Protagona

    Data Engineer

    3 weeks ago

    Protagona Dallas, United States

    As a Data Engineer, you will be part of a talented team of engineers responsible for the deployment and configuration of cloud resources to meet individual client business needs in AWS. Client engagements cover a wide variety of business requirements and require our engineers to ...

  • Apex Systems

    Data Engineer

    3 weeks ago

    Apex Systems Dallas, United States

    Position: Data Engineer · Location: Hybrid in Plano, Texas (3 days a week onsite) · Duration: 6 months contract to hire · Pay Rate: Starting at $65/HR · Contract Type: W2 Only (No C2C at this time) · Role: · This position is responsible for Data Engineering and Security... this r ...

  • Bridge Technologies and Solutions

    Data Engineer

    3 weeks ago

    Bridge Technologies and Solutions Dallas, United States

    Data engineers are responsible for developing, testing, and maintaining data pipelines and data architectures. Data engineers are responsible for developing, testing, and maintaining data pipelines and data architectures. They combine raw information from different sources to cre ...

  • Sogeti

    Data Engineer

    3 weeks ago

    Sogeti Dallas, United States

    Sogeti is a leading provider of professional technology services, specializing in Application Management, Infrastructure Management and High-Tech Engineering. Sogeti offers cutting-edge solutions around Testing, Business Intelligence, Mobility, Cloud and Security, combining world ...

  • Protagona

    Data Engineer

    2 weeks ago

    Protagona Dallas, United States

    Job Description · Job DescriptionAs a Data Engineer, you will be part of a talented team of engineers responsible for the deployment and configuration of cloud resources to meet individual client business needs in AWS. Client engagements cover a wide variety of business requireme ...

  • IT Vision Group

    Data Engineer

    2 weeks ago

    IT Vision Group Dallas, United States

    Job Description · Job DescriptionTitle : Data Engineer · Location: Dallas, TX · Duration: 12 Months+ · Job Description : · Architecting cloud native solutions across multiple B2B and B2B2C data domains · Develop a plan to migrate on-premise transactional and warehousing solutions ...

  • Insight Global

    Data Engineer

    3 weeks ago

    Insight Global Dallas, United States

    Insight Global is seeking a Data Engineer in Mexico for one of our top manufacturing clients. This candidate can sit anywhere fully remote in Mexico. In this role you will be joining the Corporate Enterprise Data Engineering Team. As an engineer you will need to have professional ...

  • ShiftCode Analytics

    Data Engineer

    3 weeks ago

    ShiftCode Analytics Dallas, United States

    DATA ENGINEER · 9+ MONTHS CONTRACT · DALLAS, TEXAS · NEED LOCAL TO DALLAS MILES) · HYBRID (2-3 DAYS/WEEK) · CLIENT DOMAIN- MORTGAGE INDUSTRY · This nationwide mortgage industry leader has an immediate 9+ month contract opportunity for a Data Integration ETL Engineer/Develope ...

  • Ascendion Inc.

    Data Engineer

    3 weeks ago

    Ascendion Inc. Dallas, United States

    About Ascendion · Ascendion is a full-service digital engineering solutions company. We make and manage software platforms and products that power growth and deliver captivating experiences to consumers and employees. Our engineering, cloud, data, experience design, and talent so ...

  • Allied Stone Inc

    Data Engineer

    2 weeks ago

    Allied Stone Inc Dallas, United States

    Job Description · Job DescriptionSUMMARY OF POSITION AND RESPONSIBILITY: · The Data Engineer is primarily responsible for resource designing, building, and maintaining our large-scale data infrastructure. · This includes data pipelines, ensuring high data quality and accessibili ...

  • Tiger Analytics

    Data Engineer

    2 weeks ago

    Tiger Analytics Dallas, United States

    Tiger Analytics is a fast-growing advanced analytics consulting firm. Our consultants bring deep expertise in Data Science, Machine Learning and AI. We are the trusted analytics partner for several Fortune 100 companies, enabling them to generate business value from data. Our bus ...

  • Loopback Analytics

    Data Engineer

    2 weeks ago

    Loopback Analytics Dallas, United States

    Job Description · Job DescriptionSalary: · About the Job · Loopback Analytics is hiring a Data Engineer to aid with development of healthcare analytics systems. This role consists mostly of coding in Python/Pyspark, specifically to aid with Loopback's product focused on critica ...

  • JBB Advanced Technologies

    Data Engineer

    3 weeks ago

    JBB Advanced Technologies Dallas, United States

    Company Overview · JBB Advanced Technologies is a Dallas-based holding company that develops and acquires valuable intellectual properties in diverse areas, including blockchain, artificial intelligence, and renewable energy. · The Opportunity · We have an immediate need for a ...

  • Loopback LLC

    Data Engineer

    3 weeks ago

    Loopback LLC Dallas, United States

    About the Job · Loopback Analytics is hiring a Data Engineer to aid with development of healthcare analytics systems. This role consists mostly of coding in Python/Pyspark, specifically to aid with Loopback's product focused on critical outcomes for specific diseases. This posit ...