Jobs
>
Dallas

    Hadoop Platform Engineer - Dallas, United States - Photon

    Photon
    Photon Dallas, United States

    3 weeks ago

    Default job background
    Description
    Job Description


    As a Hadoop Platform Engineer, you will be responsible for designing, implementing, and managing our company's Hadoop infrastructure and data ecosystem.

    You will collaborate with cross-functional teams to understand data requirements, optimize data pipelines, and ensure the reliability and performance of our Hadoop clusters.

    You will also be responsible for administering and monitoring the Hadoop environment, troubleshooting issues, and implementing security measures.

    Responsibilities:
    Design, implement, and maintain Hadoop clusters, including HDFS, YARN, and MapReduce components.

    Collaborate with data engineers and data scientists to understand data requirements and optimize data pipelines for efficient processing and analysis.

    Administer and monitor Hadoop clusters to ensure high availability, reliability, and performance.
    Troubleshoot and resolve issues related to Hadoop infrastructure, data ingestion, data processing, and data storage.
    Implement and manage security measures to protect data within the Hadoop ecosystem, including authentication, authorization, and encryption.
    Collaborate with cross-functional teams to define and implement backup and disaster recovery strategies for Hadoop clusters.
    Optimize Hadoop performance by fine-tuning configurations, capacity planning, and implementing performance monitoring and tuning techniques.
    Work with DevOps teams to automate Hadoop infrastructure provisioning, deployment, and management processes.

    Stay up to date with the latest developments in the Hadoop ecosystem and recommend and implement new technologies and tools that enhance the platform.

    Document Hadoop infrastructure configurations, processes, and best practices.
    Provide technical guidance and support to other team members and stakeholders.


    Qualifications:


    Bachelor's degree in Computer Science, Information Technology, or a related field (or equivalent work experience).Strong experience in designing, implementing, and administering Hadoop clusters in a production environment.

    Proficiency in Hadoop ecosystem components such as HDFS, YARN, MapReduce, Hive, Spark, and HBase.
    Experience with cluster management tools like Apache Ambari or Cloudera Manager.
    Solid understanding of Linux/Unix systems and networking concepts.
    Strong scripting skills (e.g., Bash, Python) for automation and troubleshooting.
    Knowledge of database concepts and SQL.Experience with data ingestion tools like Apache Kafka or Apache NiFi.
    Familiarity with data warehouse concepts and technologies.
    Understanding of security principles and experience implementing security measures in Hadoop clusters.
    Strong problem-solving and troubleshooting skills, with the ability to analyze and resolve complex issues.
    Excellent communication and collaboration skills to work effectively with cross-functional teams.
    Relevant certifications such as Cloudera Certified Administrator for Apache Hadoop (CCAH) or Hortonworks Certified Administrator (HCA) are a plus.

    #J-18808-Ljbffr
  • DTCC

    Principal Platform Engineer

    2 weeks ago

    DTCC Dallas, United States

    Title - Principal Platform Engineer - Mainframe z/OS · Are you ready to explore a world of possibilities? · Do you want to work on innovative projects, collaborate with a dynamic and supportive team, and receive investment in your professional development? At DTCC, we are at the ...

  • Sogeti

    Data Platform Engineer

    3 weeks ago

    Sogeti Dallas, United States

    This is a full-time opportunity with Sogeti. · Location - Phoenix/AZ or Dallas/TX, Onsite full-time · Onshore Platforms Administrator Lead · Lead platform administration of Azure for data engineering (majority of work) · Lead platform administration of Power BI for engineering/re ...

  • Raytheon

    Senior Platform Engineer

    4 days ago

    Raytheon Dallas, United States

    Job Description · Date Posted: · Country: · United States of AmericaLocation: · CO102: 16800 E Centretech Pkwy,Aurora 16800 East Centretech Pkwy Building S75, Aurora, CO, 80011 USAPosition Role Type: · OnsitePosition Title: Senior Platform Engineer · At Raytheon, the foundation ...

  • Strategic Employment Partners

    Backend Platform Engineer

    3 weeks ago

    Strategic Employment Partners Dallas, United States

    Growing cryptocurrency startup in Dallas is looking to hire a new Backend Platform Engineer. They are a startup focused on fulfilling the mission of crypto by providing true financial and economic freedom to its users. · In this role, you'll play a key role in building out appli ...

  • Sixth Street Inc

    Cloud Platform Engineer

    6 days ago

    Sixth Street Inc Dallas, United States

    About The Engineering Team · Mission of Sixth Street Engineering: Establish a world-class, hands-on team that applies innovative technology solutions to drive scale and attack opportunities with the greatest commercial impact. · Sixth Street Engineering is dedicated to applyin ...

  • The Resource Collaborative

    ERP Platform Engineer

    5 days ago

    The Resource Collaborative Dallas, United States

    Our client is a captive Managed Services organization offering core business services to over 200 global companies within the portfolio of an Investment firm. · The ERP Platform Engineer Dynamics D365 F&O, ensures the optimal use of our ERP systems to meet our global business and ...

  • G-Research

    Analytics Platform Engineer

    3 hours ago

    G-Research Dallas, United States

    Do you want to tackle the biggest questions in finance with near infinite compute power at your fingertips? G-Research is a leading quantitative research and technology firm, with offices in London and Dallas. We are proud to employ some of the best people in their field and to n ...

  • Raytheon

    Senior Platform Engineer

    1 week ago

    Raytheon Dallas, TX, United States Full time

    Date Posted: · Country: · United States of America Location: · CO102: 16800 E Centretech Pkwy,Aurora 16800 East Centretech Pkwy Building S75, Aurora, CO, 80011 USA Position Role Type: · Onsite Position Title: Senior Platform Engineer · At Raytheon, the foundation of eve ...

  • DTCC

    Director - Scheduling Platform Engineering

    3 weeks ago

    DTCC Dallas, United States

    Are you ready to make an impact at DTCC? · Do you want to work on innovative projects, collaborate with a dynamic and supportive team, and receive investment in your professional development? At DTCC, we are at the forefront of innovation in the financial markets. We're committed ...

  • American Airlines

    Director, Platform Engineering and Delivery

    3 weeks ago

    American Airlines Dallas, United States

    Intro · Are you ready to explore a world of possibilities, both at work and during your time off? Join our American Airlines family, and you'll travel the world, grow your expertise and become the best version of you. As you embark on a new journey, you'll tackle challenges with ...

  • Amenities Health

    Platform Engineer

    2 weeks ago

    Amenities Health Dallas, Texas, United States Permanent

    Job Description · Compensation: $(phone number removed)/yr base salary, with the addition of equity · Location: Fully Remote, but must be based in the United States · We are seeking 1 talented platform engineer to join our dynamic team. As a platform engineer at Amenities, you wi ...

  • Active RPO

    GCP Platform Engineer

    2 days ago

    Active RPO Dallas, United States

    Job Description · Job DescriptionJob Description: · Responsibilities: · Infrastructure as Code (IaC): · • Design, implement, and manage infrastructure as code using Terraform for GCP environments. · • Ensure infrastructure configurations are scalable, reliable, and follow best pr ...

  • Atmosera

    Platform Engineer

    2 weeks ago

    Atmosera Dallas, United States Full time

    We are seeking a highly motivated and experienced Platform Engineer to join our Cloud Support Team. · In this role, you will be an escalation point and lead to others technicians in addition to contributing to the excellence of the platform engineering team. You will be responsi ...

  • Amenities Health

    Platform Engineer

    1 week ago

    Amenities Health Dallas, United States

    Job Description · Job DescriptionCompany Description · Amenities is the Digital Membership Platform for healthcare. The US healthcare system is a billion dollar industry and is modeled around providing care at a hefty expense. And yet, most healthcare experiences are awful and lo ...

  • Amenities Health

    Platform Engineer

    4 weeks ago

    Amenities Health Dallas, United States Full time

    Company Description · Amenities is the Digital Membership Platform for healthcare. The US healthcare system is a billion dollar industry and is modeled around providing care at a hefty expense. And yet, most healthcare experiences are awful and loyalty hardly exists in this indus ...

  • G-Research

    Database Platform Reliability Engineer

    3 days ago

    G-Research Dallas, United States

    Location : Dallas, TX · Do you want to tackle the biggest questions in finance with near infinite compute power at your fingertips? · G-Research is a leading quantitative research and technology firm, with offices in London and Dallas. We are proud to employ some of the best peop ...

  • Apixio

    Senior Data Platform Engineer

    5 days ago

    Apixio Dallas, United States

    Who We Are: · At the intersection of health plans and providers, Apixio and ClaimLogiq are creating a leading Connected Care platform to minimize reimbursement inaccuracies and high-quality patient care so they can thrive as the industry moves toward value-based reimbursement mod ...

  • G-Research

    Database Platform Reliability Engineer

    6 days ago

    G-Research Dallas, United States

    Do you want to tackle the biggest questions in finance with near infinite compute power at your fingertips? · G-Research is a leading quantitative research and technology firm, with offices in London and Dallas. We are proud to employ some of the best people in their field and t ...

  • American Airlines

    Director, Platform Engineering and Delivery

    3 weeks ago

    American Airlines Dallas, United States

    Intro Are you ready to explore a world of possibilities, both at work and duringyour time off? Join our American Airlines family, and you'll travel the world, grow your expertise and become the best version of you. As you embark on a new journey, you'll tackle challenges with fle ...

  • The Depository Trust & Clearing Corporation

    Director Scheduling Platform Engineering

    1 day ago

    The Depository Trust & Clearing Corporation Dallas, United States

    Are you ready to make an impact at DTCC? · Do you want to work on innovative projects, collaborate with a dynamic and supportive team, and receive investment in your professional development? At DTCC, we are at the forefront of innovation in the financial markets. We're committed ...