Jobs
>
Huntsville

    Senior Data Engineer - Huntsville, United States - Xpect Solutions Inc.

    Xpect Solutions Inc.
    Xpect Solutions Inc. Huntsville, United States

    2 weeks ago

    Default job background
    Description

    Company Overview:
    XPECT Solutions, Inc. has built a strong reputation by supporting our clients in meeting their strategic goals and mission objectives. We provide high quality resources for a wide range of IT and security solutions at best-value pricing.

    Our success is built on a solid foundation of well-vetted, highly technical personnel, a disciplined project management approach, and an overarching commitment to customer service.

    We develop, test, deploy, and support exceptional solutions that enhance system functionality, while maximizing reliability and availability, and ensure the tightest security.


    Position Overview:

    Xpect Solutions is looking for a Senior ETL Engineer to join our team supporting our Federal customer out of Huntsville, AL.This position will provide the ability to make a significant impact to the mission while also allowing the candidate to grow their skills and career.

    Successful candidate will need to be able to maintain existing software as the transition from server-based to cloud-based occurs.

    The candidate will work with a GOTS-based Extract, Transform and Load (ETL) system that loads information into Postgres database with billions of rows and deals with a file repository that is in a Petabyte range.

    In addition, the candidate will be highly involved in the engineering planning and transition of the existing system software / data into a Cloud-based (currently AWS) solution.


    Core Responsibilities:

    • Design, develop, and maintain the ETL (Extract, Transform, Load) processes for master data management (MDM) system.
    • Build and optimize data pipelines to extract data from various sources, transform it into the required format, and load using Databricks and AWS services.
    • Collaborate with stakeholders to gather data requirements, understand data sources, and ensure data quality and integrity throughout the ETL process.
    • Implement data validation, cleansing, and enrichment techniques to improve the accuracy and completeness of data.
    • Monitor and troubleshoot ETL processes to identify and resolve issues in a timely manner

    Requirements:

    • Active Top-Secret Clearance with the ability to obtain an SCI
    • A Counter Intelligence Polygraph is required after start.
    • Bachelor's degree in Engineering, Computer Science, or other related analytical, scientific, or technical discipline.
    • At least 6 years experience with ETL.
    • Database ETL engineers should have experience with Oracle 11g/12c, Sun Solaris OS, Linux (CentOS, Red Hat), and Windows environments.
    • Strong proficiency in programming languages such as Scala, or Java.
    • Experience in designing and developing ETL workflows using tools like Apache Spark or AWS Glue.
    • Indepth knowledge of ETL best practices, data integration techniques, and data quality management.
    • Familiarity with different data storage technologies and databases, such as Amazon S3 or Amazon Redshift.
    • MUST have strong UNIX/LINUX experience

    Preferred Qualifications:

    • Understanding of concepts of Data Lakehouse architecture as well as OpenSearch is a plus.
    • Experience using software repository tools such as GIT or SVN

    Benefits:
    Xpect Solutions, Inc.

    is a one-of-a-kind employer with a talented team that is cleared at various levels and is certified in dozens of industry-recognized certifications.

    Our talented staff are the key to our success. They bring the knowledge, experience and technical skills to deliver the best solutions to our customers.

    We support our team by providing open communication, win-win partnerships with clients and vendors, a team-oriented culture that supports employee diversity, and a focus on professional development and growth for a long-lasting and happy career.

    We offer a benefits package that is designed to keep our most important assets – our employees – healthy, happy, energized and moving forward.

    Our philosophy is simple – empower our employees with the benefits, resources and the financial incentives they need to be successful.

    Below is an overview of our amazing benefits and perks:
    ​

    • A competitive Medical, Dental, and Vision plan.
    • Retirement Savings Plan (with company match)
    • Life Insurance
    • AD&D Insurance
    • Short Term and Long Term Disability Insurance
    • 3 weeks of annual PTO
    • 11 days of Holiday PTO
    • Performance Awards
    • Referral Bonus Plan (of up to $2,500/year)
    • Education Reimbursement/Training (of up to $2,500/year) Xpect Solutions, Inc. is an equal opportunity and affirmative action employer, who participates in E-Verify. All qualified applicants will receive consideration for employment without regard to race, color, national origin, gender, religion, age, disability, veteran's status, or any other classification as required by applicable law. EOE/M/F/D/V
  • Axient

    Data Engineer

    3 weeks ago

    Axient Huntsville, United States

    Axient - · SPACE · Check out this NEW Opportunity with Axient · Axient is seeking a Mid-Level Data Engineer to join our analytics team in Huntsville Alabama. · In this role, you will construct data analytical infrastructure, data engineering, data mining, exploratory analysis, pr ...

  • Axient

    Data Engineer

    4 weeks ago

    Axient Huntsville, United States

    Axient - · SPACE · Overview · Axient is seeking a Mid-Level Data Engineer to join our analytics team in Huntsville Alabama. · In this role, you will construct data analytical infrastructure, data engineering, data mining, exploratory analysis, predictive analysis, and statistical ...

  • Axient

    Data Engineer

    1 week ago

    Axient Huntsville, United States

    **Check out this NEW Opportunity with Axient** · Axient is seeking a Mid-Level Data Engineer to join our analytics team in Huntsville Alabama. · In this role, you will construct data analytical infrastructure, data engineering, data mining, exploratory analysis, predictive anal ...

  • Booz Allen Hamilton

    Data Engineer

    2 weeks ago

    Booz Allen Hamilton Huntsville, United States Full time

    Job Number: R0184236 · Data EngineerThe Opportunity: · Ever-expanding technology like IoT, machine learning, and artificial intelligence means that there's more structured and unstructured data available today than ever before. As a data engineer, you know that organizing big da ...

  • Axient

    Data Engineer

    3 weeks ago

    Axient Huntsville, United States

    Check out this NEW Opportunity with Axient · Axient is seeking a Mid-Level Data Engineer to join our analytics team in Huntsville Alabama. · In this role, you will construct data analytical infrastructure, data engineering, data mining, exploratory analysis, predictive analysis, ...

  • SOS International LLC

    Data Engineer

    4 weeks ago

    SOS International LLC Huntsville, United States

    Overview · SOSi is seeking · Data Engineers · to join our analytics team working on an innovative MLOps workload leveraging cutting-edge technologies and supporting a government customer in · Huntsville, Alabama. · This role will be responsible for delivering automation to k ...

  • SOSi

    Data Engineer

    2 weeks ago

    SOSi Huntsville, United States

    Overview · SOSi is seeking Data Engineers to join our analytics team working on an innovative MLOps workload leveraging cutting-edge technologies and supporting a government customer in Huntsville, Alabama. This role will be responsible for delivering automation to key national s ...

  • Booz Allen Hamilton

    Data Engineer

    3 weeks ago

    Booz Allen Hamilton Huntsville, United States Full time

    Data Engineer The Opportunity: · Ever-expanding technology like IoT, machine learning, and artificial intelligence means that there's more structured and unstructured data available today than ever before. As a data engineer, you know that organizing big data can yield pivotal ...

  • Spry Methods, Inc.

    Senior Data Engineer

    2 weeks ago

    Spry Methods, Inc. Huntsville, United States

    Who We're Looking For (Position Overview): Spry is searching for a Senior Data Engineer whom will collaborate with customers, often engaging directly with non-technical personnel, to understand their data related needs, suggest solutions, and complete work in a timely manner. Thi ...

  • Rishabh RPO

    Engineer - Data II

    3 days ago

    Rishabh RPO Huntsville, United States

    Job Description · Job Description · Title: Software Integration Engineer · Onsite Requirement: 3 Days a Week · We are a diverse team of collaborators, doers, and problem-solvers who are relentlessly committed to a culture of safety. This position will directly impact the history ...

  • Blue Origin

    Data Engineer III

    2 days ago

    Blue Origin Huntsville, United States

    At Blue Origin, we envision millions of people living and working in space for the benefit of Earth. We're working to develop reusable, safe, and low-cost space vehicles and systems within a culture of safety, collaboration, and inclusion. Join our diverse team of problem solvers ...

  • Marathon TS

    Sr. Data Engineer/ETL Engineer

    3 weeks ago

    Marathon TS Huntsville, United States

    Position Overview: · Marathon TS is looking for a Senior ETL Engineer to join our team supporting our Federal customer out of Huntsville, AL.This position will provide the ability to make a significant impact to the mission while also allowing the candidate to grow their skills ...

  • Marathon TS

    Sr. Data Engineer/ETL Engineer

    2 weeks ago

    Marathon TS Huntsville, United States

    Position Overview: · Marathon TS is looking for a Senior ETL Engineer to join our team supporting our Federal customer out of Huntsville, AL.This position will provide the ability to make a significant impact to the mission while also allowing the candidate to grow their skills ...

  • SSP Innovations LLC

    GIS Data Engineer I

    4 weeks ago

    SSP Innovations LLC Huntsville, United States

    The purpose of the Data Engineer is to migrate and convert data from foreign data models into our proprietary 3GIS data model. In addition to data conversion, the data engineer supports existing 3GIS accounts with data changes for system corrections and upgrade requirements. Data ...

  • Celestar

    Data Engineer Mid Level

    4 days ago

    Celestar Huntsville, United States

    Design, implement, and operate data management systems for intelligence needs. Design how data will be stored, accessed, used, integrated, and managed by different data regimes and digital systems. Work with data users to determine, create, and popul Data Engineer, Engineer, Soft ...

  • HigherEchelon

    Data Links/Communications Engineer

    4 hours ago

    HigherEchelon Huntsville, United States

    Data Links / Communications Engineer · Location: Huntsville, AL · Description: · Seeking a motivated and ambitiousData Links / Communications Engineer to join the Software, Simulation, Systems Engineering and Integration Directorate (S3I) Joint Technology Center - Systems Integ ...

  • Advantex Consulting

    Data Engineer- ETL with Security Clearance

    2 weeks ago

    Advantex Consulting Huntsville, United States

    Data Engineer- ETL · Locations: Huntsville, Alabama · Clearance Requirement: Active Top-Secret Clearance (SCI Eligibility) Role & Responsibilities Technology is constantly changing, and our adversaries are digitally exceeding law enforcement's · ability to keep pace. Those charge ...

  • Meta Platforms, Inc.

    SiteOps Data Center Capacity Engineer

    1 week ago

    Meta Platforms, Inc. Huntsville, United States

    Facebook is seeking a forward thinking experienced Engineer to join the Capacity team within Data Center Operations. Our data centers, and the tens of thousands of servers installed in them, are the foundation upon which our rapidly scaling infrastructure efficiently operates and ...

  • META

    SiteOps Data Center Capacity Engineer

    1 week ago

    META Huntsville, United States

    Facebook is seeking a forward thinking experienced Engineer to join the Capacity team within Data Center Operations. Our data centers, and the tens of thousands of servers installed in them, are the foundation upon which our rapidly scaling infrastructure efficiently operates and ...

  • META

    SiteOps Data Center Capacity Engineer

    1 week ago

    META Huntsville, United States

    Facebook is seeking a forward thinking experienced Engineer to join the Capacity team within Data Center Operations. Our data centers, and the tens of thousands of servers installed in them, are the foundation upon which our rapidly scaling infrastructure efficiently operates and ...