Data Engineer - Houston, United States - IntagHire

IntagHire Houston, United States

2 days ago

Description

Data Engineer with Python, SQL, Slurm, and Kubernetes - Onsite in Houston, TX. Fulltime role with a benefits package

About the Role:

We are seeking a skilled mid to senior level Python Data Engineer to join our clients' team in Houston, TX. We are seeking a talented and experienced Data Engineer to join our dynamic team. If you are passionate about transforming data into actionable insights and have a strong background in data engineering, we want to hear from you.

The ideal candidate will have 5+ years of experience in data engineering with a focus on , Python, SQL, and Java, and will work closely with our clients' Data Scientists and Business Analysts to ensure that data is properly collected, processed, and analyzed to generate insights and drive business decisions. Experience with Slurm and Kubernetes are highly preferred. The candidate will be required to work on-site at our clients' office in Downtown Houston.

Responsibilities:

Data Pipeline Development: Build and maintain efficient data pipelines for collecting, processing, and storing large volumes of data.
Data Integration: Collaborate with cross-functional teams to integrate data from various sources into our systems.
Database Management: Design, optimize, and maintain databases using SQL and NoSQL technologies.
Software Development: Write clean and efficient code using tech stacks such as , Python, Java, and more (the more, the better).
Linux Job Scheduling: Utilize Slurm or similar Linux job scheduling systems for resource management and job scheduling.
Containerization: Experience with Kubernetes (Kube) is preferred for container orchestration.
Streaming Data: Work with real-time data processing and streaming technologies, including MQTT and Kafka.
Data Quality: Ensure data quality, accuracy, and consistency by implementing data validation and cleansing processes.
Performance Optimization: Identify and resolve bottlenecks in data processing, storage, and retrieval.
Documentation: Maintain comprehensive documentation for data pipelines, systems, and processes.

Requirements:

Bachelor's degree in Computer Science, Information Systems, or a related field
At least 5 years of data engineering experience, with a strong track record of designing and implementing data solutions.
Proficiency in data engineering technologies, including , Python, SQL, and Java (additional programming languages are a plus).
Experience with Linux job scheduling, particularly with Slurm, or similar job scheduling systems.
Familiarity with containerization technologies, with a preference for Kubernetes experience.
Excellent knowledge of streaming data technologies, including MQTT and Kafka.
Strong problem-solving skills and the ability to work in a collaborative team environment.
Strong communication skills and the ability to translate complex technical concepts to non-technical stakeholders.
A commitment to best practices in data engineering, including data security and privacy considerations.
Strong problem-solving and analytical skills
Excellent communication and collaboration skills

This is an exciting opportunity to be part of a startup organization, as well as to work directly with a Fortune 200 company. If you are a strategic thinker with a passion for delivering innovative products, we would love to hear from you.

Benefits:

Profit Sharing
401k with match
100% paid medical premiums
Career development/training opportunities

Data center engineer USA

1 week ago

Excis Compliance ltd Houston, United States

Responsiblities but not limited : · Be a focal point for implementation of Infrastructure Tech Refresh projects taking direction from Customer Leadership as needed. The Tech Refresh includes replacing servers, storage, network switches, or other related infrastructure hardware/so ...
Data Engineer

6 days ago

Kaizen Technologies Houston, United States

Job Title: Data Engineer (Full time) · Location: Houston, TX (Onsite) USA · Band: U3 · Year of Experience: 5 to 7 Years · Duration: 6 Months (Will be extended for 12 months) · No Of Positions: positions is needed in a month time.) in one Quarter time. · 110K to 130K PA · Respons ...
Data Engineer

1 week ago

Addison Group Houston, United States

Job Description · Job DescriptionJob Title: Data Engineer · Office Status: Remote · Requirements: · Standard data engineering responsibilities such as building pipelines, etc. · 5-10 years of experience · Python coding experience · Databricks,Trino, DBT core expeience · SQL back ...
Data Engineer

1 week ago

Beyondsoft Houston, United States

Role: Data Engineer · Primary Skills: PostgreSQL · Role Description: As a Data Engineer you must have at least 7+ years of experience. · Responsibilities: · Interpret data-related business requirements into technical ones. · Relational database design and feature development with ...
Data Engineer

1 week ago

Apex Health Solutions Houston, United States

Position Summary: Apex Health Solutions is leading a healthcare transformation through our partnerships with physicians and healthcare insurers. Through our unique models, Apex empowers physicians to truly manage a patient's health, delivering high quality, affordable care in a m ...
Data Engineer

2 weeks ago

Addison Group Houston, United States

Position: Data Engineer · Location: Occasionally Onsite or Fully Remote in Downtown Houston · Experience Requirements: · 5-10 years of experience · Python coding · Databricks,Trino, DBT core · SQL background · Data Modeling · Position Description: · Drive data modeling initiati ...
Data Engineer

4 days ago

NR Consulting Houston, United States

Title- Data Engineer · Location: San Francisco CA, Houston TX or Remote · Job Description · • Develop and deploy production-grade services, and data infrastructure emphasizing performance, scalability, and self-service. · • Assume a leadership role in developing solutions with ...
Data Engineer

1 week ago

Quantlab Houston, United States

We are seeking a Data Engineer to join a newly formed data team. This individual will work to create and own the long-term data architecture, to internalize and continuously curate and ensure the accuracy of a variety of market and vendor data sets. A successful candidate will be ...
Data Engineer

5 days ago

Lyondell Basell North America Houston, United States

LyondellBasell · Basic Function · LyondellBasell has fully committed to achieving its vision as "The Chemical Company of the Future" and an industry leader in the areas of Sustainability and Customer Experience. The Digital Enterprise that will act as the foundation for enabling ...
Data Engineer

4 days ago

Vantage Bank Houston, United States

JOB CLASSIFICATION · Full / Part-time: Full-time · Hours Per Week: 40 · Location: 5151 San Felipe St., Suite 730, Houston TX 77056 · The Data Engineer is part of a high-performing Data Engineering team that will play a crucial role in designing, developing, and maintaining sc ...
Data Engineer

4 days ago

Brooksource Houston, United States

*Data Engineer - Fortune 500 Utility Client* · *6 Month Contract-to-Hire* · *Downtown Houston, TX (Hybrid)* · *$65-70/Hour on W2. * · *Cannot Work C2C or 1099.* · *Cannot Provide Sponsorship.* · _*Business Objective: *_ · Our client is scaling their analytics organization a ...
Data Engineer

1 week ago

Tapcheck Houston, United States

Tapcheck is looking for a Data Engineer to join our growing Data team. In this role you will partner closely with stakeholders to gather requirements and play a crucial role in shaping the future of Tapcheck's data infrastructure. · What You'll Do: · Collaborate with business s ...
Data Engineer

1 week ago

Creative Financial Staffing Houston, United States

Data Engineer · Hybrid | No Sponsorship | Direct Hire · Perks of the Data Engineer: · Hybrid Schedule · Fun Work Outings - Strong Team Culture · Work Life Balance - Generous Paid Time Off · Stock Program Offered · GROWING Tons of growth opportunities · Duties of Data Engi ...
Data Engineer

2 weeks ago

Creative Financial Staffing Houston, United States

Data Engineer · Hybrid | No Sponsorship | Direct Hire · Perks of the Data Engineer: · Hybrid Schedule · Fun Work Outings - Strong Team Culture · Work Life Balance - Generous Paid Time Off · Stock Program Offered · GROWING Tons of growth opportunities · Duties of Data Engineer: · ...
Data Engineer

4 days ago

Georgia IT Inc Houston, United States

Job Title - zure Data Engineer · Location - Houston, TX (Remote) · Duration - 12 Plus Months · Rate - DOE · Work Authorization USC, GC, GC-EAD, H4EAD, TN, L2EAD · Job Description · 6 Plus years of experience as Data engineer · Strong experience on Python and Scala · You w ...
Data Engineer

1 week ago

Chord Energy Houston, United States

The Chord Energy Data Engineer role is a technical individual contributor role, focused on supporting data infrastructure to enable data analytics and machine learning. This role involves designing and building data pipelines, ensuring data quality, and facilitating data accessib ...
Data Engineer

4 days ago

Client of Reputable Staffing & Recruiting Firm Houston, United States

Job Description · Job DescriptionBrookwoods Group is working with a Houston-based Energy Company to identify a Data Engineer. · The Data Engineer role is a technical individual contributor role, focused on supporting data infrastructure to enable data analytics and machine learn ...
Data Engineer

1 week ago

LyondellBasell Industries Houston, United States

LyondellBasell · Basic Function · LyondellBasell has fully committed to achieving its vision as "The Chemical Company of the Future" and an industry leader in the areas of Sustainability and Customer Experience. The Digital Enterprise that will act as the foundation for enabling ...
data engineer

2 weeks ago

Shell Energy Houston, United States

· At Shell Energy Solutions, we believe there's a better way to power your business and home. · Aligned with Shell's ambition to be a significant global power business and to become net zero by 2050, our cleaner, affordable and simple solutions help companies manage their energ ...
Data Engineer

2 weeks ago

LTIMindtree Houston, United States

About Us: · LTIMindtree is a global technology consulting and digital solutions company that enables enterprises across industries to reimagine business models, accelerate innovation, and maximize growth by harnessing digital technologies. As a digital transformation partner to m ...