- Data Pipeline Development: Build and maintain efficient data pipelines for collecting, processing, and storing large volumes of data.
- Data Integration: Collaborate with cross-functional teams to integrate data from various sources into our systems.
- Database Management: Design, optimize, and maintain databases using SQL and NoSQL technologies.
- Software Development: Write clean and efficient code using tech stacks such as , Python, Java, and more (the more, the better).
- Linux Job Scheduling: Utilize Slurm or similar Linux job scheduling systems for resource management and job scheduling.
- Containerization: Experience with Kubernetes (Kube) is preferred for container orchestration.
- Streaming Data: Work with real-time data processing and streaming technologies, including MQTT and Kafka.
- Data Quality: Ensure data quality, accuracy, and consistency by implementing data validation and cleansing processes.
- Performance Optimization: Identify and resolve bottlenecks in data processing, storage, and retrieval.
- Documentation: Maintain comprehensive documentation for data pipelines, systems, and processes.
- Bachelor's degree in Computer Science, Information Systems, or a related field
- At least 5 years of data engineering experience, with a strong track record of designing and implementing data solutions.
- Proficiency in data engineering technologies, including , Python, SQL, and Java (additional programming languages are a plus).
- Experience with Linux job scheduling, particularly with Slurm, or similar job scheduling systems.
- Familiarity with containerization technologies, with a preference for Kubernetes experience.
- Excellent knowledge of streaming data technologies, including MQTT and Kafka.
- Strong problem-solving skills and the ability to work in a collaborative team environment.
- Strong communication skills and the ability to translate complex technical concepts to non-technical stakeholders.
- A commitment to best practices in data engineering, including data security and privacy considerations.
- Strong problem-solving and analytical skills
- Excellent communication and collaboration skills
- Profit Sharing
- 401k with match
- 100% paid medical premiums
- Career development/training opportunities
-
Data Engineer
1 week ago
IDR, Inc. Crockett, United StatesIDR is seeking a Data Engineer to join one of our top clients for a Hybrid Position in the Houston, TX area If you are looking for an opportunity to join a large organization and work within an ever-growing team-oriented culture, please apply today · Remember to check your CV be ...
-
Data Engineer
4 weeks ago
VC5 Consulting Crockett, United StatesJob Title: · Data Engineer (AIS - Automatic Identification System) · Like the look of this opportunity Make sure to apply fast, as a high volume of applications is expected Scroll down to read the complete job description. · Location: · Houston, TX preferred - HybridPosition ...
-
Data Engineer
4 weeks ago
Vaco Crockett, United StatesTitle: Data Engineer - RemoteDo not wait to apply after reading this description a high application volume is expected for this opportunity.Pay/Salary/Benefits/Perks: Up to $150k/yrWork from Home Policy: Fully RemoteInterview Process: Streamlined process, 3 interviewsKey Skills: ...
-
Data Engineer
4 weeks ago
Beyondsoft Group Crockett, United StatesRole: Data Engineer · Is your CV ready If so, and you are confident this is the role for you, make sure to apply asap. · Primary Skills: PostgreSQL · Role Description: As a Data Engineer you must have at least 7+ years of experience. · Responsibilities: · Interpret data-rela ...
-
Data Engineer
2 weeks ago
Kaizen Technologies Crockett, United StatesJob Title: Data Engineer (Full time) · Location: Houston, TX (Onsite) USA · Band: U3 · Year of Experience: 5 to 7 Years · Duration: 6 Months (Will be extended for 12 months) · No Of Positions: positions is needed in a month time.) in one Quarter time. · 110K to 130K PA · ...
-
Data Engineer
3 weeks ago
Beyondsoft Group Crockett, United StatesRole: Data EngineerIs your CV ready If so, and you are confident this is the role for you, make sure to apply asap.Primary Skills: PostgreSQLRole Description: · As a · Data Engineer · you must have at least 7+ years of experience.Responsibilities:- Interpret data-related busin ...
-
Data Engineer
4 weeks ago
LTIMindtree Crockett, United StatesAbout Us: · LTIMindtree is a global technology consulting and digital solutions company that enables enterprises across industries to reimagine business models, accelerate innovation, and maximize growth by harnessing digital technologies. As a digital transformation partner to ...
-
Data Engineer
4 weeks ago
Addison Group Crockett, United StatesPosition: · Data Engineer · Scroll down to find an indepth overview of this job, and what is expected of candidates Make an application by clicking on the Apply button. · Location: · Occasionally Onsite or Fully Remote in Downtown HoustonExperience Requirements:5-10 years of ...
-
Data Engineer
3 weeks ago
LTIMindtree Crockett, United StatesAbout Us:LTIMindtree · is a global technology consulting and digital solutions company that enables enterprises across industries to reimagine business models, accelerate innovation, and maximize growth by harnessing digital technologies. As a digital transformation partner to m ...
-
Data Engineer
3 weeks ago
X4 Technology Crockett, United StatesAbout the Company: · For a complete understanding of this opportunity, and what will be required to be a successful applicant, read on. · This is a fantastic opportunity to join an internationally renowned powerhouse within the supply chain industry. You will have the opportuni ...
-
Data Engineer
2 weeks ago
X4 Technology Crockett, United StatesAbout the Company: · For a complete understanding of this opportunity, and what will be required to be a successful applicant, read on. · This is a fantastic opportunity to join an internationally renowned powerhouse within the supply chain industry. You will have the opportuni ...
-
Senior Data Engineer
2 weeks ago
IntagHire Crockett, United StatesSenior Data Engineer (Python/SQL) - Onsite in Houston, TX. · The following information aims to provide potential candidates with a better understanding of the requirements for this role. · No C2C please. Permanent position with full benefits. · The Senior Data Engineer (Python ...
-
Sr. Data Engineer
2 weeks ago
Recru Crockett, United StatesWe're looking for a Senior AWS Data Engineer skilled in Python open to working hybrid in Houston This role is contract-to-hire. · The information below covers the role requirements, expected candidate experience, and accompanying qualifications. · Purpose · Establish data feed ...
-
Senior Data Engineer
1 week ago
Harnham Crockett, United StatesSENIOR DATA ENGINEER · HOUSTON, TEXAS - 4 DAYS IN OFFICE · $120,000 - $160,000 BASE + BONUS + BENEFITS · Ready to apply Before you do, make sure to read all the details pertaining to this job in the description below. · Company Overview: · This automotive/retail company is s ...
-
Senior Data Engineer
2 weeks ago
Vaco Crockett, United States***Senior Data Engineer*** · All the relevant skills, qualifications and experience that a successful applicant will need are listed in the following description. · ***Onsite in Houston TX-77077*** · Job Summary · The Senior Data Engineer plays a crucial role in architecting, ...
-
Senior Data Engineer
3 weeks ago
IntagHire Crockett, United StatesSenior Data Engineer (Python/SQL) - · Onsite in Houston, TX. · The following information aims to provide potential candidates with a better understanding of the requirements for this role. · No C2C please. Permanent position with full benefits.The Senior Data Engineer (Python/ ...
-
Data Engineer III
4 weeks ago
G.A.S. Global Crockett, United StatesJob Description · Work directly with Business domain experts and Data Scientists to develop high quality, reliable, scalable, machine learning systems · Design and implement frameworks and tools to streamline the machine learning process · Automate manual data collection and p ...
-
Data Engineer III
3 weeks ago
G.A.S. Global Crockett, United StatesJob DescriptionWork directly with Business domain experts and Data Scientists to develop high quality, reliable, scalable, machine learning systemsDesign and implement frameworks and tools to streamline the machine learning processAutomate manual data collection and processing ta ...
-
Sr. Data Engineer
3 weeks ago
Recru Crockett, United StatesWe're looking for a Senior AWS Data Engineer skilled in Python open to working hybrid in Houston This role is contract-to-hire. · The information below covers the role requirements, expected candidate experience, and accompanying qualifications. · PurposeEstablish data feeds to ...
-
Network Data Engineer
2 weeks ago
Wipro Crockett, United StatesJob Title: · Network Data Engineer - L3Location: · Houston TXPrimary Skill (Technical Skill) : · Cisco Routing, Switching and Wireless, Infoblox.Educational Qualifications: · B.E. / B. TechExperience Level: · 7 - 10 Years · If you are interested in applying for this job, pl ...
Data Engineer - Crockett, United States - IntagHire
Description
Data Engineer with Python, SQL, Slurm, and Kubernetes - Onsite in Houston, TX. Fulltime role with a benefits package
The experience expected from applicants, as well as additional skills and qualifications needed for this job are listed below.
About the Role:
We are seeking a skilled mid to senior level Python Data Engineer to join our clients' team in Houston, TX. We are seeking a talented and experienced Data Engineer to join our dynamic team. If you are passionate about transforming data into actionable insights and have a strong background in data engineering, we want to hear from you.
The ideal candidate will have 5+ years of experience in data engineering with a focus on , Python, SQL, and Java, and will work closely with our clients' Data Scientists and Business Analysts to ensure that data is properly collected, processed, and analyzed to generate insights and drive business decisions. Experience with Slurm and Kubernetes are highly preferred. The candidate will be required to work on-site at our clients' office in Downtown Houston.
Responsibilities:
Requirements:
This is an exciting opportunity to be part of a startup organization, as well as to work directly with a Fortune 200 company. If you are a strategic thinker with a passion for delivering innovative products, we would love to hear from you.
Benefits:
