- Experience in monitoring and troubleshooting large scale data platforms, data pipelines, complex backend services
- Able to effectively communicate incidents, coordinate incident responses, document/manage runbooks, set up processes to support other software engineering teams and data analysts
- Experience in managing large datasets
- Experience in creating Kubernetes configurations, managing services in Kubernetes, building docker images
- Demonstrate good understanding & troubleshooting Spark jobs
- Experience in developing/maintaining automation tools in programming/scripting languages like Python
- Demonstrate good understanding in Big data eco-systems such as HDFS, Kafka, SQL etc.
- Experience in using IT automation tools such as AlgoCD, and job orchestrator systems such as AirFlow, Jenkins
- Experience in cloud based environment (AWS/GCP etc.) is a big plus.
- Experience in monitoring tools such as Splunk, Prometheus/Grafana is a big plus.
- Experience with Full-Stack web development (React, Django etc.) is a big plus.
- Support large scale data pipelines and backend services by monitoring and troubleshooting/recovering incidents
- Manage large volume datasets in Spark and Hadoop environments using scripts and automation
- Build and operate data management infra services
- Automate build, deployment, and monitoring
- Participate at an onCall & release turn
- Taking an oncall turn including weekend coverage
-
Data Engineering Manager
3 days ago
MyFitnessPal Austin, United StatesAt MyFitnessPal, we believe health starts with what you eat. We provide tools, resources and support to enable users to reach their health goals. The Marketing team at MyFitnessPal collaborates with all business units to help drive our business forward and help our users achieve ...
-
University of Texas at Austin Austin, United StatesJob Posting Title: · Data Research Engineering/Scientist Associate II, Department of Population Health, Dell Medical School · - Hiring Department: · Department of Population Health · - Position Open To: · All Applicants · - Weekly Scheduled Hours: · 40 · - FLSA Status: · Exempt · ...
-
Data Engineer
3 weeks ago
XeoMatrix Austin, United StatesData Engineer · We are currently seeking an experienced data engineer with 3 - 5 years with hands-on data engineering experience. This candidate must possess technical, business analysis, and communication skills. This position offers an opportunity to work directly with clients ...
-
Data Engineer
1 week ago
Pitney Bowes Austin, United StatesAt Pitney Bowes, we do the right thing, the right way. As a member of our team, you can too. · We have amazing people who are the driving force, the inspiration and foundation of our company. Our thriving culture can be broken down into four components: Client. Team. Win. Innovat ...
-
Data Engineer
6 days ago
Russell Tobin Austin, United StatesJob Description · Job DescriptionLocation: Remote/Prefers someone to work in the central time zone · Pay Range: $ /hour W2 · Contract Duration: 12+ Potential to extend · Summary: · Client Commerce Engineering Operations is building next-generation business analytics and decision ...
-
Data Engineer
2 weeks ago
XeoMatrix Austin, United StatesData Engineer · We are currently seeking an experienced data engineer with 5 - 7 years with hands-on data engineering experience. This candidate must possess technical, business analysis, and communication skills. This position offers an opportunity to work directly with clients ...
-
Data Engineer
3 weeks ago
Apple Austin, United StatesSummary · Posted: Apr 24, 2024 · Weekly Hours: 40 · Role Number: · At Apple, we work every day to create products that enrich people's lives Our Advertising Platforms group makes it possible for people around the world to easily access informative and imaginative content on ...
-
Data Engineer
2 weeks ago
Teacher Retirement System of Texas Austin, United StatesLocation: · 1000 Red River · Austin, Texas, 78701 · United States · Data Engineer (intermediate or Senior) - Hybrid · Requisition ID: · req1056 · Employment Type: · Unclassified Regular Full-Time (URF) · Division: · Enterprise Data & Analytics · Compensation: · 85, ,6 ...
-
Data Engineer
1 week ago
Gunderson Dettmer Austin, United StatesJob Description · Job DescriptionGunderson Dettmer is the only business law firm of its kind - exclusively serving the global venture capital and emerging technology marketplace. With 400 attorneys in eleven offices - from Silicon Valley to Singapore - we innovate for innovators, ...
-
Data Engineer
1 week ago
Loxo Austin, United StatesAs an early hire to our engineering team, you will be responsible for managing Loxo's data integration function. You will be primarily responsible for migrating new clients' legacy data from their previous recruitment platform to Loxo and will work closely with the Customer Succe ...
-
Data Engineer
2 weeks ago
Loxo Austin, United StatesJob Description · Job DescriptionAs an early hire to our engineering team, you will be responsible for managing Loxos data integration function. You will be primarily responsible for migrating new clients legacy data from their previous recruitment platform to Loxo and will work ...
-
Data Engineer
2 weeks ago
Smart IT Frame LLC Austin, United StatesDear Partner, · Greetings from Smart IT Frame, Hope you are doing well · About Our Company · Smart IT Frame specializes in enabling you with your most critical line of resources. Whether it's for permanent staffing, contract staffing, contract-to-hire or executive search, we unde ...
-
Data Engineer
2 weeks ago
Trident Consulting Austin, United StatesTrident Consulting is seeking a "Data Engineer" for one of our clients in "Austin, TX - Hybrid 3 days office in a week " A global leader in business and technology services. · Role: Data Engineer · Location: Austin, TX - Hybrid 3 days office in a week · Duration: Contract · Q ...
-
Data Engineer
3 weeks ago
Vaco Austin, United StatesTitle: Data Engineer - Remote · Pay/Salary/Benefits/Perks: Up to $150k/yr · Work from Home Policy: Fully Remote · Interview Process: Streamlined process, 3 interviews · Key Skills: 6+ years of experience in data engineering, Azure, ETL · Responsibilities: · Lead a team of enginee ...
-
Data Engineer
2 weeks ago
OneSource Regulatory Austin, United StatesJob Description · Job DescriptionSalary: · Company Introduction · OneSource Regulatory Technology hosts a number of innovative solutions to enhance job performance in the Pharmaceutical space. OSR Technology is looking for an experienced and dedicated data engineer to join our p ...
-
Data Engineer
3 weeks ago
VMC Soft Technologies, Inc Austin, United StatesTitle: Data Engineer (Spark and Scala) · Location: Austin, TX / Sunnyvale, CA · W2 CONTRACT · JOB DESCRIPTION: · Required Qualifications: · Bachelor's degree or foreign equivalent required from an accredited institution. · At least 8 years of experience in Information Technology. ...
-
Data Engineer
3 weeks ago
Teacher Retirement System of Texas Austin, United StatesLocation: · 1000 Red River · Austin, Texas, 78701 · United States · Data Engineer (intermediate or Senior) - Hybrid · Requisition ID: · req1056 · Employment Type: · Unclassified Regular Full-Time (URF) · Division: · Enterprise Data & Analytics · Compensation: · 85, ,6 ...
-
Data Engineer
6 days ago
Senseye Austin, United StatesJob Description · Job DescriptionWe are seeking a skilled Data Engineer to join our team and play a pivotal role in developing and maintaining our data infrastructure. The ideal candidate will have a strong background in data management, analytics, and software development, with ...
-
Data Engineer
1 week ago
Dropbox Austin, United StatesCompany Description · Dropbox is a special place where we are all seeking to fulfill our mission to design a more enlightened way of working. We're looking for innovative talent to join us on our journey. The words shared by our founders at the start of Dropbox still ring true to ...
-
Data Engineer
1 week ago
VMC Soft Technologies, Inc Austin, United States· Title: Data Engineer (Spark and Scala) · Location: Austin, TX / Sunnyvale, CA(Hybrid-3 days in a week) · W2 Contract · Required Qualifications: · Bachelor's degree or foreign equivalent required from an accredited institution. · NO C2C · At least 8 years of experience in Infor ...
Data Engineer - Austin, United States - Diverse Lynx
Description
Role :
Data Engineer
Location:
Austin/ Sunnyvale, CA (Onsite)
Contract
Key skills:
Python, Kube, Big Data, AlgoCD and AirFlow
Responsibilities
All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role.
We promote and support a diverse workforce across all levels in the company.