Senior Data Engineer - Foster City, California, United States
8 hours ago
Job description
Senior Data engineer
Role:
- years hands on experience in software development.
- Strong in algorithms and data structures, knowledge of Object-oriented design, Design Patterns
- Multi-threaded programming
- Strong troubleshooting, debugging, and analytical skills.
- Google cloud development experience
Mandatory Skills
- SQL skills (BQ, Hive and Spark)
- Spark jobs debugging and tuning
- Python, PySpark
- Good architecture skills to understand end to end flows/data pipelines
- -big data architecture, hadoop, hive, Sql, and airflow
- Knowledge of Unix, Github
Secondary skills
- Client stakeholder management
- Offshore team and delivery management
- Certification in relevant skills
Responsibilities
- The candidate must have complete understanding with hands-on experience in design, coding, and testing aspects
- Design, implement, and support multi-tier software applications, document and test systems, modify as necessary
- Work independently and with other engineers, and Ops teams, design and develop strategic and tactical processes, and create solutions that meet business requirements.
- Demonstrate thought processes in solving business and technical problems. Design and code should be easy to maintain, available, performing well, and can be reused across a sub-system or feature. Code may persist for the lifetime of a software version.
- Own to deliver very high-quality code that is thoroughly tested and is supported by unit tests for a flawless execution
- Can be relied on to deliver features and sub-systems on time and to requirements
- Works well within a team and contributes effectively to the success of those they interact with regularly.
Education:
Bachelors degree in computer science, Software Engineering, MIS or equivalent combination of education and experience
Similar jobs
The Data team leverages data from our autonomous vehicles and operations to determine autonomy and service readiness. · We provide the foundation for strategic decision-making at Zoox. · You will develop and implement the next generation of our data pipeline to ensure visibility ...
2 days ago
The Data team leverages data from our autonomous vehicles and operations to determine autonomy and service readiness. You will develop and implement the next generation of our data pipeline to ensure visibility into our business as we scale toward the launch of an autonomous mobi ...
1 month ago
· The Data team leverages data from our autonomous vehicles and operations to determine autonomy and service readiness. We provide the foundation for strategic decision-making at Zoox. You will develop and implement the next generation of our data pipeline to ensure visibility i ...
2 days ago
As an AV Safety Data Engineer you will play a critical role in developing and maintaining robust data infrastructure to surface safety-relevant interactions assess AV events and inform autonomy development through data-driven insights. · Develop and maintain miners that identify ...
1 week ago
The Data and Artificial Intelligence Platform (DAP) group is a key component of Visa's Technology organization, providing the enabling technology and processes to handle Visa's data assets and deliver valuable information, products, and services to customers. · ...
2 weeks ago
We work at a scale rarely seen in the industry, solving complex data and AI problems across the entire stack. · Visa is looking for Senior Data Engineers to help design, enhance and build our Data Infrastructure pipelines within an Agile development environment. · ...
2 weeks ago
At Visa, you'll have the opportunity to create impact at scale — tackling meaningful challenges, growing your skills and seeing your contributions impact lives around the world. · ...
2 weeks ago
+This is a hybrid position. As a Senior Data Engineer, you will join our Value Added Services – Digital Marketing & Engagement organization and help design, enhance, and build our data infrastructure and pipelines within an agile development environment. · +Design, develop, and m ...
2 weeks ago
+Job summary · Zoox's internship program provides hands-on experiences with state of the art technology, mentorship from some of the industry's brightest minds, and the opportunity to play a part in our success. · +Responsibilities · Build data pipelines and infrastructure to sup ...
1 week ago
As a Staff Data Engineer at Visa you'll join our Value Added Services – Digital Marketing & Engagement organization helping design enhance build our Visa data token platform within an agile development environment collaborating colleagues who will support challenge you daily. · ...
1 month ago
We are looking for a Data Engineer to help build and scale Tarro's data infrastructure as we continue to expand our product portfolio and customer base. You'll play a foundational role in shaping how data is collected, modeled, validated, and consumed across the company. · You ha ...
1 month ago
We are looking for a Data Engineer to help build and scale Tarro's data infrastructure as we continue to expand our product portfolio and customer base. · ...
1 week ago
We are looking for a Data Engineer to help build and scale Tarro's data infrastructure as we continue to expand our product portfolio and customer base.This is a high-impact opportunity to work in a fast-paced, profitable startup where you'll have real ownership, move quickly, an ...
1 month ago
As a Staff Data Engineer at Visa you'll join our Value Added Services – Digital Marketing & Engagement organization. · ...
3 weeks ago
Visa is a world leader in payments technology and at Visa you'll have the opportunity to create impact at scale — tackling meaningful challenges growing your skills and seeing your contributions impact lives around the world. · ...
2 weeks ago
At Visa you'll have the opportunity to create impact at scale — tackling meaningful challenges growing your skills and seeing your contributions impact lives around the world. · ...
3 weeks ago
We are looking for a Data Engineer to help build and scale Tarro's data infrastructure as we continue to expand our product portfolio and customer base. · ...
1 week ago
Design scalable data solutions for Meta's next-generation data platform and enable data-driven decision-making across products. · ...
3 weeks ago
$1378,788/year to $1546,660/year + bonus + equity + benefits ...
1 month ago
We are seeking a skilled Data Engineer to help develop data-driven solutions that have real-world impact. · We are looking for a Data Engineer with hands-on experience in data ingestion into cloud environments, finding and retrieving new datasets, and performing analysis on vario ...
1 month ago