- Bachelors or masters degree in computer science, Engineering, Information Systems or relevant degree is required
- 5+ years of professional work experience designing and implementing data pipelines in on-prem and cloud environments (S3, EKS)
- Experience with SQL/Relational databases.
- Experience with manipulating structured and unstructured data.
- Experience with distributed data systems such as Hadoop and related technologies (Spark, Trino, etc.).
- Background in both programming languages (Python & Scala).
- Experience working with databases that power APIs for front-end applications.
- Experience with modern schedulers (Airflow).
- Support, Design, develop, test, deploy, maintain, and improve the data pipeline.
- Designing and developing data processing techniques: automating manual processes, data delivery, data validation, data quality, and integrity.
- Support, test, deploy, and maintain the AWS ecosystem from an infrastructure standpoint (Hybrid Cloud SDK upgrade, security fixes, etc.)
- Communicate effectively with customers/team members & help with site-up challenges.
- Python
- SOL
- Spark
- Scala
- AWS ecosystem (S3, EKS)
- Airflow
- Kafka
- Catalog store (hive or similar)
- Iceberg
-
Data Engineer
1 week ago
Achmea Sunnyvale, United StatesDe afdeling · Je bent werkzaam binnen het chapter Data Engineering & Science, onderdeel van de afdeling Customer Center of Data (ongeveer 40 collega's). Het chapter bestaat uit 12 collega's (data engineers en data scientists). De afdeling Customer Center of Data werkt primair voo ...
-
Software Engineering Manager Ii, Cloud Data
3 days ago
Google Sunnyvale, United States**Minimum qualifications**: · - Bachelor's degree, or equivalent practical experience. · - 8 years of experience with software development in one or more programming languages (e.g., Python, C, C++, Java, JavaScript). · - 3 years of experience in a technical leadership role; over ...
-
Data Engineer
2 weeks ago
VeeAR Projects Inc. Cupertino, United StatesTitle: Data Engineer · Duration: 03+ months contract with quarterly extension · Location: Cupertino, CA · Qualifications: · Bachelor's or master's degree in computer science, Engineering, Information Systems or relevant degree is required · 5+ years of professional work experien ...
-
Data Engineer
1 week ago
VeeRteq Solutions Inc. Cupertino, United StatesJob Description · Job Description Data Engineer with Scala Cupertino, CA Data Engineer with Scala Exceptional skills in Scala and Spark Hands on experience with data processing technologies, ETL processes and feature engineering A track record of developing scalable pipelines and ...
-
Data Engineer
1 week ago
eTeam Inc Cupertino, United StatesData Engineer · DESCRIPTION · Seeking an experienced Data Engineer with a proven record of developing advanced data models and SQL Queries on complex, disparate systems, preferably in a Big Data warehouse environments like Snowflake. The candidate will be a member of a team devel ...
-
Data Engineer
3 weeks ago
eTeam Inc Cupertino, United StatesTitle: Data Engineer · Description · Seeking an experienced Data Engineer with a proven record of developing advanced reporting data models on complex, disparate systems, preferably in a Big Data warehouse environment. The candidate will be a member of a team developing and evolv ...
-
Head of Data Engineering
3 weeks ago
Step Mobile Palo Alto, United StatesPalo Alto, CA · **Gen Z** is the generation of the side hustle. They're creators. They're freelancers. They're investors. And they're not afraid to take on challenges, especially when it comes to their finances - and we're here for it. · **Step** is a next-generation financ ...
-
Data Engineer
3 weeks ago
Cynet Systems Cupertino, United StatesJob Description: · Pay Range $65hr - $70hr · Requirement: Minimum two years experience in a hardware product-related lab testing environment. · Experience with data parsing (using Python, SQL, Swift) (any of: plist, json, xml, csv, txt) and/or testing and maintaining architectur ...
-
Data Engineer
4 weeks ago
HCLTech Cupertino, United StatesDay 1 onsite from Cupertino, CA · Job Description: · Minimum two years experience in a hardware product-related lab testing environment · Experience with data parsing (using Python, SQL, Swift) (any of: plist, json, xml, csv, txt) and/or testing and maintaining architectures for ...
-
Data Engineer
3 weeks ago
HCLTech Cupertino, United StatesDay 1 onsite from Cupertino, CA · Job Description: · Key Requirements: · • Minimum two years experience in a hardware product-related lab testing environment · • Experience with data parsing (using Python, SQL, Swift) (any of: plist, json, xml, csv, txt) and/or testing and mainta ...
-
Data Engineer
1 week ago
VMC Soft Technologies, Inc Sunnyvale, United StatesTitle: Data Engineer (Spark and Scala) · Location: Sunnyvale, CA(Hybrid-3 days in a week) · Contract -W2 · Note: · Please make sure to share diversified profiles. · Required Qualifications: · Bachelor's degree or foreign equivalent required from an accredited institution. · At le ...
-
Data Engineer
3 weeks ago
VDart Sunnyvale, United StatesData Engineer REQ ID: will share it asap. Sunnyvale, CA (Day one on site) – We don't encourage remote / Hybrid profiles. Salary: ****K including Variables We need 1 strong on-site Spark + Scala ( coding language) candidate preferably in Sunnyvale.Requirements:SparkScalaBig data d ...
-
Data Engineer
2 weeks ago
The Dignify Solutions LLC Sunnyvale, United States8- 15 years of overall experience. · 3-5 years of software development experience with very high proficiency in Python or Scala or Java and experience optimizing SQL queries on large data. · Experience working with large-scale data warehouse solutions such as Teradata, Snowflake, ...
-
Data Engineer
2 weeks ago
Lorven technologies Sunnyvale, United StatesJob Description · Job DescriptionHi, · Our client is looking Data Engineer for Long term project in Austin, TX/Sunnyvale, CA (Hybrid) below is the detailed requirements. · Job Title : Data Engineer · Location : Austin, TX/Sunnyvale, CA · Duration : Long term · Job description: · ...
-
Data Platform Engineer
2 weeks ago
Bayside Solutions Cupertino, United StatesData Platform Engineer · W2 Contract · Salary Range: $119,600 - $140,400 per year · Location: Cupertino, CA - Remote Role · Job Summary: · We are looking for engineers to collaborate with users of our infrastructure and architect new pipelines to improve the user onboarding exper ...
-
Data Engineer
1 week ago
Talent Groups Sunnyvale, United StatesRequirements: · Spark / Scala · Java · Python · Datawarehouse · AWS – good to have · Good communication skill · ...
-
Data Platform Engineer
2 weeks ago
Bayside Solutions Cupertino, United StatesData Platform Engineer · W2 Contract · Salary Range: $135,200 - $156,000 per year · Location: Remote Role · Job Summary: · We are looking for engineers to collaborate with users of our infrastructure to architect new pipelines to improve the user onboarding experience. As part of ...
-
Data engineer with Panda
2 weeks ago
Diverse Lynx Cupertino, United StatesRole: Data Engineer · Experience : 8+ yrs · Duration : 12+Months · Work Location: Cupertino, CA (3 days/week work from office) · Must Have: Technical/Functional Skills Python, ETL pipelines, Hadoop, Teradata · Roles & Responsibilities: Prior Apple experience is a plus · Respo ...
-
Director, Data Engineering
6 days ago
Meta Menlo Park, United States**Director, Data Engineering Responsibilities**: · - Proactively formulate and implement the vision for the foundation for data and analytics to support theInfrastructure org and its goals. · - Drive technical and process innovation to increase the maturity and capability of Infr ...
-
Data Infrastructure Engineer
3 weeks ago
Bayside Solutions Cupertino, United StatesData Infrastructure Engineer · W2 Contract · Salary Range: $135,200 -$156,000 per year · Location: Cupertino, CA - Remote Role · Job Summary: · The mission of the Data Infrastructure org is to provide cutting-edge, reliable, and easy-to-use infrastructure for ingesting, storing, ...
Data Engineer - Cupertino, United States - Veear
Description
Title: Data Engineer
Duration: 03+ months contract with quarterly extension
Location: Cupertino, CA
Qualifications:
Responsibilities:
Must have skills:
Nice to have skills: