No more applications are being accepted for this job
- Experience running spark/hadoop workloads using Dataproc, Dataflow, Cloud composer, EMR, HD Insights or similar.
- Proven working expertise with Big Data Technologies Spark, PySpark, hive, and SQL.
- Demonstrates expertise in writing complex, highly optimized queries across large data sets
- Knowledge and experience in Kafka, Storm, Druid and Presto
Data Engineer - Sunnyvale, United States - Diverse Lynx
Description
Job Title Data Engineer (GCP/ Spark/Pyspark & Scala functional) Relevant Experience(in Yrs) 7 years Technical/Functional Skills <> Tech Skills - Scala, Spark, GCP, Dataproc, Hadoop, Airflow, SBT, Maven, Docker, Kubernetes, pyspark, Jenkins, Bigquery <> Experience with workflow management tools such as Jenkins, Airflow
Generic Managerial Skills Education Bachelor degree /Master Degree in Engineering Start date (dd-mmm-yy) 1st May 2023 Duration of assignment (in Months) 12+ Months Work Location (State, City and Zip) Sunnyvale C Key words to search in resume GCP/ Spark
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.