Jobs
>
San Jose

    Platform Data Engineer - San Jose, United States - Bayone

    Bayone
    Bayone San Jose, United States

    3 weeks ago

    Default job background
    Description

    Location:
    San Francisco, Seattle, LA or PST
    Enterprise Data Platform to enable timely, effective and safe sharing of data to multiple engineering, operations and business teams for building world class data products


    Responsibilities

    Build data ingestion and processing pipelines to enable data analytics and data science use-cases in areas of digital commerce, service operations, charging, reliability, finance, capex, warranty, customer service and others.

    Build modular set of data services using Python, SQL, AWS Glue, lambdas, API Gateway, Kafka, data build tool (dbt), Apache Spark on EMR among others
    Build automated unit and integration testing pipelines using frameworks like PySpark
    Create and manage CICD pipelines with Gitlab CI and AWS Code Pipeline/CodeDeploy
    Automate and schedule jobs using Managed Airflow
    Build the ODS and reporting schemas and load the data into AWS Redshift or Snowflake
    Design and build data quality management services with Apache Deequ and data observability tools like Splunk, DataDog , CloudWatch
    Provide a variety of query services with REST, Athena/Presto, server sent events
    Configure and setup the enterprise data lineage and meta data management and data catalog support using tools like Collibra/Alation
    Assist the data scientist within the data engineering team as well as other software engineering teams with data cleansing, wrangling and feature engineering
    Ensure green builds for deployment and work with program management and senior leads to burn down planned deliverables in a sprint cycle


    Qualifications
    At least 5+ years building data and analytics platforms using AWS Cloud, Python and SQL
    Knowledge of AWS technologies specifically MSK, EMR, Athena, Glue, lambdas, API Gateway as well as Python, SQL is a must
    Knowledge of modern data tools like dbt (data build tool) and Airflow orchestration is highly desired
    Ability to assist SQL analysts and Tableau developers in business teams in creating the right set of materialized views in a SQL data warehouse like Redshift/Snowflake
    Knowledge of automation and CICD best practices
    Familiarity with machine learning and data science ecosystems especially AWS Sagemaker and Databricks is highly preferred

    Hands-on experience in building and maintaining production data applications, current experience in both relational and distributed columnar date stores.

    Deep experience using SQL, Python, and SparkHands-on experience with Big-data technologies (e.g. Redshift, Athena, Glue, EMR, Kinesis, Step Function, or equivalent in other web services)
    Familiarity with timeseries database, data streaming applications, Kafka, Flink, and more is a plus

    Familiarity with modern data science and product analytics tools and techniques such as R, Machine Learning, and advanced statistics is a plus.

  • Tik Tok

    Data Engineer

    3 weeks ago

    Tik Tok San Jose, United States

    TikTok is the leading destination for short-form mobile video. Our mission is to inspire creativity and bring joy. TikTok has global offices including Los Angeles, New York, London, Paris, Berlin, Dubai, Singapore, Jakarta, Seoul and Tokyo. Why Join Us Creation is the core of Tik ...

  • RIT Solutions, Inc.

    Data Engineer

    3 weeks ago

    RIT Solutions, Inc. San Jose, United States

    Job Description: · Responsibilities: · - Architect, develop, and maintain scalable data pipelines and ETL processes, facilitating the seamless flow of data across our ecosystem. · - Collaborate closely with cross-functional teams to gather requirements, identify data sources, ...

  • Achmea

    Data Engineer

    2 weeks ago

    Achmea Sunnyvale, United States

    De afdeling · Je bent werkzaam binnen het chapter Data Engineering & Science, onderdeel van de afdeling Customer Center of Data (ongeveer 40 collega's). Het chapter bestaat uit 12 collega's (data engineers en data scientists). De afdeling Customer Center of Data werkt primair voo ...

  • InsideHigherEd

    Lead Data Engineer

    1 week ago

    InsideHigherEd San Jose, United States

    Job no: 539662 · Work type: Staff · Location: San José · Categories: Unit 9 - CSUEU - Technical Support Services, Probationary, Full Time, Information Systems & Technology · Job Summary · The Lead Data Engineer is responsible for SJSU's Campus Data Warehousing/Business Intelligen ...

  • InterSources

    Data Engineer

    3 weeks ago

    InterSources Santa Clara, United States

    Title: Data Engineer · Location: Remote · Experience: 4+ Years · About the Role · Fintech is seeking a strong and passionate data engineer with experience in large scale system implementation, with a focus on complex data pipelines. The candidate must be able to design and drive ...

  • Amaze Systems Inc.

    Data Engineer

    3 weeks ago

    Amaze Systems Inc. Santa Clara, United States

    Job Description · Job DescriptionData Engineer · San Clara, CA Hybrid · 12 Months+ Contract · Position Overview · We are searching for a talented and experienced Modern Data Stack Data Engineer to join our growing team. You will be responsible for designing, building, and mainta ...

  • Amick Brown

    Data Engineer

    1 day ago

    Amick Brown Santa Clara, United States

    Job Description · Job DescriptionAmick Brown is seeking an experienced Data Engineer for our direct client. · Location: Santa Clara, CA · Duration: 6 months · Estimated pay range: $ per client contract and candidate skills, experience and work location. · Job Description · Descri ...

  • LatentView Analytics

    Senior Data Engineer

    3 weeks ago

    LatentView Analytics San Jose, United States

    Hiring Mode: Full-time with LatentView Analytics · Start Date: ASAP · Experience: 5 to 10 years · Location: San Jose, California, USA · Note: C2C or C2H is not an option. · Job Description: · We are seeking a skilled and experienced Data Engineer to join our dynamic team. As a Da ...

  • Adobe

    Sr Data Science Engineer

    5 days ago

    Adobe San Jose, United States Full time

    Our Company · Changing the world through digital experiences is what Adobe's all about. We give everyone—from emerging artists to global brands—everything they need to design and deliver exceptional digital experiences We're passionate about empowering people to create beautiful ...

  • TEKsystems

    Data Center Engineer

    2 weeks ago

    TEKsystems Santa Clara, United States Contract

    Description: · ALL submittals must have TEK logo dubbed resume and TWO recent relevant references. · ***The key focus is HW Break/Fix, but if they have any automation (Python, Ansible) then that is a HUGE plus.*** 2 roles · NVIDIA is now looking for a motivated Engineering Tech ...

  • Russell Tobin

    Data Engineer 4

    3 weeks ago

    Russell Tobin San Jose, United States

    Job Description · Job DescriptionJob Title: Senior Data Engineer · Location: San Jose, CA (Hybrid) · Pay: $90-95/hour on W2 · Duties: · Write complex SQL queries that help Adobe identify and measure the non-genuine software base. Apply business logic to determine categorize the n ...

  • Russell Tobin

    Senior Data Engineer

    3 weeks ago

    Russell Tobin San Jose, United States

    What are we looking for in our Senior Data Engineer? · San Jose, CA HYBRID) · 6+ Months with possible extension · Pays - $85- $90/hr W2 (Depends upon the experience) · Duties: · Responsible for the strategy and execution of financial and analytics dashboards and ensuring scalabi ...

  • Software Guidance and Assistance, Inc.

    Sr. Data Engineer

    3 weeks ago

    Software Guidance and Assistance, Inc. San Jose, United States

    Software Guidance & Assistance, Inc., (SGA), is searching for a Sr. Data Engineer for a Contract assignment with one of our premier SaaS clients in San Jose, CA . This is a hybrid role. · Responsibilities : · Responsible for the strategy and execution of financial and analyti ...

  • NVIDIA

    Senior Data Engineer

    5 days ago

    NVIDIA Santa Clara, United States Full time

    At NVIDIA, our employees are passionate about parallel and GPU computing. We're united in our quest to transform the way graphics are used for work and play. Are you passionate about creating ground-breaking software for creative and innovative customer experience? Do you thrive ...

  • Russell Tobin

    Data Engineer

    3 weeks ago

    Russell Tobin San Jose, United States

    Job Description · Job Description · Job Title: Data Engineer · Location: San Jose, CA · Duration: 4 months plus · Pay Range: $70/hr- $80/hr Depending on Exp · Duties: · Leverage Databricks for tasks such as writing complex SQL queries, applying business logic, and utilizing big d ...

  • Anthro

    Data Engineer

    3 weeks ago

    Anthro San Jose, United States

    Job Description · Job DescriptionAbout the Job · As a Data Engineer at Anthro Energy, you will play a pivotal role in leveraging data to drive innovation in lithium-ion electrolyte technology. You will be responsible for structuring scalable data streams and collaborating with e ...

  • LatentView

    Data Engineer

    3 weeks ago

    LatentView San Jose, United States

    Details: · About LatentView: · LatentView Analytics is a leading global analytics and decision sciences provider, delivering solutions that help companies drive digital transformation and use data to gain a competitive advantage. With analytics solutions that provide 360-degree ...

  • Siri InfoSolutions Inc

    Data Engineer

    3 weeks ago

    Siri InfoSolutions Inc San Jose, United States

    Job Description · Job DescriptionTitle: Data Engineer · Location: San Jose, CA (Onsite) · Duration: Long Term · Contract Role · Skill Set: · Python, Spark, AWS. · ...

  • Adobe

    Sr Data Science Engineer

    22 hours ago

    Adobe San Jose, United States

    Our Company · Changing the world through digital experiences is what Adobe's all about. We give everyone—from emerging artists to global brands—everything they need to design and deliver exceptional digital experiences We're passionate about empowering people to create beautiful ...

  • Adobe

    Sr Data Integration Engineer

    3 weeks ago

    Adobe San Jose, United States

    Our Company · Changing the world through digital experiences is what Adobe's all about. We give everyone—from emerging artists to global brands—everything they need to design and deliver exceptional digital experiences We're passionate about empowering people to create beautiful ...