No more applications are being accepted for this job
- Design and build scalable and efficient data pipelines and ETL processes to collect, process, and transform large volumes of data from various sources.
- Develop and maintain data warehouses, data lakes, and databases to ensure optimal storage, organization, and accessibility of structured and unstructured data.
- Collaborate with data scientists and other stakeholders to identify data requirements and implement solutions to support their needs.
- Ensure data quality and integrity through data validation, cleansing, and normalization techniques.
- Optimize data processes and performance to ensure efficient data processing and retrieval.
- Implement data governance and security measures to protect sensitive data.
- Stay updated with emerging technologies and industry best practices in data engineering and contribute to the adoption of new tools and frameworks.
- Provide technical guidance and mentorship to junior data engineers.
Senior Data Engineer - Pleasanton, United States - XperiencOps Inc
Description
XperiencOps Inc. is seeking a highly skilled and experienced Senior Data Engineer to join our team. As a Senior Data Engineer, you will play a crucial role in designing, developing, and maintaining our data architecture and pipelines. You will collaborate closely with cross-functional teams to drive data initiatives and enable data-driven decision-making across the organization.
Responsibilities:
- Bachelor's or Master's degree in Computer Science, Information Systems, or a related field.
- Proven work experience as a Data Engineer, with a focus on building scalable and robust data pipelines and architecture.
- Strong programming skills in languages such as Python, SQL, or Java.
- Experience with big data processing frameworks and tools such as Apache Spark, Hadoop, or AWS Glue.
- Proficiency in working with relational and NoSQL databases, as well as SQL and data modeling.
- Familiarity with cloud platforms and services such as AWS or Azure.
- Strong understanding of data governance, data security, and data quality principles.
- Excellent problem-solving and analytical skills.
- Strong communication and collaboration abilities.
- Experience with streaming data technologies such as Apache Kafka or Apache Flink is a plus.
- Experience with machine learning and data science concepts is a plus.
Benefits
Office locations available for this role are:
- San Francisco, CA
- Dublin, CA