- Collaborate with and across Agile teams to design and develop data engineering solutions by rapidly delivering value to our customers
- Build distributed, low latency, reliable data pipelines ensuring high availability and timely delivery of data
- Design and develop highly optimized data engineering solutions for Big Data workloads to efficiently handle continuous increase in data volume and complexity
- Build highly performing real-time data ingestion solutions for streaming workloads
- Adhere to best practices and agreed upon design patterns across all Data Engineering solutions
- Ensure the code is elegantly designed, efficiently coded, and effectively tuned for performance
- Focus on data quality and consistency, implement processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it.
- Create design (Data Flow Diagrams, Technical Design Specs, Source to Target Mapping documents) and test (unit/integration tests) documentation
- Perform data analysis required to troubleshoot data related issues and assist in the resolution of data issues.
- Focus on end-to-end automation of data engineering pipelines and data validations (audit, balance controls) without any manual intervention
- Focus on data security and privacy by implementing proper access controls, key management, and encryption techniques.
- Take a proactive approach in learning new technologies, stay on top of tech trends, experimenting with new tools & technologies and educate other team members
- Collaborate with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility and fostering data-driven decision making across the organization
- Communicate clearly and effectively to technical and non-technical leadership
- Senior Data Engineer: 7+ years of experience in architecting, designing and building Data Engineering solutions and Data Platforms
- Experience in building Data Warehouses/Data Platforms on Redshift/Snowflake
- Experience with Databricks
- Experience working with data acquisition and transformation tools such as Fivetran and DBT
- Experience building highly optimized & efficient data engineering pipelines using Python, PySpark
- Experience working with distributed data processing frameworks such as Apache Hadoop, or Apache Spark or Flink
- Experience working with real-time data streams processing using Apache Kafka, Kinesis or Flink
- Experience working with various AWS Services (S3, EC2, EMR, Lambda, RDS, DynamoDB, Redshift, Glue Catalog)
- Expertise in Advanced SQL programming and SQL Performance Tuning
- Experience with version control tools such as GitHub or Bitbucket.
- Expert level understanding of dimensional modeling techniques
- Excellent communication, adaptability, and collaboration skills
- Excellent analytical skills, strong attention to detail with emphasis on accuracy, consistency, and quality
- Strong logical and problem-solving skills with critical thinking
- Experience in designing and building applications using Container and serverless technologies
- Experience working with fully automated workflow scheduling and orchestration services such as Apache Airflow
- Experience working with semi-structured, unstructured data, No SQL databases
- Experience with CI/CD using GitHub Actions or Jenkins
- Experience designing and building APIs
-
Data Engineer
3 days ago
Proliance Consulting Los Angeles, United StatesData Engineer · Length: until 10/31/24 (strong possibility of extension or conversion) · Associate Vendors: We are accepting applications from candidates who are currently authorized to work in the US for any employer without sponsorship. · Role & Responsibilities · • Build compl ...
-
Data Engineer
3 weeks ago
Motion Recruitment Los Angeles, United StatesOur client, a global leader in media & entertainment is actively looking for a Data Engineer to join their team in Los Angeles, CA · ***This role is a hybrid position, working onsite 3 days/week. Candidates must be commutable to Hollywood, California*** · Key Responsibilities: · ...
-
Data Engineer
2 weeks ago
Experis Los Angeles, United States ContractOur client is seeking a Data Engineer to join their team. · Job Title: Data Engineer · Location: Scottsdale, AZ OR Los Angeles, CA · What's the Job? · Collaborate with cross-functional teams to identify compliance-related data requirements. · Analyze complex data sets to identif ...
-
Data Engineer
1 day ago
Proliance Consulting Los Angeles, United StatesData Engineer · Length: until 10/31/24 (strong possibility of extension or conversion) · Associate Vendors: We are accepting applications from candidates who are currently authorized to work in the US for any employer without sponsorship. · Role & Responsibilities · Build com ...
-
Data Engineer
4 days ago
Moonware Los Angeles, United StatesEmployment: Full time · Team: Software · Location: Los Angeles, CA (in-person) · About Us · Moonware is a venture-backed startup enabling next generation air travel with automated and sustainable airfields. We're building an integrated ecosystem of AI software and smart vehicles ...
-
Data Engineer
4 days ago
SADA Los Angeles, United StatesJoin SADA as a Data Engineer · Your Mission · Job Duties: · Design, develop, implement, and maintain data and database systems, servers, and solutions; Review project requests and estimate the time, cost, and feasibility of database designs and projects within time and cost co ...
-
Data Engineer
4 days ago
Saxon Global Los Angeles, United StatesSpecialties: · Commercial Loans and Lines of Credit, Asset-Based Financing, SBA Loans, and Specialized Financing, Real Estate Loans, Cash Management Services, International Services · Principal Duties and Responsibilities: · Technical Business Analyst Responsibilities: · Colla ...
-
Data Engineer
4 days ago
arketa Los Angeles, United States[Full Time] Data Engineer at arketa (United States) | BEAMSTART Jobs · Data Engineer · arketa United States · Date Posted · 02 Aug, 2023 · Work Location · Los Angeles, CA, United States · Salary Offered · $120000 — $160000 yearly · Job Type · Full Time · Experience Required · 6 ...
-
Data Engineer
4 days ago
Motion Recruitment Partners LLC Los Angeles, United StatesData Engineer · Los Angeles, California · Hybrid · Contract · $65/hr - $77/hr · Our client, a · global leader in media & entertainment · is actively looking for a · Data Engineer · to join their team in · Los Angeles, CA · ***This role is a · hybrid position · , working on ...
-
Data Engineer
4 days ago
Whatnot Los Angeles, United States[Full Time] Data Engineer at Whatnot (United States) | BEAMSTART Jobs · Data Engineer · Whatnot United States · Date Posted · 19 Jul, 2022 · Work Location · Los Angeles, CA, United States · Salary Offered · Not Specified · Job Type · Full Time · Experience Required · 3+ years · ...
-
Data Engineer
3 days ago
University of California Los Angeles, United StatesAs a Data · Engineer on the Data Architecture team, you will play a key role in · technology initiatives to advance health informatics and analytics in the · health sciences by advancing the usability, performance, and overall · architecture of the Data Infrastructure. You will d ...
-
Data Engineer
4 days ago
Jenni Kayne Los Angeles, United StatesJenni Kayne is a California-based lifestyle brand that aims to empower an elevated approach to everyday living. Whether it's our edited style ethos or coveted interiors sensibility, we work hard to create a world that's inviting and intentional. From our stores across the country ...
-
Data Engineer
2 days ago
Manpower Group Inc. Los Angeles, United StatesOur client is seeking a Data Engineer to join their team. · Job Title: Data Engineer · Location: Scottsdale, AZ OR Los Angeles, CA · Whats the Job? · Collaborate with cross-functional teams to identify compliance-related data requirements. · Analyze complex data sets to iden ...
-
Data Engineer
3 days ago
Tik Tok Los Angeles, United StatesResponsibilities · About TikTok U.S. Data Security · TikTok is the leading destination for short-form mobile video. Our mission is to inspire creativity and bring joy. U.S. Data Security ("USDS") is a subsidiary of TikTok in the U.S. This new, security-first division was create ...
-
Data Engineer
4 days ago
Blavity Los Angeles, United StatesBlavity, Inc. is a venture-funded media and technology company, founded in 2014 around a simple idea: enable Black millennials to tell their own stories. Today, we are home to the largest network of platforms and lifestyle brands serving the multifaceted lives of Black millennial ...
-
Data Engineer
1 day ago
Identified Talent Solutions Los Angeles, United StatesAbout Our Client: · Our client is a forward-thinking platform that is revolutionizing the way individuals curate and express their personal style through digital content. Like TikTok tailors to one's sense of humor, this platform personalizes the user experience by curating prod ...
-
Data Engineer
1 day ago
PlayVS Los Angeles, United StatesPlayVS is the leading amateur esports platform in North America. We are the single community where players come together to compete, fans gather to spectate, and coaches manage their programs. We offer an incredible, full-stack esport platformgame integrations, team-building tool ...
-
Data Engineer
2 days ago
UCLA Health Los Angeles, United StatesAs a Data · Engineer on the Data Architecture team, you will play a key role in · technology initiatives to advance health informatics and analytics in the · health sciences by advancing the usability, performance, and overall · architecture of the Data Infrastructure. · You ...
-
Data Preparation Engineer
2 days ago
Nikon SLM Solutions Los Angeles, United StatesNikon SLM Solutions AG is a leading provider of metal based additive manufacturing technology, commonly referred to as 3D printers, utilizing selective laser melting powder bed fusion technology. Our 3D printers are designed to produce parts directly from a variety of metal powde ...
-
Lead Data Engineer
1 week ago
Orion Innovation Los Angeles, United StatesAs a Lead Data Engineer, you will play a crucial role in designing, developing, and maintaining our data infrastructure. You will lead a team of data engineers to ensure the successful delivery of projects and contribute to the overall data strategy. The ideal candidate will have ...
Data Engineer - Los Angeles, United States - iSpace, Inc.
Description
Data Engineer (Databricks, Snowflake, AWS)
Contract: 4-6 months
Los Angeles, CA or New York City, NY – Hybrid onsite 1-2 days per week
Seeking a Data Engineer with a passion for building robust, scalable, efficient, and high-quality Data Engineering solutions to join the Engineering Centre of Excellence. This is a great opportunity to join a data-first media company and be part of a Enterprise Data Platform team that prides itself in making them a data-driven organization. If you enjoy designing and building innovative data engineering solutions using the latest tech stack in a fast-paced environment, this role is for you.
Responsibilities
Must Have skills:
Education: Bachelor's degree in Computer Science, Computer Engineering, or relevant field
Work Experience:
Nice to Have: