- Resourceful: independently capable of seeking information, corralling resources, data wrangling (query, join, manipulate, automate), and delivering results in challenging situations
- Collaboration and Teamwork: works with others to deliver results, contributing to the team and prioritizing group needs over individual needs
- Problem Solving: uses an organized and logical approach to find solutions to complex problems. Looks beyond the obvious to uncover the root cause of problems
- Open Communication: clearly conveys thoughts, both written and verbally, listening attentively and asking questions for clarification and understanding
- Comfortable in the Spotlight: able to interact with clients regularly and effectively.
- Leverage Google Cloud Platform tools such as BigQuery, Cloud Dataflow, Cloud Dataprep, and Cloud Pub/Sub to deliver top-tier services to our clients' customers and to advance the Data & Analytics Road Map.
- Perform end-to-end big data ETLs and analytics using SQL, Python and GCP tools to meet critical business needs and craft fault-tolerant, scalable code ready for production.
- Create and evaluate comprehensive data models, including entity-relationship diagrams and dimensional data models. Utilize GCP's data services to implement ETL processes, business rules, data management, governance, lineage, metadata, and reporting solutions to develop complete data product solutions.
- Manipulate large data sets using SQL & Python (pySpark/Beam) to understand patterns in the data. Perform data profiling using various tools to learn the shape of the data to help inform data quality checks and/or curation rules that need to be developed.
- Partner with clients and data scientists in interpreting data and remediating issues when required.
- Work with data owners and stewards to enforce, maintain, and enhance data governance, quality, security, and privacy standards using GCP's robust security and compliance capabilities, including Cloud IAM and Data Catalog for metadata management.
- Prepare technical specifications for data ingestion and transformation processes using services like Cloud Dataflow and Cloud Dataprep. Collaborate with data architects to construct efficient data models for data consumption, optimized for performance and cost in Google Cloud.
- Advocate for the development and adherence to standards and best practices within the Data Engineering team, including the use of documentation templates, agile development methodologies, and GCP's best practices for security, data governance, and efficient cloud resource utilization.
- Bachelor's degree in computer science, Engineering, Mathematics, or another relevant discipline.
- 2+ years of experience in architecting and scaling big data pipelines and analytical solutions on GCP or AWS, utilizing open-source libraries and frameworks such as Apache Spark, Apache Beam, and Apache Flink for data processing.
- Proficiency in ETL (Extract, Transform, Load) processes across a variety of database technologies including RDBMS (e.g., MS SQL Server, Oracle, MySQL, PostgreSQL), MPP (e.g., Google BigQuery, AWS Redshift, Teradata, Snowflake), and NoSQL databases (e.g., MongoDB, AWS DynamoDB, Cassandra), demonstrating an in-depth understanding of data storage, retrieval, and management practices.
- Advanced SQL skills for resource optimization and managing extensive datasets in Google BigQuery and Snowflake.
- Highly skilled in Python (or Scala) for developing petabyte-scale data processing jobs on cloud services like AWS EMR, GCP Dataproc/Dataflow, or on-premise setups, incorporating technologies like Apache Spark and Apache Beam.
- Experience in creating and managing data orchestration workflows with Apache Airflow to efficiently schedule, monitor, and optimize data processing tasks.
- Advanced knowledge of data structures and algorithms, networking, operating systems, particularly Unix/Linux, and version control systems.
- Demonstrated expertise in both batch and real-time data stream processing, proficient in employing technologies such as Apache Kafka for designing and implementing solutions that address real-time data processing requirements.
- Solid grasp of data warehouse design principles and hands-on experience in deploying data warehousing solutions on GCP/AWS, focusing on performance optimization and scalability.
-
Data Engineer
2 weeks ago
Edison Smart Detroit, United StatesData Engineer | Detroit | Up to $130,000 · Join a growing IoT company in Detroit, who provides a smart software solution for energy management. · As a Data Engineer, you will work in a small team to develop data solutions for predicting energy usage in buildings. · Please note th ...
-
Data Engineer
1 week ago
GSK Solutions Detroit, United StatesJob Description · Job DescriptionJob Title: Data Engineer (100% On-site - Locals Only) · Location: Detroit, MI · Duration: 12 Months Possibility of an extension · Pay Rate: $50/hr · Job Description: · We are rebuilding Detroit's public schools. We educate and empower every stude ...
-
Data Engineer
1 week ago
Edison Smart Detroit, United StatesData Engineer | Detroit | Up to $130,000 · Make sure to apply with all the requested information, as laid out in the job overview below. · Join a growing IoT company in Detroit, who provides a smart software solution for energy management. · As a Data Engineer, you will work i ...
-
Data Engineer
1 week ago
GSK Solutions Inc. Detroit, United StatesJob Title: Data Engineer (100% On-site - Locals Only) · Location: Detroit, MI · Duration: 12 Months Possibility of an extension · Pay Rate: $50/hr · Job Description: · We are rebuilding Detroit's public schools. We educate and empower every student, in every community, every day ...
-
Data Engineer
1 week ago
Digital Technology Solutions Detroit, United StatesDTS is looking for experienced Data Engineer for our Direct Client position based in Detroit, MI · We are seeking someone with the following background: · A bachelor s or master's degree in computer science or a related technical field, and/or equivalent experience · More than 3 ...
-
Data Engineer
2 weeks ago
OneMagnify Detroit, United StatesAbout You: · You are an experienced cloud engineer with advanced technical skills and great attention to detail. You enjoy turning data into business solutions. You are a troubleshooter and passionate about what you do. You enjoy building relationships with data product owners a ...
-
Data Engineer
1 week ago
Careerbuilder-US Detroit, United StatesDate Posted: 05/20/2024 · Hiring Organization: Rose International · Position Number: · Job Title: Data Engineer · Job Location: Detroit, MI, USA, 48202 · Work Model: Onsite · Employment Type: Temporary · Estimated Duration (In months): 13 · Min Hourly Rate ($): 4 ...
-
Data Engineer
1 week ago
EPITEC Detroit, United States*In office one day per week · Required Skills/Experience · • Minimum 6 years' experience in Advanced Data Analytics. · • Proficient in advanced functions in SQL. · • Minimum 4 years' experience in Tableau, Power BI, or similar data visualization tools · • Able to extract data usi ...
-
Data Engineer
3 weeks ago
Stellar Enterprises Farmington, United StatesWith our innovative IT solutions, we support the digital transformation of our clients worldwide. In a variety of industries - from global trade to international media to energy and utilities. Around 3,000 dedicated employees work for us at more than 25 locations. · What can you ...
-
Data Engineer
3 weeks ago
Nexus Innovations Farmington, United StatesThe S-Markt & Mehrwert GmbH & Co. KG is a central service company of the Sparkassen-Finanzgruppe with over 1,150 employees, serving Sparkassen, their network partners, and other clients nationwide. We provide powerful and customer-centric solutions that are always up-to-date. Thi ...
-
Data Engineer
1 week ago
EPITEC Detroit, United States*In office one day per week · Interested in this role You can find all the relevant information in the description below. · Required Skills/Experience · • Minimum 6 years' experience in Advanced Data Analytics. · • Proficient in advanced functions in SQL. · • Minimum 4 years ...
-
Data Engineer
1 hour ago
IQVIA Detroit, United States Paid WorkLasso, an IQVIA company, is growing and looking for super curious, passionate, and driven individuals to join the team. Our people are our greatest asset and we're committed to creating an environment where we all thrive doing what we love. · Lasso is the world's most comprehensi ...
-
Cloud Data Engineer
3 weeks ago
Custom Business Solutions, Inc. Detroit, United StatesNO SUBCONTRACTS, C2C or 1099 applicants. W2 candidates only. · Custom Business Solutions, a Michigan-based talent agency, is seeking an experienced Lead Cloud Data Engineer for a Hybrid workplace opportunity in Metro Detroit, Michigan. Qualified candidates submitting an applicati ...
-
gcp data engineer
3 weeks ago
Agile Tech Labs Detroit, United StatesTitle: Senior GCP Data EngineerLocation: Dearborn, Michigan [Hybrid]Type: Full Time · To be considered for an interview, please make sure your application is full in line with the job specs as found below. · Description:Experience with large scale solution and operationalizatio ...
-
Senior Data Engineer
1 week ago
DCTek Inc. Detroit, United StatesRequirement Details · Position: Senior Data Engineer · Location: Detroit, MI (Hybrid) · Duration: Long-Term · Description: · Experience in developing data architectures including data ingestion, pipeline design, data mining and advanced data processing frameworks. · Able to as ...
-
Cloud Data Engineer
1 week ago
OneMagnify Detroit, United StatesOneMagnify is a global performance marketing organization working at the intersection of brand marketing, technology, and analytics. The Company's core offerings accelerate business, amplify real-time results, and help set their clients apart from their competitors. OneMagnify pa ...
-
Cloud Data Engineer
4 days ago
OneMagnify Detroit, United StatesOneMagnify is a global performance marketing organization working at the intersection of brand marketing, technology, and analytics. The Company's core offerings accelerate business, amplify real-time results, and help set their clients apart from their competitors. OneMagnify pa ...
-
Matech Detroit, United StatesManager, Integrated Data Analytics – Data Engineering · Job Summary · The Manager, Integrated Data Analytics provides leadership, analysis and design related to the development of data solutions in support or independent of other BI solutions. They collaborate with the agile pro ...
-
Data Engineer Intern
4 weeks ago
Getinge Wayne, United StatesAt Getinge we have the passion to perform · Join our diverse teams of passionate people and a career that allows you to develop both personally and professionally. At Getinge, our passion is to secure that every person and community have access to the best possible care, offering ...
-
Lead Cloud Data Engineer
2 weeks ago
ITC Infotech Detroit, United StatesITC Infotech is looking for a Lead Cloud Data Engineer to join the US team. · Location: Hybrid – Detroit, MI (Hybrid) · Rate - $85000 per annum plus benefits. · Your X-Factor · Work ethic - You are a consummate professional. · Aptitude - You have an innate capacity to transition ...
Cloud Data Engineer - Detroit, United States - OneMagnify
Description
OneMagnify is a global performance marketing organization working at the intersection of brand marketing, technology, and analytics. The Company's core offerings accelerate business, amplify real-time results, and help set their clients apart from their competitors. OneMagnify partners with clients to design, implement and manage marketing and brand strategies using analytical and predictive data models that provide valuable customer insights to drive higher levels of sales conversion.
OneMagnify's commitment to employee growth and development extends far beyond typical approaches. We take great pride in fostering an environment where each of our 700+ colleagues can thrive and achieve their personal best. OneMagnify has been recognized as a Top Workplace, Best Workplace and Cool Workplace in the United States for 10 consecutive years and recently was recognized as a Top Workplace in India.
About You:
You are an experienced cloud engineer with sophisticated technical skills and great attention to detail. You enjoy turning data into business solutions. You are a troubleshooter and passionate about what you do. You enjoy building relationships with data product owners and developing a complete understanding of data infrastructure. Does this sound like you? Apply today
We offer a comprehensive benefits package including medical, dental, 401(k), paid holidays, vacations, and more.
About us
Whether it's awareness, advocacy, engagement, or efficacy, we move brands forward with work that connects with audiences and delivers results. Through meaningful analytics, engaging communications and innovative technology solutions, we help clients tackle their most ambitious projects and overcome their biggest challenges.
We are an equal opportunity employer
We believe that Innovative ideas and solutions start with unique perspectives. That's why we're committed to providing every employee a workplace that's free of discrimination and intolerance. We're proud to be an equal opportunity employer and actively search for like-minded people to join our team.
We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform job functions, and to receive benefits and privileges of employment. Please contact us to request accommodation.
