Jobs
>
Novi

    Data Engineer - Novi, United States - Autodesk

    Autodesk
    Autodesk Novi, United States

    3 weeks ago

    Default job background
    Description

    Job Requisition ID #

    24WD76183

    Position Overview

    We are seeking an experienced and individual to join our team, Data Services, as a Data Engineer. You will be responsible for multiple data-related tasks, including developing SQL queries, Python pipeline development, maintaining a reporting dashboard, API management, data deduplication, being an embedded resource for multiple teams, monitoring Airflow DAGs, and infrastructure maintenance.

    You will report to a Manager - Data Services

    You will work in Novi, MI.

    Responsibilities

    • Develop SQL queries: Collaborate with the team to understand their data needs and translate them into SQL queries. This includes both ad-hoc and routine SQL queries to provide and accurate data to overseas teams
    • Python pipeline development: Utilize Python expertise to design data pipelines that ingest, transform, and deliver data. Assist team members in identifying and addressing data pipeline bottlenecks, implementing optimization techniques for smooth dataflow
    • Maintain a reporting dashboard: Maintain a reporting dashboard on a Python Flask application and build new reports to automate recurring SQL jobs on Snowflake and SQL Server. Ensure the most up-to-date data is available for overseas teams
    • API management: Manage access, usage, and optimization of the Azure API to provide accurate and efficient translation services across diverse languages. Use the Google Maps API to cleanse and enrich client addresses, improving data accuracy and geo-spatial insights
    • Data deduplication: Utilize data mining and analysis techniques to identify and analyze potential duplicate records across multiple databases. Apply defined criteria and rigorous evaluation to determine the "survivor" record among duplicates, ensuring data consistency and preserving valuable information. Manage "victim" records with care, minimizing data loss and maintaining traceability
    • Embedded resource: Act as an embedded resource for both the CED and EDEV teams. Be the L1 product monitor for both teams, identifying and addressing product issues and user feedback
    • Airflow DAG Monitor: Monitor the execution of Airflow DAGs, quickly identifying and diagnosing errors, failures, or performance issues. Investigate the cause of issues and implement appropriate solutions to ensure smooth DAG execution. Report issue patterns and DAG performance to stakeholders and suggest methods for future improvements
    • Infrastructure Maintenance: Manage maintenance and update schedules for infrastructures such as Airflow, EWS cluster, and Databand. Ensure stability and performance of these infrastructures. Be the bridge between the infrastructure team and engineering teams (CED and EDEV), understanding their needs and ensuring seamless support

    Minimum Qualifications

    • Bachelor's degree in a relevant field or equivalent work experience
    • 3+ years of experience developing SQL queries and working with databases
    • Proficiency in Python for data pipeline development
    • 1+ years of experience reporting dashboard development using tools like Python Flask
    • Familiarity with API management and optimization
    • Knowledge of data deduplication techniques and tools
    • Be the embedded resource and handle multiple responsibilities
    • Experience with Airflow DAG monitoring and infrastructure maintenance

    Learn More

    About Autodesk

    Welcome to Autodesk Amazing things are created every day with our software – from the greenest buildings and cleanest cars to the smartest factories and biggest hit movies. We help innovators turn their ideas into reality, transforming not only how things are made, but what can be made.

    We take great pride in our culture here at Autodesk – our Culture Code is at the core of everything we do. Our values and ways of working help our people thrive and realize their potential, which leads to even better outcomes for our customers.

    When you're an Autodesker, you can be your whole, authentic self and do meaningful work that helps build a better future for all. Ready to shape the world and your future? Join us

    Benefits

    From health and financial benefits to time away and everyday wellness, we give Autodeskers the best, so they can do their best work. Learn more about our benefits in the U.S. by visiting

    Salary transparency

    Salary is one part of Autodesk's competitive compensation package. For U.S.-based roles, we expect a starting base salary between $75,500 and $122,100. Offers are based on the candidate's experience and geographic location, and may exceed this range. In addition to base salaries, we also have a significant emphasis on annual cash bonuses, commissions for sales roles, stock grants, and a comprehensive benefits package.

    Equal Employment Opportunity

    At Autodesk, we're building a diverse workplace and an inclusive culture to give more people the chance to imagine, design, and make a better world. Autodesk is proud to be an equal opportunity employer and considers all qualified applicants for employment without regard to race, color, religion, age, sex, sexual orientation, gender, gender identity, national origin, disability, veteran status or any other legally protected characteristic. We also consider for employment all qualified applicants regardless of criminal histories, consistent with applicable law.

    Diversity & Belonging

    We take pride in cultivating a culture of belonging and an equitable workplace where everyone can thrive. Learn more here:

    Are you an existing contractor or consultant with Autodesk?

    Please search for open jobs and apply internally (not on this external site).

  • Learning Care Group

    Lead Data Engineer

    2 days ago

    Learning Care Group Novi, United States

    Lead Data Engineer (Remote Opportunity) · Share by Email Share on LinkedIn Share on Twitter ) Share on Facebook · Apply ) · Brand: Learning Care Group, Inc. · Location: · 21333 Haggerty Rd · Novi, · MI · Requisition ID: · Date Posted: 3/11/2024 · Join a strong community ...

  • Community Choice Credit Union

    Data Engineer

    3 weeks ago

    Community Choice Credit Union Farmington, United States

    Job Description · Job Description**This is a contract position with an estimated duration of 12 months. · Purpose & Core Values · The primary purpose of any position is to assist Community Choice Credit Union to live out our purpose: we believe in helping our neighbors achieve ...

  • Heitmeyer Consulting

    Data Quality Engineer, Data Warehousing

    2 weeks ago

    Heitmeyer Consulting Farmington Hills, United States Contract

    Job Summary · : · Heitmeyer is seeking a Data Quality Engineer to support its global banking client on a long-term regulatory and cloud initiative. This role is required to be on-site 2 days a week in the following locations: Mount Laurel, NJ Greenville, SC, Falmouth, ME, Farmin ...

  • Loop Bell Tech Inc.

    Data Engineer

    3 weeks ago

    Loop Bell Tech Inc. Novi, United States

    Create automated data pipelines using workflow orchestration tools. Assemble large data sets that meet functional / non-functional business requirements. Implement error logging mechanisms for identifying the data outliers and failed processes. Interprete problems in existing pro ...

  • Sails Software Inc

    Data Engineer US

    2 weeks ago

    Sails Software Inc Novi, United States

    Would you be interested in exploring career opportunities with us? · Please find the job description below. · Job Title: Data Engineer (On-site) · Client: Equifax · Position: C2C or 1099 · Location: Atlanta GA Onsite · St. Louis MO Onsite · Working Hours: 8 Hours/Per Day · ...

  • Sails Software Inc

    Data Engineer US

    3 weeks ago

    Sails Software Inc Novi, United States

    Would you be interested in exploring career opportunities with us? · Please find the job description below. · Job Title: Data Engineer (On-site) · Client: Equifax · Position: C2C or 1099 · Location: Atlanta GA Onsite · St. Louis MO Onsite · Working Hours: 8 Hours/Per Day · ...

  • CCS Global Tech

    Data Engineer

    6 days ago

    CCS Global Tech Sterling, United States

    DESCRIPTION · We are looking for a talented Data Engineer to support the acquisition of mission critical and mission support data sets. The preferred candidate will have a background in supporting cyber and/or network related missions within the military spaces, as either a devel ...

  • Nexus Innovations

    Data Engineer

    4 weeks ago

    Nexus Innovations Farmington, United States

    The S-Markt & Mehrwert GmbH & Co. KG is a central service company of the Sparkassen-Finanzgruppe with over 1,150 employees, serving Sparkassen, their network partners, and other clients nationwide. We provide powerful and customer-centric solutions that are always up-to-date. Thi ...

  • Stellar Enterprises

    Data Engineer

    4 weeks ago

    Stellar Enterprises Farmington, United States

    With our innovative IT solutions, we support the digital transformation of our clients worldwide. In a variety of industries - from global trade to international media to energy and utilities. Around 3,000 dedicated employees work for us at more than 25 locations. · What can you ...

  • MSX INTERNATIONAL

    Data Engineer

    1 week ago

    MSX INTERNATIONAL Southfield, United States

    Title: Data Engineer · Location: Hybrid/Southfield, MI, US · Job Type: Full-time with Benefits · Who We Are · For more than 25 years, MSX International has been a dedicated partner to leading automotive brands around the world. We support them in transforming their businesses an ...

  • Unified Tech Group Inc

    Data Engineer

    3 weeks ago

    Unified Tech Group Inc Bloomfield Hills, United States

    Job Description · Job DescriptionSalary: · Job Title: Data Engineer · Job Duties: Perform full life cycle of data project architecture implementation. Design, code and debug database and business intelligence applications in various platforms including Oracle and MS SQL Server. ...

  • JRD Systems

    Data Engineer

    4 weeks ago

    JRD Systems Dearborn, United States

    Position: Lead Cloud Data Engineer · Location: REMOTE/ Hybrid - 2 days onsite per week, Dearborn, MI · Pay/ Salary: + $120,000 · Job Type: Full-time/W2/ Open-Ended Contract · If you are in the market for a new opportunity, JRD Systems is looking to hire a Lead Cloud/ Data enginee ...

  • Akkodis

    Data Engineer

    3 weeks ago

    Akkodis Auburn Hills, United States

    Job Title: Data Engineer / Business Analyst · Type of Role: Long-term, ongoing contract · Location: Auburn Hills, MI (hybrid) · Pay Rate: $40.00/hour-$42.00/hour · Product Support is the primary quality liaison group between the factories and company. The primary role of the Data ...

  • Ciber

    Data Engineer

    1 week ago

    Ciber Dearborn, United States

    HTC Global Services wants you. Come build new things with us and advance your career. At HTC Global you'll collaborate with experts.You'll join successful teams contributing to our clients' success.You'll work side by side with our clients and have long-term opportunities to adva ...

  • Stefanini, Inc

    Data Engineer

    4 hours ago

    Stefanini, Inc Dearborn, United States

    Job Description · Job DescriptionReference #57273 · Stefanini Group is hiring · Stefanini is looking for a Data Engineer, Dearborn, MI (Hybrid) · For quick apply, please reach out Rakesh Singh at 248 · -936 · - · Open to W2 candidates only · Data Factory Data Engineer: This pos ...

  • CCS Global Tech

    Data Engineer

    1 week ago

    CCS Global Tech Sterling, United States

    Title- Data Engineer · Location - Sterling, VA · Clearance - TS/SCI · DESCRIPTION · We are looking for a talented Data Engineer to support the acquisition of mission critical and mission support data sets. The preferred candidate will have a background in supporting cyber and/or ...

  • GSK Solutions

    Data Engineer

    2 weeks ago

    GSK Solutions Detroit, United States

    Job Description · Job DescriptionJob Title: Data Engineer (100% On-site - Locals Only) · Location: Detroit, MI · Duration: 12 Months Possibility of an extension · Pay Rate: $50/hr · Job Description: · We are rebuilding Detroit's public schools. We educate and empower every stude ...

  • Akkodis

    Data Engineer

    3 weeks ago

    Akkodis Dearborn, United States

    Akkodis is seeking a Data Engineer who has experience building data products on a cloud analytics platform. · You will work on ingesting, transforming, and analyzing large datasets to support the Enterprise in the Data Factory on Google Cloud Platform (GCP). Experience with larg ...

  • Stefanini

    Data Engineer

    4 weeks ago

    Stefanini Dearborn, MI, United States

    Stefanini Group is hiring · Stefanini is looking for a Data Engineer, Location: Dearborn, MI (Hybrid) · For quick apply, please reach out Rakesh Singh at · Open to W2 candidates only · We're seeking a Data Engineer who has experience building data products on a cloud analytics ...

  • Gunderson Dettmer

    Data Engineer

    3 weeks ago

    Gunderson Dettmer Ann Arbor, United States

    Job Description · Job DescriptionGunderson Dettmer is the only business law firm of its kind - exclusively serving the global venture capital and emerging technology marketplace. With 400 attorneys in eleven offices - from Silicon Valley to Singapore - we innovate for innovators, ...