Jobs
>
Ann Arbor

    Senior Data Engineer - Ann Arbor, MI, United States - TEKsystems

    TEKsystems
    TEKsystems Ann Arbor, MI, United States

    3 weeks ago

    TEKsystems background
    Description

    Description:

    In this important role as a PySpark Senior/Lead Data Engineer you will provide engineering and support for migration from SAS Viya to AWS, Databricks, and all data-related services, including managing design, implementation, operation, and monitoring on systems provided by the Federal Government. The PySpark Senior/Lead Data Engineer reports to the Director of Information Systems.

    The PySpark Senior/Lead Data Engineer reports to the Director of Information Systems. Responsibilities include, but not limited to:

    Responsibilities include, but not limited to:

    · Develop a plan for migration of programs and data developed in SAS Viya to AWS Data Lake, Databricks PySpark, and Databricks SQL.

    · Develop and optimize ETL processes, including extracting data from source systems, transforming it into a usable format, and loading it into the target storage.

    · Create and maintain data pipelines that facilitate the flow of data from various sources to Data Lake or other storage systems.

    · Implement processes to ensure data quality and integrity, including validating and cleansing data to maintain its quality and integrity.

    · Work closely with cross-functional teams, including SMEs, quality assurance, report developers, administrators, and stakeholders to identify and address data-related issues.

    · Troubleshoot and resolve issues with Data Lake, Pipelines, Reports, and related infrastructure; escalate to other technology support resources as needed.

    · Schedule, communicate, perform, and monitor both regular and ad hoc pipeline activities in accordance with defined policies and procedures.

    · Participate in the creation (or modification) of documentation activities related to system design, configuration, operation, support policies, and compliance procedures.

    · Design and implement scalable data architectures, ensuring efficient data flow and storage.

    Qualifications:

    · Demonstrate expertise in software development using PySpark and Databricks in AWS Cloud Services.

    · Minimum of five years of experience specifically in software development in PySpark with Databricks.

    · Preferably, two years of experience using SAS Viya.

    · Experience using version control software, preferably GitHub.

    · Excellent written and verbal communication skills in English.

    All work must be performed in the United States of America.

    Skills:

    pyspark, Databricks, etl, big data, sas

    Top Skills Details:

    pyspark,Databricks,etl,big data,sas

    Additional Skills & Qualifications:

    Communication is a TOP priority for this role. It will require a high level of communication to the existing staff/team as well as key stakeholders. This role will require someone that is more than just a "do-er", they need someone to teach the team along the way and guide them until they can get up to speed. PySpark is something new to this environment and they need someone that is willing and excited to not only share their knowledge, but make sure they are setting the team up for success.

    Experience Level:

    Expert Level

    About TEKsystems:



    We're partners in transformation. We help clients activate ideas and solutions to take advantage of a new world of opportunity. We are a team of 80,000 strong, working with over 6,000 clients, including 80% of the Fortune 500, across North America, Europe and Asia. As an industry leader in Full-Stack Technology Services, Talent Services, and real-world application, we work with progressive leaders to drive change. That's the power of true partnership. TEKsystems is an Allegis Group company.

    The company is an equal opportunity employer and will consider all applications without regards to race, sex, age, color, religion, national origin, veteran status, disability, sexual orientation, gender identity, genetic information or any characteristic protected by law.

  • Gunderson Dettmer

    Data Engineer

    2 weeks ago

    Gunderson Dettmer Ann Arbor, United States

    Gunderson Dettmer is the only business law firm of its kind - exclusively serving the global venture capital and emerging technology marketplace. With 400 attorneys in eleven offices - from Silicon Valley to Singapore - we innovate for innovators, accelerate entrepreneurship, and ...

  • Gunderson Dettmer

    Data Engineer

    2 weeks ago

    Gunderson Dettmer Ann Arbor, United States

    Job Description · Job DescriptionGunderson Dettmer is the only business law firm of its kind - exclusively serving the global venture capital and emerging technology marketplace. With 400 attorneys in eleven offices - from Silicon Valley to Singapore - we innovate for innovators, ...

  • Nexient

    Data Engineer

    2 weeks ago

    Nexient Ann Arbor, United States

    **Data Engineer (SQL Server, Power BI, SSIS, SSRS)** · Ann Arbor, MI / Delivery Practice AI/ML/Data Engineering / Full-time **Role and Responsibilities:** · + This data engineer should have exceptional SQL Server programming skills as follows · + Needs to have advanced Busines ...

  • Gunderson Dettmer

    Data Engineer

    1 week ago

    Gunderson Dettmer Ann Arbor, United States

    Gunderson Dettmer is the only business law firm of its kind - exclusively serving the global venture capital and emerging technology marketplace. With 400 attorneys in eleven offices - from Silicon Valley to Singapore - we innovate for innovators, accelerate entrepreneurship, and ...

  • Stellar Enterprises

    Data Engineer

    3 weeks ago

    Stellar Enterprises Farmington, United States

    With our innovative IT solutions, we support the digital transformation of our clients worldwide. In a variety of industries - from global trade to international media to energy and utilities. Around 3,000 dedicated employees work for us at more than 25 locations. · What can you ...

  • Nexus Innovations

    Data Engineer

    3 weeks ago

    Nexus Innovations Farmington, United States

    The S-Markt & Mehrwert GmbH & Co. KG is a central service company of the Sparkassen-Finanzgruppe with over 1,150 employees, serving Sparkassen, their network partners, and other clients nationwide. We provide powerful and customer-centric solutions that are always up-to-date. Thi ...

  • KLA-Tencor

    Lead Software Engineer Data Engineering

    2 weeks ago

    KLA-Tencor Ann Arbor, United States

    Base Pay Range: $115, $197,000.00 Annually · Primary Location: USA-MI-Ann Arbor-KLA · KLA's total rewards package for employees may also include participation in performance incentive programs and eligibility for additional benefits identified below. Interns are eligible for some ...

  • Hyundai America Technical Center, Inc. (HATCI)

    Data Analytics Engineer

    2 weeks ago

    Hyundai America Technical Center, Inc. (HATCI) Ypsilanti, United States

    Job Description · Job DescriptionHyundai America Technical Center, Inc. (HATCI) is currently looking for a Virtual Development Engineer at our Superior Township, Michigan facility: · The Vehicle Control Software department in Hyundai America Technical Center, Inc. (HATCI) is a re ...

  • Talent Consulting Experts

    Battery Engineer

    1 week ago

    Talent Consulting Experts Ann Arbor, United States

    Join Our Groundbreaking Team in Ann Arbor, MI · Are you passionate about pioneering battery technology? As a Battery Engineer, you will lead projects at the forefront of lithium-ion battery innovation. Enhance the performance and reliability of our products, impacting cutting-edg ...

  • Talent Consulting Experts

    Battery Engineer

    2 weeks ago

    Talent Consulting Experts Ann Arbor, United States

    Join Our Groundbreaking Team in Ann Arbor, MI · As a Battery Engineer, you will drive projects at the forefront of lithium-ion battery innovation. This role is crucial as you will enhance the performance and reliability of our products, directly impacting the cutting-edge solutio ...

  • Talent Consulting Experts

    Battery Engineer

    2 days ago

    Talent Consulting Experts Ann Arbor, United States

    Join Our Groundbreaking Team in Ann Arbor, MI · Are you passionate about pioneering battery technology? As a Battery Engineer, you will lead projects at the forefront of lithium-ion battery innovation. Enhance the performance and reliability of our products, impacting cutting-edg ...

  • Toyota

    Automated Driving Systems

    3 days ago

    Toyota Ann Arbor, United States

    **Overview**: · **Who we are**: · Toyota Research & Development is racing toward a new future of mobility with a diverse team to help us enhance and design products to help people move. Headquartered in Michigan, the research hub of America, we offer competitive salaries, amazing ...

  • Hyundai America Technical Center, Inc. (HATCI)

    Info Big Data Engineer

    2 weeks ago

    Hyundai America Technical Center, Inc. (HATCI) Ypsilanti, United States

    Job Description · Job DescriptionLocation: Superior Township, MI · Job Level: Senior Engineer · Level of Education: B.S. or M.S. (preferred) Computer Science, Computer Engineering, Electrical Engineering, or a combination of education and equivalent experience · Level of Industry ...

  • Stefanini, Inc

    Data Engineer

    2 weeks ago

    Stefanini, Inc Dearborn, United States

    Job Description · Job DescriptionReference #57002 · Stefanini Group is hiring · Stefanini is looking for a Data Engineer, Location: Dearborn, MI · For quick apply, please reach out Rakesh Singh at 248 · -936 · - · Open to W2 candidates only · The successful candidate will be r ...

  • Stefanini, Inc

    Data Engineer

    3 weeks ago

    Stefanini, Inc Dearborn, United States

    Job Description · Job DescriptionReference #56933 · Stefanini Group is hiring · Stefanini is looking for a Data Engineer, Location: Dearborn, MI · For quick apply, please reach out Rakesh Singh at 248 · -936 · - · Open to W2 candidates only · The successful candidate will be r ...

  • Ciber

    Data Engineer

    2 weeks ago

    Ciber Dearborn, United States

    HTC Global Services wants you. Come build new things with us and advance your career. At HTC Global you'll collaborate with experts. You'll join successful teams contributing to our clients' success. You'll work side by side with our clients and have long-term opportunities to ad ...

  • Ciber

    Data Engineer

    3 weeks ago

    Ciber Dearborn, United States

    HTC Global Services wants you. Come build new things with us and advance your career. At HTC Global you'll collaborate with experts. You'll join successful teams contributing to our clients' success. You'll work side by side with our clients and have long-term opportunities to ad ...

  • JRD Systems

    Data Engineer

    3 weeks ago

    JRD Systems Dearborn, United States

    Position: Lead Cloud Data Engineer · Location: REMOTE/ Hybrid - 2 days onsite per week, Dearborn, MI · Pay/ Salary: + $120,000 · Job Type: Full-time/W2/ Open-Ended Contract · If you are in the market for a new opportunity, JRD Systems is looking to hire a Lead Cloud/ Data enginee ...

  • EPITEC

    Data Engineer

    3 weeks ago

    EPITEC Dearborn, United States

    W2Position - HYBRID In Dearborn Michigan · Position Description: · GDIA Data Engineer Job Description A position is open for a data engineer in the GDI&A Customer 360.The successful candidate will be responsible for designing, developing the transformation and modernization of bi ...

  • Stefanini, Inc

    Data Engineer

    2 weeks ago

    Stefanini, Inc Dearborn, United States

    Job Description · Job DescriptionReference #56870 · Stefanini Group is hiring · Stefanini is looking for a Data Engineer, Location: Dearborn, MI (Hybrid) · For quick apply, please reach out Rakesh Singh at 248 · -936 · - · Open to W2 candidates only · We're seeking a Data Engi ...