Jobs
>
Phoenix

    Data Engineer - Phoenix, United States - The IT Gigs

    The IT Gigs
    The IT Gigs Phoenix, United States

    1 week ago

    Default job background
    Description

    Job title: Data Engineer

    Location: Phoenix, AZ (Onsite)

    Job type: W2 Only

    VISA: USC and GC

    JD:

    Mandatory Skill Set: Apache Spark, Hive, Hadoop, BigQuery, BigTable, Cloud Composure, Dataflow, Google Cloud Storage, Python, SQL, Shell Scripting, Git.

    Good to have Skill Set: CI/CD, Jenkins, Security and Networking, Scala, GCP Identity and Access Management (IAM).

    Responsibilities:

    Data Processing: Design, develop, and maintain scalable and efficient data processing pipelines using technologies such as Apache Spark, Hive, and Hadoop.

    Programming Languages: Proficient in Python, Scala, SQL, and Shell Scripting for data processing, transformation, and automation.

    Cloud Platform Expertise: Hands-on experience with Google Cloud Platform (GCP) services, including but not limited to BigQuery, BigTable, Cloud Composer, Dataflow, Google Cloud Storage, and Identity and Access Management (IAM).

    Version Control and CI/CD: Implement and maintain version control using Git and establish continuous integration/continuous deployment (CI/CD) pipelines for data processing workflows.

    Jenkins Integration: Experience with Jenkins for automating the building, testing, and deployment of data pipelines.

    Data Modeling: Work on data modeling and database design to ensure optimal storage and retrieval of data.

    Performance Optimization: Identify and implement performance optimization techniques for large-scale data processing.

    Collaboration: Collaborate with cross-functional teams, including data scientists, analysts, and other engineers, to understand data requirements and deliver solutions.

    Security and Networking: Possess basic knowledge of GCP Networking and GCP IAM to ensure secure and compliant data processing.

    Documentation: Create and maintain comprehensive documentation for data engineering processes, workflows, and infrastructure.

    Qualifications:

    Proven experience with Apache Spark, Hive, and Hadoop.

    Strong programming skills in Python, Scala, SQL, and Shell Scripting.

    Hands-on experience with GCP services, including BigQuery, BigTable, Cloud Composer, Dataflow, Google Cloud Storage, and Identity and Access Management (IAM)

    Familiarity with version control using Git and experience in implementing CI/CD pipelines.

    Experience with Jenkins for automating data pipeline processes.

    Basic understanding of GCP Networking.

    Excellent problem-solving and analytical skills.

    Strong communication and collaboration skills.

    Please share your resume over

  • BlueTrail

    Data Engineer Azure

    1 week ago

    BlueTrail Phoenix, United States

    Waar ben jij van? · Jij bent van de data laten spreken. Als Data Engineer zorg je ervoor dat data conform de geldende standaarden, normen en data architecturen in het Rotterdamse Data en Analyse platform wordt ontsloten. · Jouw functie · Je bent lid van een multidisciplinair scr ...

  • TalentAmp

    Data Engineer

    1 week ago

    TalentAmp Arizona, United States

    TalentAmp is currently looking for Data Engineer II for one of our clients in Phoenix area. You will work in close collaboration with operations, subject matter experts, data scientists, and software engineers to develop advanced, highly automated data products. You will be a cha ...

  • Cogliano IT Staffing

    Data Engineer

    1 day ago

    Cogliano IT Staffing Phoenix, United States

    Data Engineer needed for a Direct Hire position in Phoenix, AZ Position will be remote, but candidate needs to live within a reasonable distance of Phoenix. · You will be project leader and independent contributor on a fast-growing Data Engineering team pursuing a vision of anal ...

  • Recurring Decimal

    Data Engineer

    1 week ago

    Recurring Decimal Phoenix, United States

    Data Analyst/ Engineer · Location: Phoenix, AZ or Los Angeles, CA · Hybrid · Compliance in Banking Domain knowledge is a must · Proven experience (5+ years) as a Business Analyst, Data Engineer, or similar role within the financial industry, with a strong focus on compliance and ...

  • Tekdoors

    Data Engineer

    2 days ago

    Tekdoors Phoenix, United States

    Job Description · Job DescriptionJob Title: Data Engineer · Location: Jacksonville, FL / Phoenix, AZ (Hybrid Work) · Duration: 24+ Months · Employment Type: Contract W2 · Experience: 8+ Years · Must-Have: · Bachelor's or Master's degree in Computer Science, Information Technology ...

  • MST Solutions

    Data Engineer

    1 day ago

    MST Solutions Phoenix, United States

    Details: · POSITION TITLE: Data Engineer · OFFICE LOCATION: Phoenix, AZ · CORE TIME ZONE: MST · FULL-TIME WORKING REMOTELY (from home): Yes · REMOTE WORK COMMENTS: Must be available during normal working hours in MST (AZ time) · POSITION SUMMARY: · We are looking for a savvy D ...

  • RIT Solutions, Inc.

    Data Engineers

    1 day ago

    RIT Solutions, Inc. Arizona City, United States

    Data Engineers (must have strong Heroku Experience) · 8-12 months, starts mid-May · PST / West coast candidates are preferred and will get 100% preferential priority · Rate is $50/hr. · data engineer to backfill a team member. · We need a strong data engineer with solid comm ...

  • Saxon Global

    Data Engineer

    2 days ago

    Saxon Global Arizona City, United States

    Qualifications Required in the Job: · Advanced working SQL/PLSQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases structures (Hadoop, MongoDB, dimensional designed solutions, and structur ...

  • ALTEN Technology USA

    Data Engineer

    6 days ago

    ALTEN Technology USA Phoenix, United States

    Job Description · Job DescriptionWe're ALTEN Technology USA, an engineering company that provides solutions for engineering, technology, and product development projects. For decades, we've been helping our clients develop products that are changing the world, whether that's by s ...

  • Eliassen Group

    Data Engineer

    5 days ago

    Eliassen Group Phoenix, United States

    Job Description · **100% Remote** · Our financial services client is looking for a Data Engineer to join their team. · We will accept corp to corp or w2 contractors. For our w2 consultants, we offer a great benefits package that includes Medical, Dental, and Vision benefits, 401k ...

  • TriWest Healthcare Alliance

    Data Engineer

    5 days ago

    TriWest Healthcare Alliance Phoenix, United States

    We offer remote work opportunities (AK, AR, AZ, CA, *CO, FL, *HI, IA, ID, IL, KS, LA, MD, MN, MO, MT, NE, NV, NM, NC, ND, OK, OR, SC, SD, TX, UT, VA/DC, *WA, WI and WY only) · Veterans, Reservists, Guardsmen and military family members are encouraged to apply · Job Summary · The ...

  • Nucleusteq

    Data Engineer

    5 days ago

    Nucleusteq Phoenix, United States

    What You'll Do · ● Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies · ● Partner with business teams and communicate with product managers to automate business processes, ...

  • Diverse Lynx

    Data Engineering

    1 week ago

    Diverse Lynx Phoenix, United States

    Data Engineer- Oracle Fusion cloud: Learning & Talent · AZ-Phoenix-85054 · Relevant Experience(in yrs) = 5-8 years · Technical/Functional Skills · • Must have 5-8 years of Data Engineering experience in a Big Data environment. · • Strong Data transformation/ETL skills using ...

  • The IT Gigs

    Data Engineer

    2 days ago

    The IT Gigs Phoenix, United States

    Job title: Data Engineer/Data Architect · Location: Phoenix, AZ (Onsite)/ California · Job type: W2 Only · VISA: USC, GC , OPT · 11+ years of experience Only · JD: · MUST HAVE AWS CERTIFICATIONS · Qualifications: · Proven experience with Apache Spark, Hive, and Hadoop. · Strong p ...

  • The IT Gigs

    Data Engineer

    4 days ago

    The IT Gigs Phoenix, United States

    Job title: Data Engineer/Data Architect · Location: Phoenix, AZ (Onsite)/ California · Job type: W2 Only · VISA: USC, GC , OPT · 11+ years of experience Only · JD: · MUST HAVE AWS CERTIFICATIONS · Qualifications: · Proven experience with Apache Spark, Hive, and Hadoop. · Strong p ...

  • eTek IT Services, Inc.

    Data Engineer

    1 day ago

    eTek IT Services, Inc. Phoenix, United States

    Job Description · Job DescriptionRequired SkillsBig Data Engineer with 3-4 years of hands-on Spark/Scala and Hive experience. The candidate must be able to work a hybrid schedule with the team in Phoenix, AZ (onsite every Tues/Wed/Thurs). If the candidate is not located in Phoeni ...

  • Diverse Lynx

    Data Engineer

    1 week ago

    Diverse Lynx Phoenix, United States

    Data Engineer · Phoenix, AZ · 6-12 months with possible extension · Data Engineer: Big Data; ETL - Big Data / Data Warehousing; GCP; Hadoop / HDFS; Hive; PySpark; Python 3 to 7 years of experience within Data Engineering/ Data Warehousing using Big Data · Hands-on experience wit ...

  • Identified Talent Solutions

    Data Engineer

    1 day ago

    Identified Talent Solutions Phoenix, United States

    Data Engineer (Remote - California Residents Only) · We are looking for a data engineering expert to join our Infrastructure Team. · As part of the Infrastructure Team, you will be a key strategic leader in the expansion, refinement, and continued development of our infrastruct ...

  • Integrate

    Data Engineer

    1 week ago

    Integrate Phoenix, United States

    Company Overview: · Integrate's journey began in 2010 amidst the burgeoning martech landscape. With a vision to seamlessly "integrate" the multitude of emerging data points, the company initially ventured as a Media enterprise. Pivoting to software development in 2014, the compa ...

  • Recurring Decimal

    Data Engineer

    1 week ago

    Recurring Decimal Phoenix, United States

    Data Analyst/ Engineer · Location: Phoenix, AZ or Los Angeles, CA · Hybrid · Compliance in Banking Domain knowledge · is a must · Proven experience (5+ years) as a Business Analyst, Data Engineer, or similar role within the financial industry, with a · strong focus on complianc ...