Jobs
>
Phoenix

    Data Engineer - Phoenix, United States - Identified Talent Solutions

    Default job background
    Description

    Job Description

    Job DescriptionData Engineer (Remote - California Residents Only)We are looking for a data engineering expert to join our Infrastructure Team.As part of the Infrastructure Team, you will be a key strategic leader in the expansion, refinement, and continued development of our infrastructure utilizing Amazon Web Services (AWS), as well as continuing to build out our data analytics and engineering tools. This role will be instrumental in helping us scale our work statewide and open the door for expanded use of our higher education planning platform for K-12th grade students, parents, and educators.Qualifications
    • SQL: 2 years (Required)
    • Cloud infrastructure: 2 years (Required)
    • US work authorization (Required)
    • Data Engineer - 2 years
    • Remote/Virtual - All candidates must live in California
    The ideal candidate for this team has extensive experience building out complex data architectures, including the testing, maintenance, and refinement of all data pipelines.They have also experience successfully scaling up an organization's data intake to terabytes and petabytes of data, as well as optimizing data delivery and automating manual processes. This person is comfortable working with structured and unstructured data and can troubleshoot data loading and processing tools via SQL, Python, shell scripting, AWS, etc, and take on a leadership role in special projects when needed.Extensive experience developing robust data documentation and data governance protocols is required for this role.There are no direct supervisory responsibilities for this position, but you must be able to proactively and successfully partner and collaborate with other subject matter experts on a project management basis. You must be comfortable leading and project managing work with many unknowns and ambiguous solutions, as well as carry a deep knowledge and/or curiosity about the needs and behaviors of students, educators, and parents, and a passion for educational equity.What Will You Be Doing:
    • Manage, refine, and enhance AWS cloud services infrastructure which include the following:
      EC2, VPC, RDS, ECS, CloudWatch, CloudFormation, CloudTrail
    • Transfer for sFTP, S3, Lambda, Secrets Manager, and Route 53
      Lead ETL/ELT processes which include the development, refinement, and implementation of data loading and processing tools, including Snowflake, Airflow, Python, SQL, dbt, and shell scripts
    • Review, redesign, and expand existing analytics and data processing architecture to create an optimal data pipeline(s)
      Identify, design, and implement internal process improvements:
      • automating manual processes, optimizing data delivery, designing infrastructure for greater scalability and automation
      • Maintain and update documentation of data architecture from both the macro view (i.e. architectural diagrams) and the micro view (i.e. script level tasks in Airflow)
      • Lead meetings, research processes, collect data, analyze information
      • Collaborate with the key stakeholders of your projects
      • Develop and maintain expert knowledge of our platform and organization
      • Continuously improve data pipelines and architecture by staying updated on industry trends and best practices.
    Necessary Technical Skills:
    • Build processes supporting data transformation, data structures, metadata, dependency, and workload management.
    • Advanced proficiency with cloud analytical tools: Snowflake, Redshift, Hadoop, Spark, Kafka, etc.
    • Advanced proficiency with ETL tools like Matillion, dbt, Talend, etc.
    • Advanced proficiency with data pipeline and workflow management tools: Airflow, Azkaban, Luigi, etc.
    • Advanced proficiency building and optimizing data pipelines, cloud architectures, and data sets.
    • Advanced proficiency with scripting languages like Python, R, Scala, etc.
    • Advanced proficiency developing cloud infrastructure in AWS or currently has or is in the process of obtaining AWS
    • Certification as a Solutions Architect - Associate
    • Expert SQL knowledge (SQL Server, PostgreSQL, MySQL, etc.) and understanding of relational databases, query authoring and optimization, as well as working familiarity with a variety of databases.
    • A successful history of manipulating, processing and extracting value from large structured and unstructured datasets.
    Your Strengths:
    • Strong decision-making skills and collaborative spirit with the ability to take abstract brainstorming and generate concrete proposals for action
    • Advance projects without detailed supervision, balancing multiple responsibilities, and providing colleagues with actionable proposals for advancing collective efforts
    • Thrive in a fast-paced environment with changing priorities and deadlines
    • Juggle multiple projects of various scopes with ease and grace
    • Meticulous attention to detail
    • Excellent verbal communication skills; ability to communicate with various levels of professionals.
    • Strong organizational, project, and time management skills
    We are committed to providing an environment of mutual respect where equal employment opportunities (EEO) are available to all employees and applicants without regard to race, color, ancestry, national origin, genetic characteristics, sex, gender identity, gender expression, sexual orientation, marital/parental status, political affiliation, religion, age, disability, pregnancy, childbirth, breastfeeding or veteran status.In addition to federal law requirements, we comply with applicable state and local laws governing nondiscrimination in employment. We are committed to workplace policies and hiring practices that comply with federal, state, and local law. We are interested in hiring qualified candidates who are eligible and authorized to work in the United States. At this time, we are not able to sponsor visas. As a result, we cannot hire applicants that currently, or in the future, require immigration sponsorship for work authorization (i.e., H1B or F1 Student Visa).


  • CSAA Insurance Group Phoenix, United States Full time

    CSAA Insurance Group (CSAA IG), a AAA insurer, is one of the top personal lines property and casualty insurance groups in the U.S. Our employees proudly live our core beliefs and fulfill our enduring purpose to help members prevent, prepare for and recover from life's uncertainti ...

  • BlueTrail

    Data Engineer Azure

    3 weeks ago


    BlueTrail Phoenix, United States

    Waar ben jij van? · Jij bent van de data laten spreken. Als Data Engineer zorg je ervoor dat data conform de geldende standaarden, normen en data architecturen in het Rotterdamse Data en Analyse platform wordt ontsloten. · Jouw functie · Je bent lid van een multidisciplinair scr ...

  • Nucleusteq

    Data Engineer

    2 weeks ago


    Nucleusteq Phoenix, United States

    What You'll Do · ● Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies · ● Partner with business teams and communicate with product managers to automate business processes, ...

  • TalentAmp

    Data Engineer

    3 weeks ago


    TalentAmp Arizona, United States

    TalentAmp is currently looking for Data Engineer II for one of our clients in Phoenix area. You will work in close collaboration with operations, subject matter experts, data scientists, and software engineers to develop advanced, highly automated data products. You will be a cha ...

  • RIT Solutions, Inc.

    Data Engineers

    2 weeks ago


    RIT Solutions, Inc. Arizona City, United States

    Data Engineers (must have strong Heroku Experience) · 8-12 months, starts mid-May · PST / West coast candidates are preferred and will get 100% preferential priority · Rate is $50/hr. · data engineer to backfill a team member. · We need a strong data engineer with solid comm ...

  • Tekdoors

    Data Engineer

    2 weeks ago


    Tekdoors Phoenix, United States

    Job Description · Job DescriptionJob Title: Data Engineer · Location: Jacksonville, FL / Phoenix, AZ (Hybrid Work) · Duration: 24+ Months · Employment Type: Contract W2 · Experience: 8+ Years · Must-Have: · Bachelor's or Master's degree in Computer Science, Information Technology ...

  • Saxon Global

    Data Engineer

    2 weeks ago


    Saxon Global Arizona City, United States

    Qualifications Required in the Job: · Advanced working SQL/PLSQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases structures (Hadoop, MongoDB, dimensional designed solutions, and structur ...

  • Recurring Decimal

    Data Engineer

    3 weeks ago


    Recurring Decimal Phoenix, United States

    Data Analyst/ Engineer · Location: Phoenix, AZ or Los Angeles, CA · Hybrid · Compliance in Banking Domain knowledge · is a must · Proven experience (5+ years) as a Business Analyst, Data Engineer, or similar role within the financial industry, with a · strong focus on complianc ...

  • The IT Gigs

    Data Engineer

    2 weeks ago


    The IT Gigs Phoenix, United States

    Job title: Data Engineer/Data Architect · Location: Phoenix, AZ (Onsite)/ California · Job type: W2 Only · VISA: USC, GC , OPT · 11+ years of experience Only · JD: · MUST HAVE AWS CERTIFICATIONS · Qualifications: · Proven experience with Apache Spark, Hive, and Hadoop. · Strong p ...

  • Eliassen Group

    Data Engineer

    2 weeks ago


    Eliassen Group Phoenix, United States

    Job Description · **100% Remote** · Our financial services client is looking for a Data Engineer to join their team. · We will accept corp to corp or w2 contractors. For our w2 consultants, we offer a great benefits package that includes Medical, Dental, and Vision benefits, 401k ...

  • TriWest Healthcare Alliance

    Data Engineer

    2 weeks ago


    TriWest Healthcare Alliance Phoenix, United States

    We offer remote work opportunities (AK, AR, AZ, CA, *CO, FL, *HI, IA, ID, IL, KS, LA, MD, MN, MO, MT, NE, NV, NM, NC, ND, OK, OR, SC, SD, TX, UT, VA/DC, *WA, WI and WY only) · Veterans, Reservists, Guardsmen and military family members are encouraged to apply · Job Summary · The ...

  • Diverse Lynx

    Data Engineering

    3 weeks ago


    Diverse Lynx Phoenix, United States

    Data Engineer- Oracle Fusion cloud: Learning & Talent · AZ-Phoenix-85054 · Relevant Experience(in yrs) = 5-8 years · Technical/Functional Skills · • Must have 5-8 years of Data Engineering experience in a Big Data environment. · • Strong Data transformation/ETL skills using ...

  • Diverse Lynx

    Data Engineer

    3 weeks ago


    Diverse Lynx Phoenix, United States

    Data Engineer · Phoenix, AZ · 6-12 months with possible extension · Data Engineer: Big Data; ETL - Big Data / Data Warehousing; GCP; Hadoop / HDFS; Hive; PySpark; Python 3 to 7 years of experience within Data Engineering/ Data Warehousing using Big Data · Hands-on experience wit ...

  • Cogliano IT Staffing

    Data Engineer

    2 weeks ago


    Cogliano IT Staffing Phoenix, United States

    Data Engineer needed for a Direct Hire position in Phoenix, AZ Position will be remote, but candidate needs to live within a reasonable distance of Phoenix. · You will be project leader and independent contributor on a fast-growing Data Engineering team pursuing a vision of anal ...

  • Recurring Decimal

    Data Engineer

    3 weeks ago


    Recurring Decimal Phoenix, United States

    Data Analyst/ Engineer · Location: Phoenix, AZ or Los Angeles, CA · Hybrid · Compliance in Banking Domain knowledge is a must · Proven experience (5+ years) as a Business Analyst, Data Engineer, or similar role within the financial industry, with a strong focus on compliance and ...

  • ALTEN Technology USA

    Data Engineer

    2 weeks ago


    ALTEN Technology USA Phoenix, United States

    Job Description · Job DescriptionWe're ALTEN Technology USA, an engineering company that provides solutions for engineering, technology, and product development projects. For decades, we've been helping our clients develop products that are changing the world, whether that's by s ...

  • Motion Recruitment Partners LLC

    Data Engineer

    3 weeks ago


    Motion Recruitment Partners LLC Phoenix, United States

    Job Description · We are currently seeking a talented and motivated Data Engineer with expertise in Google Cloud Platform (GCP). This financial tech company offers the opportunity for growth and advancement in a dynamic and innovative work environment. · The #1 feature of this ...

  • The IT Gigs

    Data Engineer

    3 weeks ago


    The IT Gigs Phoenix, United States

    Job title: Data Engineer · Location: Phoenix, AZ (Onsite) · Job type: W2 Only · VISA: USC and GC · JD: · Mandatory Skill Set: Apache Spark, Hive, Hadoop, BigQuery, BigTable, Cloud Composure, Dataflow, Google Cloud Storage, Python, SQL, Shell Scripting, Git. · Good to have Skill S ...

  • Integrate

    Data Engineer

    3 weeks ago


    Integrate Phoenix, United States

    Company Overview: · Integrate's journey began in 2010 amidst the burgeoning martech landscape. With a vision to seamlessly "integrate" the multitude of emerging data points, the company initially ventured as a Media enterprise. Pivoting to software development in 2014, the compa ...

  • Identified Talent Solutions

    Data Engineer

    2 weeks ago


    Identified Talent Solutions Phoenix, United States

    Data Engineer (Remote - California Residents Only) · We are looking for a data engineering expert to join our Infrastructure Team. · As part of the Infrastructure Team, you will be a key strategic leader in the expansion, refinement, and continued development of our infrastruct ...