Jobs
>
Minneapolis

    Lead Azure Data Warehouse Architect - Minneapolis, United States - Saxon Global

    Saxon Global
    Saxon Global Minneapolis, United States

    1 month ago

    Default job background
    Description

    Must Have Skills :


    Azure Data Lake design and implementation experienceExperience modeling and building out star schema on Cloud Data Lake for BI use cases.

    Databricks Data Lake experienceSparkSQLTeam Coaching skills.
    Strong architect who can hold their own and suggest solutions.
    AWS/Azure or GCP data lake experienceStreaming data pipelines with kafka for real time needsPolished consulting skills

    Callie Dump Notes From Call:
    They have teams that currently work with Azure and data so not completely in the dark here.


    The place they need help with is with a data warehouse that is pulling data from a lot of different areas across the organization.

    5-6 different analytics pipeline. Feed these to one data warehouse that will be used as a single source of truth.

    Data analytics that will have to be aligned.

    How will members align in different data pipelines and then transfer to data warehouse.

    Azure type structure. Not relational. Utilize star scheema to do rollup queries.

    Need help on Data warehousing approach on azure then drive maintenance of star scheema in that environment.

    Doing lots of fits and starts and going down false trails. Lots of trial and error.

    Wants someone with previous experience in this area. Need super strong resource.

    Using looking at synaps on azure or possibly something else.

    Medallion type architecture. Gold/silver/bronze.

    Not looking at using sql clusters in synapse. This doesn't work for them.

    Using spark based ETL. Serverless compute running against deltalake.

    Databricks?? TBD they are looking into this. Would love someone to be able to recommend yes or no.

    Need someone with strong data warehouse background.

    How does everything fit into reporting and data warehouse structure. Wants to collaborate with this person to help decide someo of these things.

    Needs someone to speak up and figure out problems and suggest path forward. Be able to explain why and why not.

    Data is coming in as parka... some coming in from MicroStrategy. Need landing zone somehow.

    Microservice oriented architecture. Reports need to be real team. Publishing out to kafka from microservices that will feed into datawarehouse. Daily basis of this. Not all file based or parka.

    Clinical encounters are going to be very important to react to quickly.

    They already have kafka but they would like to help ramp this up. Need help with how the kafka is used with datawarehouse. Make sure it lands in warehosue without losing it.

    How much data is historic vs day to day? Some monthly some daily. Gigabites of data.

    250 terabytes of data by the time this is done. It will be expanding in scope as well.

    100 million members in data store.

    Updates?? Everything is pretty much new updates. For the most part they do the data work in the intake process and what is a delta?

    There will be a silver layer in the warehouse where there will not be any differentiators. Historical data at this level.


    Bronze:
    Some tracking of history but wants to expand this to be able to do snapshots over time.

    Lots of reporting is tableau based but its very manual so they want to move towards powerbi here. They will likely use both for reporting engines.

    Data that needs to be isolated by payer as much as possible. Need to be able to show this data trail. Cant have payer data crossover. 100's of payers. They focus mainly on large payers now and then into midsized.

    3-4 million providers. 80 million total though. Trying to narrow this down.

    Healthcare experience and star scheema experience is really important. Need help with process and strategy.

    Data engineering SME that can build out work.

    Will start with proof of concept.

    Required Skills : 1. Azure Data Lake design and implementation experience 2. Experience modeling and building out star schema on Cloud Data Lake for BI use cases. 3. Databricks Data Lake experience 4. Spark 5. SQL 6. Team Coaching skills. 7. Strong architect who can hold their own and suggest solutions. 8. AWS/Azure or GCP data lake experience 9. Streaming data pipelines with kafka for real time needs 10.


    Polished consulting skillsBasic Qualification :

    Additional Skills :
    Background Check :YesDrug Screen :YesNotes :Selling points for candidate :Project Verification Info :Candidate must be your W2 Employee :YesExclusive to Apex :NoFace to face interview required :NoCandidate must be local :NoCandidate must be authorized to work without sponsorship ::NoInterview times set : :NoType of project :Architecture/DesignMaster Job Title :Architect: Apps (Other)

    Branch Code :
    Minneapolis
    #J-18808-Ljbffr
  • Genesis10

    Data Warehouse Architect

    4 days ago

    Genesis10 Minneapolis, United States

    Genesis10 is seeking a Data Warehouse Architect for a contract with our client in Minneapolis, MN. 80% Remote. Job Description: As a Databricks Platform Engineer, your role involves performing Databricks Platform administration and deploying applications on the AWS Databricks pla ...

  • Genesis10

    Data Warehouse Architect

    4 weeks ago

    Genesis10 Minneapolis, United States Temporary, Full time

    Genesis10 is seeking a Data Warehouse Architect for a contract with our client in Minneapolis, MN. 80% Remote. · Job Description: · As a Databricks Platform Engineer, your role involves performing Databricks Platform administration and deploying applications on the AWS Databricks ...

  • Saxon Global

    Lead Azure Data Warehouse Architect

    3 weeks ago

    Saxon Global Minneapolis, United States

    Must Have Skills : · Azure Data Lake design and implementation experience · Experience modeling and building out star schema on Cloud Data Lake for BI use cases. · Databricks Data Lake experience · Spark · SQL · Team Coaching skills. · Strong architect who can hold their o ...

  • GlobalSource IT

    Expert Data Platform Engineer

    2 weeks ago

    GlobalSource IT Minneapolis, United States

    GlobalSource It has a direct client - a Fortune 100 company - that is looking for an experienced Data Platform Engineer (Expert Level) / Data Architect to join their team for the long term. As a Sr. team member you will design, build and maintain data platforms that include data ...

  • Mattson Macdonald Young Structural Engineers

    Structural Project Engineer

    1 week ago

    Mattson Macdonald Young Structural Engineers Minneapolis, United States

    Looking for something a little different? Ready for a 40-hour week to be the usual, not the exception? Seeking fellow engineers who are creative, personable, and dare we say fun? MMY has always been a little different since our founding in 1983. · MMY invests in its people with f ...

  • Fractal, Inc.

    Sr. Azure Data Engineer

    6 days ago

    Fractal, Inc. Minneapolis, United States

    Senior Azure Data Engineer · Fractal is a strategic AI partner to Fortune 500 companies with a vision to power every human decision in the enterprise. Fractal is building a world where individual choices, freedom, and diversity are the greatest assets; an ecosystem where human im ...

  • Synergis

    Data Engineer

    1 week ago

    Synergis Minneapolis, United States Contract

    Data Engineer · 6 month W2 contract w/ full benefits · 100% remote · ABOUT THIS ROLE: The Data Engineer / Architect will collaborate directly with the Digital Analytics team within Enterprise Analytics & CX to design, document, build, and refine a scalable data framework to suppo ...

  • The Lignum Group

    Senior Project Manager

    1 week ago

    The Lignum Group Minneapolis, United States

    Job Purpose: · The Project Manager will be responsible for the successful implementation and administration of the Project Budget. The Project Manager will assist, communicate, and coordinate with the sales personnel, contractors, architects, other sub-contractors, purchasing, w ...

  • LVI Associates

    Associate Principal

    6 days ago

    LVI Associates Minneapolis, United States

    The Company: · They are HQ in Minnesota and have been actively expanding their presence this year across two regions. They have been in the industry for over 50 years and have built a quality reputation which has reflected in their year on year growth target · They have a huge ba ...

  • Voya Financial

    Informatica Power Center Application Support Consultant

    3 weeks ago

    Voya Financial Minneapolis, United States Full time

    We will do this together — with customers, partners and colleagues. We will fight for others, not against: We will stand up for and champion everyone's access to opportunities. The status quo is not good enough ... we believe every individual and every community deserves access t ...

  • Insight Global

    Project Architect

    4 weeks ago

    Insight Global Minneapolis, United States

    An employer is looking for a highly skilled project architect to join one of our largest national clients for a hybrid role in Austin, TX. In order to be eligible for this role, you must live and be a licensed architect in the state of TX, and be willing to travel to Austin, TX a ...

  • Agcmn

    Warehouse Manager with CDL

    1 week ago

    Agcmn Minneapolis, United States

    ** Adolfson & Peterson Construction** · ** Warehouse Manager with CDL** · Minneapolis, MN 55416 · **Company Overview:** · Adolfson & Peterson Construction, one of the nations top contractors, is recruiting for an experienced Warehouse Manager with a CDL for our Midwest region ...

  • Gulfeagle Supply

    Warehouse Manager

    1 week ago

    Gulfeagle Supply Minneapolis, United States

    Minneapolis Branch, 900 Glenwood Avenue, Minneapolis, Minnesota, United States of America · Req #4685 · Tuesday, April 9, 2024 · Gulfeagle Supply is a family-owned business with over 100+ locations nationwide. We are a full line distributor of residential and commercial roofing ...

  • Gullview Technologies

    Senior Snowflake Data Engineer

    2 weeks ago

    Gullview Technologies Minneapolis, Minnesota, United States Permanent

    Sr. Snowflake Data Engineer · Gullview Technologies is an exciting and rapidly growing technology company focused on taking on the most vital and challenging business and technical challenges our clients face in our highly connected business world today. We have an exceptional fo ...

  • GULFEAGLE SUPPLY

    Warehouse Manager

    1 week ago

    GULFEAGLE SUPPLY Minneapolis, United States

    Job Description · Job DescriptionGulfeagle Supply is a family-owned business with over 100+ locations nationwide. We are a full line distributor of residential and commercial roofing and building products. Gulfeagle Supply specializes in servicing the professional contractor whil ...

  • Diverse Lynx

    Sr Data Architect

    4 days ago

    Diverse Lynx Minneapolis, United States

    Role: Sr Data Architect · Location: Minneapolis, MN - Onsite · Type: Fulltime / permanent · Skill · Data Architecture and Modeling · Minimum Experience · 8 - 10 Years · Job description:Should design and build scalable and cost-effective public cloud (Azure) native solutions ...

  • Diverse Lynx

    Data Architect

    2 weeks ago

    Diverse Lynx Minneapolis, United States

    Job Title: Sr Data Architect · Job Type: Full Time/ Permanent · Location: Minneapolis, MN · Job Details: · Should design and build scalable and cost-effective public cloud (Azure) native solutions as per the business use cases. · Should be hands on engineer with experience in mul ...

  • Mattson Macdonald Inc

    Structural Project Engineer

    1 week ago

    Mattson Macdonald Inc Minneapolis, United States

    Looking for something a little different? Ready for a 40-hour week to be the usual, not the exception? Seeking fellow engineers who are creative, personable, and dare we say fun? MMY has always been a little different since our founding in 1983. · MMY invests in its people with ...

  • C4 Technical Services

    SQL Developer IV

    1 week ago

    C4 Technical Services Minneapolis, United States

    SQL Developer IV - Marketing Operations · Location: Remote · Tell us about your department: · The CRM Operations team is responsible for managing email, direct mail, text, and push customer communications. Positions in other companies may refer to the team as Campaign Operations ...

  • UnitedHealth Group

    Lead Analytics Engineer

    4 days ago

    UnitedHealth Group Minneapolis, United States

    Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel ...