- The Senior Data Engineer will be responsible for the build of Enterprise Data platform.
- Setting up the data pipelines that are scalable, robust and resilient and build pipelines to validate, ingest, normalize/enrich and business-specific processing of healthcare data.
- Build Azure Data Lake leveraging Databricks technology to consolidate all data across the company and serve the data to various products and services.
- The scope of this role will include working with engineering, product management, program management and operations teams in delivering pipeline platform, foundational and application-specific pipelines and building the Data Lake in collaboration with business and other teams.
- Design, Develop, Operate and drive scalable and resilient data platform to address the business requirements
- Drive technology and business transformation through the creation of the Azure Data Lake
- Ensure industry best practices around data pipelines, metadata management, data quality, data governance and data privacy
- Partner with Product Management and Business leaders to drive Agile delivery of both existing and new offerings; assist with the Leadership and collaboration with engineering organizations within Change to manage and optimize the portfolio
- 10+/ 7+ years working experience in Data processing / ETL / Big data technologies like Informatica, Hadoop, Cloudera
- 3 +/ 2+ years working experience in Databricks (essential) and Python
- Experience with Cloud / Azure architectural components
- Experience building data pipelines and infrastructure
- Deep understanding of Data warehousing concepts, reporting and Analytical concepts
- Experience with Big Data tech stack, including Hadoop, Java, Spark, Scala, and Hive, NoSQL data stores
- Bachelors degree in Mathematics, Physical Sciences, Engineering or Computer Science
- Experience in leading design and development of large systems
- Demonstrates strong drive to learn and advocate for development best practices
- Proven track record of building and delivering enterprise-class products
- Full Stack Experience (End to End Development)
- Crisp and effective executive communication skills, including significant experience presenting cross-functionally and across all levels
-
Azure Databrick Engineer
6 days ago
Diverse Lynx Louisville, United StatesJob Title: Azure Databrick Engineer · Location: Louisville, KY · Duration: Contract · DESCRIPTION: The Senior Data Engineer will be responsible for the build of Enterprise Data platform. · Setting up the data pipelines that are scalable, robust and resilient and build pip ...
-
Technical Lead Databricks Consultant
2 weeks ago
Diverse Lynx Louisville, United StatesJC/Req ID Title Technical Lead Databricks consultant (Day 1 onsite ) Duration 6-9 month Location Louisville, Kentucky (Day 1 onsite ). Mandatory Skills Technical Lead DataBricks - Data Engineering , U-SQL, Spark (Scala or Python). T-SQL, postgresql ,Azure Database technologies ...
-
Technical Lead Databricks consultant
3 weeks ago
Diverse Lynx Louisville, United StatesTitleTechnical Lead Databricks consultant (Day 1 onsite )Duration6-9 month LocationLouisville, Kentucky (Day 1 onsite ).Mandatory SkillsTechnical Lead DataBricks - Data Engineering , U-SQL, Spark (Scala or Python). T-SQL, postgresql ,Azure Database technologies (both IaaS and Paa ...
-
Technical Lead Databricks Consultant
3 days ago
Diverse Lynx Louisville, United StatesJC/Req ID · Title · Technical Lead Databricks consultant (Day 1 onsite ) · Duration · 6-9 month · Location · Louisville, Kentucky (Day 1 onsite ). · Mandatory Skills · Technical Lead DataBricks - Data Engineering , · U-SQL, Spark (Scala or Python). T-SQL, postgresql ,Azu ...
-
Cloud Engineer
2 weeks ago
Brooksource Louisville, United StatesAzure Engineer · Brooksource · Fortune 50 Healthcare Client · Remote · Do you see your next career move taking you to a Fortune 50 healthcare company? Do you aspire to work in a dynamic, high-energy, agile environment? If you feel these words describe your ideal career opportunit ...
-
Cloud Engineer
1 week ago
Brooksource Louisville, United StatesAzure Engineer · Brooksource · Fortune 50 Healthcare Client · Remote · Do you see your next career move taking you to a Fortune 50 healthcare company? Do you aspire to work in a dynamic, high-energy, agile environment? If you feel these words describe your ideal career opport ...
-
Azure Databricks developers
1 week ago
Diverse Lynx Louisville, United StatesJob Type- Azure Data Engineer · Location- Louisville, KY onsite · Job type- ContractExperience in generating data pipelines in Azure ADF · Experience in ingesting data from different Sources using in Azure ADF · Experience in transforming the data using Azure Databricks & Delt ...
-
Data Specialist/Engineer
1 week ago
Stantec Louisville, United StatesData Specialist/Engineer J ) · Description · Grow with the best. Join a smart, creative, and inspired team that works to support operational excellence. The Stantec community unites more than 28,000 employees working in over 400 locations across 6 continents. · Your Opportunity · ...
-
Data Specialist/Engineer
3 days ago
Stantec Louisville, United StatesData Specialist/Engineer J ) · Description · Grow with the best. Join a smart, creative, and inspired team that works to support operational excellence. The Stantec community unites more than 28,000 employees working in over 400 locations across 6 continents. · Your Opportunity · ...
-
Senior Site Reliability Engineer
1 week ago
CenterWell Home Health Louisville, United StatesBecome a part of our caring community and help us put health first · The Senior Site Reliability Engineer maintains, integrates and analyzes software applications within the organization. The Senior Site Reliability Engineer work assignments involve moderately complex to complex ...
-
Senior Site Reliability Engineer
1 week ago
Humana Louisville, United StatesBecome a part of our caring community and help us put health first · The Senior Site Reliability Engineer maintains, integrates and analyzes software applications within the organization. The Senior Site Reliability Engineer work assignments involve moderately complex to complex ...
-
Senior Product Engineer
2 weeks ago
INSPYR Solutions Jeffersonville, United StatesTitle: · Senior Full-stack .NET Software Engineer · Location: · Phoenix AZ · Duration: · Long term (ongoing contract) · Compensation: · $70-72/hr · Work Requirements: · US Citizen, GC Holders or Authorized to Work in the U.S. · Skillset / Experience · Why you'll love t ...
-
VP, IT
3 weeks ago
PetSmart Store Support Group, Inc. Jeffersonville, United StatesAbout the Team · It's an exciting time in technology, and that buzz is felt throughout PetSmart We are continuing to grow at a faster pace and we want to continue to provide best-in-class experiences for pets and pet parents. · Our · Technology team · has 6 different departmen ...
Azure Databricks Engineer@Louisville, KY - Diverse Lynx
Description
Job Role: Azure Databricks EngineerLocation: : Louisville, KY (day 1 onsite)
Client: Wipro
Duration: Contract
Job Description: