Senior Data Engineer - Home Office, United States - HealthFirst

Description

The Senior Data Engineer is responsible for data acquisition strategies and integration scripting and tools, data migrations, conversions, purging and back-ups; fulfills data acquisition strategy requirements. They work with product, financial control, analysts, users, and other stakeholders to understand business requirements and supports data architecture to translate into data acquisition strategies. The Senior Data Engineer will author artifacts defining standards and definitions for storing, processing, and moving data, including associated processes and business rules. Additionally, the Senior Data Engineer will map the details within these their artifacts to business processes, non-functional characteristics, QA criteria and technical enablement. The role is responsible to be constantly thinking through the needs of the business to support efficient and error free processes.

Duties and Responsibilities:

The Senior Data Engineer will be the owner of Claims Data Mart and is responsible for creating data acquisition strategy and develops data set processes. He or she will be also responsible for finding trends in datasets and developing workflows and algorithms to help make raw data more useful to the enterprise.

• Leading design, implementation, and ongoing management of robust, scalable, and flexible data pipelines supporting critical data and application integration
• Building and scaling the distributed infrastructure that drives the Amazon's EMR platform
• Automating workflows leveraging DevOps framework (CI/CD/CT) where applicable
• Ensuring quality of technical solutions as data moves across Healthfirst environments
• Working with solution and data architects to develop, construct, test and maintain architectures, prototypes, and design solutions
• Coach and mentor junior technical staff – for instance, but not limited to, developers and testers
• Helping to maintain the integrity and security of the company data
• Providing insight into the changing data environment, data processing, data storage and utilization requirements for the company and offer suggestions for solutions
• Articulating both the technical implications as well as data usage implications of proposed solutions or solution options to a wide variety of stakeholders.
• Working directly with business users to align solutions with business requirements
• Relentless focus on continuous improvement of solutions in to improve data reliability, efficiency, quality and more
• Working with solution and enterprise architects to conduct research for industry best practices and developments and recommend new features and/or improvements to existing practices and design.
• Create data monitoring capabilities for each business process and work with data consumers on updates
• Coaching peers and other members of the team through new solutions, concepts, and technologies
• Diagnosing and resolving questions and issues about the data to ensure data usability for the consumers

Minimum Qualifications:

• Firm foundation in software development principles and practices
• 5+ years' experience in a building robust data pipelines/ETL and data processing
• 3+ years' experience in building and scaling the distributed infrastructure of Amazon's EMR platform
• 3+ years' hands-on experience with PySpark/Spark SQL
• 3+ years' experience working in a production cloud infrastructure. Prior backgrounds with AWS services especially S3, Lambda, and EMR services
• Proficiency in SQL a must - knowledge of SQL and multiple programming languages in order to optimize data processes and retrieval. 5+ years' experience is required.
• Experience working in a Big Data ecosystem processing and building reliable and scalable solutions involving file systems, data structures/databases, automation, security, messaging, integration etc.
• Strong knowledge in the concepts of RDBMS/Cloud database services such as AWS RDS PostgresSQL, Redshift, Snowflake or Dynamo DB
• Exposure to CI/CD/CT for software systems Such as Jenkins, Artifactory and CloudFormation
• Must be able to develop creative solutions to problems
• Demonstrates critical thinking skills with ability to communicate across functional departments to achieve desired outcomes
• Excellent interpersonal skills with proven ability to influence with impact across functions and disciplines.
• Ability to work independently and as part of a team
• Ability to manage multiple projects/deadlines, identifying the necessary steps and moving forward through completion
• HS Diploma or GED from an accredited institution

Preferred Qualifications:

• Bachelors Degree from an accredited institution
• Leadership Capabilities with a proven track record of success directing the efforts of data engineers and business analysts within a deadline-driven and fast-paced environment
• Demonstrated experience working in an Agile environment as a Software Engineer focused on data processing
• 3+ years of working with messaging/data streaming services especially Kafka/ Amazon MKS
• 3+ years' experience in programing languages such as C/C++, Java, Python, etc.
• Strong expertise with Linux environment preferred
• Knowledge of provider-sponsored health insurance systems/processes and the Healthcare industry

WE ARE AN EQUAL OPPORTUNITY EMPLOYER. Applicants and employees are considered for positions and are evaluated without regard to race, color, religion, gender, gender identity, sexual orientation, national origin, age, genetic information, military or veteran status, marital status, mental or physical disability or any other protected Federal, State/Province or Local status unrelated to the performance of the work involved.

If you have a disability under the Americans with Disability Act or a similar law and want a reasonable accommodation to assist with your job search or application for employment, please contact us by sending an email to or calling In your email please include a description of the accommodation you are requesting and a description of the position for which you are applying. Only reasonable accommodation requests related to applying for a position within Healthfirst Management Services will be reviewed at the e-mail address and phone number supplied. Thank you for considering a career with Healthfirst Management Services.

EEO Law Poster and Supplement

All hiring and recruitment at Healthfirst is transacted with a valid "" email address only or from a recruitment firm representing our Company. Any recruitment firm representing Healthfirst will readily provide you with the name and contact information of the recruiting professional representing the opportunity you are inquiring about. If you receive a communication from a sender whose domain is not , or not one of our recruitment partners, please be aware that those communications are not coming from or authorized by Healthfirst. Healthfirst will never ask you for money during the recruitment or onboarding process.

Hiring Range*:

• Greater New York City Area (NY, NJ, CT residents): $129,900 - $187,680
• All Other Locations (within approved locations): $114,400 - $170,170

As a candidate for this position, your salary and related elements of compensation will be contingent upon your work experience, education, licenses and certifications, and any other factors Healthfirst deems pertinent to the hiring decision.

In addition to your salary, Healthfirst offers employees a full range of benefits such as, medical, dental and vision coverage, incentive and recognition programs, life insurance, and 401k contributions (all benefits are subject to eligibility requirements). Healthfirst believes in providing a competitive compensation and benefits package wherever its employees work and live.

*The hiring range is defined as the lowest and highest salaries that Healthfirst in "good faith" would pay to a new hire, or for a job promotion, or transfer into this role.