Data Engineer - Remote, United States - Edmentum

Description

WHO WE ARE

Edmentum is a dynamic educator and student-focused company dedicated to tech-enabled learning solutions. Our goal is to ensure that all students have access to flexible learning environments and educators have the tools they need to support their students. We are on a mission to create innovative, proven learning technology, partnering with educators to ignite student potential. We are a Remote First organization with a strong commitment to excellence, innovation, and customer satisfaction.

WHAT IS THE POSTION

Are you an innovative and collaborative technology professional with more than 2 years of enterprise level data engineering experience? Join Edmentum's technology team as a Data Engineer and dive right into our data lake

Edmentum creates learning technology solutions designed to support educators and supplement existing curriculum with one goal in mind: positive student outcomes. Our solutions and services are in use in more than 43,000 schools, with 400,000 educators, and 5.2 million students in all 50 states and more than 100 countries worldwide.

As a Data Engineer, you will be an essential contributor on our Technology team, a highly collaborative group that solves Edmentum's big data challenges. You will perform development and operations activities for our data lake, which serves as the foundational data architecture for Data Analytics and Research. You will be directly involved in the design, development and implementation of data infrastructure, pipelines, and storage at scale. You'll work to ingest and process both streaming and batch data using leading-edge cloud tools from AWS and Databricks that represent purpose-built architecture. We invite you to bring your passion for data and join us in operationalizing exciting data pipelines aligned to Edmentum's strategic goals.

WHAT YOU WILL DO

· Design, develop, and implement data pipelines that collect, connect, centralize, and curate data from various internal and external data sources.

· Contribute to a development team to deliver best-in-class data pipelines supporting key data initiatives for the data lake in AWS.

· Implement purpose-built data architecture for data users including data marts, 3rd party integrations, and dimensional models that allow for efficient data consumption.

· Develop and maintain APIs, microservices, and related component libraries in support of targeted platform capabilities in our technology ecosystem.

· Work in close collaboration with your data-minded colleagues focused on application development, reporting, and Business Intelligence.

WHAT IS REQUIRED

· Bachelor of Science (B.S.) from a 4-year college or university in Computer Science, Information Management Systems, or equivalent experience.

· 3 or more years of experience with Python and SQL programming skills

· 2 or more years of experience working with Spark (pyspark data frames)

· Previous Software Engineering experience working with Gitflow as a team with multi-environment deployments.

· 2 or more years of experience working with relational databases such as SQL, RDBMS (SQL Server) or Postgres.

· 1 or more years of experience with streaming data processing tools such as Kinesis or cloud functions such as AWS Lambda

· 1 or more years of experience with batch data processing with ETL tools such as Databricks ETL

· 1 or more years of experience with job administration and scheduling of complex data workloads using tools such as Apache Airflow

· 1 or more years of experience working with non-rdbms data warehouse/lake stores (such as Big Query, Snowflake, Databricks Delta Lake, or Redshift)

· Previous experience with Cloud data tools (GCP, Azure, AWS) such as: EMR, S3, EC2, Glue, and ECS

· Experience with the Databricks platform tools such as Delta Lake and Unity Catalog.

· Experience with at least 1 additional programming language (c#, scala, java, nodejs, etc.)

· Foundational understanding of Data Lake architecture patterns.

· Foundational understanding Cloud Infrastructure, Operations, and the Software Development Lifecycle (SDLC).

· Ability to deeply understand business problems and how data solutions contribute to resolving or solving them.

· Strong critical-thinking skills with the ability to think both logically and creatively to deliver elegant engineering solutions to complex problems.

· Effective communications skills (both verbally and written) with the ability to clearly articulate the key considerations of complex topics.

· Demonstrated ability to operate with a strong pride of ownership through the lifecycle of a solution and other work products.

WHY JOIN EDMENTUM

· Competitive compensation package and best in class Total Rewards offerings.

· Opportunity to lead and shape the revenue generation strategy of a dynamic company.

· Collaborative and inclusive Remote First work environment

· Company culture that values innovation, growth, and impact.

· Commitment to employee development and career advancement.

Edmentum is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender identity, sexual orientation, national origin, disability status, protected veteran status, or any other characteristic protected by law.

Equal Opportunity Employer/Protected Veterans/Individuals with Disabilities

The contractor will not discharge or in any other manner discriminate against employees or applicants because they have inquired about, discussed, or disclosed their own pay or the pay of another employee or applicant. However, employees who have access to the compensation information of other employees or applicants as a part of their essential job functions cannot disclose the pay of other employees or applicants to individuals who do not otherwise have access to compensation information, unless the disclosure is (a) in response to a formal complaint or charge, (b) in furtherance of an investigation, proceeding, hearing, or action, including an investigation conducted by the employer, or (c) consistent with the contractor's legal duty to furnish information. 41 CFR c)

Edmentum's notice regarding the collection of personal information from interested candidates is available here