Data Engineer - Austin, United States - Teacher Retirement System of Texas

Description

Position Summary

The Enterprise Data & Analytics team is experiencing rapid growth, necessitating a diverse range of skills in data engineering and data management.

This growth supports our mission to drive large-scale data platform modernization and data management initiatives.

As a Data Engineer(intermediate/Senior), your role will encompass designing, constructing, and maintaining the infrastructure, systems, and processes essential for the Investment business unit.

These efforts will enable seamless collection, storage, processing, and analysis of vital data. Of particular significance in this position is a dedicated emphasis on Power BI and the upcoming Microsoft Fabric service. Additionally, you'll engage with associated applications and services such as SQL Server, Synapse Analytics, Azure DevOps, and Azure SQL.

A pivotal aspect of this role is the capability to strategically plan, automate, orchestrate, and validate processes on a significant scale.

Key Accountabilities
Data Engineering

• Establishes and documents standards for metadata management and data pipeline control.
• Leads on designs, builds and provides ongoing operational support of TRS enterprise data warehouses and other data stores, continued development and enhancement of the enterprise data warehouses/data stores, automation of daily data extracts and external system feeds.
• Leads the supporting nontechnical users, data scientists or IT resources and operationalizing data delivery for production level deployments.
• Leads designs, builds, manages and operationalizes data (ETL) pipelines that extract data from distributed sources and load into a data warehouse, data store or other system to support data and analytics use cases.
• Leads review of pipeline code and sets standards for related metadata management.
• Manages the data pipeline continuous integration and continuous delivery (CI/CD) processes.
• Manages data pipeline jobs throughout their lifecycle.
• Designs, builds, manages and operationalizes data (ETL) pipelines that extract data from distributed sources and load into a data warehouse, data store or other system to support data and analytics use cases.
• Performs engineering and automation of data management platforms to support data pipeline management and efficient flow of data.
• Acts as a knowledge leader on data platforms, data pipelines and data stores.
• Creates logical and physical data models (including dimensional patterns) using a modern ER diagramming tool, such as ER/Studio
• Ensures compliance with data governance and data security requirements.
• Ensures data warehouse/data store implementations meet business expectations.
• Ensures that controls to verify the accuracy and consistency of data are implemented and monitored.
• Ensures the customer can exploit the data warehouse solutions and helps identify additional possible uses of information; anticipates future needs and opportunities.
• Supports development new and the enhancement of current dashboards.
• Supports the task of deploying analytics and data science outputs into existing business processes and applications.
• Uses innovative and modern tools, techniques and architectures to automate data preparation and integration tasks in order to minimize

manual processes and improve productivity.

• Assists in the identification and integration of potential new data sources.
• Performs related work as assigned.

Minimum Required Qualifications
Required Education

• Graduation from an accredited four-year college or university with major coursework in computer information systems, computer science, data management, information systems, information science, mathematics or a related field.
• High School diploma or equivalent and additional directly related experience may substitute for the required education on a year-for-year basis.

Required Experience

Three (3) - Five (5) years of experience in:

• ETL and pipeline design and development
• Data modeling
• Azure Synapse, SQL, CI/CD, Git, familiarity with Snowflake, Databricks and Programming
• Experience working with architects to design data warehouses, data lakes, data pipelines
• Data lake, warehouse, and pipeline operations
• Supporting data and analytics teams
• Agile development & DevOps approach to maintaining pipelines and databases
• Experience in a team environment requiring substantial collaboration
• Experience may be concurrent.

Required Registration, Certification, or Licensure

• None.

Preferred Qualifications

• Experience with SSIS, Synapse Pipelines/Azure Data Factory similar data integration toolset
• Experience with Data Catalog and Data Stewardship tools and processes
• Creating logical and physical data models (including dimensional patterns) using a modern ER diagramming tool, such as erwin or IDERA ER/Studio
• Power BI or equivalent data visualization
• Python or R knowledge

Knowledge, Skills, and Abilities

Knowledge of:

Data management disciplines:
data architecture, data warehousing, data integration and interoperability, data modeling (including dimensional), and data storage and operations.

• Process management, and metrics management.
• Emerging data and analytics technologies (i.e. Hadoop, Spark, MongoDB, Azure, Data Lake, etc.) (only for Data Engineer Senior)
• Cloud platforms and development patterns (i.e. AWS, Azure, MapReduce, etc.) (only for Data Engineer Senior)
• Machine-learning, statistical analysis, artificial intelligence, predictive analytics. (only for Data Engineer Senior)
• Relational and non-relational data structures, theories, principles, and practices.
• Metadata management and associated processes.
• Web services (REST, SOAP, XML, WSDL, JSON).
• Data encryption and secure transmission practices (SSL, SSH, SFTP, Certificates, PKI, OAUTH2).(only for Data Engineer Senior)
• Commonly used data and analytics technologies (i.e. Azure Synapse Analytics, SQL Server, etc.) (only for Data Engineer)

Skill in:

• Highly complex problem solving and critical thinking, and operating computers and applicable computer software.
• Planning, organizing, and coordinating work assignments to effectively meet frequent and/or multiple deadlines, handling multiple tasks simultaneously, and managing conflicting priorities and demands.
• Project management and system development life cycle concepts.(only for Data Engineer Senior role)
• Client/user interaction to determine system requirements.
• Strong written and oral communication skills.
• Strong presentation and interpersonal skills.
• Strong technical zeal with a passion for solving complex problems.

Ability to:

• Present ideas in user-friendly language.
• Establish and maintain harmonious working relationships with co-workers, agency staff, and external contacts.
• Work effectively in a professional team environment.
• Work in an Agile development environment.
• Work in a cross-functional team environment; including utilization of business and technical resources.

#J-18808-Ljbffr