Etl Developer - Baltimore, United States - SRE Tech Solutions

Description

• Design, build, and maintain data pipelines and ETL processes to ensure reliable and timely data ingestion, transformation, and delivery
• Designs logical data models and implementation of physical database structures
• Implement data quality and validation processes to ensure the accuracy, completeness, and consistency of data
• Implement data security and privacy measures to safeguard sensitive information.
• Collaborate with developers and analysts to provide them with the necessary data sets and ensure smooth data access for their analysis and analytical needs.
• Document data engineering processes, best practices, and technical specifications
• Monitor and troubleshoot data pipelines, identifying and resolving data processing, performance, and reliability issues.
• Coordinate with internal teams to understand business requirements
• Collaborate with quality assurance teams to identify and resolve defects
• Follow automated continuous delivery and deployment practices

• Bachelor's Degree from an accredited college or university in the specific discipline required by the State.
• Minimum 5 + years ETL coding experience. Proficiency in programming languages such as Python and SQL for data processing and automation
• Experience with distributed computing frameworks like Apache Spark or similar technologies
• Experience with AWS data environment, primarily EMR, Glue, S3, DocumentDB, Redshift, RDS, Athena, etc.
• Experience with data warehouses/RDBMS like Redshift and NoSQL data stores such as DocumentDB, DynamoDB, OpenSearch, etc
• Experience in building data lakes using AWS Lake Formation
• Experience with workflow orchestration and scheduling tools like AWS StepFunctions, AWS MWAA, etc.
• Strong understanding of relational databases (including tables, views, indexes, table spaces )
• Experience with source control tools such as GitHub and related CI/CD processes
• Ability to analyze a company's data needs
• Strong problemsolving skills
• Experience with the SDLC and Agile methodologies

• 8 hour shift
• Monday to Friday

• Baltimore, MD required)