DevOps Engineer - Summit, United States - Axelon
Description
Job description:
Your Required Skills5+ years of experience in building out Data pipelines in Python.
Strong knowledge of data warehousing, ETL processes, and database management.
Proficiency in data modeling, database design, and SQL.3+ years of experience developing and deploying pyspark/python scripts in cloud environment.3 + years of experience working in AWS Cloud especially services like S3, Glue, Lambda, Step Functions, DynamoDB, ECS etc.1+ years of hands-on experience in the design & development of data ingress/egress patterns on SnowflakeProficiency in Aurora Postgres database clusters on AWSFamiliarity with Orchestration tools like Airflow, Autosys, etcExperience with data lake/data marts/data warehouseProficiency in SQL, data querying, and performance optimization techniquesbility to communicate the status, challenges and proposed solution with the team.
Demonstrating the ability to learn new skills and work as a team.Knowledge of data security and privacy best practices.
Working knowledge of data governance and ability to ensure high data quality is maintained throughout the data lifecycle of a project.
Knowledge of data visualization and business intelligence tools (e.g., Tableau, Power to prioritize multiple tasks and projects and work effectively under pressure; exceptional organizational and administrative skills; at ease with abundance of details, yet mindful of big picture at all times.Strong analytical and problem-solving skills, with ability to conduct root cause analysis on system, process or production problems and ability to provide viable solutions.
Experience working in an Agile environment with Scrum Master/Product owner and ability to deliver.Your Desired Skills:
Good exposure to Containers like ECS or DockerPython API Development/Snowflake snowpark coding experienceStreaming or messaging knowledge with Kafka or Kinesis is desirable.