Data Management - McLean, United States - Mediabistro

    Default job background
    Description
    Job Description: We would like to have a very senior hands on person in addition to having the ability to actively engage/contribute to data architectural solutions that would have deep knowledge on below technologies

    Daily Responsibilities

    • attending team stand up (Mon-Thur) to report progress on the work
    • following Agile practice in general and attend Agile ceremonies.
    • hands on focus on building our new Glue platform
    • once platform is built, continuous migrate different ETL pipelines to the platform
    • needs to be able to work within the team as well as out side the team
    • needs to take rotation on production support
    • needs to be flexible on ad-hoc request from leadership or partners

    Qualifications

    • Extensive knowledge in Python and SQL, good understanding in Java
    • AWS - should have AWS developer or architect certification and atleast 3 years experience developing on AWS Cloud.
    • ETL(Batch and Real Time) - should have solid working experience with ETL application, both Batch and Real Time
    • Glue - should have solid working experience with AWS Glue technology
    • Hadoop, EMR, Spark - should have solid working experience with EMR and Spark application
    • Lambda, S3 - Should have good experience in using AWS services.
    • Would be nice to have experience with Snowflake, Databricks
    #J-18808-Ljbffr