Big Data - Plano, United States - Virtusa

    Default job background
    Description
    • Develop and maintain data platforms using Python, Spark, PySpark
    • Handling migration to PySpark AWS
    • Work with AWS and Big Data, design and implement data pipelines, and ensure data quality and integrity.
    • Collaborate with cross functional teams to understand data requirements and design solutions that meet business needs.
    • Implement and manage agents for monitoring, logging, and automation within AWS environments