beBee background
Professionals
>
Technology / Internet
>
Baltimore
sreeja p

sreeja p

Data Engineer

Technology / Internet

Baltimore, Baltimore

Social

About sreeja p:

 I've been working in big data ecosystems like Spark, Hive, Athena, Python, Pyspark, Redshift, AWS kinases, and DynamoDB. I’m currently working in architecture where we ingest data both in batch and real-time. for batch, we ingest data from Teradata and SQL Server land data in S3, write Pyspark ETL scripts to read data from S3, and do all the computations in Spark and EMR, write data back into Hive and Athena, and I also export the latest snapshot data into Redshift for analytical purposes, where we have visualization developers that build Power bi / Tableau dashboards on top of that, for real-time I write Spark streaming applications where we ingest data from AWS kinases and write data into DynamoDB for API consumption. our downstream consumers are stakeholders, data scientists, and other engineering teams as well. We use airflow DAGs to schedule all the workflows we develop in Python, and that's pretty much about my experience in my current project as well.
 

Experience

 I've been working in big data ecosystems like Spark, Hive, Athena, Python, Pyspark, Redshift, AWS kinases, and DynamoDB. I’m currently working in architecture where we ingest data both in batch and real-time. for batch, we ingest data from Teradata and SQL Server land data in S3, write Pyspark ETL scripts to read data from S3, and do all the computations in Spark and EMR, write data back into Hive and Athena, and I also export the latest snapshot data into Redshift for analytical purposes, where we have visualization developers that build Power bi / Tableau dashboards on top of that, for real-time I write Spark streaming applications where we ingest data from AWS kinases and write data into DynamoDB for API consumption. our downstream consumers are stakeholders, data scientists, and other engineering teams as well. We use airflow DAGs to schedule all the workflows we develop in Python, and that's pretty much about my experience in my current project as well.
 

Education

masters in Data Science 
bachelor's in Computer Science and engineering

Professionals in the same Technology / Internet sector as sreeja p

Professionals from different sectors near Baltimore, Baltimore

See professionals near Baltimore, Baltimore

Jobs near Baltimore, Baltimore

  • Gail Bugg - State Farm Agent

    office representative

    Found in: MyJobHelper US C2 - 2 days ago

    Gail Bugg - State Farm Agent , MD, United States

    Position Overview · Do you have aspirations to run your own business? If so, you may want to consider working in the office of Gail Bugg - State Farm Agent. As a member of our agency team, you have an opportunity to experience first-hand what it takes to be a State Farm Agent. Yo ...

  • AstraZeneca

    Principal Engineer

    Found in: Lensa US 4 C2 - 1 day ago

    AstraZeneca Baltimore, United States

    Our Frederick Manufacturing Center (FMC) creates life-changing medicines for people around the world and has been recognized by our local community as being a Top 50' Business in Frederick and awarded Frederick County's 'Best Place to Work'. This distinctive biologic manufacturin ...

  • Johns Hopkins Medicine

    operations supervisor

    Found in: beBee S2 US - 1 week ago

    Johns Hopkins Medicine Baltimore, United States Full time

    The Operations Supervisor will work within the Public Safety Dept. and is responsible for the effective and efficient management of either the internal or external security effort at Johns Hopkins Hospital. · Provides direction and management for a team of security officers to e ...

See jobs in Baltimore, Baltimore