Senior BigData Engineer - Wilmington, United States - ICS Global Soft INC

Description

Job Description

Hi.,

Hope you are doing well.

This is Krishna from ICS Global Soft Inc. Kindly find the belowjob description and let me know your availability.

Requirement:

Role: Senior BigData Engineer

Location: Wilmington, DE

Duration: Multi-Year Contract

Job Description:

•Will join a growing team buildinga modernized Data Ecosystem.

•Responsible for expanding andoptimizing data and data pipeline architecture, modernizing data ecosystem withopen source technologies as well as optimizing data flow and collection forcross functional teams.

•Project Details: Datamodernization project from scratch. Theyare taking their legacy data platform and migrating everything into AWS. Theywill be analyzing current platform, planning and designing how to set up thenew data/ETL pipelines, then start coding.

Technical Experience:

•Big data tools: Hadoop, ApacheSpark, Kafka, etc.

•Relational SQL, Snowflake andNoSQL databases, including Postgres and Cassandra.

•Data pipeline and workflowmanagement tools: NiFi, Kylo, Luigi, Airflow, Azkaban etc.

•AWS cloud services: S3, EC2, EMR,RDS, Redshift

•Stream-processing systems: Storm,Spark-Streaming, etc.

•Object-oriented/object functionscripting languages: Python, Java, C++, PySpark, Scala

General Responsibilities:

•Create and maintain optimal datapipeline architecture.

•Assemble large, complex data setsthat meet functional / non-functional business requirements.

•Identify, design, and implementinternal process improvements: automating manual processes, optimizing datadelivery, re-designing infrastructure for greater scalability, etc.

•Build the infrastructure requiredfor optimal extraction, transformation, and loading of data from a wide varietyof data sources using SQL and AWS 'big data' technologies.

•Build analytics tools thatutilize the data pipeline to provide actionable insights into customeracquisition, operational efficiency and other key business performance metrics.

•Workwith stakeholders including the Executive, Product, Data and Design teams toassist with data-related technical issues and support their data infrastructureneeds.

Best Regards

Krishna Chalasani

RecruitmentLead

1231 Greenway Drive | Ste 375 | Irving, TX 75038

E-mail:

Office: | Cell:

LinkedIn

NMSDC Certified | Certified Minority Business Enterprise (MBE), SBE | AnE-Verify company

According to Bill S.1618 Title III passed by the 105th US Congress, thismessage is not considered as "Spam" as we have included the contactinformation. If you wish to be removed from our mailing list, please respondwith "remove" in the subject field. We apologize for anyinconvenience caused..