Hadoop Developer - Jersey City, United States - The AES Group

Description

Title: Hadoop Developer

Job location: Jersey City, NJ (Hybrid) (W2).

Job Duration: 12+ Months (Possible Extension)

Visa: USC/GC only (W2)

Note:: Require Candidate in HDFS, HBase, Hive, or Cloudera. Good Experience with Spark(Pyspark) Codebase: Python preferred

Job Description

A key contributor to development initiatives that require Hadoop technical expertise across numerous components

Effectively partner with internal and external technical resources to define and design solutions to meet Business needs

Design, develop, enhance, debug, support, maintain, and test software applications that support Business units

Provide innovative solutions to problems and drive the design/development of components

Effectively conveys the message in both written and verbal development discussions

Expertise and demonstrated experience in Hadoop ecosystem components: HIVE, HDFS, SPARK

Strong grasp and experience in PySpark (2.4 or higher) development

Skilled in Bigtable design, with HBASE experience preferred

Strong knowledge of Impala, including demonstrated experience in optimized view design

Knowledge and implementation experience with RESTer API

Strong SQL knowledge and data analysis skills

Familiarity and experience with Autosys scheduler

Experience in Unix shell scripting.

Strong working experience in Agile methodology

Working experience with Autosys or other Scheduler tools

Scala experience is preferred, but not required

Familiarity with Python or Java programming language is strongly preferred

Familiarity and working experience with HIVE 3.0 (CDP platform) preferred

UI/UX development experience strongly preferred

Banking domain experience (especially in compliance and risk)