Hadoop Developer - Chicago, United States - Dexian - Signature Consultants

Description

Job Summary:

Dexian is seeking a Hadoop Developer for an opportunity with a client located in Chicago, IL.

Responsibilities:

• Build SQL/HIVE databases and tables
• Developing distributed computing Big Data applications using Spark, Elastic Search on HDP Hadoop
• Identify, capture and communicate the issues and risks promptly
• Coding various Services, Components, and participating in the development of Java and Big Data/Hadoop processes
• Conduct/Lead technical discussions with internal and external stakeholders
• Coordinate with cross-functional teams , testing teams and drive resolution of open items and issues
• End-to-end technology delivery for key strategic and regulatory projects
• Understand business requirements through user stories and user centred design, and identification of appropriate solutions
• Production of solution designs that meet the business requirements and are deliverable and supportable
• Experimentation with minimum viable products to verify best technology choices and solution design

Requirements:

• Strong SQL Skills - one or more of MySQL, HIVE, Impala, SPARK SQL
• Data ingestion experience from message queue, file share, REST API, relational database, etc. and experience with data formats like json, csv, xml
• Experience working with SPARK Structured steaming preferred
• Experience working with Hadoop/Big Data and Distributed Systems
• Experience working with admin/prod support/debugging
• Working experience with Spark, Sqoop, Kafka, MapReduce, NoSQL Database like HBase, SOLR, CDP or HDP, Cloudera or Hortonworks, Elastic Search, Kibana, etc
• Hands on programming experience in at least one of Scala, Python, PHP, or Shell Scripting, to name a few
• Performance tuning experience with spark /MapReduce and/or SQL jobs
• Experience and proficiency with Linux operating system is a must
• Experience in end-to-end design and build process of Near-Real Time and Batch Data Pipelines
• Experience working in Agile development process and deep understanding of various phases of the Software Development Life Cycle
• Experience using Source Code and Version Control systems like SVN, Git, Bit Bucket etc
• Experience working with Jenkins and Jar management
• Self-starter who works with minimal supervision and the ability to work in a team of diverse skill sets
• Ability to comprehend customer requests and provide the correct solution
• Strong analytical mind to help take on complicated problems
• Desire to resolve issues and dive into potential issues
• Ability to adapt and continue to learn new technologies is important
  
  

Dexian is a leading provider of staffing, IT, and workforce solutions with over 12,000 employees and 70 locations worldwide. As one of the largest IT staffing companies and the 2nd largest minority-owned staffing company in the U.S., Dexian was formed in 2023 through the merger of DISYS and Signature Consultants. Combining the best elements of its core companies, Dexian's platform connects talent, technology, and organizations to produce game-changing results that help everyone achieve their ambitions and goals.

Dexian's brands include Dexian DISYS, Dexian Signature Consultants, Dexian Government Solutions, Dexian Talent Development and Dexian IT Solutions. Visit

Dexian is an Equal Opportunity Employer that recruits and hires qualified candidates without regard to race, religion, sex, sexual orientation, gender identity, age, national origin, ancestry, citizenship, disability, or veteran status.