Data Engineer - Chicago, United States - RK Management Consultants

    RK Management Consultants
    RK Management Consultants Chicago, United States

    2 weeks ago

    Default job background
    Description


    Are you an experienced Data Engineer seeking new opportunities? Look no further Our direct client, a prominent financial services company, is actively seeking talented individuals like you to join their team.


    Check out the job details below and apply today to take the next step in your careerMust have Skills:4+ years of work experience in Data Platform Administration/Engineering, or relatedHands on experience with Amazon Web Services (AWS) based solutions such as Lambda, Dynamo dB, Snowflake and S3.Knowledge of Data Warehouse technology (Unix/Teradata/Ab Initio/Python/Spark/Snowflake/No SQL).Experience in migrating ETL processes (not just data) from relational warehouse Databases to AWS based solutions.

    Experience in building & utilizing tools and frameworks within the Big Data ecosystem including Kafka, Spark, and NoSQL.Deep knowledge and very strong in SQL and Relational Databases.

    Knowledge of Data Warehouse technology (Unix/Teradata/Ab Initio).Willingness to continuously learn & share learnings with others.
    Ability to work in a fast-paced, rapidly changing environment.
    Very strong verbal & written communication skills.
    Experience within the Financial industry.
    Experience with programming languages like Java or Python services and build highly available environment using proper design patterns.
    Proven experience in software development methodologies.
    Strong analytical skills and ability to multi-task.
    Experience as part of an Agile engineering or development team.
    Strong experience working with a relational database and NoSQL database.

    Strong experience with CI/CD pipelines with Jenkins or similar; Git/GitHub; ArtifactoryExperience with Test Driven Development (TDD).Experience writing unit and service level tests to ensure adequate code coverage.

    Proven skills in high availability and scalability design, as well as performance monitoring.
    Experience developing and implementing API service architecture.
    Experience in working in a cloud environment such as AWS, GCP or Azure.
    Experience provisioning infrastructure with Terraform and Cloud Formation.
    Understanding of messaging systems like MQ, Rabbit MQ, Kafka, or Kinesis.
    Ability to adapt communication for effectiveness with business partners and other technical teams.


    Preferred Skills:
    Strong experience working with a relational database and NoSQL database.
    Experience with Test Driven Development (TDD).Experience provisioning infrastructure with Terraform and Cloud Formation.

    ETL/ELT Tools (AbInitio, DataStage, Informatica)Cloud Tools and Databases (AWS, Snowflake)Other programming languages (Unix scripting, Python, etc.)Leverage CI/CD framework for data integration, Open SourceBasic understanding of key infrastructure concepts (data centers as well as cloud hosting platform) to support business data needs.

    Experience optimizing SQL both relational and NoSQL#J-18808-Ljbffr