Jobs
>
New York City

    Cloud Data Platform Engineer - New York, United States - Global Channel Management

    Global Channel Management
    Global Channel Management New York, United States

    2 weeks ago

    Default job background
    Description

    About the job Cloud Data Platform Engineer

    Cloud Data Platform Engineer needs 5+ years implementing data applications or data platforms with BigData/Hadoop, Python/Java/Spark full stack, etc.

    5+ year support experience of Big Cloud Data Platform Engineer requires:

    • 3 days a week, hybrid
    • Locations: Iselin, NJ, Charlotte, NC, N Y, NY
    • Data Engineering 60-70 %.
    • Infrastructure 30-40%. (Moving Data in & Out of cloud)
    • Snowflake exp is preferred
    • Masters or Bachelor's degree in computer science or related discipline
    • Manage and ensure delivery of project tasks as required
    • Excellent documentation skills to create and manage design, implementation and automation related documentation
    • Implementation experience for Hadoop distribution platforms like Cloudera or AWS EMR.
    • Extensive experience in designing, engineering and managing data lake ingestion, validation, transformation and consumption services leveraging cloud data tools like Hive, Spark, EMR, Glue ETL and Catalog, Snowflake etc.
    • Experience on implementing solutions with Worflow orchestration/scheduling tools such as Airflow, Autosys etc.
    • Experience building CI/CD pipelines for infrastructure implementations with Teraform, Gitlab etc.
    • Must be ability to multi-task and prioritize tasks for self
    • Must experience working in agile environment with multiple priorities
    Preferred Skills:
    • 5+ years implementing data applications or data platforms with BigData/Hadoop, Python/Java/Spark full stack, etc.
    • 5+ year support experience of Big Data technologies in Hadoop ecosystem Hive, HDFS, MapReduce, Spark, Yarn, Kafka, Pig, HBase, Sqoop, Elastic Search, Kerberos.
    • 5+ years experience with ETL/ELT tools such as AWS Glue ETL, Talend, Datastage etc.
    • 5+ years experience with Orchestration tools such as Airflow, Autosys etc.
    • Experience with Jira and Agile methodology is a plus;
    • Experience with understanding DevOps or CI/CD process w.r.t to infrastructure management activities
    Cloud Data Platform Engineer duties:
    • Design, develop and deliver cloud datastore solutions and develop automation pipelines to migrate data sets from On-prem to Cloud platforms. Practice Infrastructure as code to develop automation routines and integration flows to manage state of the datastore platform systems
    • Provision secures from start datastores and enable them with required security controls including encryption, masking, certificate/keys rotation etc.
    • Collaborates with developers, analysts, various system administrators to identify business requirements in designing efficient datastore solutions and interfaces.
    • Identifies and documents all system constraints, implications, and consequences of various proposed system changes.
    • Reviews technical documentation to guide system users and to assist with the ongoing operation, maintenance, and development of the system. Evaluates the efficiency and effectiveness of application operations and troubleshooting problems.
    • Provide expert level IT technical lead services, including the direction, evaluation, selection, configuration, implementation, and integration of new and existing technologies and tools in a cloud platform.
  • REWE Gruppe

    IT Engineer Integration Platform

    3 weeks ago

    REWE Gruppe New York, United States

    Wählen Sie aus, wie oft (in Tagen) Sie eine Benachrichtigung erhalten möchten: · Jobticker anlegen · Ort: · 51149 Köln | · Vertragsart: · Vollzeit, unbefristet | · Job-ID: · 836336 · Wir sind das Zuhause für alle Techies – oder alle, die sich in der Tech-Welt wohlfühlen. Hi ...

  • Acceler8 Talent

    Platform Engineer

    3 weeks ago

    Acceler8 Talent New York, United States

    Backend Platform Engineer Location: San Francisco (flexible/hybrid) · At our company, you'll have the opportunity to: · Engineer a data platform and engage in cutting-edge MLOps under the mentorship of distinguished MIT PhDs who are leaders in systems and ML research. · Spearhea ...

  • MRINetwork Jobs

    Platform Engineer

    2 weeks ago

    MRINetwork Jobs New York, United States

    Job Description · Job DescriptionPrior US work authorization required - thank you. · Please, no 3rd party applications - direct submissions only - no C2C - thank you. · This role is not a SQL, data warehouse, data pipeline position. · The firm is embarked on a state-of-the-art en ...

  • ICTerGezocht

    Platform Engineer

    4 weeks ago

    ICTerGezocht New York, United States

    Heel relevant · Vacature in het kort Dive into the world of Azure Data Platform Engineering and become a key player in evolving our platforms. You'll have the chance to build and manage components that empower users to create scalable, automated pipelines. Your innovative approac ...

  • MongoDB

    Platform Engineer

    3 weeks ago

    MongoDB New York, United States

    The worldwide data management software market is massive (According to IDC, the worldwide database software market, which it refers to as the database management systems software market, was forecasted to be approximately $82 billion in 2023 growing to approximately $137 billion ...

  • Celonis

    Platform Engineer

    3 weeks ago

    Celonis New York, NY, United States

    We're Celonis, the global leader in Process Mining technology and one of the world's fastest-growing SaaS firms. We believe there is a massive opportunity to unlock productivity by placing data and intelligence at the core of business processes - and for that, we need you to join ...

  • Celonis GmbH

    Platform Engineer

    4 weeks ago

    Celonis GmbH New York, United States

    We're Celonis, the global leader in Process Mining technology and one of the world's fastest-growing SaaS firms. We believe there is a massive opportunity to unlock productivity by placing data and intelligence at the core of business processes - and for that, we need you to join ...

  • Palantir Technologies

    Platform Engineer

    2 weeks ago

    Palantir Technologies New York, United States

    A World-Changing Company · Palantir builds the world's leading software for data-driven decisions and operations. By bringing the right data to the people who need it, our platforms empower our partners to develop lifesaving drugs, forecast supply chain disruptions, locate missin ...

  • Automatic Data Processing

    Platform Engineer

    3 weeks ago

    Automatic Data Processing New York, United States

    ADP Technology Services, Inc. is hiring a Platform Engineer in our New York City, NY location. Are you empathetic to client needs and inspired by transformation and impacting the lives of millions of people every day? Are you looking to join a dynami Platform Engineer, Engineer, ...

  • Motion Recruitment

    Platform Engineer

    3 weeks ago

    Motion Recruitment New York, United States

    A healthcare company is looking to expand their growing team by adding a Platform Engineer The ideal candidate will have a heavy coding background, preferrably in Python. You will also work closely with senior leadership and collaborate with other teams. · Requirements: · 5+ ye ...

  • ADP

    Platform Engineer

    3 days ago

    ADP New York, United States

    Job Description · ADP Technology Services, Inc. is hiring a Platform Engineer in our New York City, NY location. · Are you empathetic to client needs and inspired by transformation and impacting the lives of millions of people every day? · Are you looking to join a dynamic, inclu ...

  • Unreal Gigs

    Platform Engineer

    2 weeks ago

    Unreal Gigs New York, United States

    Job Description · Job DescriptionAbout Us · We're revolutionizing the way analysts evaluate and act on deals by simplifying the review process for potential opportunities. Through cutting-edge language models, we provide a platform that not only organizes information but also off ...

  • ADP

    Platform Engineer

    3 weeks ago

    ADP Cooper, NY, United States

    ADP Technology Services, Inc. is hiring a Platform Engineer in our New York City, NY location. · Are you empathetic to client needs and inspired by transformation and impacting the lives of millions of people every day? · You strive to learn new technologies and find ways to in ...

  • ADP

    Platform Engineer

    1 week ago

    ADP New York, United States Full time

    ADP Technology Services, Inc. is hiring a Platform Engineer in our New York City, NY location. · Are you empathetic to client needs and inspired by transformation and impacting the lives of millions of people every day? · Are you looking to join a dynamic, inclusive team environm ...

  • ADP

    Platform Engineer

    3 weeks ago

    ADP Cooper, NY, United States

    ADP Technology Services, Inc. is hiring a Senior Platform Engineer in our New York City, NY location. · Are you empathetic to client needs and inspired by transformation and impacting the lives of millions of people every day? · You strive to learn new technologies and find way ...

  • ADP

    Platform Engineer

    1 week ago

    ADP New York, United States

    ADP Technology Services, Inc. is hiring a Platform Engineer in our New York City, NY location. · Are you empathetic to client needs and inspired by transformation and impacting the lives of millions of people every day? · Are you looking to join a dynamic, inclusive team environm ...

  • Open Systems Technologies

    Platform Infrastructure Engineer

    3 weeks ago

    Open Systems Technologies New York, United States

    A financial firm is looking for a Platform Infrastructure Engineer to join their team in New York, NY.Compensation: $150-200kQualifications:A Bachelor's Degree in Computer Science, Engineering, or related technical field 10 years of DevOps, TechOps, or SRE experience with 5 years ...

  • Radley James

    Cloud Platform Engineer

    4 weeks ago

    Radley James New York, United States

    Company: · Join a dynamic and innovative trading firm based in the vibrant city of Miami They're at the forefront of the financial industry, utilizing cutting-edge technology and strategic insights to drive success in global markets. As they expand their operations, they're seeki ...

  • Considine Search

    Sharepoint Platform Engineer

    3 weeks ago

    Considine Search New York, United States

    Our client, an elite Global Law firm, is seeking a Sharepoint Platform Engineer. · Summary · Under the direct supervision of the Senior Application Development Manager, this individual will be responsible for the design, development, implementation, maintenance and support of Sha ...

  • Writer Corporation

    Senior platform engineer

    2 weeks ago

    Writer Corporation New York, United States

    About Writer · AI your people will love. That's our vision, and it contains multitudes :-) · AI · your people · will love. · We're filling a big need for generative AI built ground-up for the needs of enterprises and embraced by their teams. As generative AI became a board-l ...