Jobs
>
San Jose

    AWS Data Lake Technical Lead - San Jose, United States - My3Tech

    My3Tech
    My3Tech San Jose, United States

    3 weeks ago

    Default job background
    Technology / Internet
    Description

    Job Title: AWS Data Lake Technical Lead

    Job Location: REMOTE with Vocational Onsite Visits at Waterbury, VT (Travel Expenses will be reimbursed)

    Duration: 3+ Years Contract

    Job Description:

    Background:

    Client is seeking to improve statewide law enforcement data access. The purpose is to design and implement a state-controlled system to access de-identified, aggregated law enforcement and related data currently housed in a record management system.

    Client in collaboration with the Agency of Digital (ADS) Services, is seeking to procure Amazon Web Service (AWS) professional services to work with the ADS Technical Lead to build out the Public Services Lakehouse environment.

    Existing Technology Environment

    Client currently uses a Computer Aided Dispatch Records Management System (CAD RMS) system that is currently running in a MySQL instance that will be used in the first phase of the Data Lake build. The supplemental data ranges from SQL server instances and flat file sources that are currently housed internally either in SharePoint or internal file stores.

    Requirements:

    Design and implement the Clients' Data Lake in the AWS Environment

    • Store Data in AWS CJIS compliant environment.
    • Implement and design the lake house technologies with the IT Tech Lead
    • assigned to the project.
    • Design and implement using latest AWS Lake House standards.
    • Data Security Layer
    • Implement and design security Identity and Access Management roles and processes.
    • Design and Create security IAM templates.
    • Data Ingestion Layer
    • Ingestion Design for variety of sources
    • Operational Database Sources
    • MySQL, SQL Server
    • SaaS Applications
    • File Shares (SharePoint and one drive)
    • Stream Data Sources
    • System Templates of ingestion processes
    • Data Storage Layer
    • AWS S3 CJIS compliant S3 buckets
    • AWS Redshift Infrastructure
    • Power BI Connector process
    • Data Processing Layer
    • Data Extract, Load and Transform (ELT) process for loading from source to S3 and Transforming data from S3 to Redshift for reporting and analytics.
    • Templates for creating ELT processes for future processes.
    • Data Catalog Layer
    • Design and implement solution to solve data schema drift in AWS Glue for use with reporting and analytical needs.
    • Design and build crawlers for schema and build catalog that stores schema information.
    • Meta data store in catalog for consumption in data warehouse
    • Create Catalog crawler templates for data sources.
    • Create Templates for expansion of the data lake for future agencies.
    • Base data warehouse implemented environment for reporting/dashboard use.
    • Template designs for future data Lakehouse implementations.
    • Lake House design needs to be able to be used by Power BI
    • Design each layer for scaling based on usage.

    Professional Service Requirements:

    • AWS Lakehouse Certification
    • AWS Design and Implementation Lake House Technologies
    • AWS IAM
    • AWS Lakehouse Technology
    • AWS Glue Knowledge
    • Data Catalog and Crawler
    • AWS Redshift
    • AWS Athena
    • CJIS certified data storage
    • AWS CJIS Data location
    • CJIS Security Background Check (See Additional Attachments / Assurances)
  • Electronic Arts

    Technical Lead

    3 weeks ago

    Electronic Arts Redwood City, United States

    Welcome to Maxis, home to tinkerers, craftspeople, & storytellers. Our drive is to inspire everyone to make a better world through creative play. As the developer of The Sims, we create games and experiences for millions of people around the world and are always looking for new w ...

  • Wipro

    Technical Lead

    2 days ago

    Wipro San Jose, United States

    About Wipro: · Wipro Limited (NYSE: WIT, BSE: 507685, NSE: WIPRO) is a leading technology services and consulting company focused on building innovative solutions that address clients' most complex digital transformation needs. We leverage our holistic portfolio of capabilities ...

  • GlobalSoft

    Technical Lead

    3 weeks ago

    GlobalSoft San Jose, United States

    Globalsoft Inc. has opening for Technical Lead at its office in San Jose, CA. The person will be involved in designing, developing and testing software systems. Perform planning; implement and troubleshoot software problems. Optimize software system performance. Analyze user need ...

  • Wipro Technologies

    Technical Lead

    17 hours ago

    Wipro Technologies San Jose, United States

    About Wipro: · Wipro Limited (NYSE: WIT, BSE: 507685, NSE: WIPRO) is a leading technology services and consulting company focused on building innovative solutions that address clients' most complex digital transformation needs. We leverage our holistic portfolio of capabilities i ...

  • Wipro Limited

    Technical Lead

    3 weeks ago

    Wipro Limited San Ramon, United States

    Overview: · **Role Purpose** · - The purpose of the role is to support process delivery by ensuring daily performance of the Production Specialists, resolve technical escalations and develop technical capability within the Production Specialists. _ · **Do** · - **Oversee and supp ...

  • HCLTech

    Technical Lead

    2 weeks ago

    HCLTech San Jose, United States

    Job Overview: · Potential candidate must have Electro-Mechanical product design experience with Telecom & Networking background. · Job Qualification: · • Strong experience in sheet metal design (and / or plastic design), Electro-mechanical product design and good understanding of ...

  • HCLTech

    Technical Lead

    1 week ago

    HCLTech San Jose, United States

    Job Overview: · Potential candidate must have Electro-Mechanical product design experience with Telecom & Networking background. · Job Qualification: · Strong experience in sheet metal design (and / or plastic design), Electro-mechanical product design and good understanding of m ...

  • Alert Enterprise

    Technical Lead

    1 week ago

    Alert Enterprise Fremont, United States

    AlertEnterprise Technology is about powering the future with Technology and make enterprises · and the world a safer place. We are at the heart of shaping and driving technology disruption · and digital transformation for our clients running AlertEnterprise products. We set the d ...

  • QData

    Technical Lead

    2 weeks ago

    QData San Jose, United States contract

    Responsibilities & Duties To be responsible for managing technology in projects and providing technical guidance / solutions for work completion To be responsible for providing technical guidance / solutions To develop and guide the team members in enhancing their technical capab ...

  • Netskope

    Technical Lead

    2 weeks ago

    Netskope Santa Clara, United States

    About Netskope · Today, there's more data and users outside the enterprise than inside, causing the network perimeter as we know it to dissolve. We realized a new perimeter was needed, one that is built in the cloud and follows and protects data wherever it goes, so we started N ...

  • PamTen

    Salesforce Technical Lead

    3 weeks ago

    PamTen San Jose, United States

    Job Title: Salesforce Technical Lead · Key Responsibilities: · - Lead the technical design and development of Salesforce solutions, including customizations, integrations, and data migration. · - Collaborate with business stakeholders to understand their requirements and trans ...

  • Resource Logistics

    Technical Lead-API

    17 hours ago

    Resource Logistics San Jose, United States

    Join to apply for the · Technical Lead-API · role at · Resource Logistics Inc. · 1 week ago · Be among the first 25 applicants · Join to apply for the · Technical Lead-API · role at · Resource Logistics Inc. · Save this job with your existing LinkedIn profile, or create a ...

  • PamTen

    Salesforce Technical Lead

    3 weeks ago

    PamTen San Jose, United States

    Job Title: Salesforce Technical Lead · Key Responsibilities: · - Lead the technical design and development of Salesforce solutions, including customizations, integrations, and data migration. · - Collaborate with business stakeholders to understand their requirements and transla ...

  • Tata Consultancy Services

    Java Technical Lead

    3 weeks ago

    Tata Consultancy Services San Jose, United States

    #LI-CM2 Job Title · Java Technical Lead · (in Yrs) · 10-15 years · Must Have Technical/Functional Skills · Java, API Gateway, Mongo DB · Good to Have : Elastic Search and Kafka · Technical Project Lead who Interacts with Web Services: WCF & REST. · Design and implement solut ...

  • CVM Inc.

    Technical Lead/manager

    1 week ago

    CVM Inc. Pleasanton, United States

    We're seeking an technical lead manager to spearhead the expansion of CVM's growing business. CVM Inc is a custom machine designer, builder, and technical partner for a variety of industries including medical device, food processing, agriculture, injection molding, construction, ...

  • Omega Solutions

    Technical Project Lead

    3 weeks ago

    Omega Solutions Santa Clara, United States

    Title: Technical Project Lead - Infrastructure · Duration: Long Term · Location: Santa Clara, CA - Onsite · Job Description · Provide operating system Refresh and Imaging services for new Client devices in a timely and efficient manner to meet the Client's schedule in its Win ...

  • Archer Aviation

    Sr Technical Operations Lead

    2 weeks ago

    Archer Aviation San Jose, United States

    What You'll Do · * Build and operate integrated test labs for one of the world's first FAA certified eVTOL aircraft · * Manage work orders in JIRA and assign to technicians to execute builds and modifications to test labs · * Maintain lab documentation for lab modifications, repa ...

  • TalentBurst, an Inc 5000 company

    Loan IQ Technical Lead

    2 weeks ago

    TalentBurst, an Inc 5000 company San Jose, United States

    Loan IQ Tech Lead · Location: Fully Remote · Duration: 12 Months+ · Job Description: · The Loan IQ Tech Lead will join the Commercial Delivery team and be part of ongoing delivery initiatives to onboard clients to the Loan IQ platform. This role partners extensively with the appl ...

  • PayPal

    Lead Technical Product Manager

    1 week ago

    PayPal San Jose, United States

    San Jose, California, United States of America · Technical Product Management · Lead Technical Product Manager · San Jose, California, United States of America · ID: R0109614 · Job Description · Time Type: · Full time · At PayPal (NASDAQ: PYPL), we believe that every person ha ...

  • Omega Solutions

    Salesforce Technical Lead

    3 weeks ago

    Omega Solutions Santa Clara, United States

    : · Underlimitedsupervision,managesprojectsthroughthefulllifecyclefromprojectdefinitionandapprovalthroughimplementationandevaluationofallprojectdeliverables.Providesguidancetotheprojectteam.Mayalsoserveinaleadrole. · Duties/Responsibilities: · • Musthaveahands-onsalesforcedeve ...