beBee background
Professionals
>
Engineering / Architecture
>
Rosemead
shiva neyyila

shiva neyyila

Lead ETL BIG DATA DEVELOPER
Rosemead, Los Angeles

Social


About shiva neyyila:

  • 11+ years of Overall experience in the IT industry and wide range of progressive experience in providing product specifications, design, analysis, development, documentation, coding, and implementation, maintenance of the business technology solutions in Data warehousing applications.
  • Overall experience Included with extensive experience of 6+ years in the Maintenance model of supporting Data warehouse applications including the Enhancements, Jobs monitoring and Incident resolution on data restoration issues.
  • Proficient in interacting with Business Analysts, Users and Business executives to understand the requirements and come up with innovative and efficient solutions by working with the data modelers and Architects part of Projects as well as Enhancements.
  • Has wide experience in leading, managing the projects and enhancements respectively included conducting the meetings for BRDs, Developing the TDD , build and testing , UAT ,implementation and Post implementation, maintenance of deliverables with close interaction with clients.
  • 9+ Years of Strong knowledge with Talend, Datastage tools Perspectives both Relational and Bigdata base systems performing – Data integration, Data Quality, Data load Monitoring and Support .
  • Extensive experience in development and maintenance in a corporate wide ETL solutions TALEND 6.x,7.x, DataStage, Microsoft SSIS using Flat files,SQL, PL/SQL on UNIX and Windows platforms.
  • Extensive experience working in RDMS Data warehouses like Teradata, SQL Server, and Oracle.
  • Extensive Experience in BIG DATA-Cloudera ecosystems like HDFS, HIVE, PYSPARK
  • Experience in Cloud based integration DW system Snowflake in creating the ingestion framework using Azure, integrated snowflake components like Snow pipe to build various set of load mechanisms like ‘File-DB’, ‘DB-DB’, ‘File-File’.
  • Experience in working with Reporting tools Microsoft SSRS, IBM Cognos in building the Adhoc and schedule Reports.
  • Experience in working with change data capturing tools IBM CDC in building the CDC Subscriptions and maintaining the same.
  • Involved in the design of various documents like HLD, LLD and DLD documents.
  • Extensively used ETL methodology for performing Data Profiling, Data Migration, Extraction, Transformation and Loading using Talend, Datastage and designed data conversions from wide variety of source systems including  Oracle, MySQL, SQL server, Hive and non-relational sources like flat/Excel files, XML files.
  • Expert hands-on experience in analysis and troubleshooting part of Data load Monitoring support.
  • Good Knowledge on Data Warehousing concepts like Star/Snowflake Schema for designing the Dimensions and Fact tables.
  • Expertised in creating complex Jobs and fine tune existing jobs to enhance performance.
  • Expert in working close with other IT group and co-ordinate projects

Experience

                                                                                                                                   

PROFESSIONAL SUMMARY:

  • 11+ years of Overall experience in the IT industry and wide range of progressive experience in providing product specifications, design, analysis, development, documentation, coding, and implementation, maintenance of the business technology solutions in Data warehousing applications.
  • Overall experience Included with extensive experience of 6+ years in the Maintenance model of supporting Data warehouse applications including the Enhancements, Jobs monitoring and Incident resolution on data restoration issues.
  • Proficient in interacting with Business Analysts, Users and Business executives to understand the requirements and come up with innovative and efficient solutions by working with the data modelers and Architects part of Projects as well as Enhancements.
  • Has wide experience in leading, managing the projects and enhancements respectively included conducting the meetings for BRDs, Developing the TDD , build and testing , UAT ,implementation and Post implementation, maintenance of deliverables with close interaction with clients.
  • 9+ Years of Strong knowledge with Talend, Datastage tools Perspectives both Relational and Bigdata base systems performing – Data integration, Data Quality, Data load Monitoring and Support .
  • Extensive experience in development and maintenance in a corporate wide ETL solutions TALEND 6.x,7.x, DataStage, Microsoft SSIS using Flat files,SQL, PL/SQL on UNIX and Windows platforms.
  • Extensive experience working in RDMS Data warehouses like Teradata, SQL Server, and Oracle.
  • Extensive Experience in BIG DATA-Cloudera ecosystems like HDFS, HIVE, PYSPARK
  • Experience in Cloud based integration DW system Snowflake in creating the ingestion framework using Azure, integrated snowflake components like Snow pipe to build various set of load mechanisms like ‘File-DB’, ‘DB-DB’, ‘File-File’.
  • Experience in working with Reporting tools Microsoft SSRS, IBM Cognos in building the Adhoc and schedule Reports.
  • Experience in working with change data capturing tools IBM CDC in building the CDC Subscriptions and maintaining the same.
  • Involved in the design of various documents like HLD, LLD and DLD documents.
  • Extensively used ETL methodology for performing Data Profiling, Data Migration, Extraction, Transformation and Loading using Talend, Datastage and designed data conversions from wide variety of source systems including  Oracle, MySQL, SQL server, Hive and non-relational sources like flat/Excel files, XML files.
  • Expert hands-on experience in analysis and troubleshooting part of Data load Monitoring support.
  • Good Knowledge on Data Warehousing concepts like Star/Snowflake Schema for designing the Dimensions and Fact tables.
  • Expertised in creating complex Jobs and fine tune existing jobs to enhance performance.
  • Expert in working close with other IT group and co-ordinate projects.

 

 

TECHNICAL SKILL SET:

 

 

ETL Tools

Talend, DataStage and Microsoft SSIS

 

Data Capturing Tools

IBM CDC 

 

Big Data Platforms

Hadoop, Snowflake

 

                RDBMS

 

Oracle 11g/10g/9i, MS SQL Server 2008/2005, MySQL, Teradata

 

BI/Reporting Tools

 

Microsoft SSRS, IBM Cognos

Programming SkillsSQL, Oracle PL/SQL, Unix Shell Scripting
ToolsTOAD, SQL Developer, Putty, SQL Server Management Studio
Operating SystemsWindows, Unix

 

 

 

 

 

 

Certifications / Professional Awards:

 

  • IBM certified Data stage developer.
  • Microsoft certified BI developer
  • Microsoft certified SQL server developer.
  • Infosys certified publishing domain professional.

 

PROJECT EXPERIENCE:

 

  1. Project Title: Managed Services Engagement – Customer Services              Jan 2017 – Till now
  2. Role: Senior Lead ETL / Big data 
  3. Client: One of the leading providers of utilities in USA 

Responsibilities:

  • Expertized  working in Production support model to Support Data warehousing applications involved change capture tools IBM CDC, Integration/ETL tools Data stage, Talend, RDBMS and non RDMS platforms Teradata, Hadoop and Snowflake with scope of Incident resolutions, Enhancements and data load monitoring, fixture.
  • Experienced in working with business users, business analysts, IT leads and developers in analyzing business requirements and translating requirements into functional and technical design specifications part of Enhancements and Projects.
  • Working on the Data Integration to perform data and application integration with goal of moving high volume data more effectively, efficiently and with high performance to assist in business-critical projects.
  • Worked on HIVE and IMPALA QL to get the load data into Hadoop from external sources
  • Worked on Datawarehouse migration project from Hadoop to snowflake using Microsoft Azure blob , Snow pipes and Talend cloud.
  • Worked on Multiple Migration projects implementing logic from DataStage jobs to Talend 7.1 and another project to Migrating 6.2 version jobs to 7.1 version.
  • Creating standard and best practices for  ETL components and jobs.
  • Performed Data Manipulations using various Talend Components like tMap, tjavarow, tjava, tOracleRow, tOracleInput, tOracleOutput, tMSSQLInput and Big data components.
  • Troubleshoot data integration issues and bugs, analyze reasons for failure, implement optimal solutions, and revise procedures and documentation as needed.
  • Creating Talend reusable components like routines, context variable and global Map variables.
  • Using Redwood to schedule ETL Jobs on daily, weekly, Monthly, and yearly basis.

 

Environment: Talend Bigdata 7.1/6.2,TAC,Hadoop, Snowflake, Datastage ,Teradata, IBM CDC, Flat Files, Oracle 11g, TOAD, SQL developer, MS Excel, UNIX Shell Scripts.

 

 

 

                                              

Project Title: Main frame migration and FAD EDW reporting program              Mar 2013 –Dec 2016

Role: Senior DW/ETL Developer   

Client: One of the leading providers of publishing in USA 

 

Responsibilities:

  • Participated in Requirements gathering, Business Analysis, User meetings and translating user inputs into ETL and Reporting mapping documents.
  • Involved in building the architecture and Source to Target mapping to load data into Data warehouse
  • Involved in ETL, Reporting design and documentation.
  • Developed DataStage jobs from the mapping documents and loaded the data into the warehouse.
  • Worked with Business, Data architect to understand the source to target mapping rules for the ETL jobs and BI reports. 
  • Prepared both High level and Low-level mapping documents.
  • Analyzed the requirements and framed the business logic and implemented it using Data stage and Cognos.
  • Troubleshoot database, jobs, source, and target to find out the bottlenecks and improved the performance. 
  • Involved in end-to-end Testing of Datastage  jobs.
  • Experience in working with large data warehouses, jobs and extracting data from legacy systems
  • Wrote complex SQL queries to take data from various sources and integrated it with Datastage.
  • Scheduling and Automation of ETL processes with Datastage Scheduler.
  • Involved in Data load monitoring in Trouble shooting the job failures.
  • Involved rigorously in Data Cleansing and Data Validation to validate the corrupted data and send back to client.
  • Migrated BI reports, ETL Jobs from Development to Test and to Production environment

 

  • Environment: Datastage, IBM Cognos, Oracle, SQL, MS Excel, UNIX Shell Scripts.

 

 

 

Project Title: Eastern BI Reporting Program                                                             Jun 2012 –Feb 2013

Role: BI/ETL Developer   

Client: One of the leading providers of Services in USA

 

Responsibilities:

                                                    

  • Developed ETL jobs for prestaging and staging areas with all business rules, transformation rules incorporated with them.
  • Developed Adhoc reports accommodating all the business requirements by translating to the technicalities in the dimension and fact tables to pull the fields to in line with the reporting requirements.
  • Implemented different matching rules, data validation rule to get the golden record.
  • Understanding overall high level ETL process flow.
  • Developing jobs, reports, and unit testing to make sure all business rules, transformation rules applied correctly, Performance tuning of developed jobs and reports.
  • Worked on SQL SERVER database, Flat files etc.
  • Efficiently involved in creating mappings to build Business reports based on the requirement
  • Deployment of code to TEST, PROD by exporting jobs, reporting template to shared location.

Environment:  Microsoft SSIS, SSRS, SQL SERVER 2008, MS Excel, UNIX Shell Scripts.

 

Personal Information:

 

  • Gender                        : Male  
  • Marital Status             : Married         
  • Visa Details                    : H1B

Education

 

 

  • Bachelor of Technology in Electronics & Communication Engineering from Aditya Institute of Technology and Management, Tekkali, Andhra Pradesh, India.

Professionals in the same Engineering / Architecture sector as shiva neyyila

Professionals from different sectors near Rosemead, Los Angeles

Jobs near Rosemead, Los Angeles


  • Los Angeles County (CA) Los Angeles, CA, United States

    Position/Program Information · FIRST DAY OF FILING: · June 1, 2023 at 8:00 A.M. (PDT) · Until the needs of the services are met and is subject to closure without prior notice. · EXAM NUMBER: · Y8162A · TYPE OF RECRUITMENT: · OPEN COMPETITIVE JOB OPPORTUNITY · NO OUT-OF-CLASS EXPE ...


  • UnitedHealth Group Torrance, United States

    Compassion. It's the starting point for health care providers like you and it's what drives us every day as we put our exceptional skills together with a real feeling of caring for others. This is a place where your impact goes beyond providing care one patient at a time. Because ...


  • Sittercity Los Angeles, United States Full time

    I am a travel nurse working nightshift down at Children's Hospital Los Angeles and in need of a overnight sitter 6pm to 8:30am, my kids are homeschooled · Need a sitter to spend the night, making sure kids are in bed by no later than 10pm. · Hyatt House LA University Medical Cent ...