
Pavan S
Data Engineer Snowflake
Technology / Internet
About Pavan S:
- Over thirteen (13) years of IT experience with extensive Data Warehousing implementations across Retail, Insurance, Financial and Communication Industries.
- Over Eight (9) years of ETL and data integration experience in developing ETL mappings and scripts using Informatica PowerCenter
- Over Five (5) years of ETL and data integration experience in developing Graphs and scripts using AbI Inito and Talend
- Experience On migration projects (Informatica, Teradata to Abi Intio and Hadoop (data ecosystem) & snowflake
Experience
- Over thirteen (13) years of IT experience with extensive Data Warehousing implementations across Retail, Insurance, Financial and Communication Industries.
- Over Eight (9) years of ETL and data integration experience in developing ETL mappings and scripts using Informatica PowerCenter
- Over Five (5) years of ETL and data integration experience in developing Graphs and scripts using AbI Inito and Talend
- Experience On migration projects (Informatica, Teradata to Abi Intio and Hadoop (data ecosystem) & snowflake
- Experience working on loading to data into Snowflake form AWS s3 bucket using copy into commands and loading into user consumption data using snowsql
- Progressive Experience in the field of Bigdata Technologies, software programing and developing, which also include Design, Development, integration, Deployment, and maintenance
- In depth Business Knowledge in Deposits accounts and AMLKYC
- Experience in creating High Level Design and Detailed Design in the Design phase.
- Expertise in Business Model development with Dimensions, Hierarchies, Measures, Partitioning, Aggregation Rules, Time Series, Cache Management.
- Extensively worked on the ETL mappings, analysis, and documentation of OLAP reports requirements. Solid understanding of OLAP concepts and challenges, especially with large data sets.
- Strong knowledge of Entity-Relationship concept, Facts, and dimensions tables, slowly changing dimensions
- Experience in integration of various data sources like Oracle, DB2, Sybase, SQL server and MS access and non-relational sources like flat files into staging area.
- Experience in creating Reusable Transformations (Joiner, Sorter, Aggregator, Expression, Lookup, Router, Filter, Update Strategy, Sequence Generator, Normalizer and Rank) and Mappings using Informatica Designer and processing tasks using Workflow Manager to move data from multiple sources into targets.
- Experience in creating Reusable Tasks (Sessions, Command, Email) and Non-Reusable Tasks (Decision, Event Wait, Event Raise, Timer, Assignment, Worklet, Control).
- Experience in code commit in Bit bucket and code deployment using CICD process.
- Hands on experience working on Horton networks , map reduce, Sqoop , Hive .
- Experienced in UNIX work environment, file transfers, job scheduling and error handling.
- Extensively worked on developing and debugging Informatica mappings, mapplets, sessions and workflows.
- worked in building snow pipe and used snowflake clone, Time travel and stream
- Experience in the development improvement and maintenance of snow databases.
- Hands on experience in Aws Cloud services like IAM, SNS, S3, Ec2 ,SQS,RDS
- created storage integration on Snowflake which is used to establish connection between s3 and snowflake
- Worked on Performance Tuning, identifying, and resolving performance bottlenecks in various levels like sources, targets, mappings, and sessions.
- Involved in Unit testing, System testing to check whether the data loads into target are accurate.
- Experience in various methodologies like waterfall and Agile.
- Proficient in interaction with the business users by conducting meetings with the clients in Requirements Analysis phase.
- Extensive functional and technical exposure. Experience working on high-visibility projects
- Assign work and provide technical oversight to onshore and offshore developers
- Excellent analytical/ communication skills and good team player.
Education
Masters _ University of Missouri Kansas City
Professionals in the same Technology / Internet sector as Pavan S
Professionals from different sectors near North Dallas, Dallas
Other users who are called Pavan
Jobs near North Dallas, Dallas
-
Design and implement Snowflake schemas optimized with micro-partitioning, · clustering keys, materialized views, and search optimization services. · ...
Dallas2 weeks ago
-
We are seeking an experienced Data Engineer with expertise in Snowflake Data Cloud and SQL optimization. · Hands-on with Snowpipe, Streams & Tasks, Snowpark, Zero-Copy Cloning, and Secure Data Sharing. · Proficiency in Python, Scala, or Java for Snowpark development. · ...
Dallas4 weeks ago
-
Snowflake Data Engineer: Design and implement Snowflake schemas optimized with micro-partitioning and clustering keys. · Build real-time and batch ingestion pipelines into Snowflake using Snowpipe. · ...
Dallas, TX1 month ago