- Creates and maintains optimal data pipeline architecture.
- Assembles large, complex data sets that meet functional / non-functional business requirements.
- Identifies, designs, and implements internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
- Builds the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and Azure technologies.
- Builds analytics tools that utilize the data pipeline to provide actionable insights into accounting operations, customer financials, and other key business performance metrics.
- Works with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.
- Keeps our data separated and secure through multiple data centers and Azure regions.
- Work with data, product, & technology teams to strive for greater functionality in our data systems
- Performs data analysis required to troubleshoot data related issues and assist in the resolution of data issues
- Assists accounting team and sales operations/data team as needed
- May work on special data-related projects or other duties as assigned
- Communicates with external vendors and service providers as projects require
- Bachelor's degree in computer science or a related field or equivalent experience required
- 6+ years of related software development and architecture experience required
- 5+ years Azure Cloud experience required
- 2+ years of Salesforce integration experience working with APIs / SOQL queries
- Prior experience in designing/building data warehouse, data lake, and/or data lake house patterns from the ground up
- Previous Agile (Scrum/Kanban) experience required
- Working knowledge of accounting and financial systems
- Previous staffing industry a plus
- Broad knowledge of the Microsoft Azure cloud platform and expertise in architecting, designing, and implementing data & analytics solutions on Azure.
- Experience with cloud data warehouses and data lakes (Azure Synapse, Azure ADLS, Azure SQL DB, Azure Blob).
- Solid understanding of advanced SQL techniques for querying, transformation, and performance optimization.
- Data Modeling: Understanding best practices for data modeling, including star schemas, snowflake schemas, and data normalization techniques. Building the semantic layer to ensure effective translation of complex data from the data marts into business terms. This includes defining dimensions, measures, hierarchies, and business logic.
- Proficiency in complex ETL / ELT activities for enterprise Data Integrations, including architecture design, standards establishment, and mapping documentation, with expertise in optimizing pipelines for large datasets and cloud integration (Azure tools).
- Skilled in building and maintaining Data integration pipelines with cloud platforms like Azure Data Factory, while also developing and enhancing data pipelines to reduce costs and improve efficiency and SLAs.
- Data Privacy: Knowledge of data privacy laws, including an understanding of PII data and other regulations to ensure compliance.
- Data Visualization/Business Intelligence: Knowledge of tools like Microsoft PowerBI
- Familiarity with Salesforce and Salesforce APIs (nice to have)
- Experience owning processes at a detailed level, subject-matter expertise
- Monitor and optimize the Data ETL Pipelines & performance of queries, ensuring fast response times and efficient data retrieval. This may involve indexing, partitioning, and tuning the underlying data models
- Ability to adhere to and exhibit the Company Values at all times
- Working knowledge of Microsoft Word, Excel, PowerPoint, Outlook, and Teams
- Strong customer service mindset
- Strong attention to detail
- Ability to build relationships at all levels
- Strong organizational and time management skills
- Ability to work independently and collaboratively
- Strong communication skills - both oral and written
- Solid critical thinking and creative problem-solving skills
- Ability to effectively manage multiple competing priorities in a fast-paced environment
- Ability to work with sensitive information and maintain confidentiality
- Ability to mentor, coach, and motivate others
-
Data Engineer
3 weeks ago
Equifax Alpharetta, United StatesEquifax's Data Fabric team is seeking an experienced Sr. Data Engineer who can build, design and maintain the enterprise applications on the global data platform. · T o adhere to our corporate location policies, this resource will be required to be local to the surrounding Atlant ...
-
Data Engineer
2 days ago
LocumTenens Alpharetta, United StatesJOB DESCRIPTION: · The Data Engineer is responsible for supporting and developing business applications, utilizing multiple technologies as required by the business. The role works to design and implement efficient and effective data pipelines between various LT systems and to/ ...
-
Director, Data Engineering
2 weeks ago
Live Nation Worldwide, Inc. Georgia, United States Full timeTHE ROLE · We are seeking a dynamic and experienced Director of Data Engineering to lead our team in developing and optimizing data pipelines, solving complex problems, and driving technical innovation. As the Director of Data Engineering, you will be responsible for providing h ...
-
Data Engineer, Business Intelligence
3 days ago
merchant e-Solutions Alpharetta, United StatesThe Opportunity: · As we are embarking on our journey to a modern architecture on the cloud, we are looking for talented engineers to join us to build our future. You will get an opportunity to work on challenging problems in a high-volume and mission critical environment. US W ...
-
Big Data Engineer
2 days ago
CapB InfoteK Alpharetta, United StatesWe are looking for a Big Data Engineer for our long-term multiyear project out of Alpharetta, GA. (Remote till COVID). · Responsibilities: · 5-10 years of hands on experience working with Hadoop and Informatica power center. · Experience in Hadoop ecosystem and experience in ap ...
-
Azure Data Engineer
2 weeks ago
Money Fit by DRS Alpharetta, United StatesTechnical Skills- Azure Data Factory Azure Analysis Services Azure Data Lake Store, Pyspark · Experience 10 to 18 yrs · Should have hand-on experience on Azure Data Factory Azure Data Lake Azure Automation Account Storage Accounts HD Insights Azure Data bricks Batch Accounts and ...
-
Big Data Engineer
2 days ago
Equifax Alpharetta, United StatesEquifax is where you can power your possible. If you want to achieve your true potential, chart new paths, develop new skills, collaborate with bright minds, and make a meaningful impact, we want to hear from you. · Equifax is seeking creative, high-energy and driven Big Data En ...
-
Azure Data Engineer
2 days ago
PamTen Alpharetta, United StatesProject description · We are seeking a highly skilled and experienced Senior Developer specializing in Data Engineering to join our technology-driven team. The ideal candidate will have significant hands-on expertise in Data Factory, Databricks, and a strong background in designi ...
-
Spark Data Engineer
2 days ago
Diverse Lynx Alpharetta, United StatesJD Description: · Someone with experience on scala/spark skillset or java/spark. · Job Functions/Duties and Responsibilities: · Design & Development Enterprise scale ETL process for doing Data Ingestion, Transformation and Distribution integrating with multiple systems. · Pe ...
-
Network Data Engineer
3 weeks ago
Omni Inclusive Alpharetta, United StatesPrimary skills: · SD-Wan · Secondary Skills: · Network Automation · Primary Skills/ Scope · 10+ Years of related IT experience. · Hands on experience in software development specifically in Python, GIT, Ansible and YAML · Hands on experience in Layer 3 protocols (BGP, OSPF, EIG ...
-
Data Engineer
3 weeks ago
LocumTenens Alpharetta, United StatesThe Data Engineer is responsible for supporting and developing 's business applications, utilizing multiple technologies as required by the business. The role works to design and implement efficient and effective data pipelines between various LT systems and to/from LT's data lak ...
-
Data Engineer
4 weeks ago
ATech Placement Alpharetta, United StatesWe are looking for a Data Engineer to design, build and operate large scale enterprise data solutions and applications using one or more of AWS data and analytics services in combination with 3rd parties - Spark, EMR, RedShift, Lambda, Glue · Technical Skills and Requirements · ...
-
Data Engineers
3 weeks ago
Pyramid Consulting Alpharetta, United StatesDesign, develop and validate the ETL mechanisms implemented on databases, validate data integrations using XML. Create prototypes for automation tools to read present production code. Analyze, Design and build automation tools to manage tasks. Create story and tasks, estimate tim ...
-
Data Engineer
5 days ago
Jackson Healthcare Alpharetta, United StatesOverview · has been leading the way in a booming healthcare industry since 1995. Locum Tenens is a Latin phrase meaning, "to substitute for." When hospitals are understaffed, they rely on us to find them the right temporary physicians to fill in when needed. Every associate at ...
-
Data Engineer
4 days ago
The Ladders Alpharetta, United StatesJob Description: · • Snowflake data engineer will be responsible for architecting large-scale data intelligence solutions, performing architectural assessments, crafting architectural options and analysis around Snowflake Data Warehouse. · • Finalize preferred solution alternat ...
-
Lead Data Security Engineer
1 week ago
ADP Alpharetta, United StatesADP is hiring a Data Security Engineer · Are you ready to help us design the future-state to secure and govern our Data? · Well, this may be the role for you. Ready to make your mark? · As a Data Security Engineer, · you will join a highly skilled and focused Global Security tea ...
-
Senior Network Data Engineer
2 days ago
Omni Inclusive Alpharetta, United StatesPrimary skills: SD-Wan · Secondary Skills: Network Automation · Primary Skills/ Scope · 15+ Years of related IT experience. · Hands on experience in software development specifically in Python, GIT, Ansible and YAML · Hands on experience in Layer 3 protocols (BGP, OSPF, EIGRP) ...
-
Principal Data and Machine Learning Engineer
2 weeks ago
Colonial Pipeline Alpharetta, United StatesColonial has provided a wide range of opportunities for job candidates who are highly qualified, skilled, motivated and team players. Employees find exciting opportunities to grow and develop their careers at a stable company which offers a generous compensation and benefits pack ...
-
Senior Data Engineer
4 weeks ago
Visionaire Partners Alpharetta, United StatesSenior Data Engineer · We seek a Senior Data Engineer for an exciting new opportunity You will play a critical role in the design, build and maintenance of scalable data data pipelines DB's, Data Warehouse / Data Lakehouse etc. You will be part of a major technical modernization ...
-
Senior Data Engineer
5 days ago
Colonial Pipeline Alpharetta, United StatesColonial has provided a wide range of opportunities for job candidates who are highly qualified, skilled, motivated and team players. Employees find exciting opportunities to grow and develop their careers at a stable company which offers a generous compensation and benefits pack ...
Data Engineer - Alpharetta, United States - LocumTenens
Description
JOB DESCRIPTION:
The Data Engineer is responsible for supporting and developing 's business applications, utilizing multiple technologies as required by the business. The role works to design and implement efficient and effective data pipelines between various LT systems and to/from LT's data lake as needed to meet LT business and accounting needs. The DE is also responsible for data reporting & analytics activities with a focus on financial reporting and acts as part of an Agile team by participating in associated scrum ceremonies. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys analyzing and optimizing data systems and building them from the ground up.
KEY FUNCTIONS AND BASIC DUTIES:
Data Engineer – 100%
SECONDARY FUNCTIONS:
SUPERVISORY/BUDGERTARY/EXTERNAL COMMUNICATION RESPONSIBILITY:
REQUIRED EXPERIENCE:
KNOWLEDGE, SKILLS, AND ABILITIES: