- Creates and maintains optimal data pipeline architecture.
- Assembles large, complex data sets that meet functional / non-functional business requirements.
- Identifies, designs, and implements internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
- Builds the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and Azure technologies.
- Builds analytics tools that utilize the data pipeline to provide actionable insights into accounting operations, customer financials, and other key business performance metrics.
- Works with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.
- Keeps our data separated and secure through multiple data centers and Azure regions.
- Work with data, product, & technology teams to strive for greater functionality in our data systems
- Performs data analysis required to troubleshoot data related issues and assist in the resolution of data issues
- Assists accounting team and sales operations/data team as needed
- May work on special data-related projects or other duties as assigned
- Communicates with external vendors and service providers as projects require
- Bachelor's degree in computer science or a related field or equivalent experience required
- 6+ years of related software development and architecture experience required
- 5+ years Azure Cloud experience required
- 2+ years of Salesforce integration experience working with APIs / SOQL queries
- Prior experience in designing/building data warehouse, data lake, and/or data lake house patterns from the ground up
- Previous Agile (Scrum/Kanban) experience required
- Working knowledge of accounting and financial systems
- Previous staffing industry a plus
- Broad knowledge of the Microsoft Azure cloud platform and expertise in architecting, designing, and implementing data & analytics solutions on Azure.
- Experience with cloud data warehouses and data lakes (Azure Synapse, Azure ADLS, Azure SQL DB, Azure Blob).
- Solid understanding of advanced SQL techniques for querying, transformation, and performance optimization.
- Data Modeling: Understanding best practices for data modeling, including star schemas, snowflake schemas, and data normalization techniques. Building the semantic layer to ensure effective translation of complex data from the data marts into business terms. This includes defining dimensions, measures, hierarchies, and business logic.
- Proficiency in complex ETL / ELT activities for enterprise Data Integrations, including architecture design, standards establishment, and mapping documentation, with expertise in optimizing pipelines for large datasets and cloud integration (Azure tools).
- Skilled in building and maintaining Data integration pipelines with cloud platforms like Azure Data Factory, while also developing and enhancing data pipelines to reduce costs and improve efficiency and SLAs.
- Data Privacy: Knowledge of data privacy laws, including an understanding of PII data and other regulations to ensure compliance.
- Data Visualization/Business Intelligence: Knowledge of tools like Microsoft PowerBI
- Familiarity with Salesforce and Salesforce APIs (nice to have)
- Experience owning processes at a detailed level, subject-matter expertise
- Monitor and optimize the Data ETL Pipelines & performance of queries, ensuring fast response times and efficient data retrieval. This may involve indexing, partitioning, and tuning the underlying data models
- Ability to adhere to and exhibit the Company Values at all times
- Working knowledge of Microsoft Word, Excel, PowerPoint, Outlook, and Teams
- Strong customer service mindset
- Strong attention to detail
- Ability to build relationships at all levels
- Strong organizational and time management skills
- Ability to work independently and collaboratively
- Strong communication skills - both oral and written
- Solid critical thinking and creative problem-solving skills
- Ability to effectively manage multiple competing priorities in a fast-paced environment
- Ability to work with sensitive information and maintain confidentiality
- Ability to mentor, coach, and motivate others
-
Data Engineer
1 week ago
ATech Placement Alpharetta, United StatesWe are looking for a Data Engineer to design, build and operate large scale enterprise data solutions and applications using one or more of AWS data and analytics services in combination with 3rd parties - Spark, EMR, RedShift, Lambda, Glue · Technical Skills and Requirements · ...
-
Data Engineer
2 weeks ago
LocumTenens Alpharetta, United StatesJOB DESCRIPTION: · The Data Engineer is responsible for supporting and developing business applications, utilizing multiple technologies as required by the business. The role works to design and implement efficient and effective data pipelines between various LT systems and to/ ...
-
Big Data Engineer
6 days ago
CSI Alpharetta, United States ContractBig Data Engineer · 12-month contract · Job Description: · CSI Companies is looking to hire a Big Data Engineer that can design, build, and operationalize large-scale enterprise data solutions and applications using one or more AWS data and analytics services in combination with ...
-
Data Engineer, Business Intelligence
2 weeks ago
merchant e-Solutions Alpharetta, United StatesThe Opportunity: · As we are embarking on our journey to a modern architecture on the cloud, we are looking for talented engineers to join us to build our future. You will get an opportunity to work on challenging problems in a high-volume and mission critical environment. US W ...
-
Big Data Engineer
1 week ago
CapB InfoteK Alpharetta, United StatesWe are looking for a Big Data Engineer for our long-term multiyear project out of Alpharetta, GA. (Remote till COVID). · Responsibilities: · 5-10 years of hands on experience working with Hadoop and Informatica power center. · Experience in Hadoop ecosystem and experience in ap ...
-
Lead Data Engineer
5 days ago
CVS Pharmacy Alpharetta, United StatesCaremark LLC, a CVS Health company, is hiring for the following role in Alpharetta, GA: Lead Data Engineer to design, build and manage large scale data structures, pipelines and efficient Extract/ Load/ Transform (ETL) workflows to support business a Data Engineer, Data Science, ...
-
Azure Data Engineer
2 weeks ago
PamTen Alpharetta, United StatesProject description · We are seeking a highly skilled and experienced Senior Developer specializing in Data Engineering to join our technology-driven team. The ideal candidate will have significant hands-on expertise in Data Factory, Databricks, and a strong background in designi ...
-
Data Visualization Engineer
3 days ago
Aperia Alpharetta, United StatesSummary · Join Aperia Solutions, a leader in SaaS solutions for the Payments and Compliance industries. Aperia is a Texas-based fintech and managed consultancy firm that creates custom SaaS applications and other software-based solutions for the payments, banking, and processing ...
-
Big Data Engineer
2 weeks ago
Equifax Alpharetta, United StatesEquifax is where you can power your possible. If you want to achieve your true potential, chart new paths, develop new skills, collaborate with bright minds, and make a meaningful impact, we want to hear from you. · Equifax is seeking creative, high-energy and driven Big Data En ...
-
Sr. Data Engineer
5 days ago
Datum Software Alpharetta, United States*Sr. Data Engineer #37882 * Atlanta, GA · Top 5 Skillsets: * * · Very Proficient in Teradata SQL · Excel Proficient · Python · Experience with NodeJs Experience with CloudWatch insights/metrics · Strong mathematical and statistical skills · Additional Notes · Experience w ...
-
Spark Data Engineer
1 week ago
Diverse Lynx Alpharetta, United StatesJD Description: · Someone with experience on scala/spark skillset or java/spark. · Job Functions/Duties and Responsibilities: · Design & Development Enterprise scale ETL process for doing Data Ingestion, Transformation and Distribution integrating with multiple systems. · Pe ...
-
1420055 - Data Center Network Engineer
13 hours ago
Cisco Alpharetta, United StatesWho We Are · We are the Data Center Network Services team within Cisco IT that supports network services for Cisco Engineering and business functions worldwide. Our mission is simple – build the network of the future that is adaptable and agile on Cisco's Application Centric In ...
-
Critical Operating Engineer – Data Center
23 hours ago
JLL Sandy, United States Full timeJLL supports the Whole You, personally and professionally. · Our people at JLL are shaping the future of real estate for a better world by combining world class services, advisory and technology to our clients. We are committed to hiring the best, most talented people in our ind ...
-
Data Engineer
2 weeks ago
Jackson Healthcare Alpharetta, United StatesOverview · has been leading the way in a booming healthcare industry since 1995. Locum Tenens is a Latin phrase meaning, "to substitute for." When hospitals are understaffed, they rely on us to find them the right temporary physicians to fill in when needed. Every associate at ...
-
Azure Data Science Engineer
1 week ago
United Parcel Service Inc. Alpharetta, United StatesBefore you apply to a job, select your language preference from the options available at the top right of this page. · Explore your next opportunity at a Fortune Global 500 organization. Envision innovative possibilities, experience our rewarding culture, and work with talented ...
-
Data Engineer
2 weeks ago
The Ladders Alpharetta, United StatesJob Description: · • Snowflake data engineer will be responsible for architecting large-scale data intelligence solutions, performing architectural assessments, crafting architectural options and analysis around Snowflake Data Warehouse. · • Finalize preferred solution alternat ...
-
Lead Data Security Engineer
3 weeks ago
ADP Alpharetta, United StatesADP is hiring a Data Security Engineer · Are you ready to help us design the future-state to secure and govern our Data? · Well, this may be the role for you. Ready to make your mark? · As a Data Security Engineer, · you will join a highly skilled and focused Global Security tea ...
-
Data Center Network Engineer
15 hours ago
Cisco Alpharetta, United StatesWho We Are · We are the Data Center Network Services team within Cisco IT that supports network services for Cisco Engineering and business functions worldwide. Our mission is simple - build the network of the future that is adaptable and agile on Cisco's Application Centric Inf ...
-
Senior Network Data Engineer
1 week ago
Omni Inclusive Alpharetta, United StatesPrimary skills: SD-Wan · Secondary Skills: Network Automation · Primary Skills/ Scope · 15+ Years of related IT experience. · Hands on experience in software development specifically in Python, GIT, Ansible and YAML · Hands on experience in Layer 3 protocols (BGP, OSPF, EIGRP) ...
-
Lead / Senior DevOps Engineer (Big Data)
3 days ago
Epam Georgia, United StatesDescription · Are you a DevOps engineer who can easily navigate the world of Big Data? If so, we have an excellent opportunity for you. We seek a Lead / Senior DevOps Engineer (Big Data) to join our team and be an essential resource for managing the Big Data platform environmen ...
Data Engineer - Alpharetta, United States - LocumTenens
Description
JOB DESCRIPTION:
The Data Engineer is responsible for supporting and developing 's business applications, utilizing multiple technologies as required by the business. The role works to design and implement efficient and effective data pipelines between various LT systems and to/from LT's data lake as needed to meet LT business and accounting needs. The DE is also responsible for data reporting & analytics activities with a focus on financial reporting and acts as part of an Agile team by participating in associated scrum ceremonies. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys analyzing and optimizing data systems and building them from the ground up.
KEY FUNCTIONS AND BASIC DUTIES:
Data Engineer – 100%
SECONDARY FUNCTIONS:
SUPERVISORY/BUDGERTARY/EXTERNAL COMMUNICATION RESPONSIBILITY:
REQUIRED EXPERIENCE:
KNOWLEDGE, SKILLS, AND ABILITIES: