- Apply advanced knowledge of Data Engineering principles, methodologies and techniques to design and implement data loading and aggregation frameworks across broad areas of the organization.
- Gather and process raw, structured, semi-structured and unstructured data using batch and real-time data processing frameworks.
- Implement and optimize data solutions in enterprise data warehouses and big data repositories, focusing primarily on movement to the cloud.
- Drive new and enhanced capabilities to Enterprise Data Platform partners to meet the needs of product / engineering / business.
- Experience building enterprise systems especially using Databricks, Snowflake and platforms like Azure, AWS, GCP etc
- Leverage strong Python, Spark, SQL programming skills to construct robust pipelines for efficient data processing and analysis.
- Implement CI/CD pipelines for automating build, test, and deployment processes to accelerate the delivery of data solutions.
- Implement data modeling techniques to design and optimize data schemas, ensuring data integrity and performance.
- Drive continuous improvement initiatives to enhance performance, reliability, and scalability of our data infrastructure.
- Collaborate with data scientists, analysts, and other stakeholders to understand business requirements and translate them into technical solutions.
- Implement best practices for data governance, security, and compliance to ensure the integrity and confidentiality of our data assets.
- Bachelors or masters degree in computer science, Engineering, or a related field.
- Proven experience (8+) in a data engineering role, with expertise in designing and building data pipelines, ETL processes, and data warehouses.
- Strong proficiency in SQL, Python and Spark programming languages.
- Strong experience with cloud platforms such as AWS, Azure, or GCP is a must.
- Hands-on experience with big data technologies such as Hadoop, Spark, Kafka, and distributed computing frameworks.
- Knowledge of data lake and data warehouse solutions, including Databricks, Snowflake, Amazon Redshift, Google BigQuery, Azure Data Factory, Airflow etc.
- Experience in implementing CI/CD pipelines for automating build, test, and deployment processes.
- Solid understanding of data modeling concepts, data warehousing architectures, and data management best practices.
- Excellent communication and leadership skills, with the ability to effectively collaborate with cross-functional teams and drive consensus on technical decisions.
- Relevant certifications (e.g., Azure, databricks, snowflake) would be a plus.
-
Data Engineer
2 weeks ago
Sumitomo Mitsui Banking Corp Charlotte, United StatesSMBC Group is a top-tier global financial group. Headquartered in Tokyo and with a 400-year history, SMBC Group offers a diverse range of financial services, including banking, leasing, securities, credit cards, and consumer finance. The Group has more than 130 offices and 80,000 ...
-
Data Engineer
2 weeks ago
SMBC Charlotte, United StatesSMBC Group is a top-tier global financial group. Headquartered in Tokyo and with a 400-year history, SMBC Group offers a diverse range of financial services, including banking, leasing, securities, credit cards, and consumer finance. The Group has more than 130 offices and 80,000 ...
-
Data Engineer
3 weeks ago
Compunnel Inc. Charlotte, United StatesThis is a W2 role. · Responsibilities: · The person on this role will play a crucial role in building scalable and cost-effective data pipelines, data lakes, and analytics systems. · Data Ingestion: Implement data ingestion processes to collect data from various sources, includin ...
-
Data Engineer
3 weeks ago
Oriental Trading Company Charlotte, United StatesChello is built on a foundation of pioneering data-intelligence and our team of innovators, driven to tackle the financial challenges of the industries we serve. At its core, it's the first of its kind digital banking platform that delivers daily business insights, cash flow pred ...
-
Data Engineer
3 weeks ago
Netskope Charlotte, United StatesAbout Netskope · Today, there's more data and users outside the enterprise than inside, causing the network perimeter as we know it to dissolve. We realized a new perimeter was needed, one that is built in the cloud and follows and protects data wherever it goes, so we started Ne ...
-
Data Engineer
3 weeks ago
Experis Charlotte, United StatesDallas or Charlotte - Hybrid 2-3 days in office · Pay: · 24 month contract · Lead Data Engineer · Must Have: · typical ETL/Abintio but specifically Metadata hub-> an abinitio etl tool: allowing users to leverage metadata-driven development and automation capabilities. Metada ...
-
Data Engineer
3 weeks ago
PamTen Charlotte, United StatesExperience in Data Warehouse related projects in product or service-based organization · • Expert knowledge of Linux operating systems and environment and Scripting (Shell and Python preferred) · • A deep expertise in your field of Software Engineering · • Expert at troubleshoo ...
-
Data Engineer
4 weeks ago
Sia Partners Charlotte, United StatesSia Partners is a next-generation management consulting firm. We offer a unique blend of AI and design capabilities, augmenting traditional consulting to deliver superior value to our clients. Counting 3,000 consultants in 19 countries, we expect to achieve USD 420 million in tur ...
-
Data Engineer
4 weeks ago
Alpha Theory Charlotte, United StatesAbout Alpha Theory: · Alpha Theory is a fintech software company that prides itself on an inclusive and transparent culture that attracts curious teammates who are excited about tackling big ideas. We hire smart, motivated team members that crave feedback to be better. We believe ...
-
Data Engineer
2 weeks ago
LHH Charlotte, United States**Must be local to Charlotte area for a weekly hybrid commute** · LHH is seeking a Data Engineer for a rapidly growing company based out the Charlotte, NC area. The ideal candidate will have 3+ years of experience with data engineering and a proven track record of implementing ro ...
-
DATA ENGINEER
2 weeks ago
Diverse Lynx Charlotte, United StatesWe are looking for a highly capable Data Engineer who has experience in building end-to-end systems · • Experience on implementation of Data Lakes using Cloud (AWS or GCP), Hands-on with Big Data and related technologies including Spark, Kafka, ELK. · • Define and setup develop ...
-
Data Engineer
3 weeks ago
CRG Charlotte, United StatesData Engineer · Location: Remote EST hours · Duration: 12-month contract w/ potential to hire. · Pay: $65+/hr · JOB DESCRIPTION · Our global Fortune 500 client, with U.S. headquarters in Charlotte, NC, is a world class food service provider with a strong presence across the ...
-
Data Engineer
1 week ago
Sharp Decisions Charlotte, United StatesData Engineer - 4 Openings · Candidate can also work in Jersey City if not located in NC. · Role Objectives · These roles will be involved in the active development of the data platform in close coordination with the client team, beginning with the establishment of a reference da ...
-
Data Engineer
3 weeks ago
Syntricate Technologies Charlotte, United StatesHi, · Hope you are doing well · Number of position : 3 · Only Full Time no C2C and No Contract · Full-time · I, Shakib(i3 infotek) would like to share a job opportunity as Data Engineer based in Charlotte, NC (Onsite) location for a Full-time position. · *** In case, if you are ...
-
Data Engineer
3 weeks ago
The Hartford Charlotte, United StatesData Engineer - GE08AE · We're determined to make a difference and are proud to be an insurance company that goes well beyond coverages and policies. Working here means having every opportunity to achieve your goals - and to help others accomplish theirs, too. Join our team as w ...
-
Data Engineer
4 weeks ago
Clark Davis Associates Charlotte, United States*Must be US Citizen or GC holder · Scroll down to find the complete details of the job offer, including experience required and associated duties and tasks. · *No C2C · You Will: · Architect and develop data pipelines to optimize performance, quality, and scalability · Build ...
-
Data Engineer
2 weeks ago
Ryan Consulting Group Charlotte, United StatesJob Description · Job DescriptionFull-time, in office position · Must have AWS, ETL & Python experience · Must be very hands-on · Data Engineer · The Data Engineer will be part of the overall team that is actively engaged in the ongoing database engineering process, partnering wi ...
-
Data Engineer
18 hours ago
V-Soft Consulting Group Charlotte, United StatesData Engineer (SAP ECC To S4 DATA Migration) (Remote) · Primary Location: Remote · V-Soft Consulting is currently hiring for a Data Engineer (SAP ECC To S4 DATA Migration) (Remote) for our premier client. · Education and Experience " Prior experience working on a SAP ECC to S ...
-
Data Engineer
3 weeks ago
Truist Financial Charlotte, United StatesThe position is described below. If you want to apply, click the Apply button at the top or bottom of this page. You'll be required to create an account or sign in to an existing one. · Need Help? · If you have a disability and need assistance with the application, you can requ ...
-
Data Engineer
16 hours ago
Addison Group Charlotte, United StatesJob Description · Job DescriptionWith offices in Colorado and North Carolina we are one of the leading teams on providing Data Solutions in the US. We partner with household brands to be sure their customers received the best web and security experiences. Due to continued growth ...
Lead Data Engineer - Charlotte, United States - Irvine Technology
Description
Position: Lead Data Engineer (Python, SQL, Databricks or Snowflake or Fabric, and Spark is nice to have)
Location: Charlotte, NC or Tempe, AZ (Hybrid Model - 3 Remote / 2 Onsite)
Duration: (CTH) 6+ month contract to permanent full time hire (Must be in Hirable Status)
Hourly Rate: 80/hr to 90/hr (W2 or Corp to Corp)
Industry Experience: Retail (nice to have, not required)
What You Will Do:
What Gets You The Job:
Please send your resume to Dave Lim, Senior Technical Recruiter for immediate consideration.
Irvine Technology Corporation (ITC) is a leading provider of technology and staffing solutions for IT, Security, Engineering, and Interactive Design disciplines servicing startups to enterprise clients, nationally. We pride ourselves in the ability to introduce you to our intimate network of business and technology leaders bringing you opportunity coupled with personal growth, and professional development Join us. Let us catapult your career
Irvine Technology Corporation provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability or genetics. In addition to federal law requirements, Irvine Technology Corporation complies with applicable state and local laws governing non-discrimination in employment in every location in which the company has facilities.