- Apply advanced knowledge of Data Engineering principles, methodologies and techniques to design and implement data loading and aggregation frameworks across broad areas of the organization.
- Gather and process raw, structured, semi-structured and unstructured data using batch and real-time data processing frameworks.
- Implement and optimize data solutions in enterprise data warehouses and big data repositories, focusing primarily on movement to the cloud.
- Drive new and enhanced capabilities to Enterprise Data Platform partners to meet the needs of product / engineering / business.
- Experience building enterprise systems especially using Databricks, Snowflake and platforms like Azure, AWS, GCP etc
- Leverage strong Python, Spark, SQL programming skills to construct robust pipelines for efficient data processing and analysis.
- Implement CI/CD pipelines for automating build, test, and deployment processes to accelerate the delivery of data solutions.
- Implement data modeling techniques to design and optimize data schemas, ensuring data integrity and performance.
- Drive continuous improvement initiatives to enhance performance, reliability, and scalability of our data infrastructure.
- Collaborate with data scientists, analysts, and other stakeholders to understand business requirements and translate them into technical solutions.
- Implement best practices for data governance, security, and compliance to ensure the integrity and confidentiality of our data assets.
- Bachelor's or master's degree in computer science, Engineering, or a related field.
- Proven experience (10+) in a data engineering role, with expertise in designing and building data pipelines, ETL processes, and data warehouses.
- Strong proficiency in SQL, Python and Spark programming languages.
- Strong experience with cloud platforms such as Azure is a must.
- Hands-on experience with big data technologies such as Hadoop, Spark, Kafka, and distributed computing frameworks.
- Knowledge of data lake and data warehouse solutions, including Databricks, Snowflake, Amazon Redshift, Google BigQuery, Azure Data Factory, Airflow etc.
- Experience in implementing CI/CD pipelines for automating build, test, and deployment processes.
- Solid understanding of data modeling concepts, data warehousing architectures, and data management best practices.
- Excellent communication and leadership skills, with the ability to effectively collaborate with cross-functional teams and drive consensus on technical decisions.
- Relevant certifications (e.g., Azure, databricks, snowflake) would be a plus.
-
Data Engineer
20 hours ago
Vaco Charlotte, United States***Data Engineer*** · *** Hybrid in Charlotte, NC*** · ***6 Months Contract*** · ***up to $73/hr. on W2*** · ***Must have Retail Domain experience**** · ***Must have Datadog experience*** · ***Must have Sql, Python & Azure experience*** · ***Min of 3 years of experience leading/c ...
-
Data Engineer
4 days ago
Ledgent Technology Charlotte, United StatesLocation: Remote · Type: Contract to possible hire · Pay: $50-$70/hour (depending on experience) · The Data Engineering team within Data Services is responsible for creating and maintaining data pipelines, assembling complex datasets, and extracting, transforming, and loading dat ...
-
Data Engineer
1 day ago
Amtex Systems Inc. Charlotte, United StatesLead data engineer · Duration: 6 months to start · Location: Charlotte, NC · As the Technical Lead Data Engineer, your primary responsibility will be to spearhead the design, development, and implementation of data solutions aimed at empowering our organization to derive actionab ...
-
Data Engineer
4 days ago
Motion Recruitment Charlotte, United StatesOutstanding long-term contract opportunity A well-known Financial Services Company is looking for a Data Engineer in Charlotte, NC (Hybrid). · Work with the brightest minds at one of the largest financial institutions in the world. This is a long-term contract opportunity that in ...
-
Data Engineer
3 weeks ago
V-Soft Consulting Charlotte, United States ContractData Engineer (SAP ECC To S4 DATA Migration) (Remote) · Primary Location: Remote · V-Soft Consulting is currently hiring for a Data Engineer (SAP ECC To S4 DATA Migration) (Remote) for our premier client. · Education and Experience »Prior experience working on a SAP ECC to SAP S4 ...
-
Data Engineer
5 days ago
Popular Charlotte, United StatesAt Popular, we offer a wide variety of services and financial solutions to serve our communities in Puerto Rico, United States & Virgin Islands. As employees, we are dedicated to making our customers dreams come true by offering financial solutions in each stage of their life. Ou ...
-
Data Engineer
1 week ago
LHH Charlotte, United States**Must be local to Charlotte area for a weekly hybrid commute** · LHH is seeking a Data Engineer for a rapidly growing company based out the Charlotte, NC area. The ideal candidate will have 3+ years of experience with data engineering and a proven track record of implementing ro ...
-
Data Engineer
1 day ago
Zenith Services Inc. Charlotte, United StatesSkills: · Azure Data Engineers (ADF, Databricks, ADLS gen2), Python · SQL Server with trading/investment banking experience · ...
-
Data Engineer
4 weeks ago
Collabera Charlotte, United StatesMust-Have: · Batch SAS data management (4 years experience). · NEED Big Data, joining data, Reports knowledge · SQL - Should have strong knowledge. · LINUX/UNIX- VI/VIM Editor / Text Writing. · Python- Programming Efficiency is important. · ...
-
Data Engineer
4 days ago
Optomi Charlotte, United StatesEssential Job Functions: · Consulting with data management teams to understand the company's data storage needs comprehensively. · Presenting warehousing options to the company based on their storage requirements. · Developing and coding the data warehousing system according to c ...
-
Data Engineer
1 week ago
Belk, Inc. & Belk eCommerce LLC Charlotte, United States OTHEREDW Data Engineer is responsible for designing, maintaining, and optimizing data infrastructure for data collection, management, transformation, and access. Creates pipelines that convert raw data into usable formats for data scientists and other data consumers to utilize. Builds ...
-
Data Engineer
4 days ago
Banco Popular Puerto Rico Charlotte, United StatesDate: Jun 12, 2024 · Location: · Charlotte, NC, US, 28210 · Company: Popular · Workplace Type: Remote · Data Engineer | Snowflake · AtPopular,we offer a wide variety of services and financial solutions to serve our communities in Puerto Rico, United States & Virgin Islands. ...
-
Data Engineer
1 week ago
Collabera Charlotte, United StatesHome · Search Jobs · Job Description · Data Engineer · Contract: Charlotte, North Carolina, US · Salary: $62.00 Per Hour · Job Code: · End Date: · Days Left: 12 days, 3 hours left · Apply · Position Details: Industry Banking & Finance · Work Location Charlotte, NC / Pla ...
-
Data Engineer
1 week ago
The Hartford Charlotte, United StatesData Engineer - GE08AE · Were determined to make a difference and are proud to be an insurance company that goes well beyond coverages and policies. Working here means having every opportunity to achieve your goals and to help others accomplish theirs, too. Join our team as we h ...
-
DATA ENGINEER
1 week ago
Diverse Lynx Charlotte, United StatesWe are looking for a highly capable Data Engineer who has experience in building end-to-end systems · • Experience on implementation of Data Lakes using Cloud (AWS or GCP), Hands-on with Big Data and related technologies including Spark, Kafka, ELK. · • Define and setup develop ...
-
Data Engineer
2 days ago
Manpower Group Inc. Charlotte, United StatesJob Title: Senior Data Engineer - Risk and Regulatory Platform · Location: Charlotte NC (Hybrid) · Duration: 12 Months · Rate: $50 - $55/hr. on W2. · Job Description: · We are seeking a highly skilled Senior Data Engineer to join our team. In this role, you will be responsib ...
-
Data Engineer
1 week ago
SMBC Charlotte, United StatesSMBC Group is a top-tier global financial group. Headquartered in Tokyo and with a 400-year history, SMBC Group offers a diverse range of financial services, including banking, leasing, securities, credit cards, and consumer finance. The Group has more than 130 offices and 80,000 ...
-
Data Engineer
2 weeks ago
Collabera Charlotte, United StatesHome · Search Jobs · Job Description · Data Engineer · Contract: Charlotte, North Carolina, US · Salary: $52.00 Per Hour · Job Code: · End Date: · Days Left: 29 days, 3 hours left · Apply · **Long-Term-Contract** · Must-Have:Batch SAS data management (4 years experience) ...
-
Data Engineer
2 days ago
Experis Charlotte, United StatesJob Title: Senior Data Engineer - Risk and Regulatory Platform · Location: Charlotte NC (Hybrid) · Duration: 12 Months · Rate: $50 - $55/hr. on W2. · Job Description: · We are seeking a highly skilled Senior Data Engineer to join our team. In this role, you will be responsibl ...
-
Data Engineer
1 week ago
Synechron Charlotte, United StatesWe are · At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron's progressive technologies and optimization strateg ...
Lead Data Engineer - Charlotte, United States - Irvine Technology Corporation
Description
Position: Lead Data Engineer (Python, SQL, Databricks, Azure, Retail industry)
Location: Charlotte, NC or Tempe, AZ (Hybrid Model - 3 Remote / 2 Onsite)
Duration: (CTH) 6+ month contract to permanent full time hire (Must be in Hirable Status)
Hourly Rate: 80/hr to 90/hr (W2 or Corp to Corp)
Required experience: Python, SQL, Databricks, Azure, Retail industry
What You Will Do:
What Gets You The Job:
Please send your resume to Dave Lim, Senior Technical Recruiter for immediate consideration.
Irvine Technology Corporation (ITC) is a leading provider of technology and staffing solutions for IT, Security, Engineering, and Interactive Design disciplines servicing startups to enterprise clients, nationally. We pride ourselves in the ability to introduce you to our intimate network of business and technology leaders – bringing you opportunity coupled with personal growth, and professional development Join us. Let us catapult your career
Irvine Technology Corporation provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability or genetics. In addition to federal law requirements, Irvine Technology Corporation complies with applicable state and local laws governing non-discrimination in employment in every location in which the company has facilities.
