Data Engineer - Erlanger, United States - Archer Daniels Midland Company

Archer Daniels Midland Company Erlanger, United States

3 weeks ago

Description

Job Description

Data Engineer - Data Analyst
This is an exempt level position.

Summary:

Data Engineer/Analyst will work on designing, building, and implementing a data foundation to support a strategic analytics project that drives strategic growth for ADM. This involves liaising with functional teams that build or acquire the underlying data, application owners to understand raw or source data structures, and end users to accurately design strategic data marts. Finally, designing and building data pipelines, ETL/ELT integrations, constructing and modifying data marts, preparing (cleaning, transforming) data, and collaborating with extended team members to design impactful business solutions. Data Engineer needs to have specifically expert technical knowledge of Python, AzureAI and RAG and platforms and software technology (ETL/ELT, SQL, PySpark, Power BI, Python), deep expertise in data management techniques, ability to drive effective support of data analysis and model management, and experience with IT project management practices

Responsibilities:

Standardize data and reporting across businesses and teams to enable consistency and quality of key business data
Design and develop enterprise data warehouse platform that conforms to consistent methodologies, standards and industry best practices
Design, develop, test and document data integrations and assist with deployment, validation and hypercare
Maintain and support Azure integrations like ADF, Synapse and AI using technical documentation
Participate in designing overall logical & physical data warehouse and data mart models and architectures to support business requirements
Develop and maintain SQL, PL/SQL, PySpark, Python code as needed
Assist with review to confirm technical feasibility of integration development objects based on integration principles and best practices
Understand and navigate a wide array of source data systems (enterprise data warehouses, relational databases, IT systems, in house and COTS applications, documents, APIs, unstructured data, big data, Vector database etc.)
Analyze data and assist with developing insights (e.g., via data visualization tools like Power BI / SAC) to enable business decision making
Propose new methodologies to demonstrate data to improve existing methodologies
Developing prototypes and proof of concepts for required solutions
Implementing information security standards in enterprise data warehouse
Prepare and present ideas and recommendations to colleagues and management
Document solutions through high/low level design documentation
Learn new groundbreaking data science and analytic tools as needed
Contribute to development of the overall solution approach
Recommend solutions to address gaps
Assist with development estimation
Supervise and review activities of consultants

Requirements:

4-year Bachelor's degree or equivalent in IT, Computer Science, Science, Engineering, Statistics, Programming, Business Analytics, Mathematical or related field
At least 6 years of enterprise BI and Analytics technical experience implementing data warehouse and data marts in an Agile environment
5 years of recent experience using data integration, ETL, ELT, data replication, and data warehouse automation tools such as Qlik Replicate, Microsoft Azure Data Factory, Databricks and Microsoft SQL Server Integration Services
5 years of recent experience in data processing using SQL, PySpark, Python
Experience sourcing data from ERP data sources, e.g., SAP, JD Edwards, PeopleSoft, Oracle EBS in support of analytic product development and business transformation projects
Experience with MPP systems, Azure Synapse, ML and AI preferred
Experience with databases like SAP HANA,SQLMI, Synapse
Experience in delivering Cloud based Data Solutions in Azure
Experience with Data Virtualization technologies and tools, Denodo preferred
Working knowledge of BI architecture, dimensional modeling, data warehousing best practices, and data integration standard methodologies
Experience in delivering solutions using iterative development methodologies like Agile, KanBan, DevOps
Experience working with Big Data technologies such as PySpark, Kafka, DataBricks, Hive, or equivalent
Experience with visualization technologies and services including Microsoft Power BI and SAP Analytics Cloud is plus.
Working knowledge of Python ML libraries like Scikit-learn/PyTorch or Azure ML
Experience working in DevOps / CICD framework
High accountability with a demonstrated ability to deliver
Strong communication skills including design documentation
Strong collaboration skills working with architecture, design and development teams
"AJCIND" REF: 80887BR

#IncludingYou

Diversity, equity, inclusion and belonging are cornerstones of ADM's efforts to continue innovating, driving growth, and delivering outstanding performance. We are committed to attracting and retaining a diverse workforce and create welcoming, truly inclusive work environments - environments that enable every ADM colleague to feel comfortable on the job, make meaningful contributions to our success, and grow their career. We respect and value the unique backgrounds and experiences that each person can bring to ADM because we know that diversity of perspectives makes us better, together.

We are committed to ensuring all qualified applicants receive consideration for employment regardless of race, color, ethnicity, disability, religion, national origin, gender, gender identity, gender expression, marital status, sexual orientation, age, protected veteran status, or any other characteristic protected by law.

We welcome everyone to apply, especially those individuals who are underrepresented in our industry, as we strive to ensure our workforce represents the world that we help to feed: people of color, women, gender non-conforming, LGBTQIA+, veterans and persons with disabilities. For more information regarding our efforts to advance Diversity, Equity, Inclusion & Belonging, please visit our website here: Diversity, Equity and Inclusion ADM.

Benefits and Perks

Enriching the quality of life for the world begins by taking care of our colleagues. In addition to competitive pay, we support your diverse needs with a comprehensive total rewards package to enhance your well-being, including:

Physical wellness - medical/Rx, dental, vision and on-site wellness center access or gym reimbursement (as applicable).
Financial wellness - flexible spending accounts, health savings account, 401(k) with matching contributions and cash balance plan, discounted employee stock purchasing program, life insurance, disability, workers' compensation, legal assistance, identity theft protection.
Mental and social wellness - Employee Assistance Program (EAP), Employee Resource Groups (ERGs) and Colleague Giving Programs (ADM Cares).

Additional benefits include:

Paid time off including paid holidays.
Adoption assistance and paid maternity and parental leave.
Tuition assistance.
Company-sponsored training and development resources, such as LinkedIn Learning, language training and mentoring programs.

*Benefits may vary for bargained locations, confirm benefit eligibility with your recruiter.

Data Engineer

3 weeks ago

ADM Erlanger, United States

80887BR · Job Title: · Data Engineer · Department/Function: · Information Technology · Job Description: · Data Engineer – Data Analyst · This is an exempt level position. · Summary: · Data Engineer/Analyst will work on designing, building, and implementing a data foundation to su ...
Data Engineer

2 days ago

Diverse Lynx Erlanger, United States

Job Description: Qlik Replicate · Azure ADF · Azure Data Engineering · Regard · Rajiv Ranjan Rai · Diverse Lynx LLC |300 Alexander Park|Suite #200|Princeton , NJ 08540 · Office : ext:458 · Email: | URL: · Diverse Lynx LLC is an Equal Employment Opportunity employer. All ...
Sr Data Engineer

2 days ago

Archer Daniels Midland Company Erlanger, United States

Job Description · Sr. Data Engineer · Job Summary · Do you want to join a team passionate about engineering data solutions to inform business decisions and transform business performance? ADM is seeking a Sr. Data Engineer, someone who thrives in an environment continuously inte ...
Data Engineer

4 days ago

Diverse Lynx Erlanger, United States

· Job Description: · Qlik Replicate · Azure ADF · Azure Data Engineering · Regard · Rajiv Ranjan Rai · Diverse Lynx LLC |300 Alexander Park|Suite #200|Princeton , NJ 08540 · Office : (phone number removed) ext:458 · Email: | URL: · Diverse Lynx LLC is an Equal Employment Op ...
Data Engineer

2 weeks ago

Tata Consultancy Services Erlanger, United States

Roles & Responsibilities: · 1.Responsible for ownership and administration of Qlik cloud ETL environment. · 2.Responsible for deployment of artifacts to production environments for Qlik Replicate, ADF · 3.Responsible for working utilizing ITSM practices in a managed services s ...
Data Engineer

3 days ago

Archer Daniels Midland Company (ADM) Erlanger, United States Full time

Data Engineer - Data Analyst · This is an exempt level position. · Summary: · Data Engineer/Analyst will work on designing, building, and implementing a data foundation to support a strategic analytics project that drives strategic growth for ADM. This involves liaising with f ...
Engineer - Data

3 weeks ago

Schwan's Florence, KY, United States

S. manufacturer and marketer of quality foods offered through retail-grocery and food-service channels. Our many popular brands include Red Baron, Tony's, Big Daddy's, Villa PrimaTM and Freschetta pizza; Continuous Improvement Engineer at our Freschetta frozen pizza plant in Flor ...
Data Engineer

1 week ago

Qual IT Resources Cincinnati, United States

Data Engineer- Level 2- Job Description · As a Data Engineer, you will have the opportunity to build solutions that ingest, transform, store, and distribute our data products to be consumed by data scientists and our products. · Required Experience: · 4+ years of PySpark · 4+ yea ...
Data Engineer

1 week ago

SkyBridge Resources Kentucky, United States

Secret Clearance Required · Job Description: · We are seeking a highly skilled Data Engineer to join our team. The ideal candidate must be a U.S. citizen with an active Secret clearance and possess experience in developing custom data products, including dashboards and data solut ...
Data Engineer

3 weeks ago

Apex Systems Cincinnati, United States Contract

Job#: · Job Description: · GENERAL FUNCTION: · The data engineer designs and builds platforms, tools, and solutions that help the bank manage, secure, and generate value from its data. The person in this role creates scalable and reusable solutions for gathering, collecting, ...
Sr Data Engineer

3 weeks ago

Archer Daniels Midland Company Erlanger, United States

Job Description · Sr. Data Engineer · Job Summary · Do you want to join a team passionate about engineering data solutions to inform business decisions and transform business performance? ADM is seeking a Sr. Data Engineer, someone who thrives in an environment continuously inte ...
Data Engineer

1 day ago

Diverse Lynx Union, United States

Technical/Functional Skills · •Primary Skills: · o Big Data: Spark, Scala, Pyspark, HDFS · o Microsoft Stack: T-SQL, DBA, SSIS, SSRS, PowerShell · o Oracle Database: PL/SQL, Shell Scripting, Exadata · o Scripting Languages: Batch Script, Shell Script, Python · o Kafka Streaming ...
Data Engineer

3 weeks ago

ComResource Cincinnati, United States

Job Description · Job DescriptionComResource is looking for a Data Engineer. · Responsibilities: · Handle the design and construction of scalable management systems, ensure that all data systems meet company requirements, and also research new uses for data acquisition. Required ...
Data Engineer

4 weeks ago

ComResource Cincinnati, United States

Job Description · Job DescriptionComResource is looking for a Data Engineer. · Responsibilities: · Handle the design and construction of scalable management systems, ensure that all data systems meet company requirements, and also research new uses for data acquisition. Required ...
Data Engineer

4 weeks ago

eTek IT Services, Inc. Cincinnati, United States

Job Description · Job DescriptionRole : Data EngineerLocation : Cincinnati& ,OH · W2 Contract · JD : Required SkillsWord, Databricks, PySpark, Python, SQL, AzureAdditional SkillsJob DescriptionIn serving data back, make accessible to analysts and PowerBI reporting. Can build das ...
Data Engineer

1 day ago

Eliassen Group Cincinnati, United States

Job Description · **Hybrid - onsite at least 3 days a week in Cincinnati, OH.** · Our banking client is looking for a Data Engineer to join their team. · Due to client requirement, applicants must be willing and able to work on a w2 basis · For our w2 consultants, we offer a gre ...
Data Engineer

3 weeks ago

Encore Talent Solutions Cincinnati, United States

Encore Talent Solutions is seeking a Data Engineer for its direct client in Cincinnati, OH. This is a contract and onsite role. · If this sounds like the role for you and you're ready to join an amazing team, please share your resume for immediate consideration. · Job Title: Data ...
Data Engineer

2 weeks ago

Eliassen Group Cincinnati, United States

**Hybrid - onsite at least 3 days a week in Cincinnati, OH.** · Our banking client is looking for a Data Engineer to join their team. · Due to client requirement, applicants must be willing and able to work on a w2 basis. For our w2 consultants, we offer a great benefits packag ...
Data Engineer

2 weeks ago

Procter & Gamble Cincinnati, United States

Job LocationCincinnati · Job DescriptionThe OpportunityWe are currently looking for a Data Engineer to join our industry leading Data & Analytics team. Do you have what it takes to join our technical team and bring data to life? Are you able to take abstract business needs and t ...
Data Engineer

1 week ago

Encore Talent Solutions Cincinnati, United States

Encore Talent Solutions is seeking a Data Engineerfor its direct client in Cincinnati, OH. This is a contract and onsite role. · If this sounds like the role for you and youre ready to join an amazing team, please share your resume for immediate consideration. · Job Title: Data ...