- Agile Project Work: Work as a project leader in cross-functional, geographically distributed agile teams of highly skilled data engineers, software/machine learning engineers, data scientists, DevOps engineers, designers, product managers, technical delivery teams, and others to continuously innovate analytic solutions.
- Design, develop, and review real-time/bulk data pipelines from a variety of sources (streaming data, APIs, data warehouse, messages, images, video, etc) while also coach jr. team members.
- Ensure the project team is following established design patterns for data ingest, transformation, and egress.
- Develop documentation of Data Lineage and Data Dictionaries to create a broad awareness of the enterprise data model and its applications.
- Apply best practices within DataOps (Version Control, P.R. Based Development, Schema Change Control, CI/CD, Deployment Automation, Test Automation, Shift left on Security, Loosely Coupled Architectures, Monitoring, Proactive Notifications)
- Problem Solving/Project Leadership: Provide thought leadership in problem solving to enrich possible solutions by constructively challenging paradigms and actively soliciting other opinions. Actively participate in R&D initiatives
- Architecture: Utilize modern cloud technologies and employ best practices from DevOps/DataOps to produce enterprise quality production Python and SQL code with minimal errors. Identify and direct the implementation code optimization opportunities during code review sessions and proactively pull in external experts as needed.
- Self-Development: Flexibly seek out new work or training opportunities to broaden experience. Independently research the latest technologies and openly discuss applications within the department.
- Perform other duties as requested.
- Working knowledge of Azure Stream Architectures, DBT, Schema Change tools, Data Dictionary tools, Azure Machine Learning Environment, GIS Data
- Working knowledge of Software Engineering and Object Orient Programming Principles
- Working knowledge of Distributed Parallel Processing Environments such as Spark or Snowflake
- Working knowledge of problem solving/root cause analysis on Production workloads
- Working knowledge of Agile, Scrum, and Kanban
- Working knowledge of workflow orchestration using tools such as Airflow, Prefect, Dagster, or similar tooling
- Working knowledge with CI/CD and automation tools like Jenkins or Azure DevOps
- Experience with containerization tools such as Docker.
- Strong verbal and written communication skills in English language
- Bachelor's degree in engineering, computer science, analytical field (Statistics, Mathematics, etc.) or related discipline and five (5) years of relevant work experience
- Master's in engineering, computer science, analytical field (Statistics, Mathematics, etc.) or related discipline and three (3) year of relevant work experience
- Ph.D. in engineering, computer science, analytical field (Statistics, Mathematics, etc.) or related discipline and one (1) year of relevant work experience
- Strong experience in at least three areas:
- Knowledgeable Practitioner of SQL development with experience designing high quality, production SQL codebases
- Knowledgeable Practitioner of Python development with experience designing high quality, production Python codebases
- Knowledgeable Practitioner in data engineering, software engineering, and Client systems architecture
- Knowledgeable Practitioner of data modeling
- Experience applying software development best practices in data engineering projects, including Version Control, P.R. Based Development, Schema Change Control, CI/CD, Deployment Automation, Test Driven Development/Test Automation, Shift left on Security, Loosely Coupled Architectures, Monitoring, Proactive Notifications using Python and SQL
- Data science experience wrangling data, model selection, model training, modeling validation, e.g., Operational Readiness Evaluator and Model Development and Assessment Framework, and deployment at scale
-
Data Engineer, Financial Data
2 weeks ago
CIRCLE Phoenix, United StatesCircle is a financial technology company at the epicenter of the emerging internet of money, where value can finally travel like other digital data — globally, nearly instantly and less expensively than legacy settlement systems. This ground-breaking new internet layer opens up p ...
-
Data Engineer
4 days ago
Insight Global Phoenix, United StatesIn this role you will be contracted to build and maintain scalable data pipelines on Google Cloud Platform (GCP) to serve our cyber security data mart customers in building an asset inventory. You will work closely with cross-functional teams to ensure data integrity, reliability ...
-
Data Engineer
1 week ago
Virtuous Phoenix, United StatesJob Description · Job DescriptionAbout UsVirtuous is on a mission to inspire global generosity by helping nonprofits build better relationships with their donors. We offer a modern software platform that provides mid-sized charities with elegant tools for fundraising, marketing, ...
-
Data Engineer
1 day ago
Nucleusteq Phoenix, United StatesWhat You'll Do · ? Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies · ? Partner with business teams and communicate with product managers to automate business processes, ...
-
Data Engineer
3 weeks ago
eTek IT Services, Inc. Phoenix, United StatesJob Description · Job DescriptionRequired SkillsBig Data Engineer with 3-4 years of hands-on Spark/Scala and Hive experience. The candidate must be able to work a hybrid schedule with the team in Phoenix, AZ (onsite every Tues/Wed/Thurs). If the candidate is not located in Phoeni ...
-
Data Engineer
4 weeks ago
Forhyre Phoenix, United StatesJob Description · Job DescriptionWe are looking for a passionate certified Data Engineer. The successful candidate will turn data into information, information into insight and insight into business decisions. · Data analyst responsibilities include conducting full lifecycle anal ...
-
Data Engineer
2 weeks ago
Progilisys Solutions Phoenix, United StatesJob Description · Job DescriptionMUST BE A U.S. CITIZEN and HOLD AT LEAST A TIER 2 FEDERAL SECURITY CLEARANCE · NOT OPEN TO CORP TO CORP · Immediate need for Data Modelers, Data Analysts, Data Architects, and Data Engineers for a government contract we are working on for our clie ...
-
data engineer
3 days ago
Atos Phoenix, United StatesEviden, part of the Atos Group, with an annual revenue of circa € 5 billion is a global leader in data-driven, trusted and sustainable digital transformation. As a next generation digital business with worldwide leading positions in digital, cloud, data, advanced computing and se ...
-
Senior Data Engineer
3 weeks ago
Insight Global Phoenix, United StatesMust be local to Arizona · Description · You will be an independent contributor on a fast-growing Data Engineering team pursuing a vision of analytics-driven for our client. Your expertise in data engineering and software engineering will enable and empower our organization to bu ...
-
Director Data Engineering
1 week ago
McKesson Europe Arizona, United States Full timeMcKesson is an impact-driven, Fortune 10 company that touches virtually every aspect of healthcare. We are known for delivering insights, products, and services that make quality care more accessible and affordable. Here, we focus on the health, happiness, and well-being of you a ...
-
AWS Data Engineer
1 week ago
Saxon Global Phoenix, United StatesPosition: AWS Data Engineer · Location: Phoenix, AZ ( Onsite) · Job Type: Contract · ** Need local candidate who can go In-Person at NT office in Phoenix – that's only technical round. ** · Qualifications: · Degree in Computer Science, Applied Mathematics, Engineering, or any ot ...
-
GCP Data Engineer
1 week ago
Saransh Inc Phoenix, United StatesRole: GCP Data Engineer · Location: Phoenix, AZ (Onsite from Day 1) · Job Type: Contract · Key Skills: · GCP - Data flow, Data proc, Apache Beam · Job description: · 6-9 Years of hands on Exp with GCP - Data flow, Data proc, Apache Beam skills. · Writing complex SQL queries to pu ...
-
GCP Data Engineer
2 weeks ago
Tata Consultancy Services Phoenix, United StatesJob Title · GCP Data Engineer · Relevant Experience (in yrs) · 8+ · Work Location (State, City and Zip) · 18850 N 56th St, Phoenix -AZ 85054 · Technical/Functional Skills · Must Have · Google Cloud · oBigQuery · oDataflow · oDataproc · oPub/Sub · oAirflow · Exp must on one ...
-
data ops engineer
2 weeks ago
Recurring Decimal Phoenix, United StatesData Ops Engineer – JD · Qualifications: · 5+ years of overall software engineering experience that includes hands-on software development, data engineering · 3+ years for hands-on coding experience in SQL, Python, PySpark · 3+ years of experience with advanced orchestration too ...
-
Big Data Engineer
2 weeks ago
Lorven Technologies Phoenix, United States C2C, W2 - HourlyJob Title: Big Data Engineer · Job Location: Phoenix, AZ (Onsite) · Duration: 12+ months contract · Must Have · Big Data · ETL-Big Data/Data Warehousing · Data Analytics · PySpark · Hive · Unix Scripting. · Description: · Hands-on expertise with application design, software ...
-
Senior Data Engineer, Data Quality
6 days ago
NucleusTeq Phoenix, AZ, United StatesRequired Skill Sets: Terraform, AWS Cloud transformation, Redshift, Airflow, DBT, CI/CD, Autosys and Control M, Github, Snowflake, AWS certification, SQL, Apache Airflow, Data Warehousing. · Should have at least 15+ Years of overall IT experience in Designing, developing, and im ...
-
Data Center Commissioning Engineer
3 weeks ago
Datacenter People Phoenix, United StatesThe Client · Datacenter People is working with the leading data center commissioning and quality services firm in the world. · The Role · Provide engineering and technical support to plan, schedule, coordinate and execute full life cycle commissioning of critical facilities. · Pa ...
-
Senior Data Engineer
6 days ago
InterSources Arizona City, United StatesTitle: Senior Data Engineer · Location: Remote/Telecommute · Duration: Long term contract · Description: The primary responsibility of Senior Data Management Engineer is to build data pipelines, model and · prepare data, perform complex data analysis to answer Business questio ...
-
Big Data Engineer
1 day ago
Technologent Phoenix, United StatesThe Opportunity: We are seeking an experienced and highly skilled Big Data Engineer to join our client's team in Phoenix, Arizona. The ideal candidate will have a strong background in software development and a deep understanding of big data technologies, including MapReduce, Hi ...
-
Senior Data Engineer
3 days ago
American Express Phoenix, United StatesYou Lead the Way. Weve Got Your Back. · At American Express, we know that with the right backing, people and businesses have the power to progress in incredible ways. Whether were supporting our customers financial confidence to move ahead, taking commerce to new heights, or en ...
Data Engineer - Phoenix, United States - Cogliano IT Staffing
Description
Data Engineer needed for a Direct Hire position in Phoenix, AZ Position will be remote, but candidate needs to live within a reasonable distance of Phoenix.You will be project leader and independent contributor on a fast-growing Data Engineering team pursuing a vision of analytics-driven company. Your expertise in data engineering and software engineering will enable and empower our organization to build and deploy data driven solutions to production. We understand that our data does not reach its full potential until it is analyzed, and insights effectively communicated to the enterprise. You will work in close collaboration with operations, subject matter experts, data scientists, and software engineers to develop advanced, highly automated data products. You will be a champion of DataOps, and agile practices; actively participating in project teams to drive value.