- Developing and maintaining scalable data pipelines and building new API integrations to support increasing data volume and complexity.
- Designing efficient data structures and database schemas, as well as working with distributed system architecture and non-relational databases.
- Collaborating with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility and fostering data-driven decision-making across the organization.
- Implementing processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it.
- Performing data analysis required to troubleshoot data-related issues and assist in the resolution of data issues.
- Working closely with a team of engineers, product managers, and analysts.
- Defining company data assets (data models) and jobs to populate data models.
- Designing data integrations and data quality frameworks.
- Designing and evaluating open-source and vendor tools for data lineage.
- Working closely with all business units and engineering teams to develop a strategy for long-term data platform architecture.
- Other duties as assigned.
- Degree - Bachelor's degree in Computer Science, Information Technology, Business, or equivalent experience.
- Functional Experience - 5+ years of experience with BI reporting tools like Power BI or Tableau.
- Functional Experience - 3+ years of experience with large sets of regulated data, designing efficient data structures, and database schemas, as well as working with distributed systems architecture and CosmosDB.
- Functional Experience - 3+ years of experience with SQL and Python, with a focus on building reusable frameworks.
- Functional Experience - 3+ years' experience with integration technologies and protocols such as SOAP, REST, JSON, and APIs, with experience in handling streaming data.
- Functional Experience - Experience with planning and implementing a data warehouse, data lake, or other data repositories.
- Functional Experience - Hands-on experience in Azure Data Factory, DataBricks, Azure Storage, SQL Pools, CI/CD Pipeline Design, and other Azure services like Functions and Logic Apps.
- Interpersonal Relationships - Ability to work well with others of all personality types, demonstrating problem-solving skills and the ability to prioritize tasks.
- Communication - Ability to communicate in verbal and written form with both technical and non-technical personnel.
- Initiative - Success as a self-starting, hardworking, and inquisitive worker.
- Teamwork - Ability to work with cross-functional teams to deliver on a common goal.
- Agile/Scrum - Experience in an agile product environment, including a deep understanding and experience with agile methodologies.
- Domain Driven Design - Understanding and experience with Domain Driven Design.
- Financial or Education Domains and their data standards - Ed-Fi, CEDS, SIF, GAAP, etc.
- Knowledge and experience with data privacy, data governance, and data cataloging principles.
- Machine Learning - Knowledge of best practices and experience with an LLM.
- Corticon Rules Engine technology.
- WebSphere Liberty.
-
Data Engineer
1 week ago
Unreal Gigs San Francisco, United States Full timeCompany Overview: Welcome to the forefront of data-driven innovation At our company, we're revolutionizing how businesses leverage data to drive insights and make informed decisions. Our mission is to develop scalable and robust data infrastructure that empowers organizations to ...
-
Data Engineer
1 week ago
Sia Partners San Francisco, United StatesSia Partners is a next-generation management consulting firm. We offer a unique blend of AI and design capabilities, augmenting traditional consulting to deliver superior value to our clients. Counting 3,000 consultants in 19 countries, we expect to achieve USD 420 million in tur ...
-
Data Engineer
6 days ago
Rigil Corporation San Francisco, United States Full timeRole: Data Engineer · About Rigil: · Rigil is an award-winning, woman-owned, small business that specializes in technology consulting, strategy consulting and product development. We value teamwork and strive to build strong leaders. · Location: San Francisco, CA · Job Type: Fu ...
-
Data Engineer
5 days ago
Pathway Vet Alliance San Francisco, United StatesAbout Pathway · Deeptech start-up, founded in March 2020. Our primary developer offering is an ultra-performant Data Processing Framework (unified streaming + batch) with a Python API, distributed Rust engine, and capabilities for data source integration & transformation at scal ...
-
Data Engineer
1 day ago
Notion San Francisco, United StatesAbout Us: · We're on a mission to make it possible for every person, team, and company to be able to tailor their software to solve any problem and take on any challenge. Computers may be our most powerful tools, but most of us can't build or modify the software we use on them e ...
-
Data Engineer
2 weeks ago
Work & Co San Francisco, United States FreelanceSr. Data Engineer (Contractor) · Presence is a San-Francisco based consultancy specializing in digital product development and innovation for global brands. We've been delivering cutting-edge projects for ten years– and we're growing · We're currently seeking a Sr Data Engineer ...
-
Data Engineer
2 weeks ago
Sia Partners San Francisco, United States Full timeJob Description · Sia Partners is looking for a talented Data Engineer to support our activities within the Data Science Business Unit. You will be working alongside with our Data Science consultants and our clients on Data Engineering topics, including creating relevant data mod ...
-
Data Engineer
4 days ago
BayOne Solutions San Francisco, United States Full timeSenior Data Engineer · Location: (100% Remote) · Duration: Full time · The Opportunity: · Technology · Our technology team works fast and smart. With San Francisco as our home, we take bringing new tech to market seriously, developing the latest in mobile technologies, scalable a ...
-
Data Engineer
3 weeks ago
Stefanini San Francisco, United StatesJob Description · Details: Stefanini Group is hiring Stefanini is looking for Cloud Data Engineer in San Francisco, CA(Hybrid) For quick Apply, please reach out to Ayush Dwivedi - call: / email: Open to W2 Candidates only (US Citizens & Green Card Holders Only) Contributes to ...
-
Data Engineer
3 weeks ago
Hexcel West Valley City, United StatesWith our strong investment in research and development and our culture of continuous improvement, Hexcel is the industry leader in the manufacturing of advance composite materials, including carbon fiber, woven reinforcements, resins, prepregs, honeycombs and additive manufacture ...
-
Data Engineer
5 days ago
SonderMind San Francisco, United StatesAbout SonderMind · At SonderMind, we know that therapy works. SonderMind provides accessible, personalized mental healthcare that produces high-quality outcomes for patients. SonderMind's individualized approach to care starts with using innovative technology to help people not ...
-
Data Engineer
3 weeks ago
Unreal Gigs San Francisco, United StatesJob Description · Job DescriptionCompany Overview: Welcome to the forefront of data-driven innovation At our company, we're revolutionizing how businesses leverage data to drive insights and make informed decisions. Our mission is to develop scalable and robust data infrastructur ...
-
Data Engineer
1 month ago
teamworkonline San Francisco, United StatesCompany Overview · Swish Analytics is a sports analytics, betting and fantasy startup building the next generation of predictive sports analytics data products. We believe that oddsmaking is a challenge rooted in engineering, mathematics, and sports betting expertise; not intuiti ...
-
Data Engineer
2 days ago
Figma San Francisco, United StatesFigma is growing our team of passionate people on a mission to make design accessible to all. Born on the Web, Figma helps entire product teams brainstorm, design and build better products from start to finish. Whether its consolidating tools, simplifying workflows, or collaborat ...
-
Data Engineer
5 days ago
University of California San Francisco, United StatesData Engineer · Neuro-Memory and Aging · Full Time · 77338BR · Job Summary · **This is an onsite position @ Mission Bay; Local SF · The Brain Aging Network for Cognitive Health (BRANCH) study aims to understand the complex biological, genetic, and lifestyle factors that unde ...
-
Data Engineer
5 days ago
Atlassian San Francisco, United StatesOverview: · Working at Atlassian · Atlassians can choose where they work whether in an office, from home, or a combination of the two. That way, Atlassians have more control over supporting their family, personal goals, and other priorities. We can hire people in any country wh ...
-
Data Engineer
5 days ago
AEG San Francisco, United StatesIn order to be considered for this role, after clicking "Apply Now" above and being redirected, you must fully complete the application process on the follow-up screen. · Company Overview Swish Analytics is a sports analytics, betting and fantasy startup building the next generat ...
-
Data Engineer
5 days ago
BayOne Solutions San Francisco, United States Full timeSenior Data Engineer · Location: (100% Remote) · Duration: Full time · The Opportunity: · Technology · Our technology team works fast and smart. With San Francisco as our home, we take bringing new tech to market seriously, developing the latest in mobile technologies, scala ...
-
Data Engineer
5 days ago
Django Rest Framework San Francisco, United Stateshims & hers is hiring a · Remote Data Engineer · We're looking for a savvy and experienced Senior Data Engineer to join the Data Platform Engineering team at Hims. As a Senior Data Engineer, you will work with the analytics engineers, product managers, engineers, security, DevOp ...
-
Data Engineer
2 days ago
OpenAI San Francisco, United StatesAbout the team · The Safety Systems team is responsible for various safety work to ensure our best models can be safely deployed to the real world to benefit the society. The work scope covers a wide range of projects from detection to model improvement to evaluation, aiming to ...
Data Engineer - West Valley City, United States - Kesta IT
Description
Come build, innovate, disrupt, and thriveK?STA I.T is actively seeking a Data Engineer foran immediate contract engagement with our government client.
Work Location: This position is remote.
Job Description:
The IT department of our client is working on a comprehensive modernization initiative known as the Schools Information Management System (USIMS). This initiative involves replacing the current legacy system, data collection, and associated reporting applications and reports from the ground up. We are seeking a high-energy, adaptive team player with a strong work ethic to join our Information Technology (IT) team as a Data Engineer, reporting to the USIMS Program Manager/Chief Product Owner. The Data Engineer will be responsible for architecting and solutioning our data pipeline. The ideal candidate has experience in Azure, data pipelines, data architecture, and warehousing, and has some familiarity with machine learning. They are passionate about data and making people's lives easier. They enjoy both philosophical discussions and physical deployments and are comfortable working with multiple teams.
Responsibilities:
As a Data Engineer, your responsibilities will include:
Certifications: Azure Data Engineering, Azure DBA, Azure Developer, or others related to the position.
•Medical Benefits (Platinum level plans available)
•Work from home / Hybrid / Onsite options
•PTO
•Holiday Pay
•VTO
•401K
•Charitable Match
•Training reimbursement
About K?STA I.T.:
Our name says it all; K?STA I.T. (Keys-to-I.T.) AND our people are our keys to our success
K?STA I.T. is a premier Utah-based technical staffing and consulting services firm. We specialize in temporary and permanent placement of Software, Hardware, Network, Cloud, CRM/ERP, Data, End-User support, Web and Executive / leadership-based positions on a full time and consulting basis.
If you're interested in a role where top performance is rewarded, personal time is valued, and excellence is demanded at every level we want to talk to you today
Where do you want to go? We've got the keys ~ K?STA I.T.
WWW.KeSTAIT.COM