Jobs
>
Philadelphia

    Data Engineer - Philadelphia, United States - City of Philadelphia

    Default job background
    Description
    Company Description

    A best-in-class city that attracts best-in-class talent, Philadelphia is an incredible place to build a career. From our thriving arts scene and rich history to our culture of passion and grit, there are countless reasons to love living and working here. With a workforce of over 30,000 people, and more than 1,000 different job categories, the City of Philadelphia offers boundless opportunities to make an impact.
    As an employer, the City of Philadelphia values inclusion, integrity, innovation, empowerment, and hard work above all else. We offer a vibrant work environment, comprehensive health care and benefits, and the experience you need to grow and excel. If you're interested in working with a passionate team of people who care about the future of Philadelphia, start here.
    What We Offer:

    • Impact - The work you do here matters to millions.

    • Growth - Philadelphia is growing, why not grow with it?

    • Diversity & Inclusion - Find a career in a place where everyone belongs.

    • Benefits - We care about your well-being.

    The Office of Innovation & Technology (OIT) is the central IT agency for the City of Philadelphia headed by the Chief Information Officer (CIO). OIT oversees all major information and communications technology initiatives for the City of Philadelphia - increasing the effectiveness of the information technology infrastructure, where the services provided are advanced, optimized, and responsive to the needs of the City of Philadelphia's businesses, residents, and visitors. OIT responsibilities include: identifying the most effective approach for implementing new information technology directions throughout city government; improving the value of the city's technology assets and the return on the city's technology investments; ensuring data security continuity; planning for continuing operations in the event of disruption of information technology or communications services; and supporting accountable, efficient and effective government across every city department, board, commission and agency.

    Job Description

    Data Engineering at the City is a unique opportunity for meaningful, exciting work and professional development using state-of-the art technologies and software development best practices. This is a position on a diverse team of engineers, analysts, and GIS specialists, contributing to developing, maintaining, and optimizing our data pipelines and integration strategies, assisting departments and agencies in innovating, and enhancing the City's service to its residents.
    The data engineer/integration specialist will develop an intimate understanding of the City's diverse data and contribute to improving the City's data engineering infrastructure, pipelines, models, and integrations. The team uses a blend of open source, custom developed and off-the-shelf tools, including Python, Bash, SQL, DBT, GIS, Docker, Terraform, Apache Airflow, Jenkins, Postgres, PostGIS, AWS, GitHub, MuleSoft as an iPaaS and SAS API provides like ArcGIS Online and CARTO.
    Some prominent services the team is responsible for include DataBridge, OIT's enterprise data warehouse, AIS, the City's custom address information systems which supports public address search and internal geocoding, and Databridge-Airflow, a custom workflow generator and orchestrator for departmental integrations ) and open data publishing ). Some examples of OIT's commitment to serving the public through the effective and innovative integration of City open data include:

    We are looking for a candidate who is not only technically skilled but also passionate about leveraging data to improve City operations and community life. This team is fundamental to the innovation of City services that directly affect residents. If you are eager to contribute to a team that values innovation, efficiency, service-oriented work and data-driven decision-making, we encourage you to apply.

    Essential Functions
    • Working with business partners of varying technical ability to understand how their data is produced, stored, and updated, designing enhancements to optimize enterprise integrations and public data accessibility.
    • Design and develop new and expand and refine existing data pipelines using Apache Airflow, custom Python-based software, and other tools to connect diverse systems of record, centralized databases, and SaaS environments, improving data platform components, data governance, master data management, data standardization, enrichment and quality assurance.
    • Play a key role in enterprise integration and open data initiatives, developing and supporting critical systems like the City's DataBridge, Databridge-Airflow and AIS.
    • Write clear, descriptive technical documentation for systems/applications, partner with data stewards of various technical levels and communicate technical details to non-technical stakeholders.
    Competencies, Knowledge, Skills and Abilities

    Competencies:
    • Clear and concise writing and communication skills.
    • Creative problem-solving and critical thinking.
    • Ability to work with data from diverse domains.
    • Efficient time management and the ability to manage multiple workflows simultaneously.
    • Ability to seek innovative opportunities and continuous improvement.
    Knowledge and Skills:
    • Proficient in Python
    • Strong SQL skills and experience with databases (Postgres preferred).
    • Familiarity with Docker, bash and minimal Linux server administration.
    • Experience with cloud services (AWS preferred).
    • Understanding of Git/GitHub for version control and CI/CD pipelines.
    • Experience or ability to learn Airflow, DBT, Terraform, Kubernetes, Mulesoft.
    • Experience working with spatial datasets a plus.
    • Experience using command line interfaces.
    Abilities:
    • To reason about, model and manipulate complex datasets.
    • To maintain clean and secure data environments.
    • To work effectively in a hybrid (on-premises and cloud) environment.
    • To communicate complex technical concepts in understandable terms.
    Qualifications
    • Bachelor's degree in Computer Science, Information Systems, or a related field. Equivalent work experience may be considered.
    • Demonstrated experience in data engineering or a similar role, with a focus on data management/integration/ETL/ELT.
    • Proven track record with Python, SQL, and database management.
    • Experience with working with modern data engineering tech stack.
    • Familiarity with development of custom ETL/CI/CD tools and the ability to learn and adapt to new technologies.
    • Previous work in a public sector or large organization setting is a plus.
    Additional Information

    Salary Range: $75,000 - $80,000

    Starting salary to be determined based on experience and qualifications.

    Important: To apply, candidates must provide a cover letter and a resume.

    Discover the Perks of Being a City of Philadelphia Employee:

    • We offer Comprehensive health coverage for employees and their eligible dependents

    • Our wellness program offers eligibility into the discounted medical plan

    • Employees receive paid vacation, sick leave, and holidays

    • Generous retirement savings options are available

    Pay off your student loans faster - As a qualifying employer, City of Philadelphia employees are eligible to participate in the Public Service Loan Forgiveness program. Join the ranks of hundreds of employees who have already benefited from this program and achieved student loan forgiveness.

    Enjoy a Free Commute on SEPTA - Starting September 1, 2023, eligible City employees will no longer have to worry about paying for SEPTA public transportation. Whether you're a full-time, part-time, or provisional employee, you can seize the opportunity to sign up for the SEPTA Key Advantage Program and receive free Key cards for free rides on SEPTA buses, trains, trolleys, and regional rails.

    Unlock Tuition Discounts and Scholarships - The City of Philadelphia has forged partnerships with over a dozen esteemed colleges and universities in the area, ensuring that our employees have access to a wide range of tuition discounts and scholarships. Experience savings of 10% to 40% on your educational expenses, extending not only to City employees but in some cases, spouse and dependents too
    Join the City of Philadelphia team today and seize these incredible benefits designed to enhance your financial well-being and personal growth

    *The successful candidate must be a city of Philadelphia resident within six months of hire

    Effective May 22, 2023, vaccinations are no longer required for new employees that work in non-medical, non-emergency or patient facing positions with the City of Philadelphia. As a result, only employees in positions providing services that are patient-facing medical care (ex: Nurses, doctors, emergency medical personnel), must be fully vaccinated.

    The City of Philadelphia is an Equal Opportunity employer and does not permit discrimination based on race, ethnicity, color, sex, sexual orientation, gender identity, religion, national origin, ancestry, age, disability, marital status, source of income, familial status, genetic information or domestic or sexual violence victim status. If you believe you were discriminated against, call the Philadelphia Commission on Human Relations at or send an email to


  • Titan Industries Jersey Village, United States

    What You Bring · Above-average degree in an IT-related field · Programming experience (SQL, C++) · Knowledge of DWH, Data Engineering, and Business Intelligence · Strong communication, analytical, and conceptual skills · Fluent in German · Team spirit and willingness to travel · ...

  • City of Philadelphia

    Data Engineer

    4 weeks ago


    City of Philadelphia Philadelphia, United States

    Company Description · A best-in-class city that attracts best-in-class talent, Philadelphia is an incredible place to build a career. From our thriving arts scene and rich history to our culture of passion and grit, there are countless reasons to love living and working here. Wi ...

  • Mondo

    Data Engineer

    3 weeks ago


    Mondo Philadelphia, United States

    Job Description · Job DescriptionApply now: Data Engineer, this is a 100% remote opportunity. The start date is ASAP for this long-term contract position. · Job Title: Data Engineer · Location-Type: 100% remote · Start Date Is: ASAP · Duration: Long-term contract · Rate: $55-$63 ...

  • Finplicity, Inc

    Data Engineer

    4 weeks ago


    Finplicity, Inc Philadelphia, United States Full time

    *Data Engineer (full time) -- Finplicity, Inc., 1536 Kater Street, Philadelphia, PA * · *Job location: 2301 Cherry Street, #4N, Philadelphia, PA, Work on data science projects related to online scientific computing; Help design and help code algorithms related to simulation of da ...

  • NBME

    Data Engineer

    3 weeks ago


    NBME Philadelphia, United States

    Job Description · Job DescriptionPOSITION OVERVIEW · NBME is looking for a Data Engineer to join a highly skilled and growing team of data engineers and BI developers. In this role you will be using your data engineering skills and problem-solving skills to deliver meaningful ins ...

  • ClifyX

    Data Engineer

    3 weeks ago


    ClifyX Philadelphia, United States

    Open Position-GCP Data Engineer · Rate-$65 · Location-Philadelphia · Skill Set · • Python, Big Data, SQL, ETL · • Tableau · • GCP experience in Data Engg/Analytics - GCP Data Flow (Hands on experience in E2E pipeline creation is MUST) · JD · Experience working with Linux, DataBr ...

  • Manpower Group Inc.

    Data Engineer

    3 weeks ago


    Manpower Group Inc. Philadelphia, United States

    Job Title : Data Engineer (Databricks Platform Modernization) · MUST HAVES Skills/Tech : 5-7 years experience · Hands-on experience with Databricks and Azure , including implementation using Unity Catalog. · Experience in platform modernization projects and implementation. · Dee ...

  • IntegriChain

    Data Engineer

    5 hours ago


    IntegriChain Philadelphia, United States

    Job Description · Job DescriptionCompany Description · IntegriChain is the data and application backbone for market access departments of Life Sciences manufacturers. We deliver the data, the applications, and the business process infrastructure for patient access and therapy com ...

  • NBME

    Data Engineer

    3 weeks ago


    NBME Philadelphia, United States

    POSITION OVERVIEW · NBME is looking for a Data Engineer to join a highly skilled and growing team of data engineers and BI developers. In this role you will be using your data engineering skills and problem-solving skills to deliver meaningful insights to Internal and external cu ...

  • Veeva

    Data Engineer

    4 weeks ago


    Veeva Philadelphia, United States

    Veeva Systems is a mission-driven organization and pioneer in industry cloud, helping life sciences companies bring therapies to patients faster. As one of the fastest-growing SaaS companies in history, we surpassed $2B in revenue in our last fiscal year with extensive growth pot ...

  • Manpower Group Inc.

    Data Engineer

    4 hours ago


    Manpower Group Inc. Philadelphia, United States

    Job Title : Data Engineer (Databricks Platform Modernization) · MUST HAVES Skills/Tech : 5-7 years experience · Hands-on experience with Databricks and Azure , including implementation using Unity Catalog. · Experience in platform modernization projects and implementation. · ...

  • Infosys

    Data Engineer

    3 weeks ago


    Infosys Philadelphia, United States

    Data Engineer BR · DESCRIPTION/RESPONSIBILITIES: Infosys is seeking a Data Engineer. This position will interface with key stakeholders and apply your technical proficiency across different stages of the Software Development Life Cycle including Requirements Elicitation, Applicat ...

  • Aramark

    Data Engineer

    4 hours ago


    Aramark Philadelphia, United States

    **Job Description** · The Data Engineer will design, create, maintain and enhance new and existing database platforms and work on improving the performance of existing database systems within a ?Big Data Infrastructure?. They create and fine-tune queries, optimize data retrieval ...

  • Zenith

    Data Engineer

    4 hours ago


    Zenith Philadelphia, United States

    Job Description · Does managing data hygiene make you smile? Does architecting and loading a wide set of data sources to a single source of truth warehouse make your heart sing? Do you love animals? Then this is the role for you · This is the perfect opportunity for someone to ...

  • City of Philadelphia

    Data Engineer

    1 week ago


    City of Philadelphia Philadelphia, United States

    Job Description · Job DescriptionCompany Description · A best-in-class city that attracts best-in-class talent, Philadelphia is an incredible place to build a career. From our thriving arts scene and rich history to our culture of passion and grit, there are countless reasons to ...

  • Aditi Consulting

    Data Engineer

    4 hours ago


    Aditi Consulting Philadelphia, United States

    Required Skills: · 60% Spark · 40% Java and Scala · Spark Coding · Required Experience: · 8+ years of hands-on software engineering experience with any object-oriented language, Java or Scala preferred. · 5+ years of experience using Spark, EMR, Glue or other serverless comput ...

  • Veeva

    Data Engineer

    3 weeks ago


    Veeva Philadelphia, United States

    Veeva Systems is a mission-driven organization and pioneer in industry cloud, helping life sciences companies bring therapies to patients faster. As one of the fastest-growing SaaS companies in history, we surpassed $2B in revenue in our last fiscal year with extensive growth pot ...

  • Marvica Technologies

    Data Engineer

    1 week ago


    Marvica Technologies Philadelphia, United States

    Job Description · Job DescriptionData Engineer · Location: Philadelphia (Hybrid), Contract to hire · Exp: 8+ Years · Responsibilities: · Develop data-driven solutions with Cloud based technologies to meet evolving business needs. Deliver impactful, scalable, and highly performant ...

  • Aramark

    Data Engineer

    5 days ago


    Aramark Philadelphia, United States

    Job Description · Primary duties will include design, implement and support of a hybrid ecosystem of on premise and cloud data solution architectures. The candidate will have knowledge of modern data architecture, Cloud architectures, and integration patterns such as RDBMS, Snowf ...

  • codesbright

    Data Engineer

    3 weeks ago


    codesbright Philadelphia, United States Full time, Part time, Contract, Training

    Responsibilities Establish a culture of collaboration and excellence within the team – and across the organization. Explore and recommend innovative solutions to complex problems. Ensure our data assets meet our data quality standards. Have fun in a fast-paced energetic environme ...