Data Engineer

Company Description

A best-in-class city that attracts best-in-class talent, Philadelphia is an incredible place to build a career. From our thriving arts scene and rich history to our culture of passion and grit, there are countless reasons to love living and working here. With a workforce of over 30,000 people, and more than 1,000 different job categories, the City of Philadelphia offers boundless opportunities to make an impact.

As an employer, the City of Philadelphia values inclusion, integrity, innovation, empowerment, and hard work above all else. We offer a vibrant work environment, comprehensive health care and benefits, and the experience you need to grow and excel. If you’re interested in working with a passionate team of people who care about the future of Philadelphia, start here.

What we offer

• Impact - The work you do here matters to millions. 
• Growth - Philadelphia is growing, why not grow with it? 
• Diversity & Inclusion - Find a career in a place where everyone belongs.
• Benefits - We care about your well-being.

Agency Description

The Mayor’s Office of Chief Counsel and PhillyStat360 is charged with providing Mayor Parker, her Chief of Staff, her Chief Deputy Mayors and her office with direct legal counsel while spearheading the Mayor’s initiative, PhillyStat360 which will provide line of sight and wrap-around integration for all city services to ensure that Philadelphians have a government they can see, touch and feel.

Key projects for the office include:

• Creating a system that provides timely and accurate information regarding the provision of city services.
• Developing an accountability and management model, based upon existing CompStat processes, that allows for the rapid deployment of City operational resources to address quality of life and community concerns by using effective tactics and strategies that are routinely reassessed for effectiveness.
• Implementing a sustainable system that provides for relentless follow-up and the authority to nimbly adjust and adapt strategies and tactics when necessary to ensure effective performance of city services and enhance community satisfaction so that Philadelphians have a government that they can see, touch, and feel.

Counsel/PhillyStat360 will comprise a small, diverse, and nimble team whose members, collectively, have expertise and experience in domains including law, City operational departments, project and performance management, data analysis/data science, policy research and analysis, persuasion/communication, and engagement/collaboration. For most projects, the office will use a matrixed approach, pairing PhillyStat360 team members with those from City operational departments who have the specific expertise – ranging from human-centered design to user experience to digital services – needed for the project.

Job Description

Position Summary

This is professional and technical work in the field of data engineering and enterprise systems integration. Employees in this class are responsible for the design, development, and maintenance of scalable data pipelines, enterprise integrations, and workflow automation tools that support citywide operations and public-facing services. Work involves analyzing complex datasets, developing and implementing data models, and enhancing data infrastructure using modern technologies and best practices in software engineering and data management. Employees serve as technical liaisons between departmental data producers and consumers, working to standardize, enrich, and optimize data for operational use, reporting, and public transparency.

Work is performed as part of a multidisciplinary team and requires independent judgment, technical expertise, and the ability to communicate complex concepts clearly to both technical and non-technical stakeholders. Assignments are performed with considerable independence and evaluated based on overall data platform performance, successful delivery of integration services, and support of enterprise data initiatives. This position reports to the First Deputy of PhillyStat360.

Essential Functions

• Develop an intimate understanding of the City’s diverse data and contribute to improving the City’s data engineering infrastructure, pipelines, models, and integrations.
• Use a blend of open source, custom developed and off-the-shelf tools, including Python, Bash, SQL, DBT, GIS, Docker, Terraform, Apache Airflow, Jenkins, Postgres, PostGIS, AWS, GitHub, MuleSoft as an iPaaS and SAS API provides like ArcGIS Online and CARTO.
• Design, develop, and maintain robust data pipelines and workflows using Python, Apache Airflow, and related tools.
• Build and support scalable data integrations between diverse systems of record, centralized databases, and cloud-based platforms (AWS, SaaS tools, etc.).
• Collaborate with City departments and agencies to understand business needs and deliver data integrations that improve public services and resident-facing applications.
• Design and maintain data pipelines that promote equitable access to information by supporting the publication of open datasets and GIS tools that inform the public on key City initiatives.
• Document technical procedures, system architectures, and operational workflows in a clear and organized manner for internal reference and audit purposes.
• Communicate effectively with both technical and non-technical stakeholders, ensuring alignment between system capabilities and departmental needs.
• Work with departments to improve data quality and integrity, particularly for datasets used in service delivery to underrepresented and historically marginalized communities.
• Ensure integration solutions meet accessibility and inclusion standards when applied in public-facing tools and systems.
• Collaborate with business partners and stakeholders to understand technical needs, create integration solutions, and make data more accessible to internal departments and the public.
• Analyze complex datasets to identify trends, correlations, and data anomalies.
• Write technical documentation, data dictionaries, and integration specifications; effectively communicate technical information to non-technical stakeholders.
• Apply DevOps practices using tools like Docker, GitHub, and Terraform to support CI/CD pipelines.
• All other duties as assigned.

Required Competencies, Knowledge, Skills, and Abilities

Knowledge of:

• Python programming and scripting for automation and data workflows.
• SQL and relational databases (PostgreSQL preferred).
• Modern data engineering tools such as Apache Airflow, DBT, and Terraform.
• Cloud infrastructure and services (especially AWS).
• Git and GitHub for version control and CI/CD.
• Docker and Linux-based server environments.
• Geospatial data and tools (PostGIS, ArcGIS Online, CARTO) preferred.

Skill in:

• Data modeling and integration design.
• Writing clear, maintainable code and documentation.
• Analyzing large, diverse datasets to extract meaningful insights.
• Managing multiple concurrent workflows and priorities.
• Troubleshooting technical issues and implementing solutions independently.

Ability to:

• Collaborate effectively across departments with varying levels of technical expertise.
• Design and implement secure, scalable, and maintainable data systems.
• Communicate technical concepts clearly to both technical and non-technical audiences.
• Learn new tools, platforms, and programming languages as needed.
• Thrive in a hybrid work environment and contribute to a collaborative, innovative team.

Qualifications

Bachelor’s degree in Computer Science, Data Science, Information Systems, Engineering, or a related field. Equivalent experience may be considered.

At least three or more years of experience in data engineering, software development, or enterprise system integration.

Additional Information

TO APPLY: Interested candidates must submit a cover letter and resume.

Salary Range: $81,000 - $90,000

Discover the Perks of Being a City of Philadelphia Employee:

• Transportation: City employees get unlimited FREE public transportation all year long through SEPTA’s Key Advantage program. Employees can ride on SEPTA buses, subways, trolleys, and regional rail for their daily commute and more.
• Parental Benefits: The City offers its employees 8 weeks of paid parental leave.
• We offer Comprehensive health coverage for employees and their eligible dependents.
• Our wellness program offers eligibility into the discounted medical plan
• Employees receive paid vacation, sick leave, and holidays
• Generous retirement savings options are available
• Pay off your student loans faster - As a qualifying employer, City of Philadelphia employees are eligible to participate in the Public Service Loan Forgiveness program. Join the ranks of hundreds of employees who have already benefited from this program and achieved student loan forgiveness.
• Unlock Tuition Discounts and Scholarships - The City of Philadelphia has forged partnerships with over a dozen esteemed colleges and universities in the area, ensuring that our employees have access to a wide range of tuition discounts and scholarships. Experience savings of 10% to 40% on your educational expenses, extending not only to City employees but in some cases, spouse and dependents too!

Join the City of Philadelphia team today and seize these incredible benefits designed to enhance your financial well-being and personal growth!

*The successful candidate must be a city of Philadelphia resident within six months of hire

Effective May 22, 2023, vaccinations are no longer required for new employees that work in non-medical, non-emergency or patient facing positions with the City of Philadelphia. As a result, only employees in positions providing services that  are patient-facing medical care (ex: Nurses, doctors, emergency medical personnel), must be fully vaccinated.

The City of Philadelphia is an Equal Opportunity employer and does not permit discrimination based on race, ethnicity, color, sex, sexual orientation, gender identity, religion, national origin, ancestry, age, disability, marital status, source of income, familial status, genetic information or domestic or sexual violence victim status. If you believe you were discriminated against, call the Philadelphia Commission on Human Relations at 215-686-4670 or send an email to faqpchr@phila.gov.

For more information, go to: Human Relations Website: http://www.phila.gov/humanrelations/Pages/default.aspx