The Mayor’s Office of Innovation is a new team working on Mayoral-directed strategic priorities, emphasizing data analysis, human-centered design thinking, cross-departmental coordination, and public-private partnerships to ensure outcomes-based policy making.

The Innovation Team is focused on improving service delivery and city performance across the City through replicable, strategic projects in key policy areas like small business recovery, housing, and homelessness and mental health services.  

Priority initiatives include: a customer journey and data insight project to demonstrate how City dollars are funding better outcomes through our non-profit partners:;  

• The City grants millions of dollars to non-profit organizations to address homelessness but has no way of demonstrating the outcomes of grants across all departments.  
• The City funds services delivered by many non-profit organizations, but has no data set of all City-funded services. 
• There is no reliable and up-to-date list of City-funded services that departments and non-profit organizations can use, making it hard for residents to be referred to services when they need help.  

We are looking for a curious and resourceful Data Engineer to show the power of data in bringing transparency and accountability to services, while keeping equity and ethical use of data at the forefront. 

As the Innovation Team Data Engineer, you will be a part of the Mayor’s Innovation Team, and report to the Mayor’s Office. However, your position is based within Digital Services under DataSF, and will collaborate closely with the Chief Data Officer and the Chief Digital Services Officer.  

You will work directly with the Mayor’s policy staff and Department leadership, as well as community providers to identify existing data, gaps in reporting, and develop outcomes-based reporting structures. 

This position is funded, in part, through the Bloomberg Philanthropies Government Innovation Team, and will work in close partnership with the Bloomberg Center for Public Innovation at Johns Hopkins University.  

The Innovation Team will also include a Data Program Manager, a Service Designer, and a Project Manager. As a small and agile team, you will work together to deliver prototypes and solutions that will help address the city’s most pressing challenges. 

As the Data Engineer, you will be the technical lead on the program, working with stakeholders in departments to understand data sources and pipelines and building these out in a pragmatic way. You will advise the Mayor’s Office on the most feasible deliverables that are both technically possible, and high impact. You will be supported throughout by the rest of the Innovation team, the Chief Data Officer, and the Chief Digital Services Officer.  You will: 

• Work with departmental staff to develop extract, transform, load (ETL) requirements for individual datasets 
• Consult with various departments on the best way to automate and publish datasets within their data ecosystems 
• Apply an ethical lens to the appropriate use of data 
• Create new analytics pipelines using ETL/ELT approaches according to standards and patterns you help develop and refine 
• Serve as the technical lead for database exports, manipulation, and procedures used to create and update data incorporated into the data platform 
• Implement analytics pipelines and/or data models to support analytics work 
• Migrate existing ETLs to newer infrastructure to improve data quality and reliability as needed 
• Standardize and improve existing pipelines to adhere to best practices 
• As needed help iterate and refine best practices 

You will also identify ways in which data standardization, and data access, can contribute to the City’s commitment to equitable and ethical service delivery and analytics. In collaboration with departments, you will identify data gaps that hinder equity analysis.  

Removing barriers and making it easier for all people to access services or knowledge is a core part of any role with DataSF and the Innovation Team. Beyond any technical skill set or prior work history, accomplishing this ambitious task requires an empathetic understanding of the diverse array of experiences embodied in San Francisco. Your own life experience is a critical contribution to this effort. The Innovation Team is committed to building a team whose diversity reflects the residents we serve.

1.  An associate degree in computer science or a closely related field from an accredited college or university OR its equivalent in terms of total course credits/units [i.e., at least sixty (60) semester or ninety (90) quarter credits/units with a minimum of twenty (20) semester or thirty (30) quarter credits/units in computer science or a closely-related field]; AND

2.  Three (3) years of experience analyzing, installing, configuring, enhancing, and/or maintaining the components of an enterprise network.

Substitution:  Additional experience as described above may be substituted for the required degree on a year-for-year basis (up to a maximum of two (2) years). One (1) year is equivalent to thirty (30) semester units/ forty-five (45) quarter units with a minimum of 10 semester / 15 quarter units in computer science or a closely related field.

Desirable Qualifications

Personal Skills

• Enjoys collaborative processes and developing shared understanding 
• Ability to communicate with technical and non-technical audiences 
• Investigative ability and intellectual curiosity 
• Excellent oral and written communication skills 
• Ability to learn and embrace new technologies 
• Demonstrated ability working with diverse groups of stakeholders 
• Comfort with risk and trying new things 
• Ability to work independently and as part of a small team 
• Familiarity with Agile development methodology and experience working in iterative development cycles 
• Commitment to equity and the use of data to meet the needs of all San Franciscans 

Technical/Knowledge Skills

• Data engineering
• Programming proficiency in Python 
• Strong SQL skills 
• Experience writing ETL code and/or authoring ETLs through a framework 
• Experience working with a variety of databases, APIs, and formats to extract and transform data 
• Experience deploying code on cloud-based infrastructure (Azure or AWS preferred) 
• Experience training non-technical users to use technology to support their work 

Analytics 

• Experience in data cleaning and manipulation for analytics use 
• Strong quantitative analysis skills 
• Strong data visualization skills 
• Experience using business intelligence tools (e.g. PowerBI, Tableau) to develop visualizations 

Data management 

• Well-versed in the principles of open data management 
• Familiarity with open data platforms and/or data catalogs 

Bonus points if you have:

• Experience with Snowflake/DBT
• Familiarity with Microsoft’s Azure Cloud Tools and/or PowerBI

Important: Submission of a resume and a cover letter describing why you are applying for this position is REQUIRED at the time of filing.  To upload these items, please attach using the “additional attachments” function.

DataSF encourages applications regardless of whether you think you meet 100% of the skills listed below.

Verification: Applicants may be required to submit verification of qualifying education and experience at any point in the application and/or departmental selection process. Written verification (proof) of qualifying experience must verify that the applicant meets the minimum qualifications stated on the announcement. Written verification must be submitted on employer’s official letterhead, specifying name of employee, dates of employment, types of employment (part-time/full-time), job title(s), description of duties performed, and the verification must be signed by the employer. City employees will receive credit for the duties of the class to which they are appointed. Credit for experience obtained outside of the employee’s class will be allowed only if recorded in accordance with the provisions of the Civil Service Commission Rules. Experience claimed in self-employment must be supported by documents verifying income, earnings, business license and experience comparable to the minimum qualifications of the position. Copies of income tax papers or other documents listing occupations and total earnings must be submitted. If education verification is required, information on how to verify education requirements, including verifying foreign education credits or degree equivalency, can be found at http://sfdhr.org/index.aspx?page=456.

Note: Falsifying one’s education, training, or work experience or attempted deception on the application may result in disqualification for this and future job opportunities with the City and County of San Francisco. 

• Information About The Hiring Process
• Conviction History
• Employee Benefits Overview  
• Equal Employment Opportunity 
• Disaster Service Worker
• ADA Accommodation
• Veterans Preference
• Right to Work
• Copies of Application Documents
• Diversity Statement

Compensation:  $132,574 - $166,790 annually

Applicants are encouraged to apply immediately as this recruitment may close at any time.

Late or incomplete submissions will not be considered. Mailed, hand delivered or faxed documents/applications will not be accepted.

Applications will be screened for relevant qualifying experience. Additional screening mechanisms may be implemented in order to determine candidates’ qualifications. Only those applicants who most closely meet the needs of the Agency will be invited to participate in the selection process. Applicants meeting the minimum qualifications are not guaranteed advancement to the interview. Qualified applicants with disabilities requiring reasonable accommodation in the selection process must contact the Agency by phone at (415) 554-6000 or, if hearing impaired at (415) 554-6015 (TTY).

CONDITION OF EMPLOYMENT:  All City and County of San Francisco employees are required to be fully vaccinated against COVID-19 as a condition of employment. Someone is fully vaccinated when 14 days have passed since they received the final dose of a two-shot vaccine or a dose of a one-shot vaccine. Any new hire must present proof of full vaccination status to be appointed. Any new hire who will be routinely assigned or occasionally enter High-Risk Settings, must provide proof of having received a COVID-19 booster vaccine by March 1, 2022, or once eligible.

The City and County of San Francisco encourages women, minorities and persons with disabilities to apply. Applicants will be considered regardless of their sex, race, age, religion, color, national origin, ancestry, physical disability, mental disability, medical condition (associated with cancer, a history of cancer, or genetic characteristics), HIV/AIDS status, genetic information, marital status, sexual orientation, gender, gender identity, gender expression, military and veteran status, or other protected category under the law.