Staff Data Engineer, Data Pipeline
- Austin, TX
Procore is looking for a Staff Data Platform Engineer to join our P&T (Product and Technology) data engineering team. In this role, you’ll be responsible for designing and implementing Procore’s overarching data strategy. Critical projects include the design and operation of Procore’s streaming and batching data infrastructure, the architecture of Procore’s data lake, and the selection of new infrastructure technologies.
As a successful Staff Data Platform Engineer, you must be comfortable operating in a high autonomy environment, architecting systems from the ground up, and deploying new technologies to our organization. You’ll partner with world-class developers, engineers, architects, and data scientists to drive thinking, provide technical leadership, and collaborate in defining best practices around data engineering. You’ll also work alongside local product management, engineering, and research teams to develop innovative solutions to influence our product line.
What you’ll do:
Provide technical leadership to efforts around tooling and infrastructure that enable teams to efficiently complete and maintain data science projects
Partner with teams on modeling and analysis problems – from transforming problem statements into analysis problems, to working through data modeling and engineering, to analysis and communication of results
Lead code reviews, design, and best practices
Coach and mentor senior engineers
Use experience gained in the above and expertise in this space to influence our product roadmap, potentially working with the prototype engineering team to add additional capabilities to our products to solve more of these problems
What we’re looking for:
8+ years of experience in a Data Engineer role with a Graduate degree in Computer Science, Statistics, Informatics, Information Systems, or another quantitative field.
Expertise building data pipelines (in either Real-time or batch) on large complex datasets using Spark or other open-source frameworks
Experience with AWS services including EC2, S3, Glue, EMR, RDS, Snowflake, Elastic Search, Cassandra, and Data pipeline/streaming tools (Airflow, NiFi, Kafka)
Experience building and optimizing data pipelines, architectures, and data sets
A successful history of manipulating, processing, and extracting value from large disconnected datasets
Deep knowledge of stream processing using Kafka and Kstream and highly scalable ‘big data’ data stores
Expertise in Java or Python
Team Player. Experience supporting and working with cross-functional teams in a dynamic environment
Experience in End-to-end data quality control and automated testing experience
If you'd like to stay in touch and be the first to hear about new roles at Procore, join our Talent Community.
Procore Technologies is building the software that builds the world. We provide cloud-based construction management software that helps clients more efficiently build skyscrapers, hospitals, retail centers, airports, housing complexes, and more. At Procore, we have worked hard to create and maintain a culture where you can own your work and are encouraged and given resources to try new ideas. Check us out on Glassdoor to see what others are saying about working at Procore.
We are an equal opportunity employer and welcome builders of all backgrounds. We thrive in a diverse, dynamic, and inclusive environment. We do not tolerate discrimination against employees on the basis of age, color, disability, gender, gender identity or expression, marital status, national origin, political affiliation, race, religion, sexual orientation, veteran status, or any other classification protected by law.
Perks & Benefits
You are a person with dreams, goals, and ambitions—both personally and professionally. That's why we believe in providing benefits that not only match our Procore values (Openness, Optimism, and Ownership) but enhance the lives of our team members. Here are just a few of our benefit offerings: generous paid vacation, employee stock purchase plan, enrichment and development programs, and friends and family events.