Sr Data Architect (Trading Systems) (JR1014248)
- 605 Third Avenue, New York, NY
LTX is seeking an experienced Data Architect to join our growing team.
The Data Architect will assume ownership of LTX’s data and data pipeline architecture, with the goal of optimizing data flow and collection for cross functional teams.
Candidate will support software developers, systems architects, data analysts, and data scientists on numerous initiatives and will build an optimal and consistent data architecture throughout the LTX product set. Candidate must be self-directed and comfortable taking ownership of the data needs of multiple teams, systems, and products.
The ideal candidate is an experienced data pipeline builder and data wrangler who is excited by the prospect of designing and optimizing the LTX data architecture as a key component of our next generation of products.
Take ownership of the logical and physical LTX data model across all functions: data science, transactional data, market data, and reference data
Create and maintain efficient time-series databases, optimized for both data ingestion as well as time series queries
Define consistent practices across all data sets including naming, data types, and data structures. Ensure new data elements are consistent with established conventions.
Devise a strategy for accommodating time-dependent changes to reference and market data
Manage data asset life cycles
Create tools and processes to continually monitor and report on data quality and consistency
Work with data science team to implement “big data” environment. Create and maintain optimal data pipeline architecture,
Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using both traditional relational databases as well as ‘big data’ technologies.
Work with business, product, and engineering stakeholders to support their data infrastructure needs and help resolve data-related issues.
Build operational tools to troubleshoot data issues and monitor database performance
Help build a BI framework and analytical tools to extract valuable business intelligence based on transactional data and customer activity logs
We are looking for a candidate with 10 years of overall experience; 5+ years as a Data Architect. Candidate should have experience using the following software/tools:
Experience with relational SQL (especially Postgres) as well as NoSQL databases
Experience with big data tools: Hadoop, Spark, Kafka, etc.
Must have experience coding in object-oriented/object function scripting languages: Python, Java, C++, Scala, etc.
Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
Nice to have: Experience with AWS cloud services: EC2, EMR, RDS, Redshift is a plus
Nice to have: Experience with stream-processing systems: Storm, Spark-Streaming, etc
In addition, candidate:
Must possess strong analytic skills related to working with unstructured datasets and have experience manipulating, processing, and extracting value from large disconnected datasets.
Should have working knowledge of message queuing, stream processing, and highly scalable ‘big data’ data stores.
Must have solid project management and organizational skills.
Must have Fixed Income or Electronic Trading or Trading System experience