DRW, a diversified trading firm renowned for integrating sophisticated technology with exceptional talent, is currently seeking a Senior Data Engineer to join their Unified Platform team. This remote, full-time position offers a unique opportunity to contribute to the development of innovative data solutions that drive trading strategies and back-office processes.
Job Details
- Job Type: Full-time
- Job Title: Senior Data Engineer
- Company: DRW
- Location: Remote
- Salary: $180,000 to $250,000 annually, depending on experience and qualifications. The position is also eligible for an annual discretionary bonus.
Job Description
As a Senior Data Engineer on DRW’s Unified Platform team, you will play a pivotal role in designing and building a cutting-edge data platform utilized by traders, quantitative researchers, and back-office personnel. Your responsibilities will include:
- Data Platform Development: Design, build, and manage DRW’s Unified Data Platform, ensuring it meets the analytical needs of various stakeholders.
- Collaboration: Work closely with traders and researchers to identify appropriate data sources and implement processes to onboard and manage new data for analysis, unlocking future trading opportunities.
- Data Solutions Design: Develop solutions to discover, purchase, organize, track usage, manage rights, and control the quality of datasets to address the needs of various trading teams and strategies.
- Monitoring and Quality Assurance: Continuously monitor data ingestion pipelines and data quality to ensure stability, reliability, and accuracy. Contribute to the development of monitoring and quality control software and processes.
Skills and Qualifications
The ideal candidate will possess:
- Experience: 7+ years working with modern data technologies and/or building data-intensive distributed systems.
- Programming Expertise: Expert-level skills in Java/Scala or Python, with a proven ability to produce high-quality, maintainable code.
- Database Proficiency: Strong familiarity with SQL and Bash.
- Cloud Technologies: Experience leveraging and building cloud-native technologies for scalable data processing.
- Data Processing: Experience with both batch and streaming systems, understanding their limitations, and familiarity with technologies such as Flink, Spark, Polars, or Dask.
- Data Storage: Experience with various data storage technologies, including S3, RDBMS, NoSQL, Delta/Iceberg, Cassandra, Clickhouse, or Kafka.
- Data Formats: Knowledge of data formats and serialization systems like Arrow, Parquet, Protobuf/gRPC, Avro, Thrift, or JSON.
- ETL Pipelines: Experience managing complex data ETL pipelines using tools such as Kubernetes, Argo Workflows, Airflow, Prefect, or Dagster.
- Schema Governance: Prior experience dealing with schema governance and evolution.
- Data Quality Control: Experience developing processes to detect data gaps or inaccuracies.
- Mentorship: A desire to mentor less experienced team members and champion engineering best practices and high code-quality standards.
- Problem-Solving: Strong technical problem-solving skills.
- Agility: Proven ability to work in an agile, fast-paced environment, prioritize multiple tasks and projects, and efficiently handle the demands of a trading environment.
Benefits And Perks
DRW offers a comprehensive suite of employee benefits, including:
- Group medical, pharmacy, dental, and vision insurance.
- 401k with discretionary employer match.
- Short and long-term disability insurance.
- Life and AD&D insurance.
- Health savings accounts and flexible spending accounts.
Additionally, DRW is committed to continuous learning and development, providing opportunities for career growth and advancement.
Application Process
To apply for the Senior Data Engineer position at DRW, please visit their careers page and submit your application through the provided portal. Ensure that your resume highlights your relevant experience and skills that align with the job requirements.
Tips for Applicants
To enhance your chances of securing the position:
- Showcase Relevant Experience: Highlight your experience with data-intensive distributed systems, modern data technologies, and cloud-native solutions.
- Demonstrate Technical Proficiency: Provide examples of your expertise in programming languages such as Java, Scala, or Python, as well as your familiarity with SQL and Bash.
- Emphasize Collaboration: Illustrate instances where you’ve worked closely with cross-functional teams, particularly in trading or financial environments.
- Highlight Problem-Solving Skills: Discuss specific challenges you’ve faced in data engineering and the solutions you’ve implemented.
- Continuous Learning: Show your commitment to staying updated with the latest developments in data engineering and related technologies.
Data Engineering Best Practices
Success in a Senior Data Engineer role involves adhering to best practices, including:
- Robust Data Architecture Design: Create scalable and maintainable data architectures that can handle large volumes of data efficiently.
- Pipeline Optimization: Develop efficient data pipelines that ensure low latency and high throughput, utilizing appropriate technologies for batch and streaming data processing.
- Data Quality Assurance: Implement rigorous data validation and monitoring processes to maintain data integrity and reliability.
- Documentation: Maintain comprehensive documentation of data processes, architectures, and workflows to facilitate collaboration and maintenance.
- Collaboration: Work closely with cross-functional teams, including traders, researchers, and IT personnel, to ensure data solutions meet organizational needs.
