Core Data Engineer
New York
Full Time Senior-level / Expert USD 150K - 200K
Flow Traders
Flow Traders is looking for a Core Data Engineer to own the end-to-end lifecycle of our most fundamental data products. As the architect and guardian of our most valuable data, you will have a unique opportunity to make your mark on Flow Traders. High-quality data products offer substantial benefits that impact every division in our firm, playing a vital role in delivering on our strategic growth initiatives. You will be accountable for delivering these data products at an exceptional level of quality, ensuring that they are not only timely and pristine, but powerful enough to drive Flow Traders’ future growth.
What you will do
- Be accountable for timely and high-quality delivery of core data products to the rest of the organization
- Develop and own the end-to-end lifecycle of these data products
- Define and manage project plans to assume ownership of these data products
- Create and refine a common data model (esp. identifiers, normalized schemas, use of master data) across these data products
- Investigate currently available sources of data and ensure that Flow extracts maximum information and value from them
- Explore, evaluate, and onboard additional sources of available data (both independently and at the request of stakeholders)
What you need to succeed
- Excellent programming skills (any language, Python preferred)
- Working proficiency with Linux, SQL and relational databases, and version control systems
- Demonstrated ability to work with large datasets and familiarity with big data solutions
- Experience with Airflow, Kafka, and GCP (esp. GKE, Dataproc, and Big Query) highly desired
- Experience with Pandas, Spark, Apache Beam, Apache NiFi a plus
- Innate drive to generalize, systematize, and automate
- Strong interpersonal skills, works very well with both technical and non-technical stakeholders
- Ability to balance individual stakeholder demands in order to preserve quality and wide applicability of data
- Organized and able to define, manage, and execute projects (often several in parallel) while effectively triaging operational concerns
At Flow Traders, we acknowledge the importance of open and transparent communication whether it be with our employees, our stakeholders, or our local and global communities. When it comes to salary, Flow Traders uses reliable market research to create base ranges. Where candidates will fall within the range depends on a few different factors including but not limited to level of experience, location, and specific skill set. We also consider ourselves one global team, and to demonstrate that, all employees are eligible to share in the company’s success through an annual discretionary variable remuneration allocated based on company, group and individual performance and contribution.
The total compensation for this role includes a base of $150,000-$200,000 plus annual discretionary variable remuneration.
Flow Traders does not accept unsolicited resumes from any professional staffing or search firms. All resumes, and any other information identifying potential candidates, submitted to any employee at Flow Traders via-email, the Internet or directly without a valid and signed search agreement will be deemed free to contact by Flow Traders without any restrictions and no placement fee of any kind will be paid in the event the candidate is hired by Flow Traders.
Tags: Airflow Big Data BigQuery Dataproc GCP Kafka Linux Market research NiFi Pandas Python RDBMS Research Spark SQL
Perks/benefits: Startup environment
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.