Data Engineer
Dallas, TX, US
Heritage Auctions
Browse and Find coins, comics, currency, art, luxury handbags, sports memorabilia, wine, historical items, books, real estate, and more at Heritage Auctions.Description
Are you a talented and knowledgeable Data Engineer with SQL Server experience? Set your sights on a career at Heritage Auctions, headquartered in Dallas, Texas, with offices in New York, Chicago, Beverly Hills, London, Hong Kong, and other cities. Heritage Auctions is the largest auction house founded in the U.S. and serves more than 40 different auction categories, including Coins, Sports, Comics, Historical, Jewelry, Fine & Decorative Art, Wine, and many more.
SUMMARY: Responsible for the development of all phases in SQL, T-SQL, relational database programming/design, APIs, SSIS, and SSRS reporting.
- Hybrid position - On-site one day per week
- Must be local to the DFW area
BENEFITS:
- Medical, Dental, Vision coverage
- Paid time off
- 401k savings plans
COMPENSATION: Commensurate based on experience
LOCATION: South of Dallas/Fort Worth International Airport, NW corner of W. Airport Freeway (Hwy. 183) and Valley View Lane
ESSENTIAL DUTIES & RESPONSIBILITIES:
SQL Development:
- Write and optimize stored procedures, functions, table alterations, and indexes in SQL Server 2016 and 2019.
- Design and implement efficient queries using inner/outer joins and set-based logic.
- Performance tuning of stored procedures, set-based code, and indexing strategies.
- Leverage execution plans, statistics, and plan diagrams for troubleshooting and optimization.
Data Integration & Pipeline Development:
- Develop and manage data pipelines using SSIS and Azure Data Factory.
- Consume and process data from APIs, handling JSON data efficiently.
- Configure and promote objects through development to production environments using version control and coding standards.
ElasticSearch Expertise:
- Design and manage indexes and lifecycle management for optimal search performance.
- Develop ElasticSearch queries, including keyword, text, and vector search, and manage document ingestion.
- Leverage ML inference models within ElasticSearch pipelines to enhance retrieval and ranking mechanisms.
Machine Learning Integration:
- Build and integrate machine learning models into search pipelines using Python.
- Experience with libraries such as TensorFlow, PyTorch, or scikit-learn.
- Familiarity with natural language processing (NLP) and large language models (LLMs).
Advanced Search and Retrieval Systems:
- Integrate large language models (LLMs) for retrieval-augmented generation (RAG) solutions.
- Design and manage scalable, high-availability systems for efficient query processing and document retrieval.
- Utilize knowledge graphs and dynamic query generation to enhance search functionality.
Agentic AI Systems:
- Build multi-agent systems for advanced search and recommendation engines.
- Use frameworks like LangChain or LangGraph for orchestrating agent reasoning and decision-making processes.
- Optimize multi-turn conversations, state management, and task collaboration across distributed agents.
Collaboration and Ownership:
- Own the design and improvement of database schema and architecture.
- Translate business requirements into scalable system designs.
- Interact with cross-functional teams and act as a subject matter expert for data engineering and search technologies.
Requirements
EDUCATION & EXPERIENCE:
- Bachelor’s degree in Computer Science required Master’s degree preferred
- Minimum 5+ years of experience as an MS SQL programmer in a fast-paced, dynamic environment using a structured software development methodology
- Experience designing and implementing large-scale database solutions that are reliable, scalable, and perform at high levels
- Working knowledge of security and privacy issues, SQL 2019, and SQL 2022
WORK ENVIRONMENT: ?Individuals must be team-quality players in a fast-paced environment. The candidate must work in an environment with 50% development and 50% production support.
At Heritage Auctions, we celebrate diversity and are committed to fostering an inclusive environment. We welcome and encourage applications from women, minorities, veterans, mature workers, and persons with disabilities. EOE
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: APIs Architecture Azure Computer Science Data pipelines Elasticsearch Engineering JSON LangChain LLMs Machine Learning ML models MS SQL NLP Pipelines Privacy Python PyTorch RAG RDBMS Scikit-learn Security SQL SSIS Statistics TensorFlow T-SQL
Perks/benefits: 401(k) matching Career development Health care
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.