Sr. Data Engineer
New York - 150 E 42nd, United States
R
USD 94K-152K Senior-level Full Time
Tasks
- Build and maintain data models for identity linkage
- Build automated validation frameworks and quality tracking pipelines
- Build evaluation tooling for regression detection
- Collaborate with data science and product teams
- Conduct code reviews and architectural discussions
- Design build and maintain Snowflake pipelines
- Design implement test and deploy via CI CD
- Document data models and pipeline logic
- Enhance AI assisted matching engine
- Implement and test matching algorithm improvements
- Investigate data anomalies and quality issues
- Measure precision recall and match quality
- Monitor data completeness match consistency and anomalies and report results
- Support QA processes and on call responsibilities
- Write SQL and Python to transform deduplicate and enrich identity data
Perks/Benefits
- 401k
- Dental insurance
- Flexible paid time off
- Life insurance
- Long-term disability
- Medical insurance
- Paid Holidays
- Paid parental leave
- Paid sick leave
- Short-term disability
- Vision insurance
Skills/Tech-stack
AI Assisted Pipeline Logic | AWS | Agile | CI/CD | Data Deduplication | Data Governance | Data Modeling | Data Processing | Data Quality | Git | Identity matching | LLM | LLM Assisted Data Processing | Prompt engineering | Python | Record Linkage | Regression testing | SQL | Snowflake | Snowpark | Unix Shell
Education
N/A
Roles
Regions
Countries
States
Cities
Related jobs
-
Embedded Software Test Engineer USD 105K-158K5S | Agile | C# | CI/CD | Case Development401k | Disability insurance | Employee stock purchase plan | Fully remote | Health insuranceMid-level Full TimeHarrisburg, PA, US, 17111 R11h ago
-
Staff Data Engineer USD 160K-207KAnomaly Detection | Business Intelligence | DBT | Data Architecture | Data Engineering401k match | Dental insurance | Family planning resources | Flexible vacation days | Learning and development programSenior-level Full TimeRemote - USA R14h ago
-
API Integration | API Security | Authentication | CI/CD | Cloud NetworkingAnnual performance bonus | Career growth | Fully remote workSenior-level Full TimeCanada R16h ago
-
Marketing Analytics Engineer USD 142K-196KA/B | A/B Testing | Amazon Redshift | Attribution | B testingEntry-level Full TimeLehi, UT R19h ago
-
Senior Software Engineer (AI Data Engineering) USD 180K-210KAgentic Workflows | Architecture alignment | Backend Development | Code review | Data Modeling401k matching | Catered lunches | Dental insurance | Flexible schedule | Medical insuranceSenior-level Full TimeNew York, NY or Remote R20h ago
-
Senior Data Engineer CAD 100K-120KAdobe Analytics | Adobe Experience | Adobe Experience Cloud | Adobe Journey Optimizer | Adobe LaunchRemote workSenior-level Full TimeCanada R21h ago
-
Freelance Senior Data Engineer USD 100K-120KAdobe Analytics | Adobe Customer Journey | Adobe Customer Journey Analytics | Adobe Journey Optimizer | Adobe LaunchEquipment provided by worker | Freelance contract | Remote workSenior-level FreelanceUnited States R21h ago
-
Staff Software Engineer, Energy Analytics USD 165K-295KAWS | Argo | DBT | Docker | JavaRemote workSenior-level Full TimeUnited States R1d ago
-
Senior Machine Learning Engineer USD 216K-303KAdvertising Auctions | Airflow | BigQuery | Convolutional Neural Networks | Deep learning401k employer match | Family planning support | Flexible vacation | Gender-affirming care | Health care benefitsSenior-level Full TimeRemote - United States R1d ago
-
Staff Analytics Engineer USD 156K-235KAWS | Airflow | Amazon Redshift | Batch Processing | DBTBonus program | Global perks | Health and wellness benefits | RSU Equity ProgramSenior-level Full TimeUnited States R1d ago
-
Applied AI Engineer, Agentic Systems USD 112K-153K.NET | Anthropic API | CrewAI | Evaluation | Fine TuningSenior-level Full TimeRemote - United States R1d ago
-
Senior Data Platform Engineer USD 123K-200KApache Flink | ArgoCD | BigQuery | Bigtable | CI/CDMentorship opportunities | On-call rotation | Remote workSenior-level Full TimeRemote - United States R1d ago
-
AI Engineer USD 119K-258KAI Foundry | AI Studio | APIs | Agile | Azure AI401k match | Company subsidized dental coverage | Company subsidized vision coverage | Continuing education stipend | Employee assistance programSenior-level Full TimeRemote in U.S. or Hybrid in … R1d ago
-
CLIP | Computer Vision | Deep learning | Diffusion Models | Generative AIAnnual vacation | Conference reimbursement | Corporate discounts | English learning discounts | Fully remoteSenior-level Full TimeCanada R1d ago
-
Agent Frameworks | C# | Data Preparation | Deep learning | Direct Preference OptimizationAnnual vacation | English language learning discounts | Fully remote | Health support budget | Home office setup supportSenior-level Full TimeCanada R1d ago
-
Solutions Engineer (AI/ML) USD 131K-195KAPI Integration | Analytics | Artificial Intelligence | Automation | CRMCompany covered travelSenior-level Full TimeRemote, US R1d ago
-
Databricks Solution Architect USD 180K-247KAWS S3 | Apache Spark | Autoscaling | Azure Data | Azure Data LakeSenior-level Full TimeUnited States R1d ago
-
Staff Data Engineer - US (Remote) USD 160K-250KAWS | Airflow | Alerting | Amazon EMR | Apache IcebergCareer growth | Mentorship | On-call participation | Remote workSenior-level Full TimeUnited States R1d ago
-
Staff Data Engineer - CANADA (Remote) USD 159K-250KAWS | Airflow | Apache Kafka | Cloud Security | Data GovernanceMentorship | On-call participation | Remote work | Technical leadership growthSenior-level Full TimeCanada R1d ago
-
Entry-level Full Time InternshipRemote, United States R1d ago
-
Lead Analytics Manager USD 120K-150KAffiliate Marketing | Business Intelligence | Dashboard Design | Data Ingestion | Data LiteracySenior-level Full TimeAustin, TX (remote); Dallas, TX (remote); … R1d ago
-
C++ | Cloud Computing | Code Reviews | Deployment Automation | Distributed Systems401k match | Caregiving support | Family planning support | Flexible vacation | Gender-affirming careSenior-level Full TimeRemote - United States R1d ago
-
APIs | Agentic Workflows | CI/CD | Cost Management | GeminiSenior-level Full TimeRemote - USA, United States R1d ago
-
Edge AI Engineer USD 100K-150KBias Evaluation | C++ | Core ML | DSP | Edge ComputingCareer growth opportunities | Health benefits | Remote workSenior-level Full TimeUnited States - Remote R1d ago
-
Edge AI Engineer USD 100K-150KBias Evaluation | C++ | Core ML | Edge Computing | Edge inferenceCareer growth potential | H1B transfer support for eligible candidates | Remote workSenior-level Full TimeUnited States - Remote R1d ago