Data Engineer
Tasks
- Align data definitions to business requirements
- Apply metadata tags
- Build aggregate tables
- Build batch ETL/ELT pipelines
- Build real-time streaming pipelines
- Configure data contract validation gates
- Create dimensional models
- Deliver gold layer data marts
- Design data ingestion pipelines
- Document data schemas
- Implement automated data quality tests
- Investigate data discrepancies
- Monitor troubleshoot and optimize data pipelines
- Resolve support tickets
- Set up logging, alerting, and monitoring
- Write maintain data quality expectations
Perks/Benefits
- Float holidays
- Free dog walking services
- Gym access
- Hybrid remote work
- Medical, dental, and vision benefits
- ORCA cards
- Paid time off
- Parking
- Pet health insurance
- Pet-friendly office environment
- Sabbatical
- Volunteer time off
Skills/Tech-stack
Alerting | Apache Spark | Automated Monitoring | Azure | Azure DevOps | CI/CD | Code control | Data Contracts | Data Governance | Data Lineage | Data Quality | Data Quality Testing | Databricks | Delta Lake | Delta Live Tables | Delta Live) | ELT | ETL | Git | GitHub Actions | Logging | Medallion Architecture | PySpark | Quality testing | Source Code | Source Code Control | SparkSQL | Structured Streaming | Unity Catalog
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Practice Architect AI/ML USD 136K-204KAI RMF | AWS | Agent Orchestration | Agentic Workflows | Autogen401k | Health insurance | Paid time off | Remote workSenior-level Full TimeDallas, Texas, USA R9h ago
-
Senior-level Full TimeRemote or VA, VA, United States R10h ago
-
APIs | AWS | Agile | Auditability | AzureMentoring and coaching | Remote work | Training and enablementSenior-level Full TimePlainsboro, NJ. R12h ago
-
Mid-level Full TimeAustin, TX R13h ago
-
Analytics Engineer USD 119K-234KAzure Data | Azure Data Factory | Azure SQL | Azure Synapse | Azure Synapse AnalyticsSenior-level Full TimeHouston, TX, United States R14h ago
-
Mid-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL R14h ago
-
A/B | A/B Testing | Apache Airflow | Apache Kafka | Apache Spark401k match | Life insurance | Long-term disability | Medical, dental, and vision insurance | Paid HolidaysMid-level Full TimeSan Jose, California, United States R16h ago
-
Quant Analytics [Multiple Positions Available] USD 158K-201KAWS | Alteryx | Association Rule Mining | Association rule | Behavioral analyticsBackup childcare | Comprehensive health care coverage | Domestic travel | Financial coaching | Mental health supportSenior-level Full TimeColumbus, OH, United States R16h ago
-
Research Engineer / Scientist -AI for Databases USD 162K-387KAWS | Architecture Search | Artificial Intelligence | Automated Database Tuning | Azure401k match | Conference attendance | Dental insurance | Life insurance | Long-term disabilityMid-level Full TimeSan Jose, California, United States R16h ago
-
Senior Machine Learning Engineer, Content Platform USD 141K-360KApache Spark | Cloud Computing | Generative AI | Language Models | Large Language ModelsDisability benefits | Equity awards | Financial wellness support | Health insurance | Life insuranceSenior-level Full TimeSan Jose, California R1d ago
-
AI Agents | AI monitoring | API Integration | Amazon Web Services | Anthropic401k retirement plan | Medical, dental, and vision benefits | Paid Holidays | Paid time off | Variable pay/incentivesSenior-level Full TimeUnited States R1d ago
-
Lead Data Engineer USD 164K-200KAPIs | AWS | Agentic AI | Azure | Batch dataDisability and life insurance | Employee assistance program | Fertility and family forming benefits | Flexible spending account | Healthcare conciergeSenior-level Full TimeHeadquarters, United States R1d ago
-
Data Engineer USD 114K-126KAPI Integration | AWS | AWS Glue | AWS Lambda | AWS Step Functions401k company match | Free flights | Health insurance for dependents | Profit sharing | Remote workMid-level Full TimeTX-Headquarters-HDQ, United States R1d ago
-
Forward Deployed Engineer (FDE) Data42 USD 160K-297KApplication development | Artificial Intelligence | Auditability | Data Governance | Data IngestionSenior-level Full TimeCambridge (USA), United States R1d ago
-
Forward Deployed Engineer (FDE) Data42 USD 160K-297KArtificial Intelligence | Data Governance | Data Modeling | Data Pipelines | Data QualitySenior-level Full TimeCambridge (USA), United States R1d ago
-
Data Engineer USD 73K-99KAzure Data | Azure Data Factory | Azure Synapse | CI/CD | Data Factory401k with profit sharing | Career growth opportunities | Dress for your day policy | Employee resource groups | Flexible working hoursMid-level Full TimeCleveland, United States R1d ago
-
Associate Data and AI Engineer USD 74K-111KAWS | AWS Lambda | Agile | Airflow | Artificial IntelligenceHybrid work arrangement | Remote work optionMid-level Full TimeHartford CT- Home Office, United States R1d ago
-
AI/ML Technical Architect Lead USD 204K-276KAI Foundry | AWS Bedrock | AWS SageMaker | Artificial Intelligence | Automation401k match | Dental insurance | Flex work week | Health insurance | MentorshipSenior-level Full TimeUSA MD Home Office (MDHOME), United … R1d ago
-
AI/ML Software Engineer USD 103K-181KBash | CI/CD | Cloud Computing | Code review | Data PipelinesSecurity clearance supportMid-level Full TimeUSA MD Aberdeen Proving Ground (6210 … R1d ago
-
VP Senior Software Engineer / AI Engineer USD 149K-205KAPIs | AWS | Agile | Amazon Bedrock | AzureEducational assistance | Health and wellness benefits | Income replacement for qualified employees with disabilities | Paid Holidays | Paid Maternity LeaveSenior-level Full TimeNew Jersey Office - 210 Hudson … R1d ago
-
Enterprise Agentic AI Engineer, Lead USD 128K-292KAI orchestration | Agent Loops | Agent systems | Agile | Artificial IntelligenceDependent care | Paid leave | Professional development | Tuition assistance | Work-life programsSenior-level Full TimeUSA, VA, McLean (8283 Greensboro Dr, … R1d ago
-
Data Engineer II (Hybrid) USD 85K-112KData Quality | Data Transformation | Data Validation | ETL | FTPMid-level Full TimeChicago, United States; Chicago, IL, United … R1d ago
-
Data Engineer USD 77K-176KAWS | Agile | Amazon Redshift | Cassandra | Data WarehousingDependent care | Disability insurance | Health insurance | Life insurance | Paid leaveMid-level Full TimeUSA, AL, Huntsville (300 Voyager), United … R1d ago
-
AWS | Agile | Alerting | Azure | ElasticsearchSenior-level Full TimeSan Jose, United States R1d ago
-
Senior Staff AI/ML Engineer USD 130K-261KAI Governance | Agile | Apache Airflow | Apache Spark | Azure DataHealth insurance | Retirement savings plan | Tuition reimbursementSenior-level Full TimeUnited States - Santa Clara : … R1d ago