Senior Data Engineer
Richmond, Virginia, United States
USD 114K-227K Senior-level Full Time
Tasks
- Apply RBAC data privacy and PII handling using Unity Catalog
- Build automated tests monitoring and alerting for freshness completeness and accuracy
- Collaborate with ML engineers for feature pipelines
- Collaborate with analysts for curated datasets
- Create dimensional models star schemas and domain datasets
- Design build maintain scalable ETL/ELT pipelines
- Develop data models across raw curated semantic layers
- Ensure compliance and governance documentation
- Ensure pipelines meet SLAs data quality and reliability
- Establish schema design metadata and lineage standards
- Implement batch and streaming ingestion frameworks
- Implement data validation anomaly detection SLAs and documentation
- Optimize Spark jobs SQL queries cluster configurations and storage patterns
Perks/Benefits
- 401k retirement plan
- Caregiver support
- Disability insurance
- Employee assistance program
- Gym membership reimbursement
- Life insurance
- Long-term care insurance
- Mental health support
- Paid Holidays
- Paid family leave
- Paid time off
- Student loan repayment
- Training and certification support
- Tuition reimbursement
- Volunteer time off
- Wellness support
Skills/Tech-stack
Alerting | Anomaly Detection | Data Modeling | Data Quality | Data Validation | Databricks | Delta Lake | Dimensional Modeling | ELT | ETL | Lakehouse | Monitoring | PII | Python | RBAC | SQL | Spark | Star Schema | Unity Catalog
Education
N/A
Roles
Related jobs
-
.NET | AWS S3 | Amazon RDS | DTCC RTTM | DTCC Settlement WebContract through June 2027 | East Coast location flexibility | Remote workSenior-level ContractNew York, United States2h ago
-
AI and Data Science Engineer (TS/SCI Poly) USD 93K-163KAPIs | Artificial Intelligence | CI/CD | Cloud Platforms | ContainerizationMid-level Full TimeMcLean, Virginia, United States3h ago
-
Managed Services Engineer III USD 119K-198KApache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeLouisville, Kentucky, United States3h ago
-
Distributed Systems | Linux | Machine Learning | Network Programming | Performance AnalysisSenior-level Full TimeSan Jose, California, United States3h ago
-
Senior AI/ML Engineer USD 117K-195KAPI Development | AWS | AWS SageMaker | Airflow | AzureCareer growth | Customer-focused work | Onsite Pentagon work | Rapid advancementSenior-level Full TimeUSA-VA-Arlington3h ago
-
Mid-level Full TimeUSA-VA-Arlington3h ago
-
AI Forward Deployment Engineer USD 130K-145KAPIs | AWS | Airflow | Artificial Intelligence | AzureClient site travel | On-site workEntry-level Full TimeNew York, New York, United States3h ago
-
Staff Software Engineer, Generative AI USD 207K-300KAndroid | C++ | Computer Vision | Data Processing | DebuggingSenior-level Full TimeSunnyvale, CA, USA4h ago
-
RTL Design Engineer, Machine Learning Accelerators USD 138K-198KASIC | Code review | High Performance | High-Performance Design | Learning algorithmsMid-level Full TimeSunnyvale, CA, USA4h ago
-
C++ | Computer Graphics | Data Curation | Data Pipelines | Human-in-the-loopSenior-level Full TimeNew York, NY, USA; Mountain View, …4h ago
-
Senior Software Engineer, Managed Spark, OpenSource USD 174K-252KApache Flink | Apache Hive | Apache Hudi | Apache Iceberg | Apache SparkSenior-level Full TimeSunnyvale, CA, USA4h ago
-
Software Engineer III, AI/ML Machine Learning, Core USD 147K-211KC++ | Compute Technologies | Data Preprocessing | Data Storage | Distributed SystemsSenior-level Full TimeNew York, NY, USA; Mountain View, …4h ago
-
Research Scientist, Google Research, GenAI, Experiences USD 147K-211KComputer Vision | Data Mining | Deep learning | High Performance | High-Performance ComputingMid-level Full TimeMountain View, CA, USA; Kirkland, WA, …4h ago
-
Staff Software Engineer, Storage USD 207K-301KC# | C++ | Data Storage | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeSunnyvale, CA, USA4h ago
-
Software Engineer, AI/ML Computer Vision USD 147K-211KC++ | Computer Vision | Data Processing | Data Structures | Data Structures and AlgorithmsMid-level Full TimeSeattle, WA, USA; Kirkland, WA, USA4h ago
-
Senior Staff Software Engineer, TPU Performance USD 262K-365KAuto sharding | Benchmarking | C++ | Compiler optimization | Computer EngineeringBenefits | Bonus | EquitySenior-level Full TimeSunnyvale, CA, USA4h ago
-
Software Engineer, ML Quality, Google Labs USD 207K-300KA/B | A/B Testing | Algorithms | Artificial Intelligence | B testingBonus and equity | Career development | Health insurance | Paid time off | Relocation assistanceSenior-level Full TimeMountain View, CA, USA; San Francisco, …4h ago
-
Sr. Data Scientist USD 114K-220KAirflow | Anomaly Detection | Cloud Platforms | Convolutional Neural Networks | Data acquisition401k matching | Employee stock purchase plan | Healthcare benefits | Paid time off | Parental leaveSenior-level Full TimeIrvine, CA, US6h ago
-
Senior ML/AI Modeler, Risk Automation Machine Learning USD 160K-283KAPI Integration | AWS | Airflow | Artificial Intelligence | Batch ProcessingFlexible time off | Medical insurance | Modern family planning | Remote work | Retirement savings plansSenior-level Full TimeSeattle, WA, United States of America R10h ago
-
Autonomy | C++ | DDS | Edge Computing | Embedded Systems401k | Health insurance | Paid time offMid-level Full TimeSan Carlos - Hybrid R14h ago
-
API Integration | AWS | Agent Frameworks | Agentic Workflows | Autogen401k matching | Dental insurance | Health insurance | Life insurance | Long-term disabilityEntry-level Full TimeBeverly Hills, CA, US14h ago
-
Autonomy | C++ | DDS | Edge Computing | Embedded Systems401k plan | Health insurance | Paid Company Holidays | Paid time off | Phone stipendSenior-level Full TimeSan Carlos - Hybrid R14h ago
-
Staff Analytics Engineer USD 240K-250KBigQuery | BigQuery ML | Cloud platform | Customer Relationship Management | Customer relationshipEquity | Health insurance | Paid time offSenior-level Full TimeSF | Boston15h ago
-
Machine Learning Engineer III, Core Agents USD 175K-219KAWS Bedrock | Embeddings | Evaluation metrics | Indexing | Information RetrievalEmployee benefits | Equity compensation | Flexible work schedule | In office collaboration at least 3 days per weekSenior-level Full TimeRedwood City, CA15h ago
-
Senior Analytics Engineer USD 125K-168KAmazon Redshift | Automated testing | Code review | Cohort Analysis | Cohort ReportingComprehensive health insurance | Generous holiday observances | Unlimited vacation policy | Work from home stipendSenior-level Full TimeBoston, MA, US15h ago