Principal Engineer, Data Infrastructure
Tasks
- Apply AI for data workflow automation
- Architect lakehouse data patterns
- Author ADRs and RFCs
- Build stream-processing systems
- Contribute and review high quality code
- Define data contracts and schema governance
- Define data freshness availability correctness SLOs
- Design and implement event ingestion CDC
- Develop batch orchestration workflows
- Drive data governance and access controls
- Implement data catalog lineage
- Implement semantic catalog search
- Improve data quality anomaly detection
- Integrate data abstractions for analytics and ML
- Lead through architecture and design docs
- Mentor engineers through pairing
- Own data platform technical direction
- Partner on FinOps unit economics guardrails
- Profile tune and right size data systems
- Run readiness reviews and incident response
- Standardize connectors and templates
- Support SQL and pipeline generation
Perks/Benefits
- N/A
Skills/Tech-stack
Access Control | Apache Airflow | Apache Beam | Apache Flink | Apache Hudi | Apache Iceberg | Apache Kafka | Apache Spark | Batch orchestration | CDC | Dagster | Data Catalog | Data Governance | Data Lakehouse | Data Lineage | Data Quality | Delta Lake | FinOps | Generative AI | Google BigQuery | Google Pubsub | Incident Response | ML | Object storage | SLOs | SQL | Snowflake | Streaming processing
Education
N/A
Regions
Countries
States
Cities
Related jobs
-
Data Engineer I - Salesforce Data 360 USD 92K-123KAPIs | Access Control | Data Engineering | Data Governance | Data Modeling401k match | Employee resource groups | Flexible PTO | Healthcare premium coverage | Onboarding programMid-level Full TimeMorrisville, NC, US, 275603h ago
-
Senior Machine Learning Engineer, Ad Serving USD 195K-510KContinuous Improvement | Experimentation | Feature Engineering | Java | Machine LearningDisability benefits | Equity awards | Financial wellness support | Health insurance | Life insuranceSenior-level Full TimeNew York, New York6h ago
-
Senior Machine Learning Engineer, Ad Serving USD 195K-435KDeep learning | Experimentation | Feature Engineering | Java | Machine LearningDisability benefits | Equity awards | Health insurance | Life insurance | Paid time offSenior-level Full TimeBoston, Massachusetts6h ago
-
Senior Analytics Engineer USD 140K-175KBusiness Intelligence | DBT | Data Modeling | Data Pipelines | Data WarehousingDental insurance | Equity compensation | Medical insurance | Paid time off | Vision insuranceSenior-level Full TimeSouth San Francisco, California, USA10h ago
-
Fullstack - Data Platform (Autonomy) USD 170K-210KAWS | Amazon RDS | Database Indexing | Django | DocumentDBDental insurance | Equity compensation | Medical insurance | Paid time off | Vision insuranceSenior-level Full TimeSouth San Francisco, California, USA10h ago
-
Senior Embedded Software Engineer USD 160K-200KC# | C++ | CI/CD | Embedded Systems | GitDental insurance | Medical insurance | Paid time off | Travel opportunities | Vision insuranceSenior-level Full TimeSouth San Francisco, California, USA10h ago
-
Principal Software Engineer, DBS Redshift USD 220K-311KArchitecture Design | Cloud Computing | Code review | Database Management | Distributed Systems401k matching | Employee assistance program | Health insurance | Paid time off | Parental leaveSenior-level Full TimeEast Palo Alto, California, USA11h ago
-
AWS | Azure | Azure DevOps | CI/CD | Cloud platform401k plan | Commuter benefits | Dental insurance | Employee assistance programs | Employee stock purchase planSenior-level Full TimeUS - Grand Island, NY - …11h ago
-
AI Deployment Engineer USD 197K-278KGenerative AI | Infrastructure architecture | JavaScript | Machine Learning | Network ArchitectureHybrid work model | Relocation assistanceSenior-level Full TimeNew York City11h ago
-
AI/ML Infrastructure Engineer USD 176K-234KAWS EKS | Amazon Web Services | Benchling | CI/CD | Data EngineeringOn-site collaboration | Relocation support (if eligible)Mid-level Full TimeBoston, Massachusetts, United States, San Francisco, …11h ago
-
Senior Business Intelligence and Analytics Engineer USD 100K-155KAirflow | BigQuery | Command Line | DBT | Data Catalog401k matching | Company offsite | Dental insurance | Employee wellness | Free therapySenior-level Full TimeUS - Remote R11h ago
-
Machine Learning Engineer USD 150K-180KBatching | Deep learning | Embeddings | GPU | Inference Optimization401k matching | Company sponsored offsite | Employee wellness | Free therapy | Hardware or software stipendMid-level Full TimeUS - Remote R11h ago
-
Associate Data Scientist - Originations USD 85K-115KData pipeline | Machine Learning | PyTorch | Python | SQL401k match | Company equipment provided | Company in person events | Company-paid medical, dental & vision | Disability benefitsMid-level Full TimeAtlanta, GA preferred, Remote R12h ago
-
Software Engineer, Data Infrastructure USD 216K-300KApache Spark | C++ | Context Optimization | Data Modeling | Distributed SystemsCommuter stipend | Generous PTO | Health, dental, vision coverage | Learning & development stipend | Retirement benefitsSenior-level Full TimeNew York, NY; Washington, DC12h ago
-
Senior Software Engineer, Data Engineering USD 220K-240KAWS Athena | AWS EC2 | AWS EMR | AWS Glue | AWS Lambda401k match | Backup child elder and pet care support | Chime Days paid days off | Community organization time support | Family planning tool benefitsSenior-level Full TimeSan Francisco, CA, USA R12h ago
-
Artificial Intelligence | Feedback learning | Fine Tuning | Generative AI | GuardrailsSenior-level Full TimeSan Francisco, CA12h ago
-
Data Engineer, Machine Learning USD 170K-240KApache Airflow | Apache Spark | Cloud infrastructure | Dagster | Data Drift401k match | Dental insurance | Employee Assistance Program (EAP) | Flexible spending account | Health insuranceMid-level Full TimeSan Francisco12h ago
-
Senior Software Engineer, Data Enablement Platform USD 192K-240KAccess Control | Analytics | Apache Airflow | Apache Flink | Backend DevelopmentOffice based 3 days per week | On-call rotationSenior-level Full TimeSeattle, Washington, United States12h ago
-
Senior Software Engineer, Data Enablement Platform USD 192K-240KAccess Control | Apache Airflow | Apache Flink | CDC | DBTOffice based 3 days per weekSenior-level Full TimeNew York, New York, United States12h ago
-
Senior Software Engineer, Data Enablement Platform USD 192K-240KApache Airflow | Apache Flink | Apache Kafka | CDC | DBTOn site collaboration 3 days per weekSenior-level Full TimeSan Francisco, California, United States12h ago
-
Data Engineer USD 100K-120KAPI | Data Quality | Data Reconciliation | Data Validation | Data Warehousing401k match | Adoption support | Company holidays | Fertility support | Flexible PTOMid-level Full TimeRemote - US R13h ago
-
Calibration | Causal Inference | Distributed machine learning | Experimentation | JavaCommuter benefits | Dental insurance | Disability insurance | Fully stocked pantry | Healthcare insuranceSenior-level Full TimeRedwood City, US; Remote R14h ago
-
Automation | Coordinate systems | Data Migration | Database Administration | Database Design401k | Dental insurance | Health insurance | Life insurance | Paid time offMid-level Full TimeSt. Louis, MO - Globe14h ago
-
Access Control | ArcGIS Enterprise | Coordinate System | Data Security | Database Administration401k matching | Dental insurance | Health insurance | Paid Holidays | Paid vacationMid-level Full TimeRedlands, CA14h ago
-
Access Control | ArcGIS Enterprise | Backup/Restore | Coordinate systems | Data MigrationMid-level Full TimeVienna, Virginia, United States14h ago