Principal Engineer, Data Infrastructure
Tasks
- Apply AI for data workflow automation
- Architect lakehouse data patterns
- Author ADRs and RFCs
- Build stream-processing systems
- Contribute and review high quality code
- Define data contracts and schema governance
- Define data freshness availability correctness SLOs
- Design and implement event ingestion CDC
- Develop batch orchestration workflows
- Drive data governance and access controls
- Implement data catalog lineage
- Implement semantic catalog search
- Improve data quality anomaly detection
- Integrate data abstractions for analytics and ML
- Lead through architecture and design docs
- Mentor engineers through pairing
- Own data platform technical direction
- Partner on FinOps unit economics guardrails
- Profile tune and right size data systems
- Run readiness reviews and incident response
- Standardize connectors and templates
- Support SQL and pipeline generation
Perks/Benefits
- N/A
Skills/Tech-stack
Access Control | Apache Airflow | Apache Beam | Apache Flink | Apache Hudi | Apache Iceberg | Apache Kafka | Apache Spark | Batch orchestration | CDC | Dagster | Data Catalog | Data Governance | Data Lakehouse | Data Lineage | Data Quality | Delta Lake | FinOps | Generative AI | Google BigQuery | Google Pubsub | Incident Response | ML | Object storage | SLOs | SQL | Snowflake | Streaming processing
Education
N/A
Regions
Countries
States
Cities
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R12d ago
-
Mid-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL2h ago
-
Senior-level ContractRaleigh, United States2h ago
-
AI experimentation | Alerting | Artificial Intelligence | Data Annotation | Data ArchitectureSenior-level Full TimeNew York3h ago
-
Project GenAI Engineer III USD 113K-188KAWS | Bedrock | Generative AI | Machine LearningMentorship | Onsite work | Professional development | Travel up to 25%Senior-level Full TimeArlington/Rosslyn, Virginia, United States4h ago
-
AWS | Artificial Intelligence | Cloud platform | Data Architecture | Data GovernanceTravel 10 to 15 percentSenior-level Full TimeArlington/Rosslyn, Virginia, United States; Washington, District …4h ago
-
Project Lead Data Engineer III USD 119K-198KBTEQ | Database Administration | Patch Management | Performance Tuning | Query OptimizationSenior-level Full TimeSacramento, California, United States4h ago
-
Research Software Engineer, Multimodal AI USD 174K-253KAgent Orchestration | Audio | C++ | Few-Shot Learning | Few-shotMid-level Full TimeSan Jose, CA, USA6h ago
-
ML Engineer, GenAI Ads, Search Personalization USD 207K-301KC++ | Clustering Algorithms | Data Processing | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeMountain View, CA, USA6h ago
-
Senior Software Engineer, AI/ML, Geo and Gemini App USD 174K-253KA/B | A/B Testing | B testing | C++ | Data AnalysisSenior-level Full TimeNew York, NY, USA6h ago
-
Bigtable | C++ | Colossus | Data Processing | Data StorageSenior-level Full TimeMountain View, CA, USA6h ago
-
Customer Engineer, Data/Analytics, Google Public Sector USD 152K-222KApache Spark | Batch Processing | Big Data | Cloud Architecture | Data GovernanceBonus target | Equity | Health benefits | Paid time off | Retirement benefitsSenior-level Full TimeReston, VA, USA; Atlanta, GA, USA6h ago
-
Lead Software Engineer - Applied AI ML Lead USD 170K-195KApache Airflow | Apache Iceberg | Apache Kafka | Apache Spark | Automated testingBackup childcare | Financial coaching | Health care coverage | Mental health support | On-site health and wellness centersSenior-level Full TimePalo Alto, CA, United States15h ago
-
Forward Deployed AI Engineer USD 180K-230KAPI | AWS | Azure | CI/CD | Cloud platform5-day workweek | Collaborative work culture | Flexible working hours | Supportive work environmentSenior-level Full TimeNew York, New York, United States16h ago
-
Principal AI Engineer USD 200K-245KAgent-based | Agent-based architecture | Amazon Web Services | Azure | CI/CD5 days per week | Collaborative culture | Flexible working hours | Supportive work environmentSenior-level Full TimeNew York, New York, United States16h ago
-
Data Engineer, Consultant USD 125K-164KApache Airflow | Azure | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeOakland, CA, United States17h ago
-
AI Engineer (Temporary) USD 85K-95KAWS | Agents SDK | Anthropic API | Azure | Data RiskAccess to training and enablement resources | Hybrid work environment | Temporary contract with benefitsEntry-level Full Time TemporaryIthaca (Main Campus), United States17h ago
-
Senior-level Full TimeAlbany, NY, United States17h ago
-
Mid-level Full TimeUSA - Seattle, WA, United States17h ago
-
Data Engineer USD 112K-160KAWS | AWS S3 | Airflow | Azure | CI/CD401k match | Family leave | Medical, dental, and vision insurance | PTO | Paid HolidaysMid-level Full TimeSanta Monica, CA, United States17h ago
-
Sr. Software Engineer, AI Infrastructure USD 144K-236KApache Beam | Apache Flink | Apache Spark | C# | C++Career development | Hybrid work | Stock grantsSenior-level Full TimeSunnyvale, CA, United States18h ago
-
Google Cloud Platform (GCP) Data Engineer USD 100K-203KApache Beam | BigQuery | Broadcast joins | CI/CD | CachingMid-level Full TimeArlington, VA19h ago
-
Google Cloud Platform (GCP) Data Engineer USD 100K-203KApache Beam | BigQuery | CI/CD | Cloud Storage | Cloud platformSecurity clearance providedMid-level Full TimeArlington, VA19h ago
-
Senior Data Engineer USD 180K-210KAirflow | Anomaly Detection | BigQuery | CI/CD | Cloud platform401k employer match | Annual Company Holidays | Catered lunches | Company retreat | Comprehensive health coverageSenior-level Full TimeNew York City19h ago
-
Data Engineer / Data Architect (Mid to Senior) (Top Secret Clearance Required) (Hybrid) USD 140K-160KAPI Development | Agile | Backend Development | Cloud Native | Code review401k | Employee discount program | Employee referral program | Flexible spending account | Flexible work scheduleMid-level Full TimeFort Belvoir, MD, US R20h ago