Principal Engineer, Data Infrastructure
Tasks
- Apply AI for data workflow automation
- Architect lakehouse data patterns
- Author ADRs and RFCs
- Build stream-processing systems
- Contribute and review high quality code
- Define data contracts and schema governance
- Define data freshness availability correctness SLOs
- Design and implement event ingestion CDC
- Develop batch orchestration workflows
- Drive data governance and access controls
- Implement data catalog lineage
- Implement semantic catalog search
- Improve data quality anomaly detection
- Integrate data abstractions for analytics and ML
- Lead through architecture and design docs
- Mentor engineers through pairing
- Own data platform technical direction
- Partner on FinOps unit economics guardrails
- Profile tune and right size data systems
- Run readiness reviews and incident response
- Standardize connectors and templates
- Support SQL and pipeline generation
Perks/Benefits
- N/A
Skills/Tech-stack
Access Control | Apache Airflow | Apache Beam | Apache Flink | Apache Hudi | Apache Iceberg | Apache Kafka | Apache Spark | Batch orchestration | CDC | Dagster | Data Catalog | Data Governance | Data Lakehouse | Data Lineage | Data Quality | Delta Lake | FinOps | Generative AI | Google BigQuery | Google Pubsub | Incident Response | ML | Object storage | SLOs | SQL | Snowflake | Streaming processing
Education
N/A
Regions
Countries
States
Cities
Related jobs
-
Staff Machine Learning Engineer, Gen AI | Voice & Speech USD 150K-220KBigtable | Cloud Computing | Cloud Native | Cloud-native infrastructure | Data integrationRemote US basedSenior-level Full TimeUS Remote R13h ago
-
Algorithm Engineer, Battlespace Awareness USD 126K-167KAgile Development | C++ | Classification | Clustering | ControlsHealth benefits | Paid time off | Recovery BenefitsMid-level Full TimeBroomfield, Colorado, United States; Fort Collins, …17h ago
-
Algorithm Developer, Battlespace Awareness USD 126K-167KAgile | C++ | Clustering | Data Association | DebuggingMid-level Full TimeBroomfield, Colorado, United States; Fort Collins, …17h ago
-
Senior Algorithm Engineer, Battlespace USD 190K-252KAgile | C++ | Classification | Clustering | ControlsSenior-level Full TimeBroomfield, Colorado, United States; Fort Collins, …17h ago
-
ME00670-Database Engineer 3 USD 180K-240KBash | Cloud Computing | Data Guard | Data Modeling | Database AdministrationDental insurance | Group medical plan | Life insurance | Paid Holidays | Paid time offMid-level Full TimeAnnapolis Junction, MD23h ago
-
Analytics Engineer USD 130K-175KAmazon Redshift | BigQuery | Business Intelligence | CRM data | CRM data modelingEntry-level Full TimeStockholm R1d ago
-
Airflow | Decision Trees | Deep learning | Docker | EnsemblesSenior-level Full TimeSan Francisco, California, United States1d ago
-
AI Engineer USD 100K-160K.Net Core | API Development | AWS | Access Control | AnthropicHealthcare workflow domain experience optional | Office presenceMid-level Full TimeLittle Rock, AR, US1d ago
-
Principal Machine Learning Engineer, ML Platform USD 212K-287KAgent workflows | Amazon SageMaker | Artifact management | Autoscaling | Batch inferenceCharity donation match | Coaching | Company offsites | Dental coverage | Flexible working hoursSenior-level Full TimeRemote (United States) R1d ago
-
Mid-level Full TimeNew Jersey, New Jersey, United States1d ago
-
Sr. Data Engineer USD 61K-94KApache Flink | Apache Kafka | Apache NiFi | Apache Spark | Cassandra401k match | Accidental death and dismemberment insurance | Bonus plan | Commuter benefits | Flexible spending accountsSenior-level Full TimeCordova, TN, United States1d ago
-
Full Stack Gen AI Engineer USD 128K-197KAWS Bedrock | AWS Fargate | Amazon ECS | Amazon Web Services | CI/CDSenior-level Full TimeDallas, Texas, United States1d ago
-
Senior Software Engineer, AI Developer Experience USD 200K-400KAlerting | Build systems | CI/CD | Caching | DashboardsDaily lunches & snacks | Disability benefits | Life insurance | Medical/Dental/Vision insurance | Parental leaveSenior-level Full TimeSan Francisco1d ago
-
Senior Data Engineer USD 140K-216KAPI Integration | Airflow | Alerting | Amplitude | BigQuery401k match | Casual dress environment | Development dollars | Disability insurance | Life insuranceSenior-level Full TimeEdmond, OK1d ago
-
Senior-level Full TimeMountain View, CA1d ago
-
Senior Storage Engineer (Hybrid) USD 101K-188KAPI | Ansible | Auditability | Azure DevOps | BashHybrid work environment | Medical, dental, vision and life insurance | Retirement plan with 401(k) matchingSenior-level Full TimeManassas, United States1d ago
-
Senior-level Full TimeUnited States1d ago
-
Senior-level Full TimeUnited States1d ago
-
Data Governance | Data Modeling | Data Structures | Data pipeline | Java401k matching | Educational assistance | Federal Holidays | Healthcare coverage | Paid time offMid-level Full TimeAnnapolis Junction, Maryland2d ago
-
Software Engineer 2 - (Cloud, Analytics, Spark) USD 208K-254KAlgorithm Development | Data Querying | MapReduce | NoSQL | NumPy11 federal holidays | 24 days PTO | 401k 100 Percent Vested | Education assistance | Healthcare coverageSenior-level Full TimeAnnapolis Junction, Maryland; Annapolis Junction, Maryland2d ago
-
Principal Data Architect USD 123K-175KABAC | API Architecture | Access Control | Access Management | Active Directory401k | Dental insurance | Health insurance | Life insurance | Paid time offSenior-level Full TimeHanscom Afb, United States2d ago
-
APIs | AWS | Apache Spark | Azure | Azure Data401k matching | Dental insurance | Flexible working arrangements | Health insurance | Life insuranceSenior-level Full TimeSkokie, United States2d ago
-
Data Engineer, PDPO - Offense & Defense USD 147K-269KApache Spark | ClickHouse | Data Modeling | Data Warehousing | Distributed SystemsEntry-level Full TimeSan Jose, California, United States2d ago
-
Senior Software Engineer, Search Quality, AI/ML USD 174K-252KAgentic Workflows | Algorithms | Backend Development | C++ | Data StorageSenior-level Full TimeNew York, NY, USA2d ago
-
Data Engineer, gTech Users and Products Engineering USD 106K-150KApache Flume | Data Modeling | Data Pipelines | Data Warehousing | Dimensional dataBonus target | Equity | Health insurance | Paid time off | Retirement planEntry-level Full TimeBoulder, CO, USA2d ago