Senior Data Platform Engineer (Observability)
Tasks
- Build and operate data platform observability
- Deploy data ingestion pipelines and storage architectures
- Ensure HIPAA compliant ingestion and storage
- Implement data orchestration and pipeline management
- Improve metadata quality and data lineage
- Maintain data catalog search and discovery
- Manage data retention and deletion controls
- Mentor junior engineers and improve engineering standards
- Optimize performance, reliability, and cost
- Provision and manage Azure infrastructure with Terraform
- Translate requirements into engineering plans
Perks/Benefits
- 401k match
- Dental insurance
- Disability insurance
- FSA
- HSA
- Health insurance
- Life insurance
- Paid time off
- Remote work allowed
- Vision insurance
- Wellness stipend
Skills/Tech-stack
Apache Airflow | Apache Atlas | Astronomer | Audit Logging | Azure | Azure Data | Azure Data Factory | CDC | CI/CD | Dagster | Data Factory | Data Governance | Data Ingestion | Data Lineage | Data Observability | Databricks | Datahub | Encryption | Metadata Management | Observability | Python | Snowflake | Terraform
Education
N/A
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R13d ago
-
Contratação de Pessoa Jurídica para Desenvolvimento de Sistema de Coleta de Dados - Vaga Nº 107/2026 BRL 20K-31KAccess Control | Android | Audio capture | Audit Logging | AuthenticationSenior-level ContractHíbrido (Manaus, AM, Brasil) R7h ago
-
Backup administration | Backup architecture | Backup monitoring | Business Continuity | CommvaultRemote workSenior-level ContractRemote R8h ago
-
Azure | Azure Cloud | Azure Data | Azure Data Factory | Azure DatabricksRemote workMid-level ContractRemote R8h ago
-
Senior Data Engineer – Data Quality & Observability |1789 MXN 911K-1300KAlerting | Amazon Aurora | Amazon Aurora PostgreSQL | Amazon Redshift | Aurora PostgreSQLCross-functional collaboration | Fully remote | Opportunity for ownershipSenior-level Full TimeChihuahua, Mexico R9h ago
-
Data Engineer (Snowflake & DBT) INR 1000K-2000KAgile | Airbyte | CI/CD | Change Data Capture | DBTRemote workMid-level Full TimeRemote R9h ago
-
Associate Distinguished Engineer (Data Governance Framework, Data Catalog Implementation) INR 1300K-2000KBusiness glossary | Compliance | Data Architecture | Data Cataloging | Data ClassificationAwareness sessions | Continuous learning opportunities | Training programsMid-level Full TimeRemote, India R11h ago
-
Senior AI Engineer (m/f/d) EUR 36K-45K.NET | AI Search | AIOps | API Integration | AngularChildcare support | Coursera access | Experience days | Flexible hours | Free specialist access for health wellbeingSenior-level Full TimeGranada, AN, Spain R11h ago
-
GCP, Bigquery, Airflow/Consultant Specialist INR 1500K-2500KAgile | Airflow | Apache Kafka | Apache NiFi | BigQuerySenior-level Full TimeHyderabad, Telangana, India R12h ago
-
GCP, Airflow/CONSULTANT SPECIALIST INR 1500K-2500KAccess Control | Apache Airflow | Apache NiFi | Audit Logging | BigQueryFlexible working | Opportunities for professional developmentSenior-level Full TimePune, Maharashtra, India R12h ago
-
AI Forward Deployed Engineer | $120K-$150K + Hybrid + Equity | AI-Based Outage Intelligence Company A USD 120K-150KAI workflows | API Integration | Automation | Backend Development | Customer IntegrationDirect impact on company growth | Equity | Fast-moving startup environment | Hybrid work environment | Significant ownershipMid-level Full TimeKing of Prussia, PA, United States R14h ago
-
AWS SageMaker | Airflow | Amazon EC2 | Amazon EKS | Computer VisionContinuous learning and development | Flexible schedule | Fully remote | Mentorship opportunitiesMid-level Full TimeIndia R17h ago
-
Anthropic | Benchmarking | CI/CD | Docker | FastAPIAutonomy | Fully remote | PJ contract structureSenior-level Full TimeBrazil R18h ago
-
API documentation | Airflow | Amazon Web Services | Apache Beam | Apache SparkBirthday day off | Dental insurance | Educational support programs | Fitness and wellness partnerships | Fully remote workMid-level Full TimeBrazil R18h ago
-
Senior Machine Learning Engineer AUD 148K-210KAccess Control | Agent systems | CI/CD | Capabilities Based Access Control | Error RecoveryHealth and wellness benefits | Hybrid work schedule | Remote work flexibilitySenior-level Full TimeAustralia - Melbourne - Hybrid R22h ago
-
Staff Machine Learning Engineer AUD 140K-185KAWS | Amazon ECS | Amazon ElastiCache | Amazon S3 | Audit LoggingSenior-level Full TimeAustralia - Melbourne - Hybrid R22h ago
-
Senior Machine Learning Engineer AUD 148K-210KACID | Distributed Systems | Durable Execution | Event Sourcing | Fault ToleranceHybrid work | Remote work flexibilitySenior-level Full TimeAustralia - Melbourne - Hybrid R22h ago
-
API Development | Autogen | C# | C++ | Cloud PlatformsLong-term engagement | Paid Holidays | Remote work | Training and professional growthMid-level Full TimeIndia Gate, New Delhi, India - … R22h ago
-
Software Engineer AI/ML USD 112K-150KA/B | A/B Testing | AWS | Anomaly Detection | Automated testingDental insurance | Employee assistance program | Health and wellness programs | Health insurance | Retirement benefitsMid-level Full TimeEvendale, United States R22h ago
-
Azure MLOps | Azure Machine Learning | Azure Synapse | Data Deduplication | Data GovernanceSenior-level ContractRemote R22h ago
-
Senior Data Engineer INR 3715K-5449KAirflow | Batch Processing | Bitbucket | CICD | Data LakesHealth and wellbeing resources | Paid volunteer daysSenior-level Full TimeBengaluru - India - Bengaluru, 560071 … R22h ago
-
Senior Data Engineer INR 3715K-5449KAirflow | Batch Processing | Bitbucket | CICD | Data LakeHealth and wellbeing resources | Paid volunteer daysSenior-level Full TimeBengaluru - India - Bengaluru, 560071 … R22h ago
-
Databricks Data Engineer - Bengaluru INR 1500K-2500KAWS Glue | Alation | Amazon Athena | Amazon EMR | Amazon S3Career growth opportunities | Flexible schedule | Work from anywhereMid-level Full TimeIndia-Bangalore-Office-Kalyani Vista R22h ago
-
Azure Bicep | Azure Cosmos | Azure Cosmos DB | Azure Data | Azure Data FactoryCareer development | Inclusive culture | Technical trainingSenior-level Full TimeIND-Hyderabad-Hybrid, India R22h ago
-
Sr Data Engineer USD 91K-163KAI/ML | Azure DevOps | CI/CD | Code review | Data Compliance401k contribution | Career development opportunities | Comprehensive benefits | Incentive and recognition programsSenior-level Full TimeEden Prairie, Minnesota, UNITED STATES; REMOTE R22h ago