ETS Senior Engineer - Azure Databricks & Data Platform Engineer
Vienna, VA, United States
USD 76K-159K (estimate) Senior-level Full Time
Tasks
- Administer Azure Databricks environments
- Build automation and Infrastructure as Code using Bicep Terraform Azure DevOps and Git CI CD
- Configure Azure security including RBAC Managed Identities Private Endpoints Key Vault Azure Policy
- Design and support ETL ELT and data integration solutions
- Implement Unity Catalog and data governance controls
- Investigate incidents and collaborate to resolve operational issues
- Manage cluster configuration and workload monitoring
- Monitor health availability reliability and performance of Azure data services
- Monitor utilization and optimize cloud costs
- Optimize Delta Lake and cluster performance
- Participate in on-call rotation
- Provide onboarding support to application teams
- Support Azure Data Factory Azure SQL Database Azure Cosmos DB Azure Database for PostgreSQL Azure Synapse Analytics
- Support Lakehouse solutions using Azure Databricks and Azure Data Lake Storage
- Troubleshoot Databricks platform and data pipeline issues
Perks/Benefits
- N/A
Skills/Tech-stack
Azure | Azure Cosmos | Azure Cosmos DB | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Database | Azure Database for PostgreSQL | Azure Databricks | Azure DevOps | Azure Key Vault | Azure Policy | Azure SQL | Azure SQL Database | Azure Synapse | Azure Synapse Analytics | Bicep | CI/CD | Cluster tuning | Cosmos DB | Data Catalog | Data Factory | Data Governance | Data Lake Storage | Data Lineage | Database for PostgreSQL | Delta Lake | ELT | ETL | Git | Infrastructure as Code | Key Vault | Lakehouse | Managed Identities | Metadata Management | Microsoft Purview | Private Endpoints | RBAC | SQL Database | Synapse Analytics | Terraform | Unity Catalog | “as-code”
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Regions
Countries
States
Cities
Related jobs
-
APIs | AWS | Agile | Auditability | AzureMentoring and coaching | Remote work | Training and enablementSenior-level Full TimePlainsboro, NJ. R4h ago
-
Mid-level Full TimeAustin, TX R4h ago
-
Business Objects | Cognos | Data Dictionary | Data Marts | Data ModelingSenior-level Full TimeAustin, TX4h ago
-
Airflow | Apache Spark | CI/CD | Data Governance | Data LakehouseOnsite work required | Relocation possibleSenior-level Full TimeAustin, TX4h ago
-
ArcGIS | Data Engineering | Data Governance | Data Pipelines | Data QualitySenior-level Full TimeBoston, NY, United States5h ago
-
AWS Bedrock | CI/CD | CUI | Data Governance | Data PipelinesGovernment furnished equipment | Pacific Time core hours support | Remote workEntry-level Full TimeMenlo Park, CA, United States5h ago
-
Analytics Engineer USD 119K-234KAzure Data | Azure Data Factory | Azure SQL | Azure Synapse | Azure Synapse AnalyticsSenior-level Full TimeHouston, TX, United States R6h ago
-
Mid-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL R6h ago
-
Data Engineer (Multiple Positions) USD 148K-300KBig Data | ClickHouse | Data Modeling | Data Query | Data Query Optimization401k savings plan | Dental insurance | Life insurance | Long-term disability | Medical insuranceEntry-level Full TimeSeattle, Washington, United States6h ago
-
Data Lake Infrastructure & Data Analytics Research Engineer Graduate (AML-Ark-US) - 2027 Start (PhD) USD 162K-316KAI Agents | Batch Processing | Cloud infrastructure | Columnar Storage | Data Governance401k savings plan | Disability coverage | Health insurance | Life insurance | Paid HolidaysEntry-level Full TimeSan Jose, California, United States6h ago
-
Data Lake Infrastructure & Data Analytics Research Engineer Intern (AML-Ark-US) - 2027 Summer USD 86K-86KAlgorithms | Big Data | Cloud infrastructure | Columnar Storage | Data GovernanceHealth insurance | Housing allowance | Life insurance | Paid Holidays | Paid sick timeEntry-level InternshipSeattle, Washington, United States7h ago
-
Research Engineer, Data Lake Infrastructure & Data Analytics Graduate (AML-Ark-US) - 2027 Start (PhD) USD 153K-300KBatch Processing | Columnar Storage | Data Governance | Data Lake | Data ProcessingEntry-level Full TimeSeattle, Washington, United States7h ago
-
Apache Doris | Apache Flink | Apache Hive | Apache Kafka | Apache Spark401k matching | Dental insurance | Life insurance | Long-Term Disability coverage | Medical insuranceEntry-level Full TimeSan Jose, California, United States7h ago
-
AWS | Azure | Azure ML | C++ | CUDAEntry-level Full TimeSeattle, Washington, United States7h ago
-
Lead Analytics and Insights Engineer II USD 131K-229KAutomation | Dashboarding | Data Management | Data Modeling | Data QualityMentorship | Professional development | Travel opportunitySenior-level Full TimeMilwaukee, Wisconsin, United States7h ago
-
Lead Data Engineer II USD 131K-218KCloud Data | Cloud Data Platforms | Data Architecture | Data Engineering | Data GovernanceBenefits package | Professional mentorship | Travel 10 percentSenior-level Full TimeRosslyn, Virginia, United States7h ago
-
Production Engineer - Applied Machine Learning USD 162K-387KAlerting | Auto Scaling | Auto rollback | C++ | CI/CD401k match | Dental insurance | Life insurance | Long-term disability | Medical insuranceMid-level Full TimeSan Jose, California, United States7h ago
-
Senior Data Engineer ID71671 USD 156K-180KAWS Kinesis | Apache Airflow | Apache Kafka | CI/CD | DBTAnnual compensation reviews | Autonomy | Flexible hours | Internal tech talks | Learning budgetSenior-level Full TimeBlacksburg, United States7h ago
-
Senior Data Engineer ID71671 USD 156K-180KApache Airflow | Automated testing | CI/CD | DBT | DagsterAnnual learning budget | Collaborative culture | Flexible hours | Mentorship | Performance and compensation reviewsSenior-level Full TimeBoca Raton, United States7h ago
-
Senior Data Engineer ID71671 USD 156K-180KApache Airflow | Automated testing | CI/CD | DBT | DagsterAnnual learning budget | Flexible hours | Mentorship | Performance reviews | Remote workSenior-level Full TimeHouston, United States7h ago
-
Senior Data Engineer ID71671 USD 156K-180KAWS Kinesis | Apache Airflow | Apache Kafka | Automated testing | CI/CDFlexible hours | Learning budget | Location based support | Mentorship | Performance reviewsSenior-level Full TimeTampa, United States7h ago
-
A/B | A/B Testing | Apache Airflow | Apache Kafka | Apache Spark401k match | Life insurance | Long-term disability | Medical, dental, and vision insurance | Paid HolidaysMid-level Full TimeSan Jose, California, United States R7h ago
-
Software Engineer - Applied Machine Learning, Engine USD 128K-316KAWS | Alerting | Algorithms | Azure | CMDB401k match | Dental insurance | Health insurance | Life insurance | Long-term disabilityEntry-level Full TimeSan Jose, California, United States8h ago
-
Quant Analytics [Multiple Positions Available] USD 158K-201KAWS | Alteryx | Association Rule Mining | Association rule | Behavioral analyticsBackup childcare | Comprehensive health care coverage | Domestic travel | Financial coaching | Mental health supportSenior-level Full TimeColumbus, OH, United States R8h ago
-
Senior Production Engineer - Applied Machine Learning USD 218K-480KAlerting | Auto Scaling | Auto rollback | C++ | CI/CD401k matching | Dental insurance | Disability coverage | Health insurance | Life insuranceSenior-level Full TimeSan Jose, California, United States8h ago