Senior Data Engineer, Data Platform Admin (US – East Coast)
Tasks
- Administer Databricks platform
- Automate platform operations
- Configure access controls
- Configure cluster policies
- Coordinate incident response
- Develop data pipelines
- Implement CI/CD tooling
- Maintain platform availability SLAs
- Manage infrastructure as code
- Manage workspace governance
- Monitor costs
- Optimize Spark workloads
- Optimize cost inefficiencies
- Partner with IT and data architecture teams
- Resolve performance bottlenecks
- Resolve reliability issues
- Scale unified Databricks environment
- Schedule jobs
- Set security configurations
- Stabilize Databricks environment
- Support data engineers across domains
- Support onboarding new teams
Perks/Benefits
- Employee discounts
- Flexible wellness time off
- Health, dental, vision insurance
- Mental health resources
- Oura ring of your own
- Paid Holidays
- Paid parental leave
- Paid sick leave
- Paid time off
- Remote US East Coast hours
Skills/Tech-stack
AWS | AWS Glue | AWS IAM | Amazon Kinesis | Amazon S3 | Apache Spark | CI/CD | Data mesh | Databricks | Infrastructure as Code | Unity Catalog | Workflow Orchestration | “as-code”
Education
N/A
Related jobs
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R3d ago
-
Principal Engineer - Data Platform USD 221K-387KAWS | Airflow | Apache Hive | Apache Iceberg | Apache ImpalaRemote workSenior-level Full TimeSanta Clara, California, United States R15h ago
-
AWS Glue | AWS Lambda | AWS S3 | Access Control | Data GovernanceCareer growth opportunities | Collaborative and inclusive work environment | Diverse and inclusive culture | Flexible work arrangements | Permanent remote working modelSenior-level Full TimeCanada R1d ago
-
Hadoop Big Data Developer USD 100K-150KAWS EMR | Airflow | Apache Atlas | Apache Flink | Apache SparkRemote workSenior-level Full TimeUnited States - Remote R1d ago
-
Hadoop Big Data Developer USD 100K-150KAWS EMR | Airflow | Apache Atlas | Apache Flink | Apache HiveRemote workSenior-level Full TimeUnited States - Remote R1d ago
-
AI Data Engineer USD 100K-150KActive Learning | Apache Beam | CI/CD | Caching | Code review100 percent remote | Career growth | Full-time employment | H1B transfer support | W2 employmentMid-level Full TimeUnited States - Remote R1d ago
-
AI Data Engineer USD 100K-150KApache Beam | CI/CD | Code review | Data Lineage | Data Modeling100 percent remote | Career growthMid-level Full TimeUnited States - Remote R1d ago
-
Data Platform Architect USD 100K-150KAccess Management | Alation | Atlan | BigQuery | Cloud Cost OptimizationSenior-level Full TimeUnited States - Remote R1d ago
-
Data Platform Architect USD 100K-150KAlation | Amazon Redshift | Apache Flink | Apache Hudi | Apache KafkaSenior-level Full TimeUnited States - Remote R1d ago
-
Principal Applied AI Engineer, Finance USD 193K-340KAPI Development | AWS | Bias Mitigation | CI/CD | Churn modeling401k matching | Adoption Assistance | Development and career growth opportunities | Fertility treatments | Flexible work schedulesSenior-level Full TimeVirtual Office (Massachusetts), United States R1d ago
-
Data Engineer - 2373625 USD 98K-172KAzure Databricks | Data Modeling | Data Pipeline Awareness | Data Visualization | Data Warehousing401k matching | Employee stock purchase plan | Medical, dental, and vision | TelecommutingEntry-level Full TimePrimary location: Eden Prairie, MN R1d ago
-
Senior Data Engineer - 2373647 USD 146K-172KAWS | Agile Scrum | Azure | Cloud technologies | Docker401k matching | Dental insurance | Employee stock purchase plan | Medical insurance | TelecommutingSenior-level Full TimePrimary location: Eden Prairie, MN R1d ago
-
AWS | Airflow | Apache Spark | Azure Event | Azure Event Hubs401k contribution | Career development opportunities | Comprehensive benefits package | Equity stock purchase | Incentive and recognition programsSenior-level Full TimePrimary location: Eden Prairie, MN R1d ago
-
Data Engineer USD 72K-130KAI/ML | Analytics engineering | Azure DevOps | Bronze Silver Gold | CI/CD401k contribution | Career development opportunities | Comprehensive benefits package | Equity stock purchase | Incentive and recognition programsMid-level Full TimePrimary location: Eden Prairie, MN R1d ago
-
NLP Engineer USD 72K-130KArtifact Repositories | Artifactory | C# | CI/CD | Containerization401k contribution | Career development opportunities | Comprehensive benefits package | Equity stock purchase | Incentive and recognition programsMid-level Full TimePrimary location: San Diego, CA R1d ago
-
Principal, Data Engineer USD 107K-216KAI/ML | Azure | Azure Data | Azure Data Factory | Azure DevOpsSenior-level Full Time11 Keewaydin Dr, Salem NH, United … R1d ago
-
AWS | Application Security | Artificial Intelligence | Azure | Cloud SecurityConference speaking opportunities | Flexible schedule | Health Premium Plan Option | Mentorship | Paid trainingSenior-level Full TimeLos Angeles, California, United States R2d ago
-
Machine Learning Engineer V USD 231K-382KAWS | Agent Orchestration | Automated testing | Azure | CI/CDBonus eligibility | Disability insurance | Life insurance | Paid parental leave | Paid time offSenior-level Full TimeRemote, United States R2d ago
-
Senior AI Engineer USD 145K-181KAWS | Alerting | Azure | Docker | Embeddings401k match | Commuter benefits | Dental | Healthcare | Remote friendly workplaceSenior-level Full Time3750 Market Street, Philadelphia, PA, United … R3d ago
-
AWS | AWS CDK | Access Control | Airflow | Athena401k plan | Health insurance | Paid Holidays | Paid time off | Phone stipendSenior-level Full TimeSan Carlos - Hybrid R3d ago
-
Principal Software Engineer, Data Infrastructure USD 295K-345KAWS | Airflow | Chaos Engineering | Data Catalog | Distributed SystemsEquity compensation | Health benefits | Onsite work flexibilitySenior-level Full TimeSan Mateo, CA, United States R3d ago
-
Machine Learning Engineer USD 140K-180KAWS | Alerting | Apache Spark | Azure | CI/CD401k | Dental insurance | Life insurance | Light travel | Medical insuranceSenior-level Full TimeSt. Louis, MO; Boston, MA; New … R3d ago
-
Software Engineer ll, Data Platform USD 110K-120KAPI | Amazon Athena | Amazon EMR | Amazon S3 | Apache Airflow401k match | Company holidays | Disability insurance | Employee assistance program | Flexible spending accountMid-level Full TimeUnited States R3d ago
-
Principal AI Platform Engineer USD 190K-225KACR | API Integration | Alerting | Audit Logging | Azure401k match | Career growth professional development | Employee assistance program | Low-cost medical dental vision | Paid HolidaysSenior-level Full TimeRemote (United States) R3d ago
-
Senior Data Engineer-JT0224 USD 120K-183K.Net Core | .Net Framework | Apache Airflow | Azure | Azure Data401k match | Career growth opportunities | Dental insurance | Employee resource groups | Health insuranceSenior-level Full TimeRemote, United States R3d ago