Senior Software Engineer, Data Compute
Tasks
- Design scalable Spark and Airflow platform primitives
- Implement metadata management and access controls
- Improve platform reliability for multi team workloads
- Lead migration to serverless Databricks and Delta Lake
- Optimize compute resource utilization and cost efficiency
Perks/Benefits
- 401k matching
- AI tool access
- Company holidays
- Employer paid life and disability insurance
- Fertility benefits
- Learning and wellness benefits
- Life and disability insurance
- Lifestyle spending account
- Mental health benefits
- Paid health insurance
- Paid time off
- Parental leave
- Sick time
Skills/Tech-stack
Amazon S3 | Apache Airflow | Apache Spark | Databricks | Delta Lake | Parquet | Trino | Trino Metastore | Unity Catalog
Education
N/A
Related jobs
-
Senior Staff Machine Learning Engineer, Infrastructure USD 248K-310KA/B | A/B Testing | Agentic AI | Apache Airflow | Apache KafkaDisability accommodation support | Employee travel credits | Inclusion focused hiring | Remote eligibleSenior-level Full TimeUnited States6h ago
-
Senior Data Analyst USD 150K-175KAWS S3 | Amazon Athena | Amazon Aurora | Anomaly Detection | CTEDental insurance | Flexible PTO | Health insurance | Professional development budget | Vision insuranceSenior-level Full TimeUnited States10h ago
-
Senior Data Engineer USD 150K-175KAWS Glue | Airflow | Amazon Athena | Amazon Redshift | Amazon S3Continuing education support | Dental insurance | Flexible PTO | Health insurance | Professional development budgetSenior-level Full TimeUnited States10h ago
-
Data Engineer III USD 113K-127KAPIs | AWS Redshift | AWS Step Functions | Agile | Amazon EC2Healthcare benefits | Occasional travel | Remote workSenior-level Full TimeColumbia, MD, US11h ago
-
ADAS Data Analytics Intern USD 58K-75KAgile | Apache Spark | Cloud Computing | Databricks | GitPTO | Sick timeEntry-level InternshipSan Jose, CA13h ago
-
Senior Data Engineer USD 155K-220KAWS | Data Governance | Data Lineage | Data Modeling | Data ObservabilitySenior-level Full TimeSunnyvale, CA, United States14h ago
-
Data Engineer - Hybrid / Remote USD 113K-153KAccess Control | Apache Spark | Application Insights | Azure Data | Azure Data Factory401k match | Dental insurance | Health insurance | Health savings account | Life insuranceMid-level Full TimeNashville, Tennessee, United States R15h ago
-
Data Engineer USD 115K-175KAzure Data | Azure Data Factory | Azure Synapse | Azure Synapse Analytics | Copilot401k match | Company-sponsored life insurance | Dental insurance | Dress for your day | Flexible spending accountMid-level Full TimeColumbus, OH, United States18h ago
-
Data Engineer, People Innovation Labs USD 293K-325KAirflow | Amazon S3 | Dagster | Data Ingestion | Data ProcessingMid-level Full TimeSan Francisco19h ago
-
Data Engineer USD 125K-133KAWS S3 | Amazon Redshift | Apache Airflow | DBT | Dimensional Modeling401k retirement plan | Long-Term Disability coverage | Medical, dental, and vision coverage | Optional life insurance | Paid HolidaysSenior-level Full TimeRemote (United States) R19h ago
-
Data Engineer ID50062 USD 147K-166KAWS | Advanced SQL | Advanced SQL optimization | Airflow | AvroFlextime | Mentorship | Remote work options | TechtalksSenior-level Full TimeTampa, United States22h ago
-
Data Engineer ID50062 USD 147K-166KAWS | AWS SageMaker | Advanced SQL | Advanced SQL optimization | Apache AirflowFlextime | Mentorship | Office options | Personalized growth roadmaps | Remote workSenior-level Full TimeTallahassee, United States22h ago
-
Data Engineer ID50062 USD 147K-166KAWS | AWS SageMaker | Apache Airflow | Apache Spark | AvroEducation budget | Fitness budget | Flexible schedule | Mentorship | Office workSenior-level Full TimeFort Lauderdale, United States22h ago
-
Data Engineer ID50062 USD 147K-166KAWS | AWS SageMaker | Airflow | Apache Spark | AvroFlextime | Mentorship | Office work options | Personalized growth roadmaps | Remote work optionsSenior-level Full TimeJacksonville, United States22h ago
-
Data Engineer ID50062 USD 147K-166KAWS | AWS SageMaker | Amazon S3 | Apache Airflow | Apache SparkEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapsSenior-level Full TimeHouston, United States22h ago
-
Data Engineer ID50062 USD 147K-166KAWS | AWS SageMaker | Apache Airflow | Apache Spark | AvroEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionsSenior-level Full TimeBlacksburg, United States22h ago
-
Data Engineer ID50062 USD 147K-166KAWS | Airflow | Apache Spark | Avro | DuckDBEducation budget | Fitness budget | Flexible schedule | Mentorship | Office work optionsSenior-level Full TimeWest Palm Beach, United States22h ago
-
Data Engineer ID50062 USD 147K-166KAPI Integration | Airflow | Amazon Web Services | Apache Spark | AvroEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapsSenior-level Full TimeBaltimore, United States22h ago
-
Data Engineer ID50062 USD 147K-166KAWS | Airflow | Apache Spark | Avro | DuckDBEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapsSenior-level Full TimeBoca Raton, United States22h ago
-
Data Engineer ID50062 USD 147K-166KAWS | Airflow | Apache Spark | Avro | Data LakehouseFlextime | Mentorship | Office work options | Personalized growth roadmaps | Remote work optionsSenior-level Full TimeAustin, United States22h ago
-
Data Engineer ID50062 USD 147K-166KAWS | Airflow | Apache Spark | Avro | Columnar StorageFlextime | Mentorship | Office options | Personalized growth roadmaps | Remote work optionsSenior-level Full TimeMiami, United States22h ago
-
Data Engineer ID50062 USD 147K-166KAWS | Airflow | Apache Spark | Avro | DuckDBEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapsSenior-level Full TimeRichmond, United States22h ago
-
Data Engineer ID50062 USD 147K-166KAWS | Airflow | Apache Spark | Avro | DuckDBFlexible schedule | Mentorship | Personalized growth roadmaps | Remote work options | TechtalksSenior-level Full TimeOrlando, United States22h ago
-
Senior-level Full TimeCharlotte, North Carolina, United States1d ago
-
Senior-level Full TimeMenlo Park, California, United States1d ago