Senior Software Engineer, Data Compute
Tasks
- Design scalable Spark and Airflow platform primitives
- Implement metadata management and access controls
- Improve platform reliability for multi team workloads
- Lead migration to serverless Databricks and Delta Lake
- Optimize compute resource utilization and cost efficiency
Perks/Benefits
- 401k matching
- AI tool access
- Company holidays
- Employer paid life and disability insurance
- Fertility benefits
- Learning and wellness benefits
- Life and disability insurance
- Lifestyle spending account
- Mental health benefits
- Paid health insurance
- Paid time off
- Parental leave
- Sick time
Skills/Tech-stack
Amazon S3 | Apache Airflow | Apache Spark | Databricks | Delta Lake | Parquet | Trino | Trino Metastore | Unity Catalog
Education
N/A
Related jobs
-
Senior Staff Machine Learning Engineer, Infrastructure USD 248K-310KA/B | A/B Testing | Agentic AI | Apache Airflow | Apache KafkaDisability accommodation support | Employee travel credits | Inclusion focused hiring | Remote eligibleSenior-level Full TimeUnited States5h ago
-
Senior Data Analyst USD 150K-175KAWS S3 | Amazon Athena | Amazon Aurora | Anomaly Detection | CTEDental insurance | Flexible PTO | Health insurance | Professional development budget | Vision insuranceSenior-level Full TimeUnited States9h ago
-
Senior Data Engineer USD 150K-175KAWS Glue | Airflow | Amazon Athena | Amazon Redshift | Amazon S3Continuing education support | Dental insurance | Flexible PTO | Health insurance | Professional development budgetSenior-level Full TimeUnited States9h ago
-
ADAS Data Analytics Intern USD 58K-75KAgile | Apache Spark | Cloud Computing | Databricks | GitPTO | Sick timeEntry-level InternshipSan Jose, CA12h ago
-
Senior Data Engineer USD 155K-220KAWS | Data Governance | Data Lineage | Data Modeling | Data ObservabilitySenior-level Full TimeSunnyvale, CA, United States13h ago
-
Data Engineer - Hybrid / Remote USD 113K-153KAccess Control | Apache Spark | Application Insights | Azure Data | Azure Data Factory401k match | Dental insurance | Health insurance | Health savings account | Life insuranceMid-level Full TimeNashville, Tennessee, United States R14h ago
-
Data Engineer USD 115K-175KAzure Data | Azure Data Factory | Azure Synapse | Azure Synapse Analytics | Copilot401k match | Company-sponsored life insurance | Dental insurance | Dress for your day | Flexible spending accountMid-level Full TimeColumbus, OH, United States17h ago
-
Data Engineer, People Innovation Labs USD 293K-325KAirflow | Amazon S3 | Dagster | Data Ingestion | Data ProcessingMid-level Full TimeSan Francisco18h ago
-
Data Engineer ID50062 USD 147K-166KAWS | Advanced SQL | Advanced SQL optimization | Airflow | AvroFlextime | Mentorship | Remote work options | TechtalksSenior-level Full TimeTampa, United States20h ago
-
Data Engineer ID50062 USD 147K-166KAWS | AWS SageMaker | Advanced SQL | Advanced SQL optimization | Apache AirflowFlextime | Mentorship | Office options | Personalized growth roadmaps | Remote workSenior-level Full TimeTallahassee, United States20h ago
-
Data Engineer ID50062 USD 147K-166KAWS | AWS SageMaker | Apache Airflow | Apache Spark | AvroEducation budget | Fitness budget | Flexible schedule | Mentorship | Office workSenior-level Full TimeFort Lauderdale, United States20h ago
-
Data Engineer ID50062 USD 147K-166KAWS | AWS SageMaker | Airflow | Apache Spark | AvroFlextime | Mentorship | Office work options | Personalized growth roadmaps | Remote work optionsSenior-level Full TimeJacksonville, United States20h ago
-
Data Engineer ID50062 USD 147K-166KAWS | AWS SageMaker | Amazon S3 | Apache Airflow | Apache SparkEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapsSenior-level Full TimeHouston, United States20h ago
-
Data Engineer ID50062 USD 147K-166KAWS | AWS SageMaker | Apache Airflow | Apache Spark | AvroEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionsSenior-level Full TimeBlacksburg, United States20h ago
-
Data Engineer ID50062 USD 147K-166KAWS | Airflow | Apache Spark | Avro | DuckDBEducation budget | Fitness budget | Flexible schedule | Mentorship | Office work optionsSenior-level Full TimeWest Palm Beach, United States20h ago
-
Data Engineer ID50062 USD 147K-166KAPI Integration | Airflow | Amazon Web Services | Apache Spark | AvroEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapsSenior-level Full TimeBaltimore, United States20h ago
-
Data Engineer ID50062 USD 147K-166KAWS | Airflow | Apache Spark | Avro | DuckDBEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapsSenior-level Full TimeBoca Raton, United States20h ago
-
Data Engineer ID50062 USD 147K-166KAWS | Airflow | Apache Spark | Avro | Data LakehouseFlextime | Mentorship | Office work options | Personalized growth roadmaps | Remote work optionsSenior-level Full TimeAustin, United States20h ago
-
Data Engineer ID50062 USD 147K-166KAWS | Airflow | Apache Spark | Avro | Columnar StorageFlextime | Mentorship | Office options | Personalized growth roadmaps | Remote work optionsSenior-level Full TimeMiami, United States20h ago
-
Data Engineer ID50062 USD 147K-166KAWS | Airflow | Apache Spark | Avro | DuckDBEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapsSenior-level Full TimeRichmond, United States20h ago
-
Data Engineer ID50062 USD 147K-166KAWS | Airflow | Apache Spark | Avro | DuckDBFlexible schedule | Mentorship | Personalized growth roadmaps | Remote work options | TechtalksSenior-level Full TimeOrlando, United States20h ago
-
Senior-level Full TimePalo Alto, CA1d ago
-
Entry-level Full TimeSan Francisco1d ago
-
Sr. Data Engineer - Databricks USD 180K-248KAmazon Web Services | Apache Spark | Azure | Cloud platform | Data EngineeringSenior-level Full TimeUnited States - Remote R1d ago
-
Senior Data Engineer USD 140K-180KAWS | AWS Step Functions | Amazon EC2 | Amazon RDS | Amazon S3Agile team collaboration | Employee-owned company | Public trust clearance supportSenior-level Full TimeUnited States1d ago