Senior Software Engineer, Data Compute
Tasks
- Build platform primitives for Spark and Airflow
- Deliver self serve data processing experience
- Design scalable ingestion and compute primitives
- Implement metadata management and access controls
- Improve platform reliability and governance
- Lead migration to serverless Databricks and Delta Lake
- Optimize compute cost efficiency
Perks/Benefits
- 401k matching
- Catered meals
- Disability insurance
- Employer AI tools
- Fertility benefits
- Learning benefits
- Life insurance
- Mental health benefits
- Paid health insurance
- Paid time off
- Parental leave
- Sick time
- Wellness benefits
Skills/Tech-stack
Amazon S3 | Apache Airflow | Databricks | Delta Lake | Lakehouse | Parquet | Spark | Trino | Unity Catalog
Education
N/A
Related jobs
-
Senior-level Full TimeHerdon, VA, US8h ago
-
Data Engineer – Senior USD 140K-180KABAC | AWS | AWS Glue | AWS IAM | AWS Lake FormationActive MBI required | IRS contract experience preferred | U.S. citizenship requiredSenior-level Full TimeHyattsville, MD, US8h ago
-
AI/ML Engineer II USD 93K-179KAmazon EC2 | Amazon S3 | Apache Airflow | CI/CD | CSS401k | Adoption Assistance | Career path planning | Continuing education | Employee referral programMid-level Full TimePhoenix Campus (Main), United States22h ago
-
Senior Data Engineer USD 105K-149KAWS | AWS Lambda | Agile | Amazon Redshift | CI/CD401k matching | Dental insurance | Family and Medical Leave FMLA | Life insurance | Medical insuranceSenior-level Full TimeKS Overland Park, United States22h ago
-
Data Scientist I - Card Fraud USD 73K-110KData Cleansing | Data Preparation | Data Visualization | Econometrics | Hadoop401k | Health insurance | Paid Holidays | Paid time off | Sick leaveNone Full TimeAtlanta GA - 303 Peachtree Center …22h ago
-
Apache Arrow | Backtesting | Cost modeling | Cross-validation | Data QualityMid-level Full TimeNew York, New York, United States …22h ago
-
Data Engineer - Senior Manager USD 124K-280KAmazon Web Services | Apache Hadoop | Azure Data | Azure Data Factory | Data Factory401k | Annual discretionary bonus | Dental insurance | Health insurance | Holiday paySenior-level Full TimeChicago - One North Wacker Drive, …22h ago
-
Data Engineer - Senior Associate USD 77K-202KAmazon Web Services | Apache Airflow | Apache Hadoop | Azure Data | Azure Data Factory401k | Annual discretionary bonus | Dental insurance | Holiday pay | Medical insuranceSenior-level Full TimeAtlanta - 1075 Peachtree Street NE, …22h ago
-
Director, Precision Medicine Data Science & AI USD 194K-361KAI Governance | AWS | Azure | CDS frameworks | CPTExecutive-level Full TimeEast Hanover, United States22h ago
-
Hadoop Developer USD 100K-150KAWS | AWS EMR | Airflow | Apache Atlas | Apache SparkBenefits package | Career growth | Long-term project | Remote workSenior-level Full TimeUnited States - Remote R22h ago
-
Senior-level Full TimeAlpharetta, GA1d ago
-
Apache Airflow | DBT | Data Modeling | ETL | Embedded Analytics401k matchSenior-level Full TimeOrlando, Florida, United States - Remote R1d ago
-
Data Engineering | Distributed Computing | Language Models | Language Processing | Large Language ModelsHybrid work | Onsite customer support | Travel opportunitiesMid-level Full TimeJacksonville, Florida, United States1d ago
-
AIP | Distributed Computing | Language Models | Large Language Models | Machine LearningHybrid work | Travel 10 to 33 percentMid-level Full TimeNew York Mills, New York, United …1d ago
-
Distributed Systems | Language Models | Large Language Models | Machine Learning | Palantir AIPHybrid work | Travel opportunitiesMid-level Full TimeSan Francisco, California, United States1d ago
-
Data Engineering | Data Processing | Distributed Computing | Full Stack | Full-Stack DevelopmentHybrid work | Onsite customer support | Travel opportunitiesMid-level Full TimeFlorida, Florida, United States1d ago
-
Machine Learning Engineer USD 140K-220KApache Spark | Azure | Azure Machine Learning | CI/CD | Cloud StorageCareer development opportunities | High responsibilitySenior-level Full TimeUnited States - Remote R1d ago
-
Data Engineer USD 179K-273KAmazon Kinesis | Apache Airflow | Apache Kafka | Apache Spark | Data ModelingMid-level Full TimeFoster City, CA1d ago
-
ML Infrastructure Engineer USD 120K-190KAirflow | Amazon SageMaker | Apache Spark | Argo | DatabricksEntry-level Full TimeOakland, CA1d ago
-
Staff Data Engineer USD 192K-250KAWS RDS | Airflow | Amazon Aurora | Amazon Kinesis | Apache KafkaCatered lunches | Co-working travel perk | Commuter benefit | Disability insurance | Equipment allowanceSenior-level Full TimeSan Francisco, CA1d ago
-
Agentic coding | Artificial Intelligence | Azure | Database Management | DatabricksCoaching | Comprehensive healthcare | Flexible Time Off (FTO) | Hybrid work model | Leave benefitsMid-level Full TimeSF4-San Francisco - 400 Howard Street, … R1d ago
-
Senior Software Engineer, Data Platform USD 166K-220KAWS | Apache Iceberg | Athena | Containerization | DBTSenior-level Full TimeCosta Mesa, California, United States2d ago
-
Senior Software Engineer (Pipeline team) USD 185K-259KA/B | A/B Testing | AWS Bedrock | AWS Lambda | AWS S3Senior-level Full TimeUnited States - Remote R2d ago
-
Lead Data Engineer USD 135K-160KApache Iceberg | Automation | CI/CD | Cloud Platforms | Columnar Storage401k match | Commuter benefits | FSA | HSA | Paid HolidaysSenior-level Full TimeDenver, CO, United States3d ago
-
AI Agents | AWS | Azure | Cloud Computing | Data Modeling401k matching | Dental insurance | Life insurance | Medical insurance | Paid time offSenior-level Full TimeUnited States3d ago