Staff Software Engineer, Big Data Storage
Palo Alto, CA, US; Remote, US
R
USD 177K-364K Senior-level Full Time
Tasks
- Build metadata management capabilities
- Collaborate with data and ML teams
- Contribute to open-source communities
- Design data lake storage platform
- Enable governed access to data
- Execute large scale column backfills
- Implement schema evolution
- Lead technical projects
- Optimize high throughput data access
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Flink | Apache Hive | Apache Iceberg | Apache Spark | Column Backfill | Data Lake | Data Storage | Data access | Distributed Systems | High Throughput | High-throughput data | High-throughput data access | Java | Metadata Management | Presto | Python | Scala | Schema evolution | Trino
Education
Roles
Regions
Countries
States
Cities
Related jobs
-
Senior GenAI Software Engineer (North America) USD 165K-230KA/B | A/B Testing | B testing | Debugging | EvaluationEquity | Health, dental, and vision benefits | In person team gatherings quarterly | Remote-first work | Wellness stipendsSenior-level Full TimeUnited States R12h ago
-
Machine Learning Platform Engineer USD 135K-160KAmazon SageMaker | Apache Flink | C++ | CI/CD | Cloud PubSub401k match | Annual bonus | Company equipment provided | Company medical dental vision plans | Disability benefitsMid-level Full TimeAtlanta, GA preferred, Remote R14h ago
-
Senior Developer Advocate - Modern App Development USD 194K-237KAPI Integrations | AWS | Cloud platform | Code Quality | Google CloudCommunity groups | Employee stock purchase plan | Inclusion talks | Mental health benefits | Mentor/Buddy programSenior-level Full TimeCalifornia, USA, Remote; Nevada, USA, Remote; … R14h ago
-
Staff Software Engineer, AI Developer Tools USD 180K-245KAPI Design | Agent systems | CI/CD | Compliance | Data PrivacySenior-level Full TimeDenver, CO;San Francisco, CA;New York, NY;Seattle, … R15h ago
-
Senior AI Data Engineer USD 160K-200KAWS Glue | AWS Lambda | Amazon Kinesis | Amazon Redshift | Amazon S3401k matching | Dental insurance | Disability insurance | Life insurance | Medical insuranceSenior-level Full TimeSan Diego, California, United States R15h ago
-
Senior Embedded Software Engineer - Future Forward USD 153K-201KAuthentication | Board Bring-up | Bring-up | C# | C++Senior-level Full TimeSunnyvale, CA, United States R16h ago
-
Lead AI Engineer, Business Operations (Hybrid or Remote USD 150K-220KAPI Design | Backend Development | Cloud Platforms | Evaluation Frameworks | Fine Tuning401k company match | Career advancement opportunities | Dental insurance | Flexible time off policy | Life insuranceSenior-level Full TimeDallas, Texas, United States; United States R16h ago
-
AWS | Airflow | Apache Spark | Azure Synapse | Azure Synapse Analytics401k matching | Disability insurance | Employee assistance program | Life insurance | Medical/Dental/Vision insuranceMid-level Full TimeRemote, USA ; Remote, Canada R17h ago
-
Principal Data Engineer/ Technical Lead USD 219K-298KAWS | Access Layer | Aggregation pipelines | Apache Kafka | Apache Spark401k match | Employer paid medical/dental/vision | Flexible spending account | Paid parental leave | Remote first work from homeSenior-level Full TimeUnited States (Remote) R18h ago
-
Senior Software Engineer II - (AI Core Platform) USD 100K-177KAPI Development | API Gateway | AWS | Agile | AlertingMid-level Full TimeRemote, United States R19h ago
-
AI Expert USD 148K-175KAWS | Agile | Batch Processing | Data Mapping | Data ModelingHybrid work | Public Trust Clearance | Remote workSenior-level Full TimeMemphis, TN, United States R19h ago
-
Machine Learning Engineer II USD 160K-210KAirflow | Apache_Spark | Autoscaling | C++ | CI_CDDental insurance | Disability insurance | Flexible vacation | Health insurance | Life insuranceSenior-level Full TimeRemote, USA R19h ago
-
People Analytics AI Engineer USD 146K-221KAPI Integration | AWS | Amazon Redshift | Automation | Data ModelingFlexible working | Health benefits | Parental leave plans | Professional development stipend | Remote ModelSenior-level Full TimeRemote - Seattle R20h ago
-
Senior AI Integration Engineer USD 190K-190KAWS | AgenticAI | AmazonS3 | Bash | BedrockPart-time remote workSenior-level Full TimeNew York, New York, United States R21h ago
-
VP II AI, Machine Learning|US Remote* USD 202K-210KApache Spark | Azure | Databricks | ETL | Flume401k match | Medical/Dental/Vision insurance | Paid time offMid-level Full TimeRemote, United States R23h ago
-
Assistant Director, Data Science (STP) USD 139K-226KData Visualization | GLM | Insurance pricing | MLOps | Machine LearningDomestic travel | TelecommutingExecutive-level Full TimeBoston, MA, United States R1d ago
-
Inference Engineer USD 180K-250KCUDA | Continuous batching | Distributed Systems | Generative Models | Machine Learning401k | Commuter allowance | Dental insurance | Flexible PTO | Health insuranceMid-level Full Time*HQ - San Francisco, CA R1d ago
-
Principal Machine Learning Engineer USD 205K-230KAWS Lambda | BigQuery | C# | CI/CD | Cloud Functions401k | Dental insurance | Health insurance | Life insurance | Paid HolidaysSenior-level Full TimeUnited States of America - Remote … R1d ago
-
Generative AI Engineering Intern (Graduate) USD 70K-70KAWS | Agile | Azure OpenAI | Azure OpenAI Service | CI/CDDedicated mentorship | Flexible scheduling | Networking opportunities | Potential full-time employment | Remote friendly schedulingEntry-level Full Time InternshipUnited States R1d ago
-
Freelance Machine Learning Engineer USD 180KLangchain | MLOps | Machine Learning | NumPy | PandasFlexible part-time hours | Project-based assignments | Remote workMid-level FreelanceTexas, United States - Remote R1d ago
-
Freelance Machine Learning Engineer USD 180KLangchain | Language Models | Large Language Models | MLOps | NumPyFlexible weekly hours | Part-time availability | Project based workMid-level FreelanceNew York, United States - Remote R1d ago
-
Freelance Machine Learning Engineer USD 180KLLM | Langchain | MLOps | NumPy | PandasProject based workMid-level FreelanceUnited States - Remote R1d ago
-
Edge AI Engineer USD 100K-150KC plus plus | Core ML | Deep learning | Edge Computing | Embedded SystemsCareer growth | No third party employment | Remote work | W2 employmentSenior-level Full TimeUnited States - Remote R1d ago
-
AI Research Engineer (Applied AI) USD 100K-150KAblation Studies | Accelerator hardware | Data Quality | Data Validation | Data labelingMid-level Full TimeUnited States - Remote R1d ago
-
AI Data Infrastructure Engineer USD 100K-150KApache Beam | Apache Spark | CI/CD | Caching | Code reviewCareer growth | Health benefits | Remote workMid-level Full TimeUnited States - Remote R1d ago