Sr Software Development Engineer - Distributed Systems
USA, CA, Pleasanton, United States
USD 160K-285K Senior-level Full Time
Tasks
- Architect distributed data lake platform services
- Build high throughput distributed services
- Deploy monitor and debug data services
- Enable multi cloud data accessibility
- Ensure strict data consistency
- Expose transactional data as Iceberg tables
- Manage metadata and schema evolution
- Optimize query execution for analytics
Perks/Benefits
Skills/Tech-stack
ACID | API Design | Apache Iceberg | Apache Spark | Apache Trino | Clean Code | Data Consistency | Data Processing | Distributed Systems | High Throughput | Java | Metadata Management | Multi-cloud | Object-Oriented | Object-oriented programming | Parquet | Python | Query Optimization | Scala | Schema evolution | Storage Compute | Storage Compute Separation | Trino
Education
Regions
Countries
States
Cities
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R12d ago
-
Forward Deployed AI Engineer (GenAI, AWS) USD 175K-200KAWS | AWS CDK | AWS Neptune | Amazon ECS | Amazon SageMakerRemote-friendly cultureSenior-level Full TimeNew Jersey7h ago
-
Robotics Engineer USD 170K-221KC++ | Camera Object Detection | Computer Vision | Gazebo | Isaac Sim401k matching | Background check clearance | Dental insurance | Drug Test Clearance | Life insuranceEntry-level Contract Full TimeSunnyvale, California8h ago
-
Senior-level Full TimeSan Francisco, California, United States9h ago
-
Senior-level Full TimeNew York, New York, United States9h ago
-
AI Software Engineer USD 127K-175KAPI Development | Agent Orchestration | Agent runtimes | Agent systems | C++Dental insurance | Employee assistance program | Flexible Paid Vacation | Flexible paid sick leave | Flexible spending accountEntry-level Full TimeSan Francisco, CA9h ago
-
Senior Applied Scientist USD 170K-286KApache Spark | C++ | Computer Vision | Data Processing | Edge inferenceComprehensive health insurance | Parental leave | Professional development stipend | Remote work | Travel up to 5 percentSenior-level Full TimeRemote - US R10h ago
-
AI Ops Engineer USD 122K-191KAgent Development Kit | Agile | CI/CD | Cloud platform | DockerCareer coaching | Employee assistance programme | Flexible working hours | Global career opportunities | Hybrid workEntry-level Full TimeColorado, United States11h ago
-
Senior Data Engineer - Modern Data & AI Platforms USD 156K-204KAI machine learning | AWS | Cortex | DBT | Data GovernanceRemote work | Weekend and after hours release supportSenior-level Full TimeKansas City, MO, United States12h ago
-
A/B | A/B Testing | Access Control | B testing | ExperimentationSenior-level Full TimeChicago, IL, United States13h ago
-
Senior Databricks Platform Engineer USD 140K-165KAWS | Active Directory | Apache Hive | Apache Spark | Audit LoggingSenior-level Full TimeArlington, VA, United States13h ago
-
Senior Data Engineer-JT0224 USD 115K-175K.Net Core | .Net Framework | AWS CloudFormation | Apache Airflow | Azure401k match | Career growth opportunities | Dental insurance | Employee resource groups | Health insuranceSenior-level Full TimeRemote, United States R13h ago
-
Senior Machine Learning Engineer USD 140K-224KAIOps | AWS | Apache Spark | Cloud platform | Data Analysis401k match | Dental insurance | Flexible paid time off | Life insurance | Medical insuranceSenior-level Full TimeRemote, United States R13h ago
-
Senior WEM AQM Prompt Engineer USD 88K-247KA/B | A/B Testing | API Integration | B testing | CalibrationInclusive environment | Remote work | Team-first cultureSenior-level Full TimeUnited States (Remote) R14h ago
-
Mid-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL15h ago
-
Senior-level Full TimeColumbia, MD, United States16h ago
-
Senior-level ContractRaleigh, United States16h ago
-
Cloud Computing | Cloud Native | Cloud platform | Distributed Systems | Experimentation401k match | Health insurance | Life and long-term disability insurance | Life insurance | Long-term disability insuranceSenior-level Full TimeUS TX Austin16h ago
-
SYSTEM ENGINEER - Computer Network Support - AI/ML - 6+ yrs of Experience - TS/SCI w/Poly clearance is required - ES - 032726-2 A USD 136K-140KAI/ML | Agile | Confluence | Jira | LLM401k retirement plan | Dental insurance | Disability insurance | Federal Holidays | Floating holidaysMid-level Full TimeFort George G Meade, United States16h ago
-
AWS | Access Control | Automation Nodes | CI/CD | DBTSenior-level Full TimeCincinnati, Ohio, United States17h ago
-
AI Platform Engineer USD 108K-215KAutogen | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure Key VaultMid-level Full TimeBelmont, NC, United States17h ago
-
AI Platform Engineer USD 108K-215KAI Agents | Agent Frameworks | Autogen | Azure Data | Azure Data LakeMid-level Full TimeBelmont, NC, United States17h ago
-
AI experimentation | Alerting | Artificial Intelligence | Data Annotation | Data ArchitectureSenior-level Full TimeNew York17h ago
-
Project Lead Data Engineer III USD 119K-198KBTEQ | Database Administration | Patch Management | Performance Tuning | Query OptimizationSenior-level Full TimeSacramento, California, United States17h ago
-
Asynchronous training | Containerization | Curriculum learning | Distributed Systems | Distributed TrainingSenior-level Full TimeSF Bay Area, CA, Remote, US, … R17h ago