Software Engineer, Storage
Tasks
- Build and operate data ingestion system
- Debug and fix operational issues
- Export database change logs for asynchronous processing
- Ingest database data into warehouse
- Maintain periodic mutation and full table snapshots
- Participate in Oncall rotation
- Stream change data capture near real time
Perks/Benefits
Skills/Tech-stack
Asynchronous processing | Change Data Capture | Data Capture | Data Ingestion | Data Streaming | Distributed Caching | Distributed Systems | Key-Value Stores | Key-value | Warehouse Data | Warehouse Data Ingestion
Education
N/A
Roles
Related jobs
-
Lead Snowflake Forward Deployed Engineer - GPS USD 102K-174KAPI Integration | AWS | Arctic Embed | CI/CD | Cortex AILeadership opportunities | Mentorship | Professional development | Travel opportunities | US government security clearance supportSenior-level Full TimeArlington/Rosslyn, Virginia, United States; Atlanta, Georgia, …23h ago
-
Senior Staff Software Engineer, AI/ML, Security USD 262K-365KAdversarial Machine Learning | Cloud | Data Privacy | Data Processing | Data StructuresSenior-level Full TimeKirkland, WA, USA; Seattle, WA, USA1d ago
-
Applied AI Staff Software Engineer, Looker USD 207K-300KData Processing | Data Visualization | Debugging | Distributed Systems | Fine TuningSenior-level Full TimeKirkland, WA, USA1d ago
-
Staff Software Engineer, Embedded Systems/Firmware USD 207K-300KAPI Design | Bare Metal | C# | C++ | DMASenior-level Full TimeSunnyvale, CA, USA1d ago
-
Staff Software Engineer, AI/ML, Google Public Sector USD 207K-300KAccelerator optimization | C++ | Cloud Object Storage | Deep learning | Distributed SystemsSenior-level Full TimeReston, VA, USA; Washington D.C., DC, …1d ago
-
Data Engineer Lead | $140k-$175k + Hybrid + Equity | Exciting High Growth AI Operational Intelligence Startup A USD 140K-175KApache Airflow | Apache Kafka | DBT | Dagster | Data LineageEquity | Health insurance | Hybrid work | Medical insurance | Paid HolidaysExecutive-level Full TimeWayne, PA, United States R1d ago
-
Data Engineer USD 70K-80KData Ingestion | Microsoft SQL | Microsoft SQL Server | Python | REmployee assistance program | Health benefits | Retirement plan matching | Student loan assistance | Time offMid-level Full TimeVillanova, PA, United States1d ago
-
Forward Deployed Application/ ML Engineering Expert USD 198K-420KAgentic AI | Cloud Native | Data Pipelines | Distributed Systems | Language ModelsContinuous learning | Flexible working models | Health and well-being benefitsSenior-level Full TimePalo Alto, CA, US, 943041d ago
-
Sr. Machine Learning Solutions Architect USD 156K-216KAWS | Amazon EMR | Amazon Redshift | Apache Spark | AzureAutonomy to Deliver Results | Continuous improvement culture | Professional mentorship | Remote-first cultureSenior-level Full TimeUS-Remote R1d ago
-
Senior Software Engineer USD 119K-261KAdaptive Execution | Alerting | Apache Spark | Backend Development | C#Senior-level Full TimeRedmond, WA, US1d ago
-
Helix AI Engineer, Backend Infrastructure USD 150K-400KAWS | Alerting | Azure | C plus plus | Cloud platformSenior-level Full TimeSan Jose, CA1d ago
-
Senior Analytics & Activation Engineer USD 147K-221KAPIs | AWS | Amazon Web Services | Apache Spark | CI/CD401k matching | Dental insurance | Employee discounts | Medical insurance | Paid time offSenior-level Full TimeUnited States, Los Angeles, CA1d ago
-
Backend Data Engineer USD 140K-180KAgile | Apache Kafka | CI/CD | CRM Integration | Data accessCollaborative engineering culture | Comprehensive benefits package | Hybrid work environment | Mentorship opportunitiesSenior-level Full TimeHybrid Worker - USA -Dallas or … R1d ago
-
Staff Software Engineer, Embedded Finance USD 151K-309KAI tools | Distributed Systems | Enterprise Messaging | GraphQL | JavaFlexible work arrangements | Hybrid work model | Mentorship | Remote work optionSenior-level Full TimeRemote, USA R1d ago
-
Cloud Computing | Data Processing | Data Storage | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeSunnyvale, CA, USA2d ago
-
Senior Software Engineer, Managed Spark, Open Source USD 174K-252KApache Hadoop | Apache Hive | Apache Spark | Data Analysis | DebuggingSenior-level Full TimeSunnyvale, CA, USA2d ago
-
Software Engineer III, Knowledge Catalog For AI USD 147K-211KArtificial Intelligence | BigQuery | C++ | Cloud Computing | Data CatalogSenior-level Full TimeSunnyvale, CA, USA2d ago
-
C++ | Control Plane | Data Structures | Data Structures and Algorithms | Data analyticsHealth and wellness benefits | Paid time off | Retirement savings planSenior-level Full TimeSunnyvale, CA, USA2d ago
-
AWS Step Functions | Amazon Web Services | Apache Airflow | CI/CD | Cause analysis401k | Dental insurance | Life insurance | Long-term disability insurance | Medical insuranceSenior-level Full TimeWashington, DC, United States2d ago
-
Machine Learning Engineer USD 158K-266KData Processing | Distributed Systems | Generative AI | Machine Learning | Machine learning lifecycleCompassionate care leave | Full health benefits | Learning and development | Paid parental leave | Paid time offMid-level Full TimeSan Francisco, CA, United States2d ago
-
Principal Data Engineer USD 246K-311KApache Airflow | Apache Kafka | Backwards Compatibility | CDC | Change Data Capture401k match | Flexible work from home or in office | Health benefits | Learning and development budget | Mentorship and coachingSenior-level Full TimeUSA2d ago
-
Associate MLOps Engineer USD 97K-150KAWS | Azure | CI/CD | Cloud platform | Data IngestionFully remote | Health mission impactMid-level Full TimeChattanooga, TN, United States R2d ago
-
Sr. Data Governance Platform Engineer USD 132K-155KActive Directory | Agile | Amazon Web Services | Apache Spark | Azure SSO401k retirement plan | Healthcare (Medical Dental Vision) | Paid Holidays | Paid vacationSenior-level Full TimeCupertino, CA, United States2d ago
-
Staff Software Engineer, Spark USD 164K-210KApache Airflow | Apache Spark | Concurrent Systems | Containerization | Distributed SystemsCareer development support | Employee resource groups | Flexible WFH | Generous PTO | Volunteer timeSenior-level Full TimeUS-California-Remote, United States R2d ago
-
Software Development Engineer II, RFE Analytics USD 165K-223KAWS | CI/CD | Distributed Systems | Infrastructure Design | Service OrientedMid-level Full TimeSunnyvale, California, USA2d ago