Senior Software Engineer - Data Lake Ingestion
Tasks
- Build streaming ingestion applications
- Design CDC ingestion systems
- Develop self service database onboarding
- Ensure data quality and schema validation
- Guide technical designs and mentor engineers
- Handle PII across ingestion lifecycle
- Implement access controls for sensitive data
- Improve pipeline reliability and monitoring
- Land curated datasets in S3
- Scale snapshot ingestion systems
Perks/Benefits
- 401k matching
- Disability insurance
- Fertility benefits
- Life insurance
- Lifestyle Wallet
- Mental health benefits
- Paid health insurance
- Paid time off
- Parental leave
- Sick time
Skills/Tech-stack
AWS S3 | Apache Flink | Apache Kafka | Apache Spark | Change Data Capture | Data Capture | Data Modeling | Java | Kubernetes | PII handling | PostgreSQL | Python | Relational databases | Scala | Schema governance
Education
N/A
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R18d ago
-
Senior Product Engineer, Fullstack USD 165K-250KAPI Design | Amplitude | CI/CD | Data Modeling | GoHealth insurance | Startup equitySenior-level Full TimeSan Francisco3h ago
-
Embedded Software Engineer (PL Integration & IPC) USD 130K-140KAPU | AXI | AXI interconnect | BSP Development | C plus plusMid-level Full TimePalo Alto, California, United States7h ago
-
ALSA | ASIL | Audio HAL | C# | C++Career growth opportunities | Comprehensive benefits | Mentorship | On-site workMid-level Full TimePalo Alto, California, United States8h ago
-
AMD x86 | AOSP | Android | BSP | Bring-upSenior-level Full TimePalo Alto, California, United States8h ago
-
Lead Embedded Software Engineer (Mediatek Platform) USD 140K-160KBSP | Bootloader | Bring-up | C plus plus | C#Career growth | Comprehensive benefits | MentorshipSenior-level Full TimePalo Alto, California, United States8h ago
-
Robotics Software Engineer BRL 120K-145KAutonomous Navigation | C++ | Controls systems | Embedded Systems | Hardware-in-the-loopCareer growth | Comprehensive benefits | MentorshipMid-level Full TimeNorth Reading, MA8h ago
-
Senior Data Engineer - Modern Data & AI Platforms USD 156K-204KAWS | Cortex | DBT | Data Governance | Data IngestionRemote workSenior-level Full TimeKansas City, MO, United States10h ago
-
Data Engineer - SPACECOM USD 110K-142KAPI Development | Apache Spark | Data Validation | Data Visualization | DatabricksOnsite SCIF WorkMid-level Full TimeColorado Springs, CO11h ago
-
Staff Software Engineer - AI Platform USD 175K-287KApache Beam | Apache Flink | Apache Spark | C# | C++Health and wellness programs | Time awaySenior-level Full TimeMountain View, CA, United States11h ago
-
Senior Software Engineer - AI Platform USD 144K-236KApache Beam | C# | C++ | CUDA | CUDA optimizationHealth and wellness programs | Time offSenior-level Full TimeMountain View, CA, United States11h ago
-
Mid-level Full TimeWashington, D.C.12h ago
-
Data Engineer - CDAO Central USD 122K-142KAPI Development | Apache Spark | Cloud Computing | Data Pipelines | Data ValidationOnsite work | SCIF environment access | Top Secret SCI clearanceMid-level Full TimeWashington, D.C.13h ago
-
Partner Technology Solutions Engineer USD 156K-195KAPI Development | Cloud infrastructure | Code review | Go | Jira401k plan | Dental | Development budget | Employee stock purchase plan | Equipment budgetSenior-level Full TimeNew York, New York, USA13h ago
-
Senior Embedded Software Engineer USD 140K-165KC# | C++ | CORBA | Device Drivers | Linux401k match | Certification assistance | Employer Provided Disability Insurance | Employer provided dental insurance | Employer provided life insuranceSenior-level Full TimeCedar Rapids, IA13h ago
-
AI Solutions Engineer USD 122K-168KAgentic AI | Bias Mitigation | CI/CD | Docker | Generative AICompany holidays | Health insurance | Learning and development reimbursement | Life insurance | Long-term disabilityMid-level Full TimeTorrance, California, United States15h ago
-
Senior Embedded Software Engineer USD 125K-160KAMD Xilinx | AMD Xilinx Devices | ARM Cortex | C# | Digital Signal401k match | Dental insurance | Employee assistance program | Every other Friday off | FSASenior-level Full TimeCamarillo, CA, United States15h ago
-
AI Engineer III USD 120K-140KAgent systems | Agentic AI | Amazon S3 | Amazon Web Services | Apache Airflow401k matching | Dental insurance | Employee assistance program | Flexible PTO | Life insuranceSenior-level Full TimeSan Antonio, TX, United States15h ago
-
Data Engineer - TRANSCOM USD 100K-135KAPI Development | Apache Spark | Data Pipeline Development | Data Validation | Data pipelineOnsite SCIF Work | Top Secret clearance required to startMid-level Full TimeScott AFB, IL16h ago
-
Data Engineer USD 114K-160KCribl | Data Modeling | Data Warehouse | Data analytics | Data pipeline401k match | Holiday pay | Medical, dental & vision coverage | Paid time offMid-level Full TimeHuntsville, AL, United States16h ago
-
Machine Learning Engineer, GenAI Technology USD 180K-300KArtificial Intelligence | C++ | Compliance | Data integration | Java401k match | Employee affinity groups | Fully-paid health care benefits | Generous parental and family leave | Mental wellness programsSenior-level Full TimeNew York, NY17h ago
-
Embedded Security Software Engineer USD 111K-167KBinary Analysis | Binary Ninja | C# | C++ | Control Flow AnalysisDental insurance | Disability insurance | Life insurance | Medical insurance | Paid leaveMid-level Full TimeHerndon, Virginia18h ago
-
20454 - Analytics Engineer x 2 GBP 40K-42KAzure Data | Azure Data Factory | Azure Synapse | Data Factory | Data ModelingFlexible working | Hybrid working | Training and coachingEntry-level Full TimeNational, National18h ago
-
Senior Data Engineer USD 92K-135KAWS | Azure Data | Azure Data Factory | Change Data Capture | Cloud Security401k matching | Lifecycle benefits | Loan forgiveness | Tuition reimbursementSenior-level Full TimeChicago, IL, United States18h ago
-
Airflow | Apache Spark | CI/CD | Data Governance | Data LakehouseSenior-level ContractAustin, United States18h ago