Senior Software Engineer, Data Lake
Tasks
- Build self service onboarding tooling
- Design and scale CDC ingestion systems
- Design and scale snapshot ingestion systems
- Develop streaming ingestion applications
- Implement PII handling workflows
- Implement retention pipeline workflows
- Implement secure access controls
- Improve pipeline reliability and monitoring
- Mentor engineers on technical design
- Scale data quality and schema validation
Perks/Benefits
- 401k matching
- Disability insurance
- Fertility benefits
- Health insurance
- Life insurance
- Lifestyle benefits spending account
- Mental health benefits
- Paid time off
- Parental leave
- Sick time
Skills/Tech-stack
AWS S3 | Apache Flink | Apache Kafka | Apache Spark | Change Data Capture | Container Orchestration | Data Capture | Data Pipelines | Data Quality | Data Validation | Java | Kubernetes | PII handling | PostgreSQL | Python | Scala | Schema governance | Streaming Data | Streaming data pipelines
Education
N/A
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R22d ago
-
Software Engineer, Data Engineering USD 70K-200KAWS | AWS Glue | AWS Lambda | Amazon Athena | Amazon EC2Mid-level Full TimeIrvine, CA8h ago
-
Staff Frontier Agents Engineer (Applied AI) USD 252K-315KA/B | A/B Testing | AWS | Ablation Studies | AzureCommuter stipend | Generous PTO | Health, dental, vision coverage | Learning and development stipend | Retirement benefitsSenior-level Full TimeSan Francisco, CA; Seattle, WA; New …9h ago
-
Senior Frontier Agents Engineer (Applied AI) USD 216K-270KA/B Testing | AWS | Ablation Studies | Agent systems | AzureCommuter stipend | Health, dental, vision coverage | Learning and development stipend | Paid time off | Retirement benefitsSenior-level Full TimeSan Francisco, CA; Seattle, WA; New …9h ago
-
Frontier Agents Engineer (Applied AI) USD 180K-225KA/B | A/B Testing | AWS | Ablation Studies | Agent FrameworksCommuter stipend | Dental insurance | Health insurance | Learning and development stipend | Paid time offMid-level Full TimeSan Francisco, CA; Seattle, WA; New …9h ago
-
AI & Machine Learning Vice President USD 120K-220KAWS | Alteryx | Anomaly Detection | Azure | C#401k | Dental insurance | Disability insurance | Health insurance | Hybrid work modelExecutive-level Full TimeUnited States R11h ago
-
Software Engineer, ML Infra (Junior & New Grad) USD 125K-175KAWS | Azure | Bug tracking | C++ | Cloud ComputingEntry-level Full TimeMountain View, California, United States11h ago
-
Senior Embedded Software Engineer USD 191K-253KARM | Bare Metal | Board Bring-up | Bring-up | Build systemsComprehensive benefits | On-site work opportunities | U.S. Secret security clearance sponsorshipSenior-level Full TimeCosta Mesa, California, United States11h ago
-
AI Programmer Analyst - Need 11+ Exp USD 120K-154KAI Agents | AIOps | Anomaly Detection | Automated Incident Remediation | Azure AIMid-level Contract Full TimeDallas, TX, United States11h ago
-
Staff Machine Learning Engineer, Applied Research USD 189K-389KC++ | Graph Neural Networks | Information Retrieval | Java | Language ProcessingSenior-level Full TimeSan Francisco, CA, US; Remote, US R12h ago
-
Director, Data Analyst/BI Engineer USD 138K-175KAWS | Access Control | Aggregated Event Measurement | Airflow | BigQuery401k match | Healthcare Dental Vision | PTO | Paid Holidays | Parental leaveExecutive-level Full TimeUnited States R12h ago
-
AI Engineer - FDE (Forward Deployed Engineer) USD 152K-210KAWS | Agent systems | Apache Spark | Azure | Databricks Intelligence PlatformRemote work | Travel opportunitiesSenior-level Full TimeUnited States13h ago
-
Senior Production Engineer, Storage USD 172K-209KAnsible | Backup and Restore | Block Storage | C# | Data replication401k match | Calm subscription | Cell phone reimbursement | Commuter benefit | HSA employer contributionSenior-level Full TimeSunnyvale, CA - US13h ago
-
API Design | AWS | Access Control | Amazon S3 | Apache AirflowEmployee discounts | Employee equity | Medical, dental & vision coverage | Pet insurance | Unlimited PTOSenior-level Full TimeNashville, TN13h ago
-
API Design | AWS | Apache Airflow | Apache Flink | Apache KafkaDental insurance | Employee discounts | Employee equity | Health insurance | Pet insuranceSenior-level Full TimeRemote - United States R13h ago
-
Software Engineer, Gen AI USD 179K-224KElasticsearch | MongoDB | Node.js | Python | ReactCommuter stipend | Comprehensive health, dental and vision coverage | Generous PTO | Learning and development stipend | Retirement benefitsMid-level Full TimeSan Francisco, CA; New York, NY14h ago
-
API Integration | Apache Airflow | Apache Spark | Big Data | Classified EnvironmentsHealth insurance | Paid leave | RetirementSenior-level Full TimeHanover, MD14h ago
-
Senior Data Engineer USD 115K-175KAWS Fargate | AWS Glue | AWS IAM | AWS Lambda | AWS MWAACharitable giving program | Company-Paid Holidays | Dental insurance | Flexible PTO | Life insuranceSenior-level Full TimeMassachusetts - Boston R14h ago
-
Senior Machine Learning Engineer USD 203K-267KAlgorithm Design | Artificial Intelligence | C# | Complexity analysis | Data Cleansing401k match | Experience bonus | Mental health benefits | Unlimited sick days | Wellness reimbursementSenior-level Full TimeSeattle, Washington, United States15h ago
-
Senior-level Full TimeWashington, DC15h ago
-
GTM AI Engineer USD 115K-175KAPI Integration | Agent Frameworks | Data Engineering | Deep learning | Java401k | Coaching benefits | Dental insurance | Education stipend | Flexible vacationSenior-level Full TimeAustin | Chicago | New York …15h ago
-
Staff ML Engineer, Product USD 210K-260KEvaluation | LLM | MLOps | Machine Learning | NLP401k matching | Commuter benefits | Health, dental & vision plans | Lunch daily | Snacks and coffeeSenior-level Full TimeSan Francisco, CA, Washington, D.C., New …16h ago
-
AI Engineer II USD 125K-145KAPI Gateway | AWS | AWS Bedrock | AWS Lambda | Amazon APICareer advancement | Employee recognition | LinkedIn Learning Platform | Open PTO | Paid HolidaysMid-level Full TimeRemote US R16h ago
-
Principal AI Engineer (Remote) USD 128K-200KAPI Gateways | Agent Orchestration | Artificial Intelligence | BigQuery | By DesignAfter hours incident support | Occasional overtime | Occasional travel | Remote workSenior-level Full TimeOak Brook, IL, United States R16h ago
-
Mid-level Full TimeChicago, Illinois, United States17h ago