Senior/Staff Software Engineer, Data Platform
Tasks
- Architect AWS and Databricks pipeline components
- Architect pipeline metrics
- Define tables and data models
- Enable team to research and evolve data processing methods
- Ensure data governance and privacy compliance
- Govern business critical product datasets
- Implement and maintain data pipelines
- Implement big data solutions
- Implement data security with security team
- Lead architecture design for data platforms
- Monitor pipeline performance accuracy and availability
- Optimize data processing and data access
- Spot diagnose and fix data stability issues
- Troubleshoot data processing issues
Perks/Benefits
- 11 paid holidays
- 401k plan
- Commuter benefits
- Dental insurance
- Flexible vacation
- Life insurance
- Long-term disability
- Medical insurance
- Paid parental leave
- Short-term disability
- Vision insurance
Skills/Tech-stack
AWS | AWS CloudFormation | Airflow | Amazon S3 | Apache Spark | Backend Engineering | Data Governance | Data Modeling | Data pipeline | Databricks | Datadog | ELT | Elasticsearch | GitHub | Infrastructure as Code | Kafka | MWAA | NoSQL | Python | Redpanda | SQL | Scala | Terraform | “as-code”
Education
N/A
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R20d ago
-
Senior-level Full TimeRedmond, WA5h ago
-
Senior Data Engineer USD 100K-118KAWS | Amazon Redshift | Aurora PostgreSQL | Data Modeling | Data PipelinesCareer development opportunities | Dental insurance | Life insurance | Medical insurance | Paid HolidaysSenior-level Full TimeNew York, NY, US5h ago
-
Staff ML Engineer, Agent Training & Environments USD 250K-280KApache Kafka | CI/CD | Cloud platform | Direct Preference Optimization | Google CloudCareer growth tied to impact | Hybrid work model | Ownership and autonomySenior-level Full TimeSan Francisco Bay Area R7h ago
-
Senior Space Embedded Linux Software Engineer USD 169K-216KAnalog electronics | Bare Metal | C# | C++ | CAN401k employer match | Dental insurance | EV charging | Flexible PTO | HSA employer matchSenior-level Full TimeEl Segundo, California, United States8h ago
-
Space Embedded Linux Software Engineer USD 131K-184KAnalog electronics | Bare Metal | C# | C++ | CAN401k employer match | EV charging | Flexible PTO | HSA employer match | Medical/Dental/Vision insuranceEntry-level Full TimeEl Segundo, California, United States8h ago
-
AWS Glue | AWS S3 | Amazon Kinesis | Ansible | Apache Flink401k | Dental insurance | Medical insurance | Paid sick hours | Vision insuranceMid-level Contract Full TimeEnglewood Cliffs, NJ, United States8h ago
-
Senior Applied AI/ML Engineer USD 180K-230KAgentic Workflows | Artificial Intelligence | Benchmarking | Compliance | Data Privacy401k retirement plan | Flexible time off | Health, dental and vision coverage | Opportunities for company events and connection | Remote or hybrid flexibilitySenior-level Full TimeSanta Monica, CA9h ago
-
Sr. AI/ML Engineer II (6761) USD 152K-195KArtificial Intelligence | MLOps | Machine Learning | PyTorch | Python401k match | Employee Assistance and Wellness Programs | Flexible work arrangements | Health, dental, and vision insurance | Paid time offMid-level Full TimeHybrid - Local to D.C. metro … R10h ago
-
BI Data Engineer USD 88K-116KAzure Synapse | Azure Synapse Analytics | C# | DAX | Data Governance401k match | Company-Paid Holidays | Dental insurance | Life insurance | Long-term disabilityMid-level Full TimeBoise, Idaho10h ago
-
AI Eng Lead/Manager USD 125K-180KAPI Development | AWS Bedrock | Agentic Workflows | Azure Prompt Flow | Batch Processing401k | Commuter benefits | Dental insurance | Disability coverage | Employee assistance programSenior-level Full TimeColumbia, MD, United States13h ago
-
Agentic AI & Graph Machine Learning Research Engineer USD 128K-159KAgent communication | Agent2Agent | AgentOps | Agentic AI | Autogen401k match | Dental insurance | Gym facilities | Life insurance | Medical insuranceMid-level Full TimeCalabasas, CA13h ago
-
APIs | Artificial Intelligence | Behavioral analytics | Cognitive Modeling | Docker401k match | Dental insurance | Gym facilities | Life insurance | Medical insuranceMid-level Full TimeCalabasas, CA14h ago
-
AI Ops Engineer USD 122K-191KAgent Development Kit | Agile | CI/CD | Cloud platform | Distributed SystemsCareer coaching | Certifications coaching | Employee assistance programme | Flexible working hours | Healthcare benefitsEntry-level Full TimeRemote, United States R14h ago
-
Senior Machine Learning Engineer, GenAI Data USD 243K-295KAmazon S3 | Cloud Computing | Data Generation | Data Versioning | Data orchestrationEquity compensation | Health benefitsSenior-level Full TimeSan Mateo, CA, United States R14h ago
-
Software Engineer USD 120K-145KAWS | Automated testing | Azure | CI/CD | Containerization401K company matching | Catered team lunches | Dental insurance | Dependent care benefits | Drinks and snacksSenior-level Full TimeBoulder, CO14h ago
-
Autoscaling | Batching | CI/CD | Calibration | Cloud infrastructureDental insurance | Equity compensation | Health insurance | Hybrid work | Performance bonusSenior-level Full TimeNew York15h ago
-
Data Engineer USD 95K-130KBigQuery | Business Objects | Change Management | Cloud platform | Data CleansingMid-level Full TimeNashville, TN, United States16h ago
-
Sr. Software Engineer (AI Systems & Infrastructure) USD 135K-240KA/B | A/B Testing | AWS | Ansible | Apache FlinkOn-site workSenior-level Full TimeColumbia, MD, United States16h ago
-
Machine Learning Engineer USD 180K-230KAPI Development | Apache Spark | Backtesting | Data Validation | DatabricksHigh collaboration | High ownership | Mission-driven work | Rapid career growthSenior-level Full TimeNew York City17h ago
-
Sr. Data AI Engineer USD 150K-200KAgent architecture | C++ | Data Pipelines | Data Quality | Data TransformationIn-office collaboration | Relocation Support N/ASenior-level Full TimeLittle Rock, AR, United States17h ago
-
Senior-level Full TimeArlington, Virginia17h ago
-
Senior Databricks Data Engineer USD 152K-200KApache Spark | Artificial Intelligence | Azure Data | Azure Data Services | Azure DevOpsSenior-level Full TimeCalabasas17h ago
-
Software Engineer II - Data Platform USD 110K-157KAWS | Agile | Algorithms | Azure | CI/CDDental insurance | Disability insurance | Flexible spending account | Flexible vacation | Health insuranceMid-level Full TimeRemote, USA R17h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Friendly laid-back atmosphere | Opportunity for impactMid-level Full TimeSan Francisco, CA, USA17h ago