Senior Software Engineer - Data Platform
Tasks
- Automate testing for platform quality
- Build batch and real time data processing
- Build secure scalable cloud data architecture
- Collaborate with stakeholders on data engineering solutions
- Design data ingestion pipelines
- Develop data discovery and lineage
- Implement data governance and ingestion governance
- Mentor junior data engineers
- Optimize data cost and performance
- Provide production support for data platform
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | AWS CDK | Amazon Kinesis | Apache Flink | Apache Spark | C Sharp | CloudFormation | FastAPI | Hadoop | Infrastructure as Code | Kafka | OpenAPI | Presto | Pulumi | Python | Real Time | Real-time Streaming | Terraform | “as-code”
Education
Bachelor of Arts | Bachelor of Engineering | Bachelor of Science
Regions
Countries
States
Cities
Related jobs
-
Senior Platform Engineer - Databricks Integration USD 180K-247KAPI Integration | AWS GovCloud | Agile Development | Auto Scaling | CI/CDSenior-level Full TimeFalls Church, VA, United States6h ago
-
Analytics Engineer USD 120K-175KData Cataloging | Data Governance | Data Pipelines | Data Quality | Data Quality ManagementHybrid work schedule | Mentorship and training | Professional office environmentSenior-level Full TimeMilwaukee, WI, United States8h ago
-
Entry-level Full TimeCary, NC, United States8h ago
-
Apache Spark | Clustering | Data Ingestion | Data Ingestion Pipelines | Data ModelingSenior-level ContractLos Angeles, United States9h ago
-
Cloud Computing | Data Pipelines | Experimental Design | Java | Machine LearningCommunity volunteering | Internal mobility | Learning opportunities | Mentorship programs | Recognition programsMid-level Full TimeAustin, TX, United States9h ago
-
Senior-level Full TimeAustin, TX, United States9h ago
-
Data Analysis | Distributed Systems | Experimentation | Information Retrieval | Language ModelsSenior-level Full TimeSan Jose, California, United States11h ago
-
Apache Spark | Computer Vision | Data Curation | Data Pipelines | GroundingSenior-level Full TimeSunnyvale, CA | Bellevue, WA | …12h ago
-
Staff Software Engineer, NotebookLM, Generative AI, Labs USD 207K-300KAlerting | Computer Vision | Data Processing | Data Structures | Data structures algorithmsSenior-level Full TimeMountain View, CA, USA12h ago
-
Systems Development Engineer, Quantum AI USD 138K-198KAutomation | CI/CD | Cloud APIs | Cloud infrastructure | Configuration ManagementMid-level Full TimeGoleta, CA, USA12h ago
-
Software Engineer III, AI/ML, Display Ads USD 147K-211KAlgorithms | C++ | Data Analysis | Data Processing | Data StructuresSenior-level Full TimeMountain View, CA, USA12h ago
-
Embedded Firmware Engineer, Digital Signal Processing USD 192K-278KAuto-negotiation | Bring-up | DSP | Digital Signal | Digital Signal ProcessingSenior-level Full TimeSunnyvale, CA, USA12h ago
-
Senior-level Full TimeUnited States14h ago
-
Senior-level Full TimePeoria, IL, US, 6163914h ago
-
AI/ML Engineer USD 117K-171KA/B | A/B Testing | API Development | AWS | B testingDental insurance | Health insurance | Paid time off | Retirement plan | Sick leaveSenior-level Full TimeResidence Based, Residence Based, US14h ago
-
Cloud Data Engineer USD 92K-113KAgile | Apache Airflow | Beam | BigQuery | Cloud ComposerOnsite workMid-level Full TimeAda, MI, United States, 4935516h ago
-
AWS | Azure | Cloud platform | Data Pipelines | Demand forecastingOnsite collaborationSenior-level Full TimeLewisville, TX, US19h ago
-
Senior Embedded Software Engineer USD 170K-210KC++ | Cause analysis | Configuration Management | Device identity | Diagnostics401k | FSA or HSA | Health, dental, vision insurance | Incentive stock options | Pre-tax commuter benefitsSenior-level Full TimeEmeryville, United States22h ago
-
Forward Deployed Machine Learning Engineer USD 180K-300KAPI Design | Cloud Computing | Deep learning | Diffusion Models | Fine TuningIn-person collaboration days | Remote work flexibility | Travel cost coverageSenior-level Full TimeSan Francisco (USA) R22h ago
-
Forward Deployed Engineer USD 150K-250KAPIs | End to End | End-to-End Development | Go | Machine LearningTravel to client sitesEntry-level Full TimeSF Bay Area, CA23h ago
-
Forward Deployment Engineer - Gen AI USD 162K-224KAWS Bedrock | AWS SageMaker | Autogen | Azure OpenAI | ChromaCareer development opportunities | Individual responsibility | Travel to client sitesMid-level Full TimeNew York, New York, United States23h ago
-
Computer Vision | Experiment design | Experiment tracking | Generative AI | Image ProcessingSenior-level Full TimeAEP Headquarters, United States23h ago
-
Senior Software Engineer - Platform & MLOps USD 152K-230KAWS | Azure | CI/CD | Datadog | DockerDiscretionary incentive plan | Flexible work policy | Learning and development access | Medical benefitsSenior-level Full TimeSeattle, Washington, United States - Remote R23h ago
-
Lead Software Engineer (Python, LLM) - AskGartner USD 116K-170KAWS | AWS EMR | AWS Glue | AWS Kinesis | AWS QuickSight20 plus PTO days | 401k match | Collaborative culture | Employee assistance program | Employee stock purchase planSenior-level Full TimeIrving - 6011 Connection, United States23h ago
-
APIs | Agent architecture | Embeddings | Inference Serving | LLMDirect technical influence | Early stage equity upside | Fast Moving Engineering Culture | High technical autonomy | Remote workMid-level Full TimeSan Francisco, CA; Onsite R23h ago