Data Infrastructure Engineer
Tasks
- Automate deployments with Kubernetes Terraform and CI/CD
- Build data pipelines on Spark Kafka Ray
- Collaborate with ML and product teams
- Design fault-tolerant streaming and batch systems
- Monitor debug and improve distributed jobs
- Optimize data workflows for performance cost and latency
Perks/Benefits
Skills/Tech-stack
AWS GCP Azure | Batch Processing | CI/CD | Cloud Environments | Cloud Environments (AWS | Cloud Environments (AWS, GCP) | Cloud environments AWS GCP Azure | Data Systems | Distributed data | Distributed data systems | Flink | Java | Kafka | Kubernetes | Python | Ray | Scala | Spark | Streaming | Terraform
Education
N/A
Regions
Countries
States
Cities
Related jobs
-
Automation Testing | CI/CD | CSS | Cypress | Feature DevelopmentMedical, dental & vision coverage | Paid time off | Parental leave | Reimbursement programs | Retirement planMid-levelRaleigh, United States R13d ago
-
Technical Support Engineer 2 (Remote) USD 70K-100KActive Directory | Ansible | Apache | Backup and Patching | ColdFusion401k match | Dental insurance | Flexible schedules | Health insurance | Life insuranceMid-level Full TimeDallas, TX, US R7h ago
-
AI Engineer USD 118K-204KAWS | Data Analysis | Data Modeling | Data Quality | Exploratory Data AnalysisMid-level Full TimeAnnapolis Junction, MD7h ago
-
Gen AI Architect USD 125K-188KAI Model Deployment | AI model | API Integration | Azure OpenAI | Data SecuritySenior-level Full TimeNew York, United States10h ago
-
Azure Data | Azure Data Factory | Azure Data Lake | Azure Databricks | Azure SynapseSenior-level Full TimeMinnetonka, MN.10h ago
-
Machine Learning Engineer, Risk Data Mining - USDS USD 145K-337KData Mining | Feature Engineering | Interpretability | Language Processing | Machine LearningEntry-level Full TimeSan Jose, California, United States11h ago
-
Mid-level Full TimeSunnyvale, CA, USA12h ago
-
AI Agents | Artificial Intelligence | C++ | Data Monitoring | Data ProcessingMid-level Full TimeSunnyvale, CA, USA12h ago
-
Energy Market Optimization Engineer USD 136K-198KAIMMS | Electricity Market Simulation | Electricity Markets | Electricity market | GAMs401k matching | Dental insurance | Disability insurance | Employee assistance program | Employee business networksMid-level Full TimeHolyoke, MA, 01040, USA15h ago
-
Embedded Software Engineer 4 USD 90K-135KAutomated testing | C++ | CI/CD | Linux | Memory Management401k employer match | Dental insurance | Disability coverage | Life insurance | Medical insuranceMid-level Full TimeChillicothe, IL16h ago
-
Senior Machine Learning Engineer - Energy USD 145K-155KAnomaly Detection | Apache Spark | Azure Databricks | Azure DevOps | Azure Machine Learning401k match | Career advancement opportunities | Charitable Matched Giving | Commuter benefits | Company Seeded HSASenior-level Full TimeOakland, CA, United States21h ago
-
Data Engineer USD 65K-105KAutomated testing | Azure DevOps | BigQuery | CI/CD | Cloud ComposerCompany-Paid Holidays | Disability insurance | Employee assistance programs | Life insurance | Medical, dental & vision coverageMid-level Full TimeNashville, TN, US23h ago
-
NumPy | Pandas | Python | SciPy | Scikit-learnFlexible schedule | Freelance projects | Part-time engagement | Stable internet requiredSenior-level FreelanceUnited States - Remote R23h ago
-
Sr. Engineer - Data Analytics (Hybrid) USD 140K-215KAmazon Web Services | Apache Airflow | Apache Kafka | CQL | CassandraCompetitive vacation and holidays | Employee networks and volunteer opportunities | Employee wellness programs | Hybrid work | Paid adoption leaveSenior-level Full TimeUSA NY Remote, United States R23h ago
-
API Design | Distributed Systems | Kubernetes | Microservices | PostgreSQLDaily catered lunch | Medical, dental & vision coverage | Unlimited PTO | Visa supportSenior-level Full TimeSan Francisco, CA; Hybrid R23h ago
-
Research Data Engineer II USD 77K-115KAcceptance Testing | Artificial Intelligence | C# | CI/CD | Cloud ComputingEntry-level Full TimeSaunders Research Building, United States23h ago
-
Access Control | Azure | Azure Databricks | Azure Storage | C#401k employer match | Adoption Assistance | Choice time off | FSA and HSA accounts | Hybrid work modelMid-level Full TimeMINNEAPOLIS, United States R23h ago
-
Access Control | Azure | Azure Databricks | Azure Storage | Azure Well Architected401k matching | Choice time off | Hybrid work | Medical, dental, and vision insurance | Paid HolidaysMid-level Full TimeNEW YORK CITY, United States R23h ago
-
Data Scientist II - Computer Vision USD 140K-170KComputer Vision | Convolutional Neural Networks | Deep learning | Experiment tracking | Field extractionMid-level Full TimeRemote - US R1d ago
-
AWS | Best practices | Distributed Systems | Docker | DynamoDBHybrid work | Onsite 2 days per weekSenior-level Full TimeAustin, TX, United States1d ago
-
Entry-level Full TimeSan Francisco1d ago
-
AI Developer Subcontractor USD 101K-195KAWS | Big Data | C plus plus | Computer Vision | Data ProcessingMid-level Contract Full TimeFL, United States1d ago
-
DevOps Machine Learning Infrastructure Engineer USD 125K-145KAWS EKS | Ansible | CI/CD | Ceph | Docker401k plan | Accidental critical illness and hospital indemnity coverage | Disability coverage | Employee Assistance Program (EAP) | Flexible Spending Account (FSA)Senior-level Full TimeRedwood City, California, United States1d ago
-
AI Software Developer USD 113K-188KAWS | Agentic AI | Algorithms | Azure | Cloud infrastructure401k employer match | Employer Paid Short Term Disability Long Term Disability | Employer-paid life insurance | Equity incentive plan | Federal Holiday Paid LeaveSenior-level Full TimeAlexandria, Virginia, United States - Remote R1d ago
-
Sr. Fullstack Engineer - Analytics USD 180K-260KBackbone.js | Cassandra | Code review | D3.js | DebuggingDental insurance | Health insurance | Hybrid work option | Paid time off | Parental leaveSenior-level Full TimeSanta Clara, California, United States1d ago