Senior Software Engineer, Big Data
Tasks
- Build data exploration pipelines
- Build data processing pipelines
- Build machine learning infrastructure
- Deploy cloud technologies
- Deploy code to Kubernetes environment
- Drive innovation and system evolution
- Write test instrument and deploy code
Perks/Benefits
Skills/Tech-stack
Algorithms | Amazon Kinesis | Amazon Kinesis Data Analytics | Apache Beam | Apache Flink | Apache Flume | Apache Hudi | Apache Kafka | Apache NiFi | Azure Databricks | Cassandra | Cloud Dataflow | Containerization | Data Structures | Data analytics | Delta Lake | Docker | Google Cloud | Google Cloud Dataflow | HBase | Hadoop | Hive | Kinesis Data Analytics | Kubernetes | ML Infrastructure | MongoDB | Object-Oriented | Object-oriented programming | Spark
Education
Related jobs
-
Staff Software Engineer, AI Data Platform USD 250K-280KCloud platform | Google Cloud | Google Cloud Platform | GraphQL | KafkaSenior-level Full TimeSan Francisco Bay Area R5h ago
-
Principal AI Engineer USD 160K-220KAI Governance | API Design | AWS | AWS Bedrock | Agent OrchestrationSenior-level Full TimeUS - Remote R11h ago
-
Senior AI Engineer USD 95K-197KAWS | Autogen | Azure | CI/CD | Clean CodeAutonomy | Learning and development programs | MentorshipSenior-level Full TimeSeattle, Washington, USA R13h ago
-
Senior Systems Engineer, Storage - DGX Cloud USD 208K-414KAlerting | Algorithms | Ansible | Argo CD | CI/CDSenior-level Full TimeUS, CA, Remote, United States R1d ago
-
Hadoop Developer USD 100K-150KAWS | AWS EMR | Airflow | Apache Atlas | Apache SparkBenefits package | Career growth | Long-term project | Remote workSenior-level Full TimeUnited States - Remote R1d ago
-
Storage Engineer (NetApp / Pure / Ceph) USD 100K-150KAnsible | Backups | CRUSH maps | Capacity Planning | CephSenior-level Full TimeUnited States - Remote R1d ago
-
Storage Engineer (NetApp / Pure / Ceph) USD 100K-150KAnsible | Backups | CRUSH maps | CSI | Capacity PlanningSenior-level Full TimeUnited States - Remote R1d ago
-
Storage Engineer (NetApp / Pure / Ceph) USD 100K-150KAnsible | Backups | CRUSH | CSI | Capacity PlanningSenior-level Full TimeUnited States - Remote R1d ago
-
Machine Learning Engineer USD 140K-220KApache Spark | Azure | Azure Machine Learning | CI/CD | Cloud StorageCareer development opportunities | High responsibilitySenior-level Full TimeUnited States - Remote R1d ago
-
Machine Learning Platform Engineer USD 135K-160KAmazon SageMaker | Apache Flink | C++ | CI/CD | Cloud PubSub401k match | Annual bonus | Company equipment provided | Company medical dental vision plans | Disability benefitsMid-level Full TimeAtlanta, GA preferred, Remote R3d ago
-
Senior Developer Advocate - Modern App Development USD 194K-237KAPI Integrations | AWS | Cloud platform | Code Quality | Google CloudCommunity groups | Employee stock purchase plan | Inclusion talks | Mental health benefits | Mentor/Buddy programSenior-level Full TimeCalifornia, USA, Remote; Nevada, USA, Remote; … R3d ago
-
Staff Software Engineer, Big Data Storage USD 177K-364KApache Flink | Apache Hive | Apache Iceberg | Apache Spark | Column BackfillSenior-level Full TimePalo Alto, CA, US; Remote, US R3d ago
-
AWS | Airflow | Apache Spark | Azure Synapse | Azure Synapse Analytics401k matching | Disability insurance | Employee assistance program | Life insurance | Medical/Dental/Vision insuranceMid-level Full TimeRemote, USA ; Remote, Canada R3d ago
-
Principal Data Engineer/ Technical Lead USD 219K-298KAWS | Access Layer | Aggregation pipelines | Apache Kafka | Apache Spark401k match | Employer paid medical/dental/vision | Flexible spending account | Paid parental leave | Remote first work from homeSenior-level Full TimeUnited States (Remote) R3d ago
-
AI Expert USD 148K-175KAWS | Agile | Batch Processing | Data Mapping | Data ModelingHybrid work | Public Trust Clearance | Remote workSenior-level Full TimeMemphis, TN, United States R3d ago
-
Machine Learning Engineer II USD 160K-210KAirflow | Apache_Spark | Autoscaling | C++ | CI_CDDental insurance | Disability insurance | Flexible vacation | Health insurance | Life insuranceSenior-level Full TimeRemote, USA R3d ago
-
VP II AI, Machine Learning|US Remote* USD 202K-210KApache Spark | Azure | Databricks | ETL | Flume401k match | Medical/Dental/Vision insurance | Paid time offMid-level Full TimeRemote, United States R3d ago
-
Data Engineer - AWS/Databricks - Mid Level USD 121K-170KAWS | AWS Glue | Adaptive query execution | Amazon CloudWatch | Amazon RDSComprehensive benefits | Mentorship | Mentorship and personalized development plans | Training budget | Work/life balance focusMid-level Full TimeReston, VA, United States R3d ago
-
Assistant Director, Data Science (STP) USD 139K-226KData Visualization | GLM | Insurance pricing | MLOps | Machine LearningDomestic travel | TelecommutingExecutive-level Full TimeBoston, MA, United States R4d ago
-
Principal Machine Learning Engineer USD 205K-230KAWS Lambda | BigQuery | C# | CI/CD | Cloud Functions401k | Dental insurance | Health insurance | Life insurance | Paid HolidaysSenior-level Full TimeUnited States of America - Remote … R4d ago
-
Generative AI Engineering Intern (Graduate) USD 70K-70KAWS | Agile | Azure OpenAI | Azure OpenAI Service | CI/CDDedicated mentorship | Flexible scheduling | Networking opportunities | Potential full-time employment | Remote friendly schedulingEntry-level Full Time InternshipUnited States R4d ago
-
AI Data Infrastructure Engineer USD 100K-150KApache Beam | Apache Spark | CI/CD | Caching | Code reviewCareer growth | Health benefits | Remote workMid-level Full TimeUnited States - Remote R4d ago
-
Storage Engineer (NetApp / Pure / Ceph) USD 100K-150KAnsible | Backups | CRUSH | CSI | CephRemote workSenior-level Full TimeUnited States - Remote R4d ago
-
Rust, AI Engineer, Director USD 220K-275KAPI Gateway | AWS | Agile | ArgoCD | AzureFlexible time off | Healthcare | Leave benefits | Retirement benefits | Tuition reimbursementExecutive-level Full TimeNY7 - 50 Hudson Yards, New … R4d ago
-
Machine Learning Engineer USD 102K-202KA/B | A/B Testing | Anomaly Detection | Atlas Vector Search | B testingSenior-level Full TimeSan Jose, United States R4d ago