Senior Big Data Engineer
Tasks
- Architect data lake and data warehouse solutions
- Automate data ingestion and transformation
- Build event driven and batch data pipelines
- Collaborate with stakeholders to deliver data products
- Develop analytics and real time processing platforms
- Ensure data quality, lineage, and governance
- Implement CI/CD workflows
- Monitor data systems and observability
Perks/Benefits
Skills/Tech-stack
AWS CloudFormation | AWS Glue | AWS Lambda | AWS S3 | AWS Step Functions | Agile | Amazon Athena | Amazon CloudWatch | Amazon RDS | Apache Hadoop | Azure DevOps | DynamoDB | Git | Hive | Java | Jenkins | Kafka | Microsoft Fabric | MongoDB | Oracle | PostgreSQL | Power BI | PySpark | Python | SQL | SQL Server | Scrum | Shell Scripting | Splunk | Step Functions | Terraform
Education
Master of Engineering | Master of Science | Master of Technology
Related jobs
-
Data Engineer (Remote) USD 132K-178KAPI Integration | AWS | Data Ingestion | Data Lake | Data NormalizationRemote workMid-level Full TimeSan Francisco, United States of America R4h ago
-
Data Engineer II USD 63K-114KETL | SQL | Snowflake401k | Flexible work schedule | Health insurance | Paid time off | Tuition reimbursementMid-level Full TimeRemote-MN, United States R18h ago
-
C# | MATLAB | NumPy | Pandas | PythonPart-time schedule | Project based workSenior-level Full TimeUnited States - Remote R18h ago
-
Freelance Data Science Engineer (Python & SQL) USD 180K-180KBig Data | Big data processing | Data Processing | Data Visualization | Feature EngineeringEnglish communication requirement | Flexible schedule | Part-time project-based workMid-level FreelanceTexas, United States - Remote R18h ago
-
Freelance Data Science Engineer (Python & SQL) USD 180K-180KBig Data | Feature Engineering | Langchain | MLOps | Machine LearningFlexible hours | Paid hourly equivalent | Part-time availability | Project based workMid-level FreelanceNew York, United States - Remote R18h ago
-
Freelance Data Science Engineer (Python & SQL) USD 180K-180KBig Data | Big data processing | Customer Analytics | Data Processing | Feature EngineeringFreelance opportunities | Part-time schedule | Project based workMid-level FreelanceUnited States - Remote R18h ago
-
Machine Learning Developer (Freelance) USD 180K-180KLangchain | MLOps | Model Deployment | NumPy | PandasProject based workMid-level FreelanceNew York, United States - Remote R18h ago
-
Machine Learning Developer (Freelance) USD 180K-180KLangchain | Language Models | Large Language Models | MLOps | NumPyEnglish proficiency requirement | Freelance project-based work | Part-time flexible scheduleMid-level FreelanceUnited States - Remote R18h ago
-
Machine Learning Developer (Freelance) USD 180K-180KGenerative AI | Langchain | Language Models | Large Language Models | MLOpsFreelance project-based workMid-level FreelanceTexas, United States - Remote R18h ago
-
Freelance Machine Learning Engineer USD 180K-180KDeep learning | LLMs | Langchain | MLOps | Machine LearningFlexible workload during active phases | Part-time schedule | Project based workMid-level FreelanceUnited States - Remote R18h ago
-
Freelance Machine Learning Engineer USD 180K-180KLLM | Langchain | MLOps | Machine Learning | NumPyPart-time schedule | Project based workMid-level FreelanceNew York, United States - Remote R18h ago
-
Freelance Machine Learning Engineer USD 180K-180KLLM | Langchain | MLOps | NumPy | PandasFlexible weekly hours | Paid per project | Part-time schedule | Project based workMid-level FreelanceTexas, United States - Remote R18h ago
-
Principal Data Engineer USD 160K-200KAI Agents | AWS Glue | AWS Lambda | Amazon ECS | Amazon MSK401k | Dental insurance | Discounts | Fully remote | Medical insuranceExecutive-level Full TimeNew York, NEW YORK, United States R19h ago
-
Senior Database Engineer USD 150K-180KApache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Databricks401k company contribution | Career progression | Dental insurance | Flexible vacation policy | Health insuranceSenior-level Full TimeRemote (United States) R20h ago
-
Staff Engineer – Experimentation Team USD 182K-295KAWS | Bayesian | Bayesian optimization | BigQuery | CUPEDDental insurance | Health insurance | Mental health benefits | Restricted stock units | Vision insuranceSenior-level Full TimeRemote - US R20h ago
-
GenAI Product Engineer USD 70K-136KAPI Development | Cloud Computing | Cloud platform | DevOps | Generative AICertification training | Fully remote within contiguous US | Hands-on experienceMid-level Full TimeArlington, VA R21h ago
-
Staff Data Engineer USD 170K-200KABAC | Aerospike | Amazon Redshift | Amazon S3 | Amazon SNSEmployee discounts | Employee equity | Medical, dental, and vision coverage | Pet insurance | Unlimited PTOSenior-level Full TimeRemote - United States R21h ago
-
Staff Machine Learning Engineer USD 220K-280KAWS | Amazon SageMaker | Apache Flink | BigQuery | C++401k match | Annual performance reviews | Company equipment | Dental insurance | Disability benefitsSenior-level Full TimeAtlanta, GA preferred, Remote R22h ago
-
Staff Data Engineer USD 181K-282KAPIs | Alerting | C++ | CI/CD | Cloud401k match | Dental insurance | Disability insurance | Flexible time off | Health insuranceSenior-level Full TimeUnited States R22h ago
-
Data Engineer USD 120K-151KAirflow | DBT | Data Modeling | Data Warehousing | ELTHybrid work | Remote work up to four weeks per yearMid-level Full TimeSeattle, Washington, United States R1d ago
-
Platform Engineer, Principal USD 163K-270KAPI Integration | Automation | Azure | CI/CD | Cloud servicesCareer development | Continuous learning | Financial growth | Professional growth | Remote work opportunitiesSenior-level Full TimeOakland, CA, United States R1d ago
-
ML Engineer Summer Intern (Remote & Paid) USD 40K-42KArtificial Intelligence | Classification | Data Visualization | Data Wrangling | Generative AI401k participation | Flexible work schedule | Remote work | Volunteer time offEntry-level InternshipUnited States, United States R1d ago
-
Senior Data Engineer USD 135K-175KAWS | AWS Lambda | Azure Databricks | Distributed Systems | ETLFlexible work arrangements | Professional developmentSenior-level Full TimeRemote - United States R1d ago
-
Staff Data Platform Engineer USD 180K-275KAPI Design | Access Control | Amazon EMR | Apache Iceberg | Apache Spark401k match | Catered lunch | Cell phone reimbursement | Commuter benefits | Corporate wellness programSenior-level Full TimeSilicon Valley, CA; USA Remote R1d ago
-
Availability Management | Database Administration | Database Integrity | Incident Management | On-CallRemote workMid-level Full TimeNew York, United States of America R1d ago