Senior Data Engineer
Tasks
- Apply data modeling principles
- Conduct unit testing
- Design data workflows
- Develop PySpark jobs
- Develop data pipelines
- Import and export data
- Leverage Livy
- Manage Git branches
- Manage Hive tables
- Manage data movement
- Manage secrets
- Model data in Snowflake
- Operate Hadoop commands
- Perform file operations
- Review merge requests
- Use AWS CLI
- Utilize SSIS
- Work with Hive on Tez
Perks/Benefits
- International tech conference
- Reimbursement benefit
- Remote work
- Training opportunities
- Wellness program
Skills/Tech-stack
AWS | AWS Secrets | AWS Secrets Manager | Ansible Vault | Apache Airflow | Data Modeling | Git | GitLab | HDFS | Hadoop | Hive | Livy | Microsoft SQL | Microsoft SQL Server | PySpark | SQL Server | SSIS | Secrets Manager | Snowflake | Sqoop
Education
Roles
Related jobs
-
Software Engineer (GenAI) GBP 60K-70KAWS | Agile | CI/CD | Docker | Generative AI25 days holiday | Bike loan scheme | Discounted private healthcare | Employee assistance programme | Enhanced family leaveMid-level Full TimeManchester / Hybrid, England, United Kingdom R5h ago
-
Senior Staff Engineer, Data Science INR 2000K-3380KAWS | Azure | Classification | Cloud platform | Data AnalysisSenior-level Full TimeRemote, India R5h ago
-
Senior Staff Engineer, Data Science INR 2000K-3380KAWS | Azure | Classification | Continuous Improvement | Data AnalysisContinuous improvement culture | Global team environment | MentorshipSenior-level Full TimeRemote, India R5h ago
-
Senior AI/ML Engineer (m/f/d) EUR 36K-45KAWS | Azure | Azure Machine Learning | Azure Resource | Azure Resource ManagerChildcare support | Continuous training | English and German classes | Flexible hours | Free specialist servicesSenior-level Full TimeMálaga, AN, Spain R7h ago
-
Data Engineer expert (m/f/d) EUR 36K-45KAPI Integration | AWS | Azure | Azure DevOps | CI/CDAccess to employee assistance program | Childcare support | Continuous training | Flexible schedule | Health insuranceSenior-level Full TimeGranada, Sevilla, Reus, Valencia o A … R7h ago
-
Data Engineer USD 85K-130KAWS | Anomaly Detection | Apache Airflow | Argo CD | BashCompany laptop | Corporate events | English lessons | Flexible working hours | Gym accessMid-level Full TimeFully Remote R9h ago
-
Lead Machine Learning Engineer INR 3100K-4500KApache Airflow | Argo Workflows | Deep learning | GenAI | JavaSenior-level Full TimeBangalore, India R11h ago
-
Data Analytics Engineer (Remote) USD 110K-175KBigQuery | Data Quality | Data Visualization | Git | Google AnalyticsCareer growth | English communication support | Flexible work schedule | International team | Office location flexibilityMid-level Full TimeRemote R15h ago
-
Data Analytics Engineer (Remote) USD 110K-175KBigQuery | Data Modeling | Data Quality | Data Visualization | GitCareer growth | Flexible work schedule | International team | Remote work | Team eventsMid-level Full TimeRemote R15h ago
-
Data Analytics Engineer (Remote) USD 110K-175KAPI Integration | BigQuery | Dashboarding | Data Quality | Data ValidationCareer development | Flexible schedule | International team | Remote work | Social daysMid-level Full TimeRemote R15h ago
-
Data Analytics Engineer (Remote) USD 110K-175KDashboarding | Data Modeling | Data Quality | Data Visualization | GitCareer growth opportunities | Flexible schedule | International team | Office locations access | Remote workMid-level Full TimeRemote R15h ago
-
Data Analytics Engineer (Remote) USD 110K-175KBigQuery | Data Visualization | Git | Google Analytics | Google TagCareer development | Flexible work schedule | International team | Remote work | Team eventsMid-level Full TimeRemote R15h ago
-
Data Analytics Engineer (Remote) USD 109K-175KAPIs | BigQuery | Data Modeling | Data Quality | Data ScienceCareer development | Flexible work schedule | International team | Office flexibility | Remote workMid-level Full TimeRemote R15h ago
-
Mid-level Full TimeIndia Offsite (ZIN99) R17h ago
-
Internship Data Engineer - Flutter Studios, Hybrid RON 102K-104KAgile | Apache Spark | Automated testing | Git | JavaAnnual leave | Career growth sessions | Dental insurance | Flexible benefits | Health insuranceEntry-level Full Time InternshipCluj-Napoca, Romania R17h ago
-
Machine Learning Engineer II PLN 180K-300KAWS | Azure | Confluence | Deep learning | Distributed SystemsAnnual leave | Family leave | Life assurance | Lunch eCard | Medical care planMid-level Full TimePoland-Remote R17h ago
-
Mid-level Full TimePHK, United States R17h ago
-
AWS | Airflow | Debezium | GCP | KafkaCSE | Occasional travel | Performance bonus | Profit-sharing bonus | Public transportMid-level Full TimeParis R17h ago
-
Senior Data Engineer INR 2520K-3500KAzure | CI/CD | Data Governance | Data Modeling | DevOpsCareer growth opportunities | Global hybrid work policy | Inclusive culture | Professional development support | Remote work optionSenior-level Full TimeNoida, India R17h ago
-
Senior Data Engineer / Analytics Engineer (AWS) INR 3750K-6250KAWS | Alerting | Amazon Redshift | Amazon S3 | Apache AirflowClient-facing role | Continuous learning | Fully remote | Internal knowledge sharing | Sponsored technical eventsSenior-level Contract Full TimeRemote job R19h ago
-
Senior Data Engineer / Analytics Engineer (AWS) INR 3750K-6250KAWS | Amazon CloudWatch | Amazon Redshift | Amazon S3 | Apache AirflowClient-facing role | Fully remoteSenior-level Contract Full TimeRemote job R19h ago
-
AI Engineer (React UI) - Remote US USD 135K-170KAWS | Accessibility | Anthropic Claude | Apache Airflow | AzureRemote workSenior-level Full TimeWauwatosa, WI, United States R21h ago
-
APIs | AWS | Azure | Data Pipelines | Distributed SystemsEquity options | Flexible work environment | Remote workMid-level Full TimeRemote R1d ago
-
A/B | A/B Testing | AWS | Apache Airflow | B testingAnnual bonus | Conference budget | Health insurance | Life insurance | Permanent contractSenior-level Full TimeRemote Portugal, Portugal R1d ago
-
Staff Data Platform Engineer USD 164K-246KAWS | AWS CDK | AWS Lambda | Batch Processing | CI/CD401k match | Annual equity awards | Catered meals | Company paid life insurance | Flexible paid time offSenior-level Full TimeRemote, United States R1d ago