Senior Big Data Engineer
Location(s): Pune, Maharashtra, India
R
INR 2000K-3000K (estimate) Senior-level Full Time
Tasks
- Automate pipeline scheduling and orchestration
- Build and maintain scalable data pipelines
- Design Hadoop ecosystem solutions
- Design data models and data architecture
- Develop real-time and batch data workflows
- Identify and resolve technical risks and data issues
- Write complex SQL queries
Perks/Benefits
Skills/Tech-stack
Autosys | Data Modeling | Data Warehousing | Dimensional Modeling | Distributed Systems | HDFS | Hadoop | Hive | Impala | PySpark | SQL | Scala | Shell Scripting | Spark | Sqoop | Streaming
Education
N/A
Related jobs
-
GCP, Bigquery, Airflow/Consultant Specialist INR 1500K-2500KAgile | Airflow | Apache Kafka | Apache NiFi | BigQuerySenior-level Full TimeHyderabad, Telangana, India R15h ago
-
GCP, Airflow/CONSULTANT SPECIALIST INR 1500K-2500KAccess Control | Apache Airflow | Apache NiFi | Audit Logging | BigQueryFlexible working | Opportunities for professional developmentSenior-level Full TimePune, Maharashtra, India R15h ago
-
Principal Data Engineer INR 3740K-5876KAirflow | Amazon Athena | Amazon EMR | Amazon Redshift | Apache FlinkHealth and wellbeing resources | Paid volunteer daysSenior-level Full TimeBengaluru - India - Bengaluru, 560071 … R1d ago
-
Senior Data Engineer INR 3715K-5449KAirflow | Batch Processing | Bitbucket | CICD | Data LakesHealth and wellbeing resources | Paid volunteer daysSenior-level Full TimeBengaluru - India - Bengaluru, 560071 … R1d ago
-
Senior Data Engineer INR 3715K-5449KAirflow | Batch Processing | Bitbucket | CICD | Data LakeHealth and wellbeing resources | Paid volunteer daysSenior-level Full TimeBengaluru - India - Bengaluru, 560071 … R1d ago
-
Databricks Data Engineer - Bengaluru INR 1500K-2500KAWS Glue | Alation | Amazon Athena | Amazon EMR | Amazon S3Career growth opportunities | Flexible schedule | Work from anywhereMid-level Full TimeIndia-Bangalore-Office-Kalyani Vista R1d ago
-
AI workflows | API Integration | Big Data | Big Data Technologies | Cloud ComputingFlexible work environment | Hybrid work | Professional development opportunities | Supportive leadershipSenior-level Full TimeMumbai - Hiranandani, India R1d ago
-
AI Engineer II (Remote) USD 39K-72KAPIs | AWS | CI/CD | Data workflows | Distributed SystemsFull-time employment | Remote workMid-level Full TimeIndia, Remote R1d ago
-
Data Warehouse, ETL, Cloud / Consultant Specialist INR 3000K-4000KAWS | Agile | Ansible | Cloud platform | Confluent KafkaFlexible working | Inclusive work environment | Professional developmentSenior-level Full TimePune, Maharashtra, India R1d ago
-
GCP, Digital Analytics, Bigquery/Senior Consultant Specialist INR 2500K-3900KAttribution Modeling | Batch Processing | BigQuery | Cloud platform | Customer AnalyticsCareer growth | Flexible working | Inclusive workplace | Opportunities for professional developmentSenior-level Full TimeHyderabad, Telangana, India R1d ago
-
GCP Data Engineer- Senior Consultant INR 1500K-2500KAirflow | Apache Spark | BigQuery | Cloud Functions | Cloud Storage100 percent remote | Autonomy | Buddy from day 1 | Certificate training programs | Community webinarsSenior-level Full TimeIndia R1d ago
-
Azure Databricks | Azure DevOps | Data Quality | Data Warehousing | DatabricksCollaborative Agile environment | Fully remote | Hands on cloud data platform exposureMid-level Full TimeIndia R1d ago
-
Sr. Computer Scientist (Data Platform Engineer) INR 3264K-4200KAerospike | Algorithms | Amazon Web Services | Apache Spark | CassandraSenior-level Full TimeBangalore, India R2d ago
-
Senior-level Full TimeBangalore, India R2d ago
-
Senior Software Engineer (India) INR 3500K-5000KAWS | AWS CDK | Async API | Asyncio | AuthenticationRemote work | Work from homeSenior-level Full TimeIndia - Remote R2d ago
-
Artificial Intelligence | Backend integration | Embeddings | Entity Extraction | EvaluationFlexible time off | Healthcare | Hybrid work model | Retirement plan | Support for working parentsExecutive-level Full TimeHA4 - DLF Building Tower B, … R2d ago
-
Senior Machine Learning Engineer INR 3584K-4580KAWS | Azure | CI/CD | Data Science | DatabricksLearning and development programs | Mentorship culture | Remote workSenior-level Full TimeBangalore, India R2d ago
-
Senior Machine Learning Engineer INR 3584K-4580KAmazon Web Services | Azure | CI/CD | Cloud platform | DatabricksCoaching and mentoring | Employee development programs | Learning and development programs | Remote work flexibilitySenior-level Full TimeBangalore, India R2d ago
-
Data Engineer -6 Years-Remote INR 1500K-2500KA/B | A/B Testing | B testing | Data Analysis | PythonRemote workMid-level Full TimeBengaluru, Karnataka, India R2d ago
-
Senior Software Engineer - Data Platform INR 3500K-4580KAmazon Redshift | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkCompany holidays | Daily meals | Dental insurance | Family planning assistance | Fitness coachingSenior-level Full TimeBengaluru, Karnataka, India R2d ago
-
Mid-level Full TimeBangalore, Karnataka, India R2d ago
-
Alerting | Amazon Redshift | Anomaly Detection | Aurora PostgreSQL | CI/CDFully remoteSenior-level Full TimeIndia R2d ago
-
AI-enabled | AI-enabled development | API Integration | Architecture | Data ModelingLaptop provided | Medical insurance | Mentorship | No weekend work | Remote workSenior-level Contract Full TimeDelhi R2d ago
-
AI Governance | Airflow | Alerting | Anomaly Detection | Artifact RegistryMid-level Full TimePune, Maharashtra, India R2d ago
-
AWS Glue | AWS Glue Data Catalog | Amazon Athena | Amazon QuickSight | Amazon RedshiftContract-based engagement | Cross-functional team collaboration | Fully remote work | Professional growthSenior-level Contract Full TimeIndia R2d ago