Big Data Engineer
Pune, Maharashtra, India
INR 2000K-2700K (estimate) Senior-level Full Time
Tasks
- Build and maintain data processing systems
- Champion coding standards and testing
- Design scalable data pipelines
- Ensure data quality, integrity, and performance
- Manage Hadoop ecosystem components
- Mentor data engineers
- Optimize data workflows
- Orchestrate batch scheduling
- Own data solution architecture
- Troubleshoot production pipeline issues
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Hadoop | Apache Spark | Batch scheduling | CA7 | Control-M | Data Pipelines | Data Quality | ETL | HDFS | Hive | Impala | Job orchestration | Python | SQL | Testing | Version control
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Databricks Data Engineer (Databricks, PySpark, Cloud, MLOps) | 100% Remote | Contract 12 + Months | AS A INR 1500K-2600KAmazon Web Services | Apache Spark | CI/CD | Cloud platform | DatabricksRemote workSenior-level Full TimeIndia, India R5h ago
-
Data Engineer II INR 2000K-3000KAWS | Amazon Kinesis | Apache Airflow | Apache Beam | Apache FlinkComplimentary games | Family leave | Health insurance | Mental well-being support | Paid time offSenior-level Full TimeLocations: Hyderabad, Telangana, India7h ago
-
Senior-level Full TimeHyderabad, India8h ago
-
AI Architect INR 2000K-4800KAI code assistant | Backend Services | Cloud Computing | Code Assistant | Code QualitySenior-level Full TimeHyderabad, India8h ago
-
Senior BI Engineer - Tableau & Python INR 3000K-4000KBusiness Intelligence | Data Modeling | Data Visualization | Data Warehousing | DatabricksCareer growth | Certification support | Flexible collaboration | Innovation time | MentorshipSenior-level Full TimeHyderabad, TS, India9h ago
-
Applied AI ML Senior Associate INR 3264K-5000KAWS | Azure | CI/CD | Cloud platform | Distributed SystemsSenior-level Full TimeBengaluru, Karnataka, India9h ago
-
Associate Program Manager INR 2000K-4000KAI Agents | AI Foundry | AI Governance | AI orchestration | APIsMid-level Full TimeChandigarh, India9h ago
-
AI/ML Engineer INR 1860K-4000KAI Agent Builder | AI Pipelines | AI vector search | Agent Builder | AirflowMid-level Full TimeChennai, Tamil Nadu, India9h ago
-
GenAI Developer INR 1500K-2129KDeep learning | Docker | GenAI | Language Processing | Machine LearningWell-being focusEntry-level Full TimePune, Maharashtra, India10h ago
-
Senior-level Full TimeHyderabad, Telangana, India11h ago
-
Engineering-L2-Bengaluru-Analyst-Software Engineering INR 1500K-2500KApache Spark | Avro | CI/CD | Data Clustering | Data ModelingEntry-level Full TimeBengaluru, Karnataka, India11h ago
-
Senior-level Full TimeNoida, Uttar Pradesh, India12h ago
-
ML-Ops INR 3700K-5000KAsyncio | CI/CD | CProfile | Caching | DjangoLeadership development | Training sessionsSenior-level Full TimeMumbai, Maharashtra, India13h ago
-
Generative AI Engineer INR 1200K-2500KAI Services | AWS | Amazon SageMaker | Anthropic API | AzureCollaborative team environment | Leadership development | Training programsMid-level Full TimeMumbai, Maharashtra, India13h ago
-
Staff GenAI Engineer INR 2000K-5000KAWS | Agentic AI | Azure | CI/CD | ClassificationCollaborative team environment | Global consulting environment | Leadership development program | Mentorship programs | Training sessionsSenior-level Full TimeMumbai, MH, India13h ago
-
Mid-level Full TimeMumbai, Maharashtra, India13h ago
-
Senior-level Full TimeMumbai, Maharashtra, India13h ago
-
Executive, R&D Injectable (AI/ML) INR 3000K-5000KAPIs | Anomaly Detection | Computer system | Computer system validation | Data AnalysisExecutive-level Full TimeAhmedabad City, Gujarat, India13h ago
-
Lead Software Engineer - Python and AI INR 3500K-6000KAI assisted code | AI-assisted code review | AWS ECS | AWS Lambda | Agent FrameworksSenior-level Full TimeBengaluru, Karnataka, India14h ago
-
Lead Data Engineer - Azure + Fabric INR 1200K-2700KAzure | Azure DevOps | CDC | CI/CD | Data GovernanceSenior-level Full TimeGurugram, Haryana, India14h ago
-
Databricks Engineer - Senior/ Lead INR 1500K-2800KACID | ADLS Gen2 | Apache Spark | Azure Data | Azure Data FactorySenior-level Full TimeHyderabad, TS, India14h ago
-
Data Engineer - Azure + Fabric INR 1400K-2700KAccess Control | Apache Spark | Azure Data | Azure DevOps | Azure SynapseSenior-level Full TimeGurugram, Haryana, India14h ago
-
Mid-level Full TimeNoida R14h ago
-
Embedded Software Senior Lead Engineer INR 2475K-3465KAgile | Automated Build | Automated Build and Test | Board Support | Board Support PackageEmployee assistance program | Employee resource groups | Flexible time off | Holiday leave | Medical insuranceSenior-level Full TimeHYDERABAD, TELANGANA, India14h ago
-
Senior-level Full TimeIndia15h ago