Big Data Engineer
Tasks
- Automate data pipelines and workflows using orchestration frameworks like Airflow
- Build data solutions including data lakes warehouses ETL pipelines APIs and analytics platforms
- Develop real-time data processing pipelines
- Develop scalable low-latency data pipelines using Kafka Flink Spark Streaming
- Ensure data security compliance and regulatory requirements
- Implement data governance metadata management and data quality standards
Perks/Benefits
Skills/Tech-stack
Airflow | Data Pipeline Development | Data pipeline | Database Management | Flink | HBase | Hadoop | Hive | Kafka | Linux | MapReduce | Oozie | Pipeline Development | PySpark | Python | Relational Database | Relational Database Management | SQL | Shell Scripting | Spark
Education
Roles
Related jobs
-
Associate Data Engineer INR 1500K-2500KDBT | Data Modeling | Data integration | Datawarehouse | ETL401k plan | Flexible paid time off | Learning and development | Medical benefits | Paid parental leaveMid-level Full TimePune, MH, India6h ago
-
Senior Data Engineer INR 2156K-2600KAWS | Apache Airflow | Apache Spark | Azure Synapse | BigQueryFlexible work hours | Health benefitsSenior-level Full TimeBengaluru, INDIA, India6h ago
-
AI Engineer INR 2500K-3500KAPIs | Data Pipelines | Deep learning | LLMs | Language ProcessingInclusive environment | Remote workMid-level Full TimeIndia7h ago
-
Senior-level Full TimeBangalore, KA, IN12h ago
-
Platform Engineering Professional - Data Engineer INR 2520K-3380KAb Initio | Apache Spark | BigQuery | CI/CD | ConfluenceMid-level Full TimeOuter Ring Road, Bellandur, Bengaluru, India12h ago
-
Systems Integration Senior Analyst INR 2500K-4500KAI Services | API Design | Autogen | Azure AI | Azure AI ServicesSenior-level Full TimeNoida, UP, IN12h ago
-
Systems Integration Senior Analyst INR 2500K-4500KAI frameworks | API Design | Autogen | Azure AI | Azure OpenAISenior-level Full TimeNoida, UP, IN12h ago
-
Systems Integration Senior Analyst INR 2500K-4500KAPI Design | Autogen | Azure AI | Azure Search | ClaudeSenior-level Full TimeNoida, UP, IN12h ago
-
Data Engineer - Azure Databricks INR 2520K-3380KAzure Cloud | Azure Data | Azure Data Factory | Data Factory | DatabricksSenior-level Full TimeBangalore, KA, IN12h ago
-
Data Engineer - Azure Databricks INR 2520K-3380KAgile | Azure Cloud | Azure Data | Azure Data Factory | Data FactorySenior-level Full TimeBangalore, KA, IN12h ago
-
Data Engineer - Azure Databricks INR 2520K-3380KAzure Cloud | Azure Data | Azure Data Factory | Data Factory | DatabricksSenior-level Full TimeBangalore, KA, IN12h ago
-
Forward Deployed Engineer INR 2500K-4200KAI | APIs | Automation | Cloud technologies | DatabasesBenefits | Flexible work environment | Vibrant and dynamic cultureMid-level Full TimeHyderabad, India13h ago
-
Forward Deployed Engineer INR 2500K-4200KAI | API | API Architecture | Automation | BPMFlexible work hours | Health benefits | Professional development | Vibrant work environmentMid-level Full TimeHyderabad, India13h ago
-
AI Automation Engineer INR 1800K-2541KAI | API Development | AWS | Automation Framework | Automation Framework DesignSenior-level Full TimeBangalore, India14h ago
-
Data Engineer INR 2000K-2500KData Catalog | Data Governance | Data Observability | Data Quality | Data WarehousingMid-level Full TimeHyderabad, India22h ago
-
Senior-level Full TimeIN-TN-Chennai23h ago
-
Senior-level Full TimeIN-TN-Chennai23h ago
-
Senior Software Engineer - Backend/Platform Engineering – AI‑First (Agentic + GenAI + RAG) INR 2500K-4500KAI | AWS | Azure AI | Java | LLMSenior-level Full TimeIndia1d ago
-
Software Engineer, Persistent Disk, PhD, Early Career, 2026 INR 2000K-3000KAI | Backup Technology | C# | C++ | Data StorageSenior-level Full TimeBengaluru, Karnataka, India; Hyderabad, Telangana, India1d ago
-
Software Engineer III - Data Engineer INR 2000K-2450KAWS | Agile methodologies | Application Resilience | Artificial Intelligence | AzureSenior-level Full TimeHyderabad, Telangana, India1d ago
-
Data Engineer III INR 1200K-2000KBig Data | Data Mining | Data Modeling | Data Transformation | Data WarehousingSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Senior Software Engineer INR 3000K-4600KCloud Native | Concurrenc | Data Architectures | Distributed Systems | KubernetesHealth benefits | Paid time off | Work-life balanceSenior-level Full TimeHyderabad, India1d ago
-
Mid-level Full TimePune, IN1d ago
-
Associate Process Manager INR 1500K-2000KBigQuery | CI/CD | Data Architecture | Data Modeling | Data QualityMid-level Full TimePune, Maharashtra, India1d ago
-
Full Stack Development - Python INR 2400K-3000KAngular | CI/CD | Deployment Pipelines | GitHub | JavaScriptMid-level Full TimeIndia1d ago