Senior Data Engineer
Tasks
- Build data warehouse solutions
- Create and maintain design documentation
- Debug Hadoop and Hive job failures
- Debug production data pipeline issues
- Design and build distributed data systems
- Develop ETL data pipelines
- Develop algorithms using defined rules
- Evaluate and implement data storage and processing approaches
- Ingest store process and analyze large data sets
- Monitor job failure alerts and resolve issues
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Kafka | Apache NiFi | Apache Spark | Cloudera | Distributed Systems | HDFS | Hadoop | Hive | Impala | Java | Linux | MapReduce | Python | SQL | Scala | Sqoop | Unix Shell | YARN
Education
N/A
Roles
Related jobs
-
AI/ML Engineer INR 2500K-3500KAPI Development | BigQuery | CI/CD | Classification | Cloud FunctionsInnovation culture | Personal growth | Professional growthSenior-level Full TimeBengaluru , Pune5h ago
-
Microsoft Fabric Data Engineer INR 1500K-2443KAPI Integration | Azure Data | Azure Data Factory | Azure Data Lake | Azure SQLMid-level Full TimeBengaluru, India5h ago
-
Senior Data Engineer - Azure Databricks INR 1500K-2500KAgile | Apache Kafka | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeHyderabad, TS, India6h ago
-
Applied Computer Vision Engineer - Data Driven Development INR 1500K-2000KAzure | Azure Blob | Azure Blob Storage | Azure Machine Learning | Blob StorageMid-level Full Timebangalore, India6h ago
-
Senior-level Full TimeBangalore7h ago
-
Mid-level Full TimeBengaluru, Pune8h ago
-
Agile | Docker | Java | Kubernetes | LLM orchestrationSenior-level Full TimeChennai, TN, India8h ago
-
Embedded Python Developer INR 3000K-4460KAsynchronous programming | Bash | CAN | CI/CD | DockerFlexible working hours | Pre-IPO stock options | Technology Career GrowthSenior-level Full TimePune8h ago
-
Data Engineering-Azure-FTE INR 1500K-2000KAzure Data | Azure Data Factory | Azure Data Lake | Azure Databricks | Data FactoryMid-level Full TimeINDIA - PUNE - BIRLASOFT OFFICE …10h ago
-
Software Engineer - .NET - Career INR 1200K-2156K.NET | Agile | Angular | Azure DevOps | C#Guided career tracks | Healthcare benefits | Hybrid work setting | Online learning platform | Organizational growthMid-level Full TimeIND-Trivandrum-Equifax Analytics-PEC, India12h ago
-
Mid-level Full TimePune, PDC3B, India12h ago
-
Custom Software Engineer INR 800K-1500KCloud Storage | Data Engineering | Data Modeling | Data pipeline | Data pipeline orchestrationMid-level Full TimePune, PDC3B, India12h ago
-
Mid-level Full TimeBengaluru, BDC6F, India12h ago
-
Lead AI Engineer INR 2500K-3500KAgent Development | Debugging | Incident Response | LLM API | Language ModelGrowth and innovation | Hybrid work policy | Inclusive company culture | Remote work option | Self-directionSenior-level Full TimeNoida, India R12h ago
-
A2A | AWS | Agentic Systems | Amazon Bedrock | AngularFlexible working | Inclusive benefits | Mentorship | Wellbeing programsSenior-level Full TimeGurugram 10 C, India12h ago
-
AWS | Agile | Amazon Web Services | Angular | Apache AirflowFlexibility programmes | Inclusive benefits | Mentorship | Work-life supportSenior-level Full TimeMumbai Goregaon, India12h ago
-
IN_Senior Associate_DBT Data Engineer, SQL, Snowflake_Data and Analytics_Advisory_Bangalore INR 2000K-3000KAWS | Apache Airflow | Apache Kafka | Azure | Azure EventSenior-level Full TimeBengaluru Millenia, India12h ago
-
API Management | Adobe Analytics | Adobe Experience | Adobe Experience Platform | AutomationFlexible work programs | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India12h ago
-
AI machine learning | API Integration | Adobe Experience | Adobe Experience Platform | Adobe Journey OptimizerSenior-level Full TimeBengaluru Millenia, India12h ago
-
Analytics Cloud | Apache Spark | CI/CD | Data Governance | Data ModelingFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeNoida, India12h ago
-
API Integration | API Management | Adobe Analytics | Adobe Experience | Adobe Experience PlatformFlexibility programs | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India12h ago
-
Asynchronous programming | Data Validation | FastAPI | Integration Testing | JWTSenior-level Full TimePune, India12h ago
-
API Management | Adobe Analytics | Adobe Experience | Adobe Experience Platform | CRMSenior-level Full TimeBengaluru Millenia, India12h ago
-
Data Engineer INR 2400K-3500KCloud Data | Cloud Data Architecture | Data Architecture | Data Modeling | Data QualitySenior-level Full TimeBengaluru, BDC11A, India12h ago
-
Data Engineer INR 2520K-3380KAgile | Apache Flink | Apache Hive | Apache Spark | CI/CDCounseling sessions | Discount vouchers | Family care leave | Leave plan | Medical insuranceSenior-level Full TimeBengaluru, India12h ago