Senior Data Engineer
Primary location: Gurgaon, India
INR 1500K-3000K (estimate) Senior-level Full Time
Tasks
- Apply CI CD automated testing and documentation
- Automate operational support tasks
- Build lakehouse ingestion and transformation frameworks
- Conduct code reviews and technical design discussions
- Design data pipelines
- Develop ETL/ELT solutions
- Develop reusable PySpark components and notebooks
- Implement data quality validations
- Migrate legacy workloads to Azure Databricks and Snowflake
- Perform performance tuning and cost management
- Provide production support and root cause analysis
- Set up monitoring logging alerting and exception handling
- Support data governance security lineage and access control
Perks/Benefits
Skills/Tech-stack
Access Control | Airflow | Alerting | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Databricks | Batch Processing | CI/CD | Cost Optimization | Data Factory | Data Governance | Data Lake Storage | Data Lineage | Data Quality | DataStage | Dimensional Modeling | ELT | ETL | Exception Handling | Git | Incremental processing | Lakehouse Architecture | Linux | Logging | Monitoring | Notebook development | Orchestration | Performance Tuning | PySpark | Python | SAS | SQL | Scheduling | Snowflake | Source Control | Teradata
Education
Roles
Related jobs
-
Oracle AI Developer INR 2475K-3465KAzure DevOps | LLM integration | Langchain | Langgraph | Language ModelsSenior-level Full TimeGurugram, HR, IN5h ago
-
Senior Data Engineer, BizTech INR 2940K-4170KAmazon Redshift | Apache Flink | Apache Kafka | Apache Spark | Batch Data ProcessingSenior-level Full TimeBangalore, India6h ago
-
Senior Software Engineer INR 4000K-6000KAI Model Garden | AI vector search | Alerting | Bash | BigQuerySenior-level Full TimeNoida, UP, IN11h ago
-
Assistant Manager-Adobe Analytics INR 1000K-1890KA/B | A/B Testing | AWS | Adobe Analysis Workspace | Adobe AnalyticsMid-level Full TimePune, IN11h ago
-
Senior-level Full TimeOff Embassy Golf Links Business Park, …11h ago
-
APIs | Agentic AI | Azure | Bagging | BoostingFlexibility programmes | Inclusive benefits | Mentorship | Work-life balance supportSenior-level Full TimePune, India11h ago
-
Product Engineer II - Geospatial Data Science INR 1500K-2400KAgile | ArcGIS | Arcpy | Deep learning | GDALMid-level Full TimeNew Delhi, Delhi, India13h ago
-
API Security | Application Security | Application Security Testing | Azure DevOps | Branch PoliciesContract-to-hire | Hybrid work mode | On-call coverageMid-level ContractShaikpet, India20h ago
-
Principal Data Engineer INR 3000K-4000KAWS | AWS Glue | AWS Lambda | Amazon EMR | Amazon S3Employee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimePune, MH, India20h ago
-
Mid-level Full TimeKarnataka, Bengaluru, India20h ago
-
API Integrations | AWS | Automation & Integration | Azure | Cloud infrastructureCollaborative environment | Fully remote work | International projects | Professional growth opportunities | Work-life balanceMid-level Full TimeIndia R21h ago
-
Junior Software Engineer INR 480K-800KAzure Data | Azure Data Factory | Azure Data Lake | Azure Synapse | Azure Synapse AnalyticsClient facing communication experience | Night shift rotation | Remote workEntry-level Full TimeHyderabad/Remote, India R21h ago
-
Software Engineer - Data Engineer INR 2475K-3465KAWS | Azure | CI/CD | Computer Vision | Data GovernanceCollaborative work environment | Professional development | Training opportunitiesSenior-level Full TimeBangalore - Karnataka, India - Kalyani …21h ago
-
Associate Engineer - AI/ML with Python INR 2500K-4000KAWS | Celery | Django | Docker | ElasticsearchCollaborative work environment | In-office 5 days a week | Learning and development opportunities | Professional growth and developmentMid-level Full TimeBangalore - Karnataka, India - Kalyani …21h ago
-
Mid-level Full TimeIN-TN-Chennai22h ago
-
Senior-level Full TimeIN-TN-Chennai22h ago
-
Databricks Platform Engineer INR 264KApache Spark | Azure Monitor | CI/CD | Cluster policies | DatabricksMid-level Full TimeIN-KA-Bangalore22h ago
-
Databricks Data Engineer INR 1500K-2200KApache Kafka | Apache Spark | Azure | Azure Data | Azure Data LakeMid-level Full TimeIN-KA-Bangalore22h ago
-
Agentic AI Engineer INR 2000K-5000KAI LLM Gateway | AI/LLM | Azure | Azure Cosmos | Azure Cosmos DBSenior-level Full TimeIN-KA-Bangalore22h ago
-
Mid-level Full TimeIN-KA-Bangalore22h ago
-
Data Engineer INR 1500K-2500KApache Airflow | BigQuery | Cloud Composer | Cloud Dataflow | Cloud FunctionsMid-level Full TimeIndia-Telangana-Hyderabad22h ago
-
Analytics Engineer - Finance INR 1500K-2600KAccess Control | Agile | Amazon Web Services | Apache Airflow | Automated testingMid-level Full TimeIN-Pune23h ago
-
AI Engineer INR 2500K-5000KA/B | A/B Testing | Async workers | Autogen | B testingCareer growth | Diversity and inclusion | Inclusive cultureSenior-level Full TimeIndia - Bengaluru1d ago
-
Quality Data Analytics Specialist INR 1500K-2700KAlation | Data Management | Data Quality | Data Reconciliation | Data ValidationSenior-level Full TimePune, India1d ago
-
Sr Data and AI specialist INR 2000K-4500KAgentic AI | Cloud Computing | DAX | Data Modeling | Data TransformationMentoringSenior-level Full TimeAhmedabad, Gujarat, India1d ago