Senior Data Engineer
IND - Greater Noida - HeritEdge, India
R
INR 3000K-4000K (estimate) Senior-level Full Time
Tasks
- Build ETL/ELT pipelines
- Build specialized cost efficient micro pipelines
- Configure infrastructure with IaC
- Create feature ready datasets
- Develop PySpark data processing
- Enable local SQL development with DuckDB
- Implement dbt transformations
- Manage orchestration with idempotent DAGs
- Optimize job latency and cost
- Set up data monitoring and alerting
- Tune SQL and Spark query performance
- Use DuckDB for embedded analytics
Perks/Benefits
Skills/Tech-stack
AWS CloudFormation | Airflow DAGs | Alerting | Amazon Kinesis | Amazon S3 | Apache Airflow | Apache Iceberg | Apache Spark | Azure Blob | Azure Blob Storage | Blob Storage | CI/CD | DBT | Data Monitoring | Data Quality | Databricks | Delta Lake | DuckDB | Kafka | Kubernetes | Parquet | Prefect | PySpark | Python | SQL | Snowflake | Spark Streaming | Terraform
Education
N/A
Roles
Regions
Countries
States
Related jobs
-
Senior Software Engineer - Full Stack & GenAI INR 3242K-4680KAPI Security | AWS | Amazon RDS | Amazon S3 | AngularHybrid work | Professional developmentSenior-level Full TimeBengaluru, KA, India R14h ago
-
Senior Software Engineer, Machine Learning INR 3600K-5400KA/B | A/B Testing | Amazon S3 | Apache Airflow | B testingDental insurance | Financial wellness support | Health insurance | Mental health support | Paid time offSenior-level Full TimeBengaluru, India R16h ago
-
ABAP | BDC | Business Intelligence | Data Modeling | Data PipelinesCareer development | Employee communities | Global onboarding | Health insurance | Hybrid workSenior-level Full TimeIndia R18h ago
-
API Versioning | Asynchronous processing | Authentication | CI/CD | CeleryCollaborate with backend and frontend teams | Full-time employment | Fully remote | Hands on experience with production LLM and VLM systems | Work on AI infrastructure model routing and microservicesMid-level Full TimeIndia R19h ago
-
Data Science AI Engineer INR 2000K-4500KAPI Development | AWS | Azure | CMS | Cloud ComputingFully remote | Work-life balanceEntry-level Full TimeBangalore, KA, IN, 560100 R21h ago
-
Lead Data Science AI Engineer INR 2000K-5000KAPI Development | AWS | Agent workflows | Agentic AI | AzureFully remote | Minimal travelSenior-level Full TimeBangalore, KA, IN, 560100 R21h ago
-
Software Engineer - Front Line Manager INR 1800K-2525KAirflow | Angular | Apache Beam | BigQuery | BigtableGuided career tracks | Healthcare packages | Hybrid work setting | Online learning platform | Organizational growth potentialMid-level Full TimeIND-Trivandrum-Equifax Analytics-PEC, India R21h ago
-
Senior Data Engineer INR 2771K-4064KArtificial Intelligence | BigQuery | Cloud platform | Data Engineering | Data VisualizationGuided career tracks | Healthcare packages | Hybrid work setting | Online learning platform | Paid time offSenior-level Full TimeIND-Bangalore-Equifax Credit Information Services, India R21h ago
-
Senior Data Engineer INR 2771K-4064KAI machine learning | BigQuery | Cloud platform | Data Visualization | Entity ResolutionGuided career tracks | Healthcare package | Hybrid work setting | Online learning platform | Organizational growth potentialSenior-level Full TimeIND-Bangalore-Equifax Credit Information Services, India R21h ago
-
Lead Full Stack Data Engineer INR 3242K-4500KCI/CD | DAX | Data Factory | Data Governance | Data ModelingSenior-level Full TimeIndia - Remote R21h ago
-
Machine Learning Engineer IV INR 4443K-7998KAPIs | Batch Processing | Cost Optimization | Distributed Systems | EmbeddingsBonuses | Disability insurance | Health insurance | Life insurance | Paid parental leaveSenior-level Full TimePune, India R1d ago
-
Senior-level Full TimeIndia, Remote R1d ago
-
MongoDB, Python, MSA/Consultant Specialist INR 1000K-2000KAWS | Aggregation Pipeline | Azure | CI/CD | DockerFlexible working | Inclusive work environment | Professional development opportunitiesSenior-level Full TimeHyderabad, Telangana, India R1d ago
-
AI Engineer - Quality INR 3264K-5876KAPI Testing | Apex | Automation | CI/CD | Data ValidationHybrid work model | Learning platform access | Mental health counseling | Mentorship programs | Paid parental leaveSenior-level Full TimeBangalore, India R1d ago
-
Data Engineer -- Regulatory Reporting & Portfolio Intelligence INR 1000K-1500KAWS | Amazon Redshift | Apache Airflow | Data Quality | GCSEmployee assistance program | Flexible-hybrid work | Generous vacation program | Internal workshops | Learning stipendMid-level Full TimeBangalore R1d ago
-
AWS | Amazon Kinesis | Apache Airflow | Apache Spark | Cloud platformFully remoteMid-level Full TimeIndia R1d ago
-
Apache Airflow | Apache Spark | Batch data | Batch data pipelines | Cloud infrastructureCommunity culture | Full-time contract | Long term role | Professional growth | Remote-first workSenior-level Contract Full TimeIndia R1d ago
-
AWS S3 | AWS storage | AWS storage services | Active Directory | Ansible100 percent remote work | Flexible time off | Holiday allowance | Medical insurance | Shift allowanceMid-level Full TimeIndia R1d ago
-
Databricks Platform Engineer (AWS) INR 1500K-3500KAWS | AWS Cloud | AWS Cloud Database | Amazon Virtual Private Cloud | Asset bundlesFlexible work arrangement | Hybrid working model | Wellness supportSenior-level Full TimeHyderabad, India R1d ago
-
Databricks Data Engineer - Bengaluru INR 1500K-2600KAWS | AWS Glue | Amazon Athena | Amazon EMR | Amazon S3Work from anywhereMid-level Full TimeIndia-Bangalore-Office-Kalyani Vista R1d ago
-
Data Engineer, Vice President INR 3000K-4000KAWS | Azure | Cost Optimization | Data Governance | Data ModelingComprehensive healthcare | Flexible time off | Hybrid work model | Retirement plan | Support for working parentsExecutive-level Full TimeM11 - Commers III, 43, 44 … R1d ago
-
Director, Data Engineering INR 4000K-5000KAPIs | AWS | Agile | Anomaly Detection | AzureComprehensive healthcare | Flexible time off | Hybrid work model | Retirement plan | Support for working parentsExecutive-level Full TimeHA3-Gurugram - DLF Cyber City, India R1d ago
-
Sr Data Engineer INR 2771K-4064KAgile | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageFlexible working hours | Paid parental leave | Remote Working | Training and development programmesSenior-level Full TimeBangalore RMZ-ECO WORLD, India R1d ago
-
Computer Scientist II INR 3242K-3584KAI Agents | AIOps | AWS | Alertmanager | ArgoOn-call rotationSenior-level Full TimeBangalore, India R1d ago
-
Senior Computer Scientist INR 3264K-5000KAWS | Agentic AI | Application Insights | Application Security | AzureSenior-level Full TimeBangalore, India R1d ago