Sr Data Engineer - ETRM
INR 2771K-4064K (estimate) Senior-level Full Time
Tasks
- Build and optimize end-to-end data pipelines
- Collaborate with cross-functional teams in agile environment
- Design and support enterprise data platforms and analytics solutions
- Design develop and maintain scalable high performance data engineering solutions
- Evaluate and adopt emerging technologies and AI driven solutions
- Implement data modeling for reporting analytics and operations
- Integrate transform and support analytics using databases
- Manage source control CI CD and release management
- Optimize data products processes and platform performance
- Translate trading business requirements into scalable data solutions
- Tune and optimize PySpark and SQL for efficiency and scalability
Perks/Benefits
- Flexible working hours
- Paid parental leave
- Remote working option
- Training and development programmes
Skills/Tech-stack
Agile | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Databricks | Azure DevOps | Azure Fabric | CI/CD | Data Catalog | Data Factory | Data Lake Storage | Data Management | Data Modeling | GitHub | Master Data | Master Data Management | Non-relational | Non-relational Databases | Performance Tuning | PySpark | Python | Query Optimization | Relational databases | SQL | SQL Query Optimization | SQL query
Education
Bachelor of Computer Science | Bachelor of Engineering | Bachelor of Science | Master of Computer Applications
Roles
Related jobs
-
AI Agents | AWS | Anthropic | Azure | Azure OpenAIDirect customer collaboration | Freelance contract opportunity | Fully remote | Inclusive workplace | Learning opportunitiesMid-level Full TimeIndia R7h ago
-
AI Agents | AI Evaluation | Agent systems | CI/CD | DockerFlexible project-based work | Freelance contract engagement | Fully remoteSenior-level Contract Full TimeIndia R7h ago
-
Data Engineer INR 1500K-2700KAsset bundles | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2Flexible workplace accommodations | Hybrid work modelMid-level Full TimeChennai, India R8h ago
-
AWS Bedrock | Amazon SageMaker | BentoML | CI/CD | DockerCollaborative environment | Exposure to modern AI ML infrastructure | Full-time employment | Remote work from India | Technical ownershipSenior-level Full TimeIndia R12h ago
-
Data Scientist Engineer Advisor INR 2400K-3380KAWS | Azure | Bias Mitigation | Data Analysis | Data QualityMid-level Full TimeBangalore, KA, IN R13h ago
-
AI Engineer INR 3672K-4800KAPI Integration | Access Controls | Agent Orchestration | CI/CD | Data Leakage PreventionAsynchronous work | Career growth | Continuous learning | Remote workMid-level Full TimeRemote, Bangalore R15h ago
-
Senior Data Platform Engineer INR 3584K-4580KAWS | Apache Kafka | Apache Spark | Azure | Cloud platformCollaborative cross site work | Healthcare benefits | Internet or cell phone reimbursement | Learning and development stipend | Travel opportunities to headquartersSenior-level Full TimeBengaluru, India R15h ago
-
Senior Software Engineer - Multi-Product Platform INR 2500K-4680KAPI Development | Error Handling | Fault Tolerance | Incident Response | MonitoringSenior-level Full TimeHybrid - Bangalore, India R21h ago
-
BigQuery | CI/CD | Cloud Composer | Cloud IAM | Cloud NetworkingConference reimbursement | Corporate discounts | Coworking reimbursement | Equipment and workspace reimbursement | Fully remoteSenior-level Full TimeIndia R22h ago
-
Senior AI Engineer/ Senior Associate Director, Tech SME INR 1860K-2800KAPIs | AWS | Agent Orchestration | Agent systems | AzureMid-level Full TimePune, Maharashtra, India R22h ago
-
Data Engineer INR 720K-720KAWS | Apache Airflow | Apache NiFi | Apache Superset | AzureChildcare support | Counseling sessions | Health insurance | Internet allowance | Learning SupportSenior-level Full TimeBangalore, India R23h ago
-
AWS Lambda | Amazon DynamoDB | Amazon RDS | Amazon S3 | CI/CDHybrid workSenior-level ContractHyderabad, India R23h ago
-
Software Engineer I INR 1500K-2500KApache Spark | CI/CD | Data Ingestion | Data Modeling | Data QualityCareer development | Community building | Learning opportunities | Work from Anywhere cultureEntry-level Full TimeIndia R1d ago
-
Apache Airflow | Apache Beam | Apache Flink | Asynchronous Messaging | BigQueryFlexible working | Opportunities for growth | Professional developmentMid-level Full TimePune, Maharashtra, India R1d ago
-
Staff Product Analytics Engineer INR 3242K-4995KAWS | Agile | Azure | Cloud billing | Data EngineeringFlexible PTO | Hybrid work model | Learning platform | Mental health counseling | Mentorship programsSenior-level Full TimeBangalore, India R1d ago
-
AI/ML Engineering Lead/(Gen AI,Python,LLM,ETL)Associate Director INR 2000K-4000KAgent Orchestration | Agentic AI | Apache Airflow | Apache Beam | Audit LoggingFlexible working | Inclusive environment | Professional developmentMid-level Full TimePune, Maharashtra, India R1d ago
-
AI/ML Engineer INR 1500K-2500KAPIs | Azure | Continuous integration | Data Pipelines | Distributed SystemsCareer advancement programs | Certification programs | Dental & vision coverage | Education reimbursement | Employee assistance programMid-level Full TimeBangalore, Karnataka, India R1d ago
-
Senior Manager INR 1500K-3000KAdaptive Query | Adaptive query execution | Airbyte | Amazon Kinesis | Asset bundlesSenior-level Full TimePune, Maharashtra, India R1d ago
-
Mid-level Full TimeGurugram, Haryana, India R1d ago
-
Mid-level Full TimePune, Maharashtra, India R1d ago
-
AI Data Engineer III INR 3000K-4000KAWS | Agile methodologies | Amazon Redshift | Apache Airflow | CI/CDEducation assistance program | Fitness benefits | Flexible working hours | Health checkups | Hybrid work environmentSenior-level Full TimeBengaluru, Karnataka, India R1d ago
-
Entry-level Full TimeIndia R1d ago
-
SAP Data Engineer INR 1500K-2500KAWS | AWS Glue | AWS Lambda | Airflow | Amazon EC2Learning and development programs | Multicultural experience | Professional growthEntry-level Full TimeIndia R1d ago
-
API Integration | Agent Frameworks | Agentic Workflows | Automation platforms | Event DrivenAutonomy | Fully remote | Healthcare benefits | Professional development | U S business hours alignmentMid-level Full TimeIndia R1d ago
-
API Development | AWS | Agents | Angular | AzureHome office setup budget | International multicultural environment | Learning and development budget | Visa and relocation support | Work from homeSenior-level Full TimeIndia R1d ago