Sr.Data Engineering
Tasks
- Collaborate with data scientists and analysts
- Create documentation for pipelines and architecture
- Deploy applications using Helm
- Design ETL ELT data pipelines
- Develop CI CD automation for data solutions
- Implement unit and integration tests for pipelines
- Ingest data from databases APIs and streaming sources
- Manage data infrastructure on OpenShift
- Optimize SQL queries and database performance
- Set up monitoring alerting and dashboards
- Transform data into clean formats
Perks/Benefits
- N/A
Skills/Tech-stack
Azure Data | Azure Data Factory | Azure Databricks | Azure Event | Azure Event Hubs | Azure Key Vault | Azure SQL | Azure SQL Database | CI/CD | Data Factory | ELT | ETL | Event Hubs | GitHub Actions | Grafana | Helm | Kafka | Key Vault | Kubernetes | OpenShift | PySpark | Python | SQL | SQL Database | SQL Server
Roles
Related jobs
-
Sr Developer Software INR 2000K-4000KAWS | AWS Glue | AWS Lambda | Amazon ECS | Amazon EMRFlexible work environment | Internal mobility | Volunteering opportunities | Well-being | Work-life balanceSenior-level Full TimeKA Bangalore, India6h ago
-
Data Architect INR 1500K-2600KApache Kafka | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeBangalore North, India14h ago
-
Senior AI/ML Engineer INR 3799K-5572KAI Security | AI Services | AWS | Agentic AI | AirflowAccident Coverage | Career growth | Group term life insurance | Health insurance | Hybrid work supportSenior-level Full TimeIQEQ Hyderabad, Tower 2, 7th floor, … R15h ago
-
AIML Engineer Digital & AI INR 3242K-5000KAWS | Azure | CI/CD | Deep learning | DockerAccident Coverage | Career growth | Group term life insurance | Internet allowance | Medical insuranceSenior-level Full TimeIQEQ Hyderabad, Tower 2, 7th floor, … R15h ago
-
Lead Database Engineer INR 1500K-3000KAudit Logging | Azure Data | Azure Data Factory | Azure Database | Azure Database MigrationSenior-level Full TimePune City, India15h ago
-
Data Scientist INR 2500K-4500KAdvanced Statistics | Apache Spark | Azure Data | Azure Data Factory | Azure KubernetesEquity and inclusion focus | Mentorship opportunities | Travel to other locations in India and globally | Work on global projectsSenior-level Full TimeBangalore - Karnataka - India15h ago
-
Lead AI Engineer - Agentic Engineering INR 2500K-5000KAPI Design | Agent Orchestration | Agent systems | Autogen | Automated RegressionSenior-level Full TimeHyderabad, TS, India15h ago
-
MongoDB, Python, MSA/Consultant Specialist INR 1200K-2000KAWS | Aggregation Pipeline | Azure | CI/CD | Data ModelingContinuous professional development | Flexible working | Inclusive workplace cultureSenior-level Full TimeHyderabad, Telangana, India R16h ago
-
Senior-level Full Timebengaluru, India16h ago
-
Senior-level Full Timebengaluru, India16h ago
-
Senior-level Full Timebengaluru, India16h ago
-
Senior-level Full Timebengaluru, India16h ago
-
DevOps/MLOps Specialist INR 4000K-5500KAnsible | Apache Airflow | Apache Beam | Apache Kafka | CI/CDMid-level Full Timebengaluru, India16h ago
-
Senior-level Full TimePune, Maharashtra, India16h ago
-
Data Ingestion Engineer (ADF+Dbt+Snowflake) INR 1500K-2000KAPI Integration | Azure Data | Azure Data Factory | DBT | Data FactoryMid-level Full TimePune, MH, India17h ago
-
Mid-level Full TimeBengaluru, Karnataka, India R18h ago
-
C# | C++ | Data Science | Data Structures | Distributed SystemsExecutive-level Full TimeBengaluru, Karnataka, India18h ago
-
Senior-level Full TimePune, Maharashtra, India18h ago
-
Assistant Manager INR 1500K-2500KAirflow | BigQuery | Cloud Composer | Cloud Dataproc | Cloud StorageMid-level Full TimePune, Maharashtra, India18h ago
-
Mid-level Full TimeChennai, Tamil Nadu, India R18h ago
-
Applied AI/ML Engineer INR 2000K-3000KAgentic Systems | Bias Mitigation | Decision Trees | Evaluation Frameworks | Fallback mechanismsMid-level Full TimeBengaluru, Karnataka, India18h ago
-
Mid-level Full TimeNoida, Uttar Pradesh, India R18h ago
-
AWS Data Engineer INR 1500K-2500KAWS | AWS Glue | Amazon Athena | Amazon EMR | Amazon S3Hybrid workMid-level Full TimeBengaluru, Karnataka, India R18h ago
-
EAI Software Engineer INR 1800K-2500KAPI Gateway | APIs | Agile | ArgoCD | CI/CDOn site work 4 days per week | Relocation N/AMid-level Full TimeHyderabad, India19h ago
-
Software Engineer III-Java, Kafka/Streams INR 2000K-3000KAgile | Application Resiliency | CI/CD | Data Visualization | JavaSenior-level Full TimeMumbai, Maharashtra, India19h ago