Sr.Data Engineering
Tasks
- Apply data modeling for efficient storage and retrieval
- Automate CI CD for data solutions
- Build Azure data solutions using Azure services
- Build and optimize scalable data pipelines
- Collaborate with data scientists and analysts
- Configure data infrastructure on OpenShift
- Create documentation for pipelines and architecture
- Design ETL ELT data pipelines
- Develop SQL queries for extraction transformation loading
- Implement unit and integration tests for data pipelines
- Ingest data from databases APIs and streaming sources
- Optimize query and pipeline performance
- Set up monitoring alerting and dashboards
- Transform data into clean usable formats
Perks/Benefits
- N/A
Skills/Tech-stack
Azure Data | Azure Data Factory | Azure Databricks | Azure Event | Azure Event Hubs | Azure Key Vault | Azure SQL | Azure SQL Database | Azure SQL Server | CI/CD | Data Factory | Data Modeling | ELT | ETL | Event Hubs | GitHub Actions | Grafana | Helm | Indexing | Integration Testing | Kafka | Key Vault | Kubernetes | OpenShift | Performance Tuning | PySpark | Python | SQL | SQL Database | SQL Server | Streaming Data | Unit Testing
Roles
Related jobs
-
Entry-level Full TimeBangalore, India; Sunnyvale, CA; San Bruno, …4h ago
-
Apache Spark | Avro | Azure Data | Azure Data Factory | Azure Data LakeRemote work optionMid-level Full TimeDallas / Philadelphia, USA; Bangalore, India; …4h ago
-
AWS | Amazon Aurora | Amazon RDS | Amazon S3 | CI/CDMid-level Full TimeDahisar West, Maharashtra7h ago
-
Data Platform Operations Engineer (Databricks, DBT, Snowflake, AWS, Aurora) - Mumbai, MH - AS A INR 1300K-2000KAmazon Aurora | Amazon S3 | Amazon Web Services | Backup and Recovery | CDCMid-level Full TimeMumbai, MH7h ago
-
DevOps / AWS Data Platform Engineer (Databricks, Snowflake, Aurora, S3, DBT) - Mumbai, MH - AS A INR 1500K-2500KAWS S3 | Alerting | Amazon Aurora | Amazon RDS | Amazon Web ServicesMid-level Full TimeMumbai, MH7h ago
-
Apache Spark | Data Pipelines | Data Validation | Databricks | Feature EngineeringMid-level Full TimeMumbai, MH7h ago
-
Software Engineer III - Python INR 3000K-5000KAlerting | CI/CD | Docker | Infrastructure as Code | KubernetesSenior-level Full TimeBengaluru, Karnataka, India10h ago
-
Senior-level Full TimeBANGALORE, Karnataka, Inde10h ago
-
Agentic AI | Agile | Artificial Intelligence | Docker | Generative AISenior-level ContractShaikpet, India10h ago
-
Senior AI Engineer / Data Scientist (Agentic AI) INR 2000K-5000KAI Search | AI Services | Agentic AI | Azure | Azure AISenior-level Full TimeChennai, India11h ago
-
Senior-level Full TimeIN-KA-Bangalore11h ago
-
GenAI Developer INR 1800K-4500KAPI Development | AWS | Azure | C++ | Cloud platformFull-time work | Work from OfficeSenior-level Full TimeIN-TN-Chennai11h ago
-
Expert Data Engineer INR 3500K-4200KAPI Integration | Access Control | Attribute-Based Access Control | Attribute-based access | Audit LoggingHybrid workSenior-level Full TimeBangalore, Karnataka, India11h ago
-
Mid-level Full TimeNoida, Uttar Pradesh, India12h ago
-
Amazon S3 | Apache Iceberg | Cloud Computing | Concurrency | Data ModelingCareer development | Health benefits | Paid time off | Remote work flexibilitySenior-level Full TimeHyderabad, India12h ago
-
Agile | Apache Airflow | Azure Data | Azure Data Factory | Azure DevOpsEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India12h ago
-
Software Engineer (Full Stack Developer, Node JS & React JS)) INR 2000K-4500KAI Agents | AI orchestration | API Design | Agile | CI/CDSenior-level Full TimeBangalore, India Office (BANGALORE) R12h ago
-
GCP, Bigquery, Airflow/Consultant Specialist INR 1500K-2500KAgile | Apache Airflow | Apache Kafka | Apache NiFi | BigQueryFlexible working | Inclusive work environment | Professional developmentSenior-level Full TimeHyderabad, Telangana, India R12h ago
-
Expert Data & AI Engineer INR 3000K-4000KAWS | Apache Spark | Automation | Azure | Azure DevOpsCareer development opportunities | Collaborative culture | Learning opportunities | Team leadership opportunitiesSenior-level Full TimeHyderabad, India13h ago
-
Staff Software Engineer, Machine Learning INR 3000K-4680KC++ | Cross-Functional Collaboration | Cross-functional | Data Pipelines | Fine TuningHealth and wellness programs | Time awaySenior-level Full TimeBengaluru, KA, India13h ago
-
Mid-level Full TimeBangalore, Karnataka, IN13h ago
-
Senior AI Engineer INR 2500K-5000KAPI Design | Agile | Azure | Azure AI | Azure ArcHybrid work | On-call supportSenior-level Full TimeBangalore, Karnataka, IN13h ago
-
Lead Expert Data Engineer- Procurement INR 3000K-4000KAWS | Apache Spark | Azure | Azure DevOps | CI/CDSenior-level Full TimeHyderabad, India14h ago
-
Senior-level Full TimeHyderabad, Telangana, India14h ago
-
Data Engineer - Associate Director INR 1500K-2600KAWS | AWS Glue | Agile | Apache Airflow | Apache HadoopMid-level Full TimeBangalore, Karnataka, India14h ago