Data Engineer
Chennai, Tamil Nadu, India
INR 1500K-2000K (estimate) Mid-level Full Time
Tasks
- Automate operational tasks
- Build automated testing deployment pipelines
- Build data pipelines
- Collaborate with development and operations teams
- Deploy containerized data services
- Design data pipelines
- Develop ETL processes
- Ensure data governance
- Ensure data quality
- Implement ELT processes
- Implement data modeling
- Implement infrastructure-as-code
- Ingest data from sources
- Maintain data architectures
- Manage CI/CD pipelines
- Manage data warehousing
- Monitor data pipelines
- Optimize data pipelines
- Orchestrate containers
- Provision cloud resources
- Set up logging and alerting
- Store data in Cloud Storage
- Transform data
- Troubleshoot data pipeline issues
Perks/Benefits
- N/A
Skills/Tech-stack
Agile | Alerting | Ansible | Apache Kafka | Apache Spark | Artifact Registry | Bash | BigQuery | CI/CD | Cloud Build | Cloud Dataflow | Cloud Pub/Sub | Cloud Run | Cloud SQL | Cloud Storage | Cloud platform | Data Governance | Data Modeling | Data Quality | Data Warehousing | Database Design | Dataform | Dimensional Modeling | Docker | ELT | ETL | Faiss | Fine Tuning | Git | GitLab CI | Google Cloud | Google Cloud Platform | Hadoop | Infrastructure as Code | Java | Jenkins | Kubernetes | Logging | Monitoring | Prompt engineering | Pub/Sub | Python | RAG | Relational modeling | Retrieval-Augmented Generation | SQL | Scala | Scripting | Streaming Data | Tekton | Terraform | Vector Database | Vector Search | Vertex AI | “as-code”
Education
Bachelor of Engineering | Bachelor of Engineering - Computer Science | Bachelor of Science | Bachelor of Science Computer Science
Roles
Related jobs
-
Senior-level Full TimeKarnataka, Bengaluru, India4h ago
-
Mid-level Full TimeIN-AP-Hyderabad5h ago
-
Senior Data Management Professional - Data Rates INR 2800K-4000KAgile | Alerting | Anomaly Detection | CSV | Cause analysisSenior-level Full TimePune5h ago
-
Software Engineer - Data Engineer INR 2617K-3465KAWS | Azure | Data Engineering | Data Governance | Data LakesCollaborative work environment | Professional growth | Training and developmentSenior-level Full TimeBangalore - Karnataka, India - Kalyani …5h ago
-
Associate - Embedded AI & Data Analytics Engineer INR 980K-1141KC++ | Classification | Data Modeling | Data Preprocessing | Data ValidationMid-level Full TimeBangalore - Karnataka, India - Kalyani …5h ago
-
Associate - Agentic AI - Embedded System INR 2000K-2500KCI/CD | Distributed Systems | Edge AI | GPU Utilization | LangchainAccess to cutting edge technologies and tools | Collaborative work environment | In-office 5 days a week | Professional growth and developmentMid-level Full TimeBangalore - Karnataka, India - Kalyani …5h ago
-
Associate - Agentic AI - Embedded System INR 2000K-2500KDistributed Systems | Edge AI | GPU | LLM | LangchainAccess to cutting edge technologies and tools | Collaborative and dynamic work environment | Onsite work 5 days a week | Opportunities for professional growth and development | Recognition and rewards for outstanding performanceMid-level Full TimeBangalore - Karnataka, India - Kalyani …5h ago
-
Associate - Agentic AI - Data analytics engineer INR 1000K-1820KC++ | Classification | Data Modeling | Data Pipelines | Data PreprocessingAccess to cutting-edge technologies | Collaborative work environment | Professional growth opportunitiesMid-level Full TimeBangalore - Karnataka, India - Kalyani …5h ago
-
BI Developer (Power BI + Sigma Computing) INR 1500K-2209KAccess Control | CI/CD | Data Governance | Data Model | Data ModelingSenior-level Full TimeGurugram, Haryana, India6h ago
-
Software Engineering INR 1500K-2000KApache Spark | Azure | Azure AKS | Azure Compute | Azure DataOn-call rotationMid-level Full TimeBengaluru, KA, IN6h ago
-
Software Engineering INR 1500K-2000KAI-enabled | AI-enabled development | Apache Spark | C# | C++Career growth opportunities | On-call rotationMid-level Full TimeBengaluru, KA, IN6h ago
-
Forward Deployed Engineer, Generative AI, Google Cloud INR 2000K-4500KAPI Integration | Agent systems | Cloud platform | CrewAI | Generative AISenior-level Full TimeMumbai, Maharashtra, India7h ago
-
Software Engineer III, Full Stack, Cloud AI INR 2000K-3500KAgentic AI | Cloud Computing | Connectivity systems | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeBengaluru, Karnataka, India7h ago
-
API Testing | Apache JMeter | Automation Framework | Azure | BitbucketEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimePune, MH, India7h ago
-
Azure Data Engineer Consultant INR 1500K-2000KAzure Blob | Azure Blob Storage | Azure Data | Azure Data Factory | Azure Data LakeCorporate social responsibility programs | Discounts on products and services | Maternity and paternity leave | Networking opportunities | VIRTUAL interviewMid-level Full TimeBangalore, Karnataka, India7h ago
-
AI Engineer(Python, SQL, and GenAI frameworks ,LLM architecture, RAGs, embeddings, prompt tuning,agentic AI INR 2000K-4000KAWS | Agentic AI | Azure | Containerization | DockerSenior-level Full TimeGurugram, HR, India7h ago
-
Senior ETL Developer, Data Management INR 1500K-2209KAgile | Autosys | Control-M | Data Quality | ETLRotational on-callSenior-level Full TimeBangalore, India9h ago
-
Data Engineering Specialist INR 2000K-3000KAWS | Ab Initio | Apache NiFi | Apache Spark | BigQueryCareer development | Continuous training | Knowledge transfer sessionsSenior-level Full TimeBengaluru, IN, 5601039h ago
-
Data Analytics Professional INR 2500K-4000KAI Algorithms | Automation | Business Intelligence | Data Analysis | Data IntegrityEntry-level Full TimeBengaluru, IN, 5601039h ago
-
Software Engineer II INR 1500K-2000KAzure Cosmos | Azure Cosmos DB | Azure Data | Azure Data Factory | Azure EventMid-level Full TimeBengaluru, KA, IN9h ago
-
Senior AI Engineer INR 2500K-4500KAI Search | API Development | AWS Bedrock | AWS SageMaker | Apache AirflowSenior-level Full TimeHyderabad, TS, India10h ago
-
D&T Lead - Data Engineer INR 2000K-2800KAmazon Web Services | Azure | Batch Processing | Cloud Data | Cloud Data WarehouseSenior-level Full TimePune, IN10h ago
-
Applied AI ML Associate INR 1000K-1500KAmazon Web Services | Apache Spark | Batch Processing | Caffe | Computer VisionMid-level Full TimeHyderabad, Telangana, India10h ago
-
Sr. Machine learning /Data Scientist INR 3000K-4500KAWS Bedrock | AWS SageMaker | Apache Spark | Classification | ClusteringAccreditations | Bike to work | Educational assistance | Employee assistance program | Employee discount schemeSenior-level Full TimeMumbai, MH, India10h ago
-
Python, Pyspark, GCP Data Engineer INR 2800K-4000KApache Airflow | Apache Spark | Apache Spark SQL | BigQuery | CCPASenior-level Full TimeBangalore, Karnataka, India10h ago