Data Engineer
Chennai, Tamil Nadu, India
INR 1500K-2500K (estimate) Mid-level Full Time
Tasks
- Analyze and integrate massive datasets
- Automate data pipeline operations
- Build cloud analytics platforms on GCP
- Deploy container based microservices architectures
- Design data warehouse and data lake solutions
- Develop Apache Beam data pipelines
- Develop SQL-based data solutions
- Develop proof-of-concept solutions
- Develop reusable data products and subject areas
- Evaluate and productionalize GCP data tools
- Implement CI CD and build pipelines
- Implement automated data lineage
- Ingest streaming and batch data into GCP
- Land source application data into GCP
- Transform and modernize data pipelines on GCP
Perks/Benefits
- N/A
Skills/Tech-stack
Airflow | Apache Beam | Batch Ingestion | BigQuery | Bigtable | Cloud Build | Cloud Composer | Cloud Storage | Cloud platform | Container Orchestration | Data Catalog | Data Fusion | Data Lake | Data Lineage | Data Validation | Data Warehousing | Data pipeline | Data pipeline orchestration | Dataproc | ETL | GCP Data | GCP Data Catalog | GCP Dataflow | Google Cloud | Google Cloud Platform | Informatica EDC | Java | Microservices | Pipeline Orchestration | PubSub | Python | SQL | Streaming Data | Tekton | Terraform
Education
N/A
Roles
Related jobs
-
Snowflake Developer INR 1500K-2200KAgile | Automated Deployment | CI/CD | Data Ingestion | Data LakeSenior-level Full TimeIN-HR-Gurgaon3h ago
-
Practice Customer Engineer, Data Analytics INR 1500K-3000KApache Spark | Batch Processing | Big Data | C++ | Cloud platformSenior-level Full TimeBengaluru, Karnataka, India; Mumbai, Maharashtra, India4h ago
-
Staff Software Engineer, AI Garage INR 2500K-5000KAI Evaluation | Agentic AI | Artificial Intelligence | C plus plus | C#Senior-level Full TimeHyderabad, Telangana, India4h ago
-
Senior-level Full TimeBangalore, Karnataka, India5h ago
-
Senior-level Full TimeBangalore, Karnataka, India5h ago
-
Cloud DevOps - Consultant INR 2000K-2700KAWS Lake | AWS Lake Formation | Amazon Web Services | Apache Airflow | Apache KafkaClient-facing consulting experience | Growth mindset | Team collaborationMid-level Full TimeGurgaon, Haryana, India5h ago
-
Expert AI Engineer INR 2475K-5000KAI Search | Agent systems | Agentic AI | Azure AI | Azure AI SearchCompany-paid certifications | Conferences | Financial consultations | Internal meetups | Language coursesSenior-level Full TimeIndia5h ago
-
Senior-level Full TimeBangalore, India6h ago
-
Manager- Data Engineer INR 1500K-2200KAzure Data | Azure Data Factory | Azure Data Lake | Azure DevOps | Azure SQLMid-level Full TimeBangalore, Karnataka, India6h ago
-
AI Engineer INR 3000K-5000KAI Services | Alerting | Application Insights | Audit Logging | AuthenticationCareer development support | Cross-functional collaboration | Flexible ownership of AI platform | Industry certification supportSenior-level Full TimeMumbai, India6h ago
-
AWS | AWS CodeDeploy | AWS Lambda | Agile | Amazon AuroraSenior-level Full TimeBengaluru, Karnataka, India6h ago
-
Lead Software Engineer Python Gen AI INR 3500K-5500KAWS | Agents | Amazon Web Services | Anomaly Detection | AuthenticationSenior-level Full TimeBengaluru, Karnataka, India6h ago
-
Gen AI Specialist INR 2500K-5000KAI Model Evaluation | AI Model Optimization | AI model | API Gateway | AWS LambdaSenior-level Full TimeHyderabad, India7h ago
-
Senior-level Full TimePune, Maharashtra, India7h ago
-
Senior Software Test Engineer (python, pyspark, SQL, databricks, playwright/ selenium) INR 2156K-2800KAPI Testing | Airflow | Azure Kubernetes | Azure Kubernetes Service | BitbucketEmployee assistance program | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeChennai, TN, India9h ago
-
Software Engineer II INR 1800K-4000KArtificial Intelligence | Azure Machine Learning | C# | Data Pipelines | DebuggingMid-level Full TimeIndia, Karnataka, Bangalore9h ago
-
React.Js Developer-HDFC-Gurugram INR 1500K-3000KAPI Design | AWS | AWS Lambda | Apache Kafka | DockerSenior-level Full TimeIndia - Bengaluru9h ago
-
Assistant Manager - Forward Deployed Engineer / AI Engineer INR 1860K-4000KAutogen | Cloud Computing | CrewAI | FastAPI | FlaskMid-level Full TimeBangalore, Karnataka, India10h ago
-
Mid-level Full TimeBangalore, Karnataka, India10h ago
-
API | C# | C++ | Concurrency | Driven systemsSenior-level Full TimeIndia, Karnataka, Bangalore10h ago
-
Senior SDET – Performance Engineering INR 2500K-4000KAKS | APM | Azure | C# | CI/CD401k | Cafe Amenities | Fitness Center | Health insurance | Recreational facilitiesSenior-level Full TimePune, MH, India10h ago
-
Data & Analytics Engineer - Consultant INR 1500K-2500KApache Spark | Data Modeling | Data Warehousing | Databricks | Delta LakeSenior-level Full TimeBangalore, Karnataka, India11h ago
-
AI / ML Engineer II / III INR 1800K-3000KAirflow | Anomaly Detection | Apache Spark | Classification | Data EngineeringMid-level Full TimeBengaluru, India11h ago
-
Cloud DevOps & Integration - Consultant INR 1500K-2600KAWS Lake | AWS Lake Formation | Apache Airflow | Apache Kafka | Apache SparkMid-level Full TimeGurgaon, Haryana, India11h ago
-
Senior-level Full TimeBangalore, KA, India12h ago