Data engineer
Tasks
- Architect data models
- Build analytics monitoring and dashboards
- Build scalable data solutions
- Define data strategy and best practices
- Design and build data systems
- Design and deploy streaming systems
- Develop and maintain batch data pipelines
- Develop and maintain real-time data pipelines
- Implement data quality monitoring
- Implement experiment logging
- Integrate data systems with backend and machine learning
- Integrate machine learning models into data systems
- Monitor test and validate data reliability
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Apache Kafka | Apache Spark | Azure | CI/CD | Columnar Databases | Data Modeling | Data Pipelines | Data Warehousing | Databricks | Docker | Grafana | JavaScript | Kubernetes | LLM workflows | Machine Learning | Node.js | Prometheus | Prompt engineering | Python | REST APIs | Relational databases | Security | Splunk | TypeScript
Education
Roles
Related jobs
-
Senior-level Full TimeMaharashtra, Mumbai, India4h ago
-
Lead Consultant – Data Engineer INR 2486K-3380KApache Spark | Azure Data | Azure Data Factory | CI/CD | Data FactoryContinuous learning opportunities | MentorshipSenior-level Full TimeIndia-Hyderabad5h ago
-
Senior-level Full TimeIN-TN-Chennai5h ago
-
GCP Data Engineer INR 1200K-2000KAmazon Redshift | Apache Airflow | Apache Flink | Apache Spark | Apache Spark StreamingSenior-level Full TimeIN-AP-Hyderabad5h ago
-
Senior-level Full TimeIN-AP-Hyderabad5h ago
-
Senior-level Full TimeIndia7h ago
-
Software Engineer III - Python, AWS INR 2500K-3200KAWS | Agentic Frameworks | Amazon Web Services | Apache Airflow | AzureSenior-level Full TimeMumbai, Maharashtra, India7h ago
-
Staff Software Engineer, Applied AI, Search INR 2500K-4500KData Processing | Debugging | Distributed Computing | Fine Tuning | Information RetrievalSenior-level Full TimeBengaluru, Karnataka, India7h ago
-
Senior - Azure Data Engineering INR 2500K-3380KApache Spark | Azure Cosmos | Azure Cosmos DB | Azure Data | Azure Data FactorySenior-level Full TimeBangalore, Karnataka, India7h ago
-
Customer Engineer, AI Infrastructure INR 2500K-4500KASICs | Accelerators | CUDA | Cloud Native | Cloud Native ArchitectureCustomer facing collaboration | Travel opportunitiesSenior-level Full TimeBengaluru, Karnataka, India; Gurugram, Haryana, India7h ago
-
Senior Software Engineer, Google Distributed Cloud Appliance INR 500K-2000KArtificial Intelligence | C++ | CSS | Cloud Native | Cloud-native computingSenior-level Full TimeBengaluru, Karnataka, India7h ago
-
DE&A - Core - Snowflake Data Engineer INR 2000K-2900KAWS | Azure | Azure Data | Azure Data Factory | Batch ProcessingMid-level Full TimePune, Maharashtra, India7h ago
-
DE&A - Core - Snowflake Data Engineer INR 1500K-2500KAWS | Azure | Azure Data | Azure Data Factory | Batch ProcessingFlexible working | Remote workMid-level Full TimePune, Maharashtra, India7h ago
-
Senior-level Full TimeHyderabad, TS, IN7h ago
-
Senior QA Engineer(Data Platform Testing) INR 2156K-2541KAPI Gateway | API Testing | AWS API | AWS API Gateway | AWS LambdaReward and recognition | Volunteering | Wellness | Work-life balanceSenior-level Full TimeHyderabad, India8h ago
-
Senior Data Analytics Engineer INR 800K-1200KAccess Control | Airbyte | Anchor modeling | CI/CD | Common table expressions401k | Café | Fitness Center | Health insurance | Recreational facilitiesSenior-level Full TimeBengaluru, KA, India8h ago
-
Apprentice ,Data Engineering INR 400K-444KAPIs | Artificial Intelligence | Automation | Cloud technologies | Data ModelingAccess to online courses | Insurance | Mentorship | Paid time off | Professional developmentEntry-level Apprenticeship Full TimeChennai, Tamil Nadu, India8h ago
-
Data Analytics & Data Engineering Vice President INR 1500K-6000KAccess Control | Agile | Alteryx Designer | Cloud Computing | ConfluenceExecutive-level Full TimeIndia9h ago
-
Assistant Manager INR 1500K-2000KAmazon Neptune | Apache Spark | Azure Cosmos | Azure Cosmos DB | CSIMid-level Full TimeIndia9h ago
-
GenAI & Python Developer INR 2500K-3000KAPI Development | Data Preprocessing | Data pipeline | Generative AI | GitAgile working environmentMid-level Full TimeNoida, Uttar Pradesh, India9h ago
-
Associate, Decision Science INR 1500K-3000KAzure | C# | Data Visualization | Deep learning | Distributed ComputingHybrid work flexibilityMid-level Full TimeBengaluru, KA, India10h ago
-
Specialist, Data Management & Quantitative Analysis II INR 1100K-1475KAmazon S3 | CI/CD | Dashboards | Data APIs | Data CleansingFlexible work resources | Health benefits | Paid leave | Paid volunteer timeMid-level Full TimePune, MH, India10h ago
-
Applied AI /ML INR 500K-539KAmazon Web Services | Apache Spark | Computer Vision | Data Warehousing | Distributed SystemsAgile team collaboration | Team leadershipMid-level Full TimeHyderabad, Telangana, India10h ago
-
Lead Software Engineer - Big data, AWS, Python INR 2000K-2400KAWS | Agile | Apache Spark | Application Resiliency | Application developmentSenior-level Full TimeBengaluru, Karnataka, India10h ago
-
Senior-level Full TimeIndia10h ago