Data Engineer / Big Data Engineer
Chennai, India
INR 2000K-2000K (estimate) Senior-level Full Time Found 3d ago
Tasks
- Design and optimize ETL processes
- Design scalable backend components
- Design schemas, indexes, and queries
- Develop dashboards with Power BI
- Develop data-driven applications
- Develop solutions using relational and non-relational databases
- Implement data modeling
- Implement data pipelines using DataStage/Informatica or similar tools
- Leverage containerized deployments and enterprise architectures
- Maintain data quality and performance
- Manage batch and streaming data workflows
- Participate in system analysis
- Support advanced data platform tools like Presto, Spark, MLflow
- Support real-time data processing
- Translate requirements into analytical views
- Work within distributed architectures including JEE, Kubernetes, Kafka
Perks/Benefits
- N/A
Skills/Tech-stack
Data Modeling | Data integration | DataStage | Distributed Processing | ETL | Hive | Informatica | Kafka | Kubernetes | MongoDB | NoSQL | Power BI | Python | Relational databases | SQL | Scala | System design
Education
Roles
Language: en |
Views: 0 |
Clicks: 0
Related jobs
-
Sr Software Engineer INR 2500K-3100KAgile methodology | Cloud services | Code review | Communication | Data FormatsSenior-level Full TimePune, India11h ago
-
Sr Software Engineer INR 2500K-3100KAgile methodology | Cloud services | Data Modeling | Database Management | Design PatternsSenior-level Full TimePune, India11h ago
-
Software Engineer INR 1500K-2500KAgile | Cloud services | Code review | Communication | Data ModelingMid-level Full TimePune, India11h ago
-
Mid-level Full TimeIN-TN-Chennai15h ago
-
Sr. Computer Vision & Edge AI Engineer INR 2500K-4500KComputer Vision | Deep learning | Edge Devices | Edge Hardware | GPU AccelerationSenior-level Full TimeMaharashtra, Pune, India15h ago
-
Mid-level Full TimeMaharashtra, Pune, India19h ago
-
Custom Software Engineer INR 960K-1475KAnalytics platform | Azure Data Services | Cloud Computing | Data Services | Data analytics platformMid-level Full TimeHyderabad, HDC3B, India1d ago
-
Custom Software Engineer INR 885K-1200KApplication development | Azure Data Services | Cloud Computing | Data Services | Data integrationMid-level Full TimeChennai, CDC2E, India1d ago
-
Custom Software Engineer INR 885K-1475KAnalytics platform | Application development | Azure Data Services | Cloud Computing | Data ServicesMid-level Full TimeBengaluru, BDC7C, India1d ago
-
Custom Software Engineer INR 960K-1475KApplication development | Azure Data Services | Cloud Computing | Data Services | Data integrationMid-level Full TimeHyderabad, HDC3B, India1d ago
-
Data Engineer INR 1500K-2500KAWS | Agile | Automation | Azure | Cloud ArchitectureCompetitive salaries | Health insurance | Office amenities | Scholarship opportunities | Volunteer programsMid-level Full TimeBengaluru, KA, India1d ago
-
Staff Software Engineer -ML/AI INR 2500K-4600KAPI Development | Algorithms | Embeddings | Hugging Face | Knowledge graphsSenior-level Full TimeBengaluru, India1d ago
-
Principal Consultant, Data Engineer ETL INR 2500K-3380KAWS | Airflow | Azure | Big Data | Cloud ComputingContinuous learning | Impact-driven environment | Innovation culture | MentorshipSenior-level Full TimeIndia-Bangalore1d ago
-
Senior Principal Consultant, RAG Engineer INR 2535K-4225KAI Tooling | AI/ML | AI/ML Tools | AWS | AirflowHands-on experience | Inclusive culture | Learning opportunities | MentorshipSenior-level Full TimeIndia-Bangalore1d ago
-
Lead Consultant-Data Engineer INR 2486K-3380KAWS | Apache Hadoop | Apache Kafka | Apache Spark | AzureAI certifications | Career growth | Hands-on experience | Innovative environment | MentorshipSenior-level Full TimeIndia-Bangalore1d ago
-
Principal Consultant-Data Engineer INR 2486K-3380KAWS | Amazon Redshift | Apache Hadoop | Apache Kafka | Apache SparkAI certifications | Career growth | Inclusive culture | MentorshipSenior-level Full TimeIndia-Bangalore1d ago
-
Senior-level Full TimeIN-AP-Hyderabad1d ago
-
Data Engineer INR 1500K-2500KAzure Data | Azure Data Factory | Azure Data Lake | Azure Functions | Azure SQLMid-level Full TimeIN-AP-Hyderabad1d ago
-
AWS Data Engineer INR 2000K-2125KAWS | Best practices | CI/CD | Cloud Architecture | Cloud platformSenior-level Full TimeIN-TN-Chennai1d ago
-
Senior-level Full TimeIN-TN-Chennai1d ago
-
AI Engineer INR 2000K-4725KAWS | Algorithms | Azure | Cloud Architecture | CommunicationCareer progression | Diversity and inclusion initiatives | Education assistance | Employee discounts | Financial adviceSenior-level Full TimeBengaluru, KA, India1d ago
-
Software Engineer INR 1600K-2400KAgile tools | Agile tools (JIRA, Rally) | Agile tools (Jira | Angular | BigQueryMid-level Full TimeChennai, Tamil Nadu, India1d ago
-
Senior Software Engineer , Enterprise Advanced INR 2486K-4144KAlgorithms | Asynchronous systems | Cloud infrastructure | Computer Science | Computer science fundamentalsComprehensive benefits | Flexible working | Industry conferences | Professional growth | Supportive teamSenior-level Full TimeGurugram1d ago
-
DevOps Engineer III - Kubernetes, AWS, Terraform INR 2200K-3065KAWS | Aurora | Automation | CI/CD | CNI pluginsSenior-level Full TimeHyderabad, Telangana, India1d ago
-
Group BI Engineer I INR 2000K-2040KAgile | Azure Analysis | Azure Analysis Service | Azure Data | Azure Data LakeMid-level Full TimeBangalore, Karnataka, India1d ago