Senior Data Engineer
Tasks
- Apply machine learning algorithms for production readiness
- Build big data processing pipelines using Hadoop ecosystem
- Build data pipelines for ingestion cleanse and standardization
- Deploy models through microservices reporting dashboards or email
- Integrate data pipelines with REST APIs and service authentication
- Prepare data for analysis
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Druid | Apache Kafka | Apache Spark | CI/CD | Continuous integration | Data Cleansing | Data Standardization | Docker | Elasticsearch | HDFS | Hadoop | Hive | Impala | Kubernetes | Kudu | Logstash | Machine Learning | MapReduce | Microservices | NoSQL | Pig | RDBMS | REST API | Solr | Source Control
Education
N/A
Roles
Related jobs
-
IN-Associate_AI/ML Developer_MS Engg_Advisory_Kolkata INR 1500K-2000KApp Service | Azure App | Azure App Service | Azure Blob | Azure Blob StorageFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportMid-level Full TimeKolkata DN 57, India9h ago
-
CI/CD | Couchbase | Design Patterns | Docker | GuiceSenior-level Full TimeGurugram 8 B, India9h ago
-
Technical Support Engineer INR 850K-1100KAmazon Web Services | Apache Hadoop | Apache Spark | Bash | Cloud platformFlexible paid time offMid-level Full TimeHyderabad, India16h ago
-
Principal Consultant-Manager, GenAI Engineer (Cloud: GCP) INR 2520K-3380KAgent Development | Agent Development Kit | Agent systems | Artificial Intelligence | Automated testingContinuous learning opportunities | MentorshipSenior-level Full TimeIndia-Hyderabad20h ago
-
Senior-level Full TimeIN-AP-Hyderabad21h ago
-
Senior-level Full TimeIN-MH-Pune21h ago
-
Lead-Affluent BIU & Analytics-AFFLUENT-Program & MIS INR 1960K-2600KA/B | A/B Testing | B testing | Clustering | Data GovernanceSenior-level Full TimeMumbai, Maharashtra, India21h ago
-
ALM | ASPICE | Anomaly Detection | Automation | CybersecuritySenior-level Full TimeBengaluru, Karnataka, India21h ago
-
Software Engineer III Data Engineer-Python, AWS INR 2050K-3500KAWS | CI/CD | Databricks | ETL | PySparkSenior-level Full TimeBengaluru, Karnataka, India21h ago
-
Azure Data | Azure Data Factory | Azure Data Lake | Dashboards | Data CleansingSenior-level Full TimeBengaluru, Karnataka, India22h ago
-
Software Engineer, Fleet Analytics, PhD, Early Career, 2026 INR 2500K-4110KData Storage | Distributed Computing | Distributed Systems | Information Retrieval | Integer ProgrammingSenior-level Full TimeBengaluru, Karnataka, India22h ago
-
Algorithms | Artificial Intelligence | Capacity Planning | Data center | Data center capacity planningSenior-level Full TimeBengaluru, Karnataka, India22h ago
-
Algorithms | Artificial Intelligence | BigQuery | Cloud Storage | Cloud platform24x7 support rotation | Non-standard hours | On-call workMid-level Full TimeBengaluru, Karnataka, India; Pune, Maharashtra, India22h ago
-
Agentic AI Developer INR 2500K-2800KAPI Development | AWS | Azure | Deep learning | Deployment PipelinesMid-level Full Timepune, Maharastra, India22h ago
-
Senior-level Full TimeBengaluru, Karnataka, India22h ago
-
Senior Data Engineer INR 1200K-2000KAWS Glue | AWS Lambda | AWS Step Functions | Alerting | Amazon EMRSenior-level Full TimeHyderabad, IN1d ago
-
Junior AI/ML Engineer – Data Engineer (Retail Intelligence) INR 1200K-1800KA I | A I Agent | A I Agent Frameworks | A/B | A/B TestingCross-functional collaboration | Hybrid work environment | MentorshipMid-level Full TimeBengaluru, Karnātaka, India1d ago
-
Azure Data Engineer INR 1500K-2000KAzure Data | Azure Data Factory | Azure Data Lake | Azure Functions | Azure SynapseMid-level Full TimeChennai, Tamil Nadu, India1d ago
-
Consultant - AI Engineer with Cloude INR 2500K-4500KAWS | Autogen | Azure | Cloud platform | ContainerizationSenior-level Full TimeBangalore, Karnataka, India1d ago
-
Senior-level Full TimeChennai, Tamil Nadu, India1d ago
-
SDE - Backend* INR 1600K-2200KAlgorithms | CI/CD | Data Structures | Distributed Systems | DockerCollaborative culture | Hybrid work | Leadership development programs | Learning and development | Multicultural work environmentMid-level Full TimeIndia1d ago
-
SDE - Backend* INR 1600K-2200KAlgorithms | Availability | CI | CI/CD | Code reviewCollaborative culture | Hybrid work | Learning and development programs | Multicultural experience | Professional growthMid-level Full TimeIndia1d ago
-
Entry-level Full TimePune, ASIA, India1d ago
-
Senior-level Full TimePune, MAHĀRĀSHTRA, India1d ago
-
Lead Assistant Manager INR 1000K-2000KACID | Batch Processing | CI/CD | Data Ingestion | Data ModelingWork from office 5 days per weekSenior-level Full TimeGurugram, Haryana, India1d ago