Data Engineer
Tasks
- Coordinate data collection and handling with privacy compliance
- Design and implement data schemas and business rules
- Develop data orchestration workflows
- Format and prepare data for features
- Identify data sources and extract data
- Implement batch and streaming data engineering
- Monitor data loads and resolve issues
- Research and evaluate data engineering technologies
- Troubleshoot data availability and activation issues
Perks/Benefits
- N/A
Skills/Tech-stack
ADLS | API Management | AWS | AWS CloudFormation | Agile | Amazon S3 | Apache Flume | Apache Kafka | Artifactory | As-a-Service | Azure | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | Azure DevOps | Azure Resource | Azure Resource Manager | Azure Resource Manager Templates | Ceph | Cloud platform | Continuous Deployment | Continuous integration | Data Lake Storage Gen2 | Databricks | Docker | Git | Google Cloud | Google Cloud Platform | Gradle | HDFS | Hadoop | HashiCorp Terraform | Hybrid Cloud | Infrastructure as a Service | JSON | Kubernetes | Maven | Microservices | Minio | Object storage | Oracle | Parquet | Platform as a Service | PySpark | Python | Resource Manager Templates | SAFe Scrum | Software as a Service | SonarQube | Spark Operator | Spark on Kubernetes | Subversion | Virtualization | Webpack
Education
N/A
Roles
Related jobs
-
APIs | Automation | CMDB | CNAPP | CSPMEducation reimbursement | Health plans | Hybrid work | Parental leave | Remote workSenior-level Full TimeRemote - India R7h ago
-
Bash | Cloud platform | Data Pipelines | Data Processing | DockerFlexible asynchronous culture | Friendly relaxed atmosphere | Supportive entrepreneurial team | Work life impactMid-level Full TimeBangalore, India7h ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | Dataset EngineeringAsynchronous culture | Flexible remote work | Friendly work environment | Mission-driven workMid-level Full TimeDelhi, India7h ago
-
Senior-level Full TimeBengaluru, India7h ago
-
Procode Developer INR 1500K-2500KAzure | Azure Functions | Azure Logic | Azure Logic Apps | Azure OpenAICareer growth programs | Certification support | Flexible work hours | Remote work | Work-life balanceMid-level Full TimeGurgaon, IN11h ago
-
Risk Data Engineer INR 2800K-4000KAWS | Automation | Azure | Bitbucket | Cloud platformHealth and wellbeing servicesSenior-level Full TimeBengaluru, IN11h ago
-
Data Engineer INR 3000K-3880KAWS | Batch Processing | Data Cleansing | Data Governance | Data LakeHybrid work environment | Relocation assistance | Remote work options within country | Travel up to 10 percentSenior-level Full TimeIN: Pune - Building 5, India11h ago
-
API Management | Agentic AI | CI/CD | Code review | DspyFlexibility programmes | Inclusive benefits | MentorshipMid-level Full TimeBengaluru Millenia, India11h ago
-
.NET | Acceptance Test | Acceptance Test-Driven Development | Agentic AI | AutoGPTFlexible work options | Mentorship | Wellbeing supportMid-level Full TimeBengaluru Millenia, India11h ago
-
AI/LLM Platform Engineer INR 2500K-4500KADK | AI gateway | API Design | API Lifecycle Management | API lifecycleSenior-level Full TimeBangalore, KA, IN11h ago
-
Machine Learning Operations Engineer INR 1800K-3000KAlerting | CI/CD | CUDA | Drift Detection | Entity recognitionMid-level Full TimePune, India11h ago
-
Software Development Specialist INR 2800K-4000KAI machine learning | Agile | Apache Spark | Azure CLI | Data EngineeringSenior-level Full TimeBangalore, KA, IN11h ago
-
Senior Data Engineer INR 2500K-3500KAWS | ETL | GCP | Looker | Power BIHybrid work | Professional development | Remote workSenior-level Full TimeDelhi NCR R1d ago
-
Data Engineer (Elasticsearch + Datawarehousing) INR 1500K-2700KAPI | API Development | AWS | Apache Spark | AzureMid-level Full TimeIndia - Remote R1d ago
-
Data Engineer- Service INR 1500K-2500KAWS | Apache Hive | Apache Kafka | Apache NiFi | Apache SparkFlexible working options | Growth opportunities | Health insurance | Professional developmentMid-level Full TimeBangalore1d ago
-
Lead DevOps Engineer INR 2800K-5000KAPI Gateway | AWS | AWS API | AWS API Gateway | AWS CloudFormationSenior-level Full TimeBangalore1d ago
-
L1 Data Engineer - Remote INR 1500K-2400KAzure Data | Azure Data Factory | Azure Synapse | Azure Synapse Analytics | CI/CDCollaborative team | Remote workSenior-level Full TimeIndia - Remote R1d ago
-
Acceptance Test | Acceptance Test-Driven Development | Agentic AI | Continuous Delivery | Continuous Integration/Continuous DeliveryFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing support | Work visa sponsorship not specifiedMid-level Full TimeBengaluru Millenia, India1d ago
-
API Management | Acceptance Test | Acceptance Test-Driven Development | Artificial Intelligence | AutoGPTFlexibility programs | Inclusive benefits | MentorshipMid-level Full TimeBengaluru Millenia, India1d ago
-
.NET | Agentic AI | Autonomous Agents | C# | CI/CDFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportMid-level Full TimeBengaluru Millenia, India1d ago
-
.NET | API Management | Agentic AI | Artificial Intelligence | C#Flexible work arrangements | Inclusive benefits | Mentorship | Wellbeing programsMid-level Full TimeBengaluru Millenia, India1d ago
-
.NET | API Management | Agentic AI | C Sharp | CI/CDFlexibility programmes | Mentorship | Wellbeing supportMid-level Full TimeBengaluru Millenia, India1d ago
-
Agentic AI | AutoGPT | Continuous Delivery | Continuous Integration/Continuous Delivery | Continuous integrationFlexibility programmes | Inclusive benefits | MentorshipMid-level Full TimeBengaluru Millenia, India1d ago
-
Sr. Software Engineer - Power BI Job INR 3000K-4000KAnalysis Services | Azure DevOps | Azure Synapse | Azure Synapse Analytics | DAXFlexible work arrangements | Inclusive team environment | Stable employment | Training and continuous learningSenior-level Full TimePune, IN1d ago
-
Sr. Software Engineer - Data Bricks Job INR 3000K-4000KARM Templates | Access Control | Algorithms | Analysis Services | Apache SparkContinuous learning | Flexible work arrangements | Inclusive team environment | Stable employmentSenior-level Full TimePune, IN1d ago