Data Engineer
Tasks
- Build ETL/ELT processes
- Contribute to CI/CD pipelines and automated testing
- Design scalable data pipelines
- Develop data models and technical documentation
- Develop reusable PySpark and Spark SQL components
- Implement data quality checks and validation
- Implement data security privacy governance and role based access
- Integrate data from enterprise databases APIs and cloud systems
- Maintain production support for data solutions
- Optimize Spark workloads and SQL performance
- Orchestrate schedule monitor and recover workflows
- Troubleshoot data pipeline failures and data quality issues
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Access Control | Alerting | Apache Spark | Automated testing | CI/CD | Data Governance | Data Lineage | Data Modeling | Data Privacy | Data Quality | Data Security | Data Warehousing | Data integration | Databricks | Databricks Workflows | Delta Lake | ELT | ETL | Exception Handling | Git | Lakehouse | Logging | Metadata Management | Monitoring | Partitioning | Performance Tuning | PySpark | Python | RBAC | Role-Based Access | Role-Based Access Control | SQL | Scheduling | Spark SQL | Unity Catalog | Version control | Workflow Orchestration
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
ARM | ASIC | Arc | Bitbucket | C#Entry-level Full TimeBengaluru, KA, India19h ago
-
AI Foundry | API Design | Agent Framework | Agents | AzureAI-native team | Enterprise product impact | Onsite work | Ownership of production systemsMid-level Full TimeNOIDA, Uttar Pradesh, India1d ago
-
Senior Software Engineer (App-Framework) INR 2475K-3465KClass Loading | Concurrency | Distributed Systems | Garbage Collection | Input OutputSenior-level Full TimeBengaluru, India1d ago
-
Senior Software Engineer - Networking Infra INR 2475K-3500KC++ | Distributed Systems | Java | Multi-cloud | NetworkingSenior-level Full TimeBengaluru, India1d ago
-
Senior Software Engineer (Data Platform) INR 2000K-3000KAirflow | CI/CD | DBT | Data Governance | Data QualitySenior-level Full TimeBengaluru, India1d ago
-
Staff Software Engineer - Fullstack INR 2475K-3500KAccessibility | Dashboarding | Data Pipelines | Data Visualization | Distributed SystemsSenior-level Full TimeBengaluru, India1d ago
-
Senior-level Full TimeHyderabad, India1d ago
-
Staff Software Engineer, Looker, Cloud Data Analytics INR 2500K-4200KAI platforms | Artificial Intelligence | Data Storage | Distributed Computing | Enterprise SoftwareSenior-level Full TimeHyderabad, Telangana, India1d ago
-
Embedded Developer - IOT Connectivity INR 1000K-1800KAWS IoT | AWS IoT Core | Automated testing | Azure IoT | Azure IoT HubFlexible hours | Health insurance | On-demand training | Paid volunteering leave | Parental supportMid-level Full TimeChennai, TN, IN, 6000971d ago
-
Senior ML Engineer INR 3000K-4000KAzure | Azure DevOps | Change Management | Classification | ClusteringAnnual leave | Employee assistance programme | Employee wellbeing platform Unmind | Flexible working | Learning and development opportunitiesSenior-level Full TimeChennai, IN2d ago
-
Data Engineer Platform and Tools – Google Cloud Platform (GCP) INR 1500K-2500KAirflow | BigQuery | CI/CD | Cloud Build | Cloud ComposerSenior-level Full TimeHyderabad, India2d ago
-
AI Model Training | AI model | Bash | Cloud platform | Data IngestionAsynchronous culture | Entrepreneurial team | Flexible management approach | Remote-friendlyMid-level Full TimeBangalore, India2d ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerAsynchronous culture | Entrepreneurial team | Friendly work environment | Opportunity for large impactMid-level Full TimeNoida, India2d ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudEntrepreneurial team | Flexible, async culture | Mission driven product impact | Supportive hands off managementMid-level Full TimeMumbai, India2d ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerAsynchronous culture | Entrepreneurial environment | Friendly laid-back atmosphere | Hands-off managementMid-level Full TimeAhmedabad, India2d ago
-
Senior-level Full TimeHyderabad India - Block B2d ago
-
Staff Database Platform Engineer INR 2500K-4200KAWS IAM | AWS RDS | Amazon EC2 | Amazon S3 | AnsibleSenior-level Full TimeIN - India - Bangalore2d ago
-
Staff Machine Learning Engineer INR 3600K-5000KA/B | A/B Testing | AWS | Agentic Workflows | AzureHybrid work | Onsite collaborationSenior-level Full TimeIndia - Pune - Office R2d ago
-
Apache Beam | Apache Cassandra | Apache Flink | Apache Kafka | Apache SparkSenior-level Full TimeBangalore, India2d ago
-
Agentic AI Engineer - Senior Manager INR 3000K-5000KAgent Orchestration | Agent systems | Agile methodology | Amazon Web Services | C++Employee networks | Flexible work/life support | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeBangalore, India2d ago
-
Agentic AI Engineer - Senior Manager INR 3000K-5000KAWS | Agent systems | Agile | Azure | C++Employee networks | Flexible work/life support | Paid volunteer daysSenior-level Full TimeHyderabad, India2d ago
-
Agentic AI Engineer - Assistant Manager INR 2000K-5000KAWS | Azure | C++ | CI/CD | DockerEmployee networks | Flexible work/life support | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeBangalore, India2d ago
-
Agentic AI Engineer - Senior Manager INR 3000K-5000KA2A protocol | AWS | Agent Orchestration | Agent systems | Agile DevelopmentEmployee networks | Flexible work/life support | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeBangalore, India2d ago
-
Agentic AI Engineer - Assistant Manager INR 2000K-5000KAWS | Azure | C++ | CI/CD | DockerEmployee networks | Flexible work/life support | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeHyderabad, India2d ago
-
AI Data & Knowledge Engineer - Assistant Vice President INR 4000K-6000KAirflow | Big Data | Big data architecture | CI/CD | Data ArchitectureEmployee networks | Flexible work/life support | Inclusive development opportunities | Paid volunteer daysExecutive-level Full TimeHyderabad, India2d ago