Senior Data Engineer
Tasks
- Assemble large, complex data sets
- Automate manual data processes
- Build data extraction, transformation, loading infrastructure
- Design and implement process improvements
- Develop production scripts and utilities
- Ensure data quality using testing and validation
- Integrate models into data processes
- Maintain documentation for datasets and programs
- Optimize data delivery
- Redesign infrastructure for scalability
- Transform algorithms into production code
Perks/Benefits
Skills/Tech-stack
Apache Airflow | Apache Spark | Azure | Azure Data | Azure Data Lake | Azure SQL | Azure SQL Data | Azure SQL Data Warehouse | Azure Storage | Data Lake | Data Modeling | Data Pipelines | Data Warehouse | Data Warehousing | Databricks | Hadoop | KSH | Python | SQL | SQL Data Warehouse | Scala | Unix
Education
N/A
Roles
Related jobs
-
Assistant Manager Machine Learning INR 1500K-1809KA/B | A/B Testing | AWS Glue | AWS Lambda | AWS SageMakerMid-level Full TimeIndia-Gurugram5h ago
-
Senior-level Full TimeKochi, India5h ago
-
Senior-level Full TimeIN-TN-Chennai5h ago
-
Associate Process Manager INR 1800K-2800KAgentic AI | Agile methodologies | Causal Inference | Cypher | Experimental DesignMid-level Full TimeMumbai, Maharashtra, India6h ago
-
Partner Engineer, Generative AI INR 2500K-3000KAI infrastructure | AWS | Azure | C plus plus | Cloud platformSenior-level Full TimeBangalore, India | Mumbai, India6h ago
-
Entry-level Full TimePune, India7h ago
-
Principal Consultant - Data & AI INR 2500K-3200KAI Services | Agile | Apache Kafka | Apache Spark | Artificial IntelligenceSenior-level Full TimeHyderabad, TS, IN; Bengaluru, KA, IN; …7h ago
-
Agentic AI/ Prompt Engineer INR 1800K-3000KCloud Platforms | Embeddings | LLMs | Langchain | LlamaindexMid-level Full TimeNoida, Uttar Pradesh, India7h ago
-
AWS | Automated testing | Azure | CI/CD | Data PipelinesMid-level Full TimeMumbai, Maharashtra, India7h ago
-
Assistant Manager- Python Gen AI with GCP- Bangalore INR 1200K-1700KAI Agents | API Development | Agile methodologies | Application Performance Optimization | Application performanceWork from client office 5 days per weekMid-level Full TimeBangalore, Karnataka, India8h ago
-
Software Engineer III - Data Engineer INR 1200K-2000KAWS | Apache Airflow | Azure | Big Data | Data GovernanceSenior-level Full TimeMumbai, Maharashtra, India8h ago
-
Senior Associate -Applied AI ML -Digital INR 1050K-1496KAlgorithms | Apache Spark | Big Data | Classification | CompilersMid-level Full TimeBengaluru, Karnataka, India8h ago
-
Sr. SW Engineer - SDET - Automation, GenAI tooling, API Testing INR 2156K-3000KAI | AI Agents | API Testing | CI/CD | Cloud NativeHybrid workSenior-level Full TimeBengaluru, INDIA, India9h ago
-
IT Support Specialist 1 (Regional) INR 2000K-2000KAgile | Apache Spark | Azure Data | Azure Data Factory | Azure DevOpsSenior-level Full TimeBengaluru, KA, IN9h ago
-
Staff Software Engineer - Python, AI/ML, Cloud, GenAI INR 2000K-5000KAWS | Agent Orchestration | Azure | CI/CD | ContainerizationSenior-level Full TimeBengaluru, INDIA, India9h ago
-
AI Engineer- Associate Consultant INR 1500K-2000KAWS | Agent Orchestration | Autonomous Agents | Azure | ClassificationCareer growth | Collaborative work environment | Continuous learning | Inclusive work environmentMid-level Full TimeBangalore, Karnataka, India9h ago
-
Data Scientist Consultant INR 2500K-3000KAgent Orchestration | Agentic AI | Azure | Classification | ClusteringSenior-level Full TimeBangalore, Karnataka, India9h ago
-
Software Engineer III - AIML Platform Reliability INR 2500K-3500KAI Operations | AI Ops | AWS | Automation | Cloud ComputingSenior-level Full TimeBengaluru, Karnataka, India9h ago
-
Executive-level Full TimeIndia9h ago
-
Software Engineer I - Python, AWS INR 2200K-3600KAWS | AWS IAM | Agile | Amazon CloudWatch | Amazon EMRSenior-level Full TimeMumbai, Maharashtra, India10h ago
-
Senior Database Engineer (3+ years, Aurora, Dynamo, Redis) INR 1244K-2200KAmazon Aurora | Amazon Aurora MySQL | Amazon Aurora PostgreSQL | Amazon Web Services | Aurora MySQL24x7 support rotation | Hybrid workSenior-level Full TimeBengaluru, INDIA, India10h ago
-
Senior Data Engineer - Azure Databricks INR 300K-500KACID | Apache Spark | Azure | Azure Data | Azure Data FactorySenior-level Full TimeHyderabad, TS, India10h ago
-
AI Senior Engineer INR 2520K-4500KAgent Orchestration | Amazon Web Services | Autogen | Azure | Cloud platformSenior-level Full TimePune, MH, IN11h ago
-
AI/ML Engineer INR 1500K-2000KAzure | Data Pipelines | DeepSpeed | Distributed Systems | DockerCar lease | Career advancement programs | Certification programs | Corporate NPS | Dental coverageMid-level Full TimeBangalore, Karnataka, India11h ago
-
Senior AI/ML Engineer I INR 2500K-4170KAzure | Data Modeling | Data Structures | Deep learning | DeepSpeedCar lease | Career advancement programs | Certification programs | Continuous learning opportunities | Dental insuranceSenior-level Full TimeBangalore, Karnataka, India11h ago