Data Engineer with Scala and Spark/ Pyspark
INR 2000K-3000K (estimate) Senior-level Full Time
Tasks
- Build and maintain high-performance data pipelines
- Design large scale data processing applications
- Develop and integrate native APIs and data services
- Gather requirements and deliver data engineering solutions
- Implement data quality monitoring governance
- Optimize Spark jobs and distributed computing processes
- Perform code reviews and contribute to architecture decisions
- Troubleshoot performance bottlenecks in ingestion pipelines
Perks/Benefits
Skills/Tech-stack
AWS | Agile | Apache Airflow | Apache Spark | Azure | Batch Processing | CI/CD | Caching | Cloud platform | Concurrency | Containerization | Data Governance | Data Modeling | Data Quality | DevOps | Distributed Systems | ELT | ETL | Google Cloud | Google Cloud Platform | Hadoop | Java | Kafka | Microservices | Monitoring | Native APIs | Partitioning | Performance Tuning | SQL | Scala | Streaming Data | Troubleshooting
Education
N/A
Roles
Regions
Countries
States
Telangana, IN | Tamil Nadu, IN | Maharashtra, IN | Karnataka, IN | Haryana, IN
Related jobs
-
Senior Data Engineer INR 2000K-3000KAWS | AWS Batch | AWS Glue | AWS Lambda | AWS Step FunctionsHealth benefits | Paid time off | Wellbeing benefits | Work-life balanceSenior-level Full TimeHyderabad, India R5h ago
-
AI Engineer, FDE (Forward Deployed Engineer) INR 2500K-4200KAWS | Agent systems | Apache Spark | Apache Spark SQL | AzureRemote work | Travel once every 4 to 8 weeksSenior-level Full TimeBengaluru, India; Delhi, India; Mumbai, India; … R7h ago
-
Forward Deployed Engineer INR 2000K-3000KAWS | Apache Spark | Application development | Artificial Intelligence | AzureCustomer-facing role | Travel 20 percentSenior-level Full TimeRemote - India R7h ago
-
Senior Data Engineer (Managed Services) INR 1500K-3000KAutomation | Azure | Azure Data | Azure Data Factory | Azure SynapseCareer growth and progression | Company bonus scheme | Comprehensive benefits package | Hybrid work schedule | Inclusive cultureSenior-level Full TimeHyderabad, Telangana, India R9h ago
-
Engineers (Agentic / Automation) INR 2475K-4580K.Net Core | AWS Lambda | Amazon RDS | Amazon S3 | Amazon SQSSenior-level Full TimeGurgaon, HR, IN R13h ago
-
Business Analyst – Automation & AI Solutions (m/f/d) INR 1800K-2134KAWS | Agent workflows | Azure | CI/CD | ClaudeHybrid work model | Language classes | Learning and development | Mentoring program | Travel vouchers and discountsMid-level Full TimeGurugram R21h ago
-
Lead - Data Scientist INR 2500K-4720KAnomaly Detection | Cloud Computing | Data Governance | Deep learning | DevSecOpsCareer development opportunities | Inclusive workplace | Mentoring and team developmentSenior-level Full TimeNoida,Uttar Pradesh,India R1d ago
-
Senior Applied AI Engineer INR 3380K-4720KAI/ML | API Development | AWS Bedrock | AWS SageMaker | Agent systemsOwnership and autonomy | Professional services client collaboration | Remote workSenior-level Full TimeIndia-Remote R1d ago
-
Applied AI Solution Architect INR 3242K-4800KAI machine learning | API Development | AWS Bedrock | AWS SageMaker | Agent systemsMentorship | Ownership of work | Remote-first work | Training and development opportunitiesSenior-level Full TimeIndia-Remote R1d ago
-
Staff Software Engineer, Data Platform INR 3700K-4600KAmazon Kinesis | Apache Beam | Apache Flink | Apache Kafka | Apache MesosSenior-level Full TimeBengaluru, India R1d ago
-
GCP Data Engineer 1 INR 1500K-2500KApache Beam | Apache Iceberg | Avro | BigQuery | CI/CDHybrid workSenior-level Full TimeBangalore, Karnataka, India R1d ago
-
Software Engineer INR 1500K-2100KAWS | Agile | Bash | CI/CD | CloudWatchFamily wellbeing benefits | Health and wellbeing benefits | Hybrid work | Paid time off | Work-life balance benefitsMid-level Full TimeHyderabad, India R1d ago
-
AWS | Artificial Intelligence | Azure | CI/CD | Computer VisionCareer development | Inclusive culture | Professional learning | Remote workSenior-level Full TimeIndia R1d ago
-
Data / Retrieval Engineer INR 3200K-4720KAPIs | Access Control | Attribute-Based Access Control | Attribute-based access | ChunkingSenior-level Full TimeNoida/Gurgaon, UP, IN R1d ago
-
AI Orchestration / Platform Engineer INR 2500K-4680KAlerting | Authentication | Authorization | CI/CD | CachingSenior-level Full TimeNoida/Gurgaon, HR, IN R1d ago
-
Principal Agentic AI Engineer / Hands-on Technical Lead INR 3600K-5000KAI tracing | Agent patterns | Authentication | Authorization | AutogenSenior-level Full TimeNoida/Gurgaon, HR, IN R1d ago
-
Machine Learning Engineer 3 ( Firefly ) INR 3264K-5000KCUDA | Diffusion Models | Distributed Systems | GANs | GPU resource managementSenior-level Full TimeNoida, India R1d ago
-
AI Services | Azure AI | Azure AI Services | Azure OpenAI | Azure SpeechHybrid work | Onsite work | Travel 10 percentSenior-level Full TimeKarnataka, Bengaluru Old No 62, Plot … R1d ago
-
Databricks Data Engineer - Manager INR 1500K-2100KApache Spark | Azure Blob | Azure Blob Storage | Azure Data | Azure Data FactoryEducational support | Employee networks | Flexible work programs | Hybrid work environment | InsuranceMid-level Full TimeBangalore, India R1d ago
-
Databricks Data Engineer - Senior Manager INR 2771K-4064KApache Spark | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOpsHybrid work environment | Paid volunteer daysSenior-level Full TimeHyderabad, India R1d ago
-
Principal Data Engineer- Databricks & AI platform INR 3715K-5400KAWS | Airflow | Apache Spark | Asset bundles | AzureEmployee assistance program | Employee resource groups | Health benefits | Learning programs | No meeting daysSenior-level Full Time3010 - Bangalore Office, India R1d ago
-
Audit Analytics Specialist INR 1500K-2600KACL | AI | Automation | Dashboards | Data CleansingHybrid workMid-level Full TimeIN-KA-BANGALORE-NEON BUILDING WEST TOWER, India R1d ago
-
Specialist, Data Engineering INR 1000K-2000KAWS Glue | AWS Secrets | AWS Secrets Manager | Access Control | Active DirectoryMid-level Full TimeIND - Telangana - Hyderabad (Hitec … R1d ago
-
AWS | ArgoCD | Autogen | Azure | CI/CDHybrid workSenior-level Full TimeBengaluru, India R1d ago
-
Staff Machine Learning Engineer INR 3584K-5876KAI systems | Data Pipelines | Deep learning | Experimentation | JavaCareer development and mentoring | Community volunteering programs | Employee peer recognition programs | Flexible time off | Health insuranceSenior-level Full TimeBangalore, India R1d ago