Data Engineer
Tasks
- Deploy to production
- Design data solutions
- Develop batch data processing
- Develop data pipelines
- Develop streaming data processing
- Document technical artifacts
- Ensure data quality
- Generate and parse JSON
- Generate and parse XML
- Handle REST API requests and responses
- Optimize Spark application performance
- Participate in agile development
- Participate in code release
- Perform ETL processes
- Test data pipelines
- Triage production defects
- Validate business rules
- Write and unit test Spark applications
- Write complex SQL queries
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Spark | Data frame | Hadoop | JSON | NoSQL | OOP | Pair RDD | PySpark | RDD | REST APIs | SQL | Spark SQL | XML
Education
Related jobs
-
Java Fullstack Engineer with GenAI & React INR 1500K-2500KAgile Development | Azure | Design Patterns | Docker | Extreme programmingEmployee assistance program | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India6h ago
-
Senior-level Full TimeMumbai, Maharashtra, India7h ago
-
AWS | Artificial Intelligence | Azure | CI/CD | Computer VisionCareer development | Inclusive culture | Professional learning | Remote workSenior-level Full TimeIndia R12h ago
-
Data / Retrieval Engineer INR 3200K-4720KAPIs | Access Control | Attribute-Based Access Control | Attribute-based access | ChunkingSenior-level Full TimeNoida/Gurgaon, UP, IN R14h ago
-
Tech S And T-Cloud AI Platform Engineer-ISR-Senior-GDSF02 INR 3000K-5000KAI Pipelines | ARM Templates | AWS | AWS CloudFormation | Amazon BedrockSenior-level Full TimeNoida, UP, IN, 20130114h ago
-
Sr Analytics Engineer INR 2400K-3000KAPI Integration | AWS | Amazon Redshift | Data Analysis | Data GovernanceRelocation assistanceSenior-level Full TimeBengaluru, India14h ago
-
AI Services | Azure AI | Azure AI Services | Azure OpenAI | Azure SpeechHybrid work | Onsite work | Travel 10 percentSenior-level Full TimeKarnataka, Bengaluru Old No 62, Plot … R14h ago
-
Senior Data Engineer, Director INR 1500K-3000KAWS EMR | Amazon Athena | Amazon DynamoDB | Amazon Kinesis | Amazon QuickSightSenior-level Full TimeGurugram, India14h ago
-
Analyst/Consultant - Data Engineer - Azure (INDM) INR 1500K-2000KApache Cassandra | Azure Blob | Azure Blob Storage | Azure Data | Azure Data FactoryMid-level Full TimePune, Maharashtra, India1d ago
-
Senior-level Full TimeBangalore, KA, India1d ago
-
Senior Database Engineer INR 2000K-2500KBackup and Recovery | Cassandra | Data Modeling | Data Warehousing | Database DesignSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Staff Software Engineer - Fullstack INR 2475K-3500KAccessibility | Dashboarding | Data Pipelines | Data Visualization | Distributed SystemsSenior-level Full TimeBengaluru, India1d ago
-
Anonymization | Artificial Intelligence | Data Deidentification | Data Drift | Data Drift DetectionMid-level Full TimeNew Delhi, DL, India1d ago
-
Senior-level Full TimeIND-KA-Bengaluru, India1d ago
-
Senior-level Full TimeHyderabad, India2d ago
-
Principal Software Engineer INR 3264K-5876KAWS | Apache Iceberg | Apache Kafka | Apache Spark | Automated testingSenior-level Full TimeHyderabad, TG, India R2d ago
-
Data Engineer Platform and Tools – Google Cloud Platform (GCP) INR 1500K-2500KAirflow | BigQuery | CI/CD | Cloud Build | Cloud ComposerSenior-level Full TimeHyderabad, India2d ago
-
Staff Database Platform Engineer INR 2500K-4200KAWS IAM | AWS RDS | Amazon EC2 | Amazon S3 | AnsibleSenior-level Full TimeIN - India - Bangalore2d ago
-
Apache Beam | Apache Cassandra | Apache Flink | Apache Kafka | Apache SparkSenior-level Full TimeBangalore, India2d ago
-
Agentic AI Engineer - Assistant Manager INR 2000K-5000KAWS | Azure | C++ | CI/CD | DockerEmployee networks | Flexible work/life support | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeHyderabad, India2d ago
-
Software Engineer – Java/Go | Distributed Systems | Microservices | Kafka | Cloud | 4–8 Years INR 2000K-3000K12-Factor | 12-Factor App | AI Coding Assistants | AI coding | Asynchronous systemsSenior-level Full TimeIND-BANGALORE, India2d ago
-
Senior Manager INR 2000K-5000KAWS | Agents SDK | Anthropic Claude | Anthropic Claude API | AuthenticationSenior-level Full TimeNoida, Uttar Pradesh, India2d ago
-
Mid-level Full TimeHaryana, India R2d ago
-
Continuous integration | Development Lifecycle | Git | JavaScript | LaravelCo-working space | Mentorship | Modern equipment | Training programs | Trial dayMid-level Full TimeChennai, Hybrid R2d ago
-
Associate - Analytics Solution INR 1000K-1500KAgile | Alteryx | Artificial Intelligence | Confluence | Data GovernanceMid-level Full TimeBengaluru, Karnataka, India2d ago